Metrics to guide a multi-objective evolutionary algorithm for ordinal classification

Cruz-Ramírez, M., Hervás-Martínez, C., Sanchez-Monedero, Javier ORCID: https://orcid.org/0000-0001-8649-1709 and Gutiérrez, P.A. 2014. Metrics to guide a multi-objective evolutionary algorithm for ordinal classification. Neurocomputing 135 , pp. 21-31. 10.1016/j.neucom.2013.05.058

Preview

PDF - Accepted Post-Print Version Download (430kB) | Preview

Abstract

Ordinal classification or ordinal regression is a classification problem in which the labels have an ordered arrangement between them. Due to this order, alternative performance evaluation metrics are need to be used in order to consider the magnitude of errors. This paper presents a study of the use of a multi-objective optimization approach in the context of ordinal classification. We contribute a study of ordinal classification performance metrics, and propose a new performance metric, the maximum mean absolute error (MMAE). MMAE considers per-class distribution of patterns and the magnitude of the errors, both issues being crucial for ordinal regression problems. In addition, we empirically show that some of the performance metrics are competitive objectives, which justify the use of multi-objective optimization strategies. In our case, a multi-objective evolutionary algorithm optimizes an artificial neural network ordinal model with different pairs of metric combinations, and we conclude that the pair of the mean absolute error (MAE) and the proposed MMAE is the most favourable. A study of the relationship between the metrics of this proposal is performed, and the graphical representation in the two-dimensional space where the search of the evolutionary algorithm takes place is analysed. The results obtained show a good classification performance, opening new lines of research in the evaluation and model selection of ordinal classifiers.

Item Type:	Article
Date Type:	Publication
Status:	Published
Schools:	Journalism, Media and Culture
Publisher:	Elsevier
ISSN:	0925-2312
Date of First Compliant Deposit:	5 July 2018
Date of Acceptance:	30 May 2013
Last Modified:	07 Nov 2023 06:49
URI:	https://orca.cardiff.ac.uk/id/eprint/112884

Citation Data

Cited 60 times in Scopus. View in Scopus. Powered By Scopus® Data

Actions (repository staff only)

Edit Item