JSM 2015 Preliminary Program

Online Program Home
My Program

Abstract Details

Activity Number: 81
Type: Contributed
Date/Time: Sunday, August 9, 2015 : 4:00 PM to 5:50 PM
Sponsor: Biometrics Section
Abstract #315999
Title: Cost-Sensitive Performance Metric for Ordinal Classification
Author(s): Nysia George* and Ching-Wei Chang and Tzu-Pin Lu
Companies: FDA/NCTR and National Center for Toxicological Research and National Taiwan University
Keywords: Multiclass Classification ; Ordinal data ; Misclassification ; Performance metric ; Cost-Sensitive
Abstract:

The surge of interest in personalized medicine during recent years has increased the application of ordinal classification problems in biomedical science. Currently, accuracy, Kendall's tau-b, and AMAE are three commonly used metrics for evaluating the effectiveness of a multiclass ordinal classifier. Although there are benefits to each, no single metric considers the benefits of predictive accuracy with the tradeoffs of misclassification error. In addition, decisions that consider pairwise analysis of the metrics are not trivial due to inconsistent findings. Hence, a new cost-sensitive metric is proposed to find the optimal tradeoff between the two most critical performance measures of a classification task. The proposed method accounts for imbalanced class distribution, the inherent ordinal data structure, and misclassification cost, thereby providing a more comprehensive tool for comparative analysis of multiple ordinal classifiers. The strengths of our methodology are demonstrated through real data analysis of cancer datasets and simulation studies.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2015 program





For program information, contact the JSM Registration Department or phone (888) 231-3473.

For Professional Development information, contact the Education Department.

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

2015 JSM Online Program Home