JSM 2012 Home

JSM 2012 Online Program

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

Online Program Home

Abstract Details

Activity Number: 511
Type: Contributed
Date/Time: Wednesday, August 1, 2012 : 10:30 AM to 12:20 PM
Sponsor: Biometrics Section
Abstract - #305660
Title: Equivalence of Improvement in Area Under ROC Curve and Linear Discriminant Analysis Coefficient Under Assumption of Normality
Author(s): Olga Demler*+ and Michael Pencina and Ralph D'Agostino
Companies: Boston University and Boston University and Boston University
Address: 30 Edge Hill Rd, Newton, MA, 02467, United States
Keywords: linear discriminant analysis ; ROC ; AUC ; risk prediction model ; logistic regression

We investigate the addition of new variables to an existing risk prediction model and the subsequent impact on discrimination quantified by the Area Under the Receiver Operating Characteristics Curve (AUC of ROC). Based on practical experience, concerns have emerged that the significance of association of the variable under study with the outcome in the risk model does not correspond to the significance of the change in AUC: that is, often the variable is significant, but the change in AUC is not. This paper demonstrates that under the assumption of multivariate normality and employing linear discriminant analysis to construct the risk prediction tool, statistical significance of the new predictor(s) is equivalent to the statistical significance of the increase in AUC. Under these assumptions the result extends asymptotically to logistic regression. We further show that equality of variance-covariance matrices of predictors within cases and non-cases is not necessary when linear discriminant analysis is used.. However, our practical example from the Framingham Heart Study data suggests that the finding might be sensitive to the assumption of normality.

The address information is for the authors that have a + after their name.
Authors who are presenting talks have a * after their name.

Back to the full JSM 2012 program

2012 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.