Abstract:
|
We interpret standard diagnostic accuracy statistics, such as Youden index and AUC, in light of risk-stratification (how well a biomarker separates those at higher risk from those at lower risk) to better understand implications for public-health programs. We introduce an intuitive statistic, Mean Risk Stratification (MRS): the average change in risk (pre-test vs. post-test) revealed for tested individuals. MRS is a function of both AUC and disease prevalence, and thus little risk-stratification is possible for rare diseases (regardless of AUC), demonstrating a high-bar to justify population-based screening. AUC measures multiplicative relative gains in risk-stratification: AUC=0.6 achieves only 20% of maximum risk-stratification (AUC=0.9 achieves 80%). However, large relative gains in risk-stratification might not imply large absolute gains if disease is rare. We use MRS to compare cervical cancer screening tests in China vs. USA. The test with the worst AUC=0.72 in China (visual inspection with ascetic acid) provides twice the MRS of the test with best AUC=0.83 in the USA (HPV and Pap cotesting) because China has three times more cervical precancer/cancer.
|