|
Activity Number:
|
126
- Diagnostics, Classification, and Agreement
|
|
Type:
|
Contributed
|
|
Date/Time:
|
Monday, July 31, 2017 : 8:30 AM to 10:20 AM
|
|
Sponsor:
|
Section on Medical Devices and Diagnostics
|
|
Abstract #322755
|
|
|
Title:
|
Overall Unscaled Indices for Assessing Agreement Among Multiple Raters
|
|
Author(s):
|
Jeong Hoon Jang* and Amita Manatunga and Qi Long
|
|
Companies:
|
Emory University and Emory University and University of Pennsylvania
|
|
Keywords:
|
Agreement ;
Coverage probability ;
Multiple raters ;
Total deviation index ;
Unscaled index
|
|
Abstract:
|
The need to analyze agreement exists in various clinical studies where assessing inter-rater reliability is of great importance. Several unscaled agreement indices, such as total deviation index, coverage probability and their extensions are widely recognized for two main reasons: (1) they are intuitive in a sense that interpretations are tied to the original measurement unit; (2) practitioners can readily determine whether the agreement is satisfactory by directly comparing the value of the index to a pre-specified tolerable coverage probability or distance. However, these indices were only defined in the context of comparing two raters or multiple raters that assume homogeneity of all variances. In this manuscript, we introduce several overall unscaled indices that can be used to evaluate agreement among multiple raters that exhibit potentially heterogeneous measurement processes. We present the definitions of overall indices and propose inference procedures in which bootstrap methods are used for the estimation of standard errors. We assess the performance of the proposed approaches by simulation studies. Finally, we demonstrate the application of our methods using renal study.
|
Authors who are presenting talks have a * after their name.
Back to the full JSM 2017 program
|
