Online Program Home
  My Program

All Times EDT

Abstract Details

Activity Number: 225 - Contributed Poster Presentations: Section on Medical Devices and Diagnostics
Type: Contributed
Date/Time: Tuesday, August 4, 2020 : 10:00 AM to 2:00 PM
Sponsor: Section on Medical Devices and Diagnostics
Abstract #309885
Title: Overall Agreement for Multiple Raters with Replicated Measurements
Author(s): Tongrong Wang*
Keywords: Overall Agreement; coverage probability; total deviation index; relative area under the coverage probability curve; replication; generalized estimating equations

Multiple raters are often needed to be used interchangeably in practice for measurement or evaluation. Assessing agreement among these multiple raters via agreement indices are necessary before their participation. While the intuitively appealing agreement indices have been extended for assessing agreement among multiple raters, the extensions have limitations. The existing overall agreement indices either require normality and homogeneity assumptions or did not preserve the intuitive interpretation of the indices originally defined for two raters. In this paper, we propose a new set of overall agreement indices based on maximum pairwise differences among all raters. The proposed new indices retain the original intuitive interpretation from the pairwise version. Without making any distributional assumption, we also propose a new unified nonparametric estimation and inference approach for the overall indices based on generalized estimating equations that can accommodate replicates made by the same rater. Simulation studies are conducted to assess the performance of the proposed methods with and without replications.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2020 program