|
Activity Number:
|
320
|
|
Type:
|
Contributed
|
|
Date/Time:
|
Tuesday, August 5, 2008 : 2:00 PM to 3:50 PM
|
|
Sponsor:
|
Section on Nonparametric Statistics
|
| Abstract - #302699 |
|
Title:
|
Assessing Individual Observer Agreement in Studies Involving Replicated Observations
|
|
Author(s):
|
Jingjing Gao*+ and Michael Haber
|
|
Companies:
|
Emory University and Emory University
|
|
Address:
|
Dept. of Biostatistics 3rd Flr, Atlanta, GA, 30322-4201,
|
|
Keywords:
|
coefficient of individual agreement ; categorical data ; repeated measurements
|
|
Abstract:
|
Methods for assessment of individual observer agreement are based on comparing disagreement between two observers to the disagreement between replicated observations made by the same observer on the same subject. These methods have been developed for continuous and binary observations. In this presentation we propose a new nonparametric approach to evaluating individual agreement between two observers making replicated categorical observations on each subject. We consider two situations: (1) a symmetric assessment of agreement between two observers, and (2) an assessment of the agreement of a new observer with an imperfect 'gold standard'. The reliability of the estimation method is examined via a simulation study. Data from a study aimed at determining the validity of diagnosis of breast cancer based on mammograms is used to illustrate the new concepts and methods.
|
