JSM 2012 Home

JSM 2012 Online Program

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

Online Program Home

Abstract Details

Activity Number: 294
Type: Contributed
Date/Time: Tuesday, July 31, 2012 : 8:30 AM to 10:20 AM
Sponsor: Biometrics Section
Abstract - #305012
Title: New Methods for Assessing Observer Agreement
Author(s): Michael Haber*+ and Yi Pan and Jingjing Gao and Lijun Zhang and Zhaohui Qin
Companies: Emory University and CDC and Emory University and Emory University and Emory University
Address: Rollins School of Public Health, Atlanta, GA, 30322-0001, United States
Keywords: Coefficient of individual agreement ; Coefficient of individual equivalence ; ChIP-Seq genomic data

Observer agreement is usually assessed by Cohen's kappa for categorical data or by the concordance correlation coefficient for quantitative data. These coefficients have limitations, as they depend on the marginal distributions of the measured variables. We review and compare two new coefficients of agreement that do not share these limitations. Both coefficients require replicated measurements on each study subject. The coefficient of individual agreement compares the disagreement between and within observers. The coefficient of individual equivalence compares the inter-observer disagreement to the disagreement expected by chance, i.e., when readings are assigned to observers at random. Both coefficients can be applied to categorical and quantitative data. An example comparing two methods for identifying protein-interacting genomic regions from ChIP-Seq data is used as an illustration.

The address information is for the authors that have a + after their name.
Authors who are presenting talks have a * after their name.

Back to the full JSM 2012 program

2012 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.