Abstract #300710

This is the preliminary program for the 2003 Joint Statistical Meetings in San Francisco, California. Currently included in this program is the "technical" program, schedule of invited, topic contributed, regular contributed and poster sessions; Continuing Education courses (August 2-5, 2003); and Committee and Business Meetings. This on-line program will be updated frequently to reflect the most current revisions.

To View the Program:
You may choose to view all activities of the program or just parts of it at any one time. All activities are arranged by date and time.

The views expressed here are those of the individual authors
and not necessarily those of the ASA or its board, officers, or staff.

Back to main JSM 2003 Program page
JSM 2003 Abstract #300710
Activity Number: 117
Type: Topic Contributed
Date/Time: Monday, August 4, 2003 : 10:30 AM to 12:20 PM
Sponsor: Social Statistics Section
Abstract - #300710
Title: Evaluating Interobserver Agreement via the Coefficient of Interobserver Variability
Author(s): Michael Haber*+ and Huiman X. Barnhart and Jingli Song
Companies: Emory University and Emory University and Emory University
Address: Rollins School of Public Health, Atlanta, GA, 30322-0001,
Keywords: observer agreement ; observer variability
Abstract:

Existing indices of observer agreement for continuous data, like the intraclass correlation coefficient or the concordance correlation coefficient, are based on the total observer-related variability, i.e., on the sum of the variabilities between and within observers. This work introduces a new index that measures the interobserver agreement. This index is based upon the interobserver variability, which is defined in terms of the distances among the "true" readings made by different observers on the same subject. Therefore, the interobserver variability measures the actual differences among observers and it does not depend on the intraobserver (error) variability. The new coefficient of interobserver variability (CIV) is defined as the ratio of the interobserver and the total observer variability. We show how to estimate the CIV and how to use bootstrap- and ANOVA-based methods for inference. We also develop a coefficient of excess observer variability, which compares the overall observer variability to the expected variability when there are no differences among the observers.

  • The address information is for the authors that have a + after their name.
  • Authors who are presenting talks have a * after their name.

Back to the full JSM 2003 program

JSM 2003 For information, contact meetings@amstat.org or phone (703) 684-1221. If you have questions about the Continuing Education program, please contact the Education Department.
Revised March 2003