JSM 2005 - Toronto

Abstract #304090

This is the preliminary program for the 2005 Joint Statistical Meetings in Minneapolis, Minnesota. Currently included in this program is the "technical" program, schedule of invited, topic contributed, regular contributed and poster sessions; Continuing Education courses (August 7-10, 2005); and Committee and Business Meetings. This on-line program will be updated frequently to reflect the most current revisions.

To View the Program:
You may choose to view all activities of the program or just parts of it at any one time. All activities are arranged by date and time.



The views expressed here are those of the individual authors
and not necessarily those of the ASA or its board, officers, or staff.

The Program has labeled the meeting rooms with "letters" preceding the name of the room, designating in which facility the room is located:

Minneapolis Convention Center = “MCC” Hilton Minneapolis Hotel = “H” Hyatt Regency Minneapolis = “HY”

Back to main JSM 2005 Program page
Legend: = Applied Session, = Theme Session, = Presenter
Activity Number: 353
Type: Topic Contributed
Date/Time: Wednesday, August 10, 2005 : 8:30 AM to 10:20 AM
Sponsor: Section on Statistics in Epidemiology
Abstract - #304090
Title: A Novel Approach To Assess Rater Agreement with Target Values for Ordinal Data
Author(s): Zheng Zhang*+
Companies: Emory University
Address: 1518 Clifton Road NE, Atlanta, GA, 30322, United States
Keywords: rater agreement ; kappa statistics ; conditional probability ; ordinal data ; accuracy ; diagnostic test
Abstract:

Measurements of agreement are needed to assess the acceptability of a new procedure or methodology in various biomedical studies. This manuscript is to propose a novel method to assess the agreement of the measurements with the target values (or sometimes called gold standard) when the data are ordinal. We consider the conditional probability of measurement X being greater (or less) than a cut-off point c, conditional upon target value T being greater (or less) than c, and compute the average conditional probability across all possible values of c, which we call mean right agreement probability (mRAF) and mean left agreement probability (mLAF). We propose to use the ratio of mRAF and mLAF (AR) to address the accuracy of the measurement (reflects the shift of the marginal distribution) and the average of mRAF and mLAF (SP) to address the precision. We compare AR with the kappa statistics and find AR addresses agreement more accurately. We also argue that mRAF and mLAF can be used to assess the performance of multiclass diagnostic tests when both the test and the gold standard are ordinal. The method is applied to two real-data sets.

  • The address information is for the authors that have a + after their name.
  • Authors who are presenting talks have a * after their name.

Back to the full JSM 2005 program

JSM 2005 For information, contact jsm@amstat.org or phone (888) 231-3473. If you have questions about the Continuing Education program, please contact the Education Department.
Revised March 2005