JSM 2013 Home
Online Program Home
My Program

Abstract Details

Activity Number: 496
Type: Contributed
Date/Time: Wednesday, August 7, 2013 : 8:30 AM to 10:20 AM
Sponsor: Survey Research Methods Section
Abstract - #309701
Title: Combining Paradata and Survey Responses to Identify Sources of Measurement Error in Medical Event Reporting
Author(s): Andrew Mercer*+ and Weijia Ren and Virender Kumar and Frederick Rohde
Companies: Westat and Westat and Westat and Agency For Healthcare Research and Quality
Keywords: Paradata ; Measurement Error ; Panel Surveys ; Panel Conditioning ; Recall Error
Abstract:

The ability to observe within-subject change over time is the primary objective of most panel surveys. When characteristics of the data collection process systematically affect reporting differently at different times, it becomes difficult to differentiate true change from measurement error. The Medical Expenditure Panel Survey (MEPS) employs an overlapping panel design in which new cohorts enter the survey every January and are interviewed five times covering a cumulative two-year reference period. Underreporting is a perennial concern for household surveys and this concern may be exacerbated in panel surveys because of issues such as panel conditioning (Kalton et al 1989). In particular, a review of the literature pertaining to the accuracy of household-reported healthcare utilization data suggests that medical events tend to be underreported (Bhandari and Wagner 2006; Zuvekas and Olin 2009). Separate MEPS panels consistently exhibit a pattern of disproportionately high medical event reporting in the first round relative to all subsequent rounds and an additional decline at the final round of data collection. The fact that this pattern persists across separate panels suggests that these differences may reflect measurement error. Steps to repair this error will depend on its cause. One hypothesis is that respondents reduce their reporting in Round 2 in order to reduce burden. Alternatively, the error may be cognitive in origin, with longer reference periods in Round 2 resulting in a greater level of forgetting on the part of the respondent. In this paper we compare the plausibility of these hypotheses for explaining changes in response patterns using both paradata and survey responses. We find no support for the hypothesis that burden leads to lower reporting, however, we do find a negative association between the length of the reference period and the level of reporting.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2013 program




2013 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

ASA Meetings Department  •  732 North Washington Street, Alexandria, VA 22314  •  (703) 684-1221  •  meetings@amstat.org
Copyright © American Statistical Association.