Activity Number:
|
472
- Paradata and Responsive Survey Design
|
Type:
|
Contributed
|
Date/Time:
|
Thursday, August 6, 2020 : 10:00 AM to 2:00 PM
|
Sponsor:
|
Survey Research Methods Section
|
Abstract #311099
|
|
Title:
|
Evaluation of Key Performance Indicators for Interviewer Falsification Suspicion from Paradata and Interview Data
|
Author(s):
|
Tom Krenzke* and Weijia Ren and Wendy Van de Kerckhove and Stephanie Mendoza
|
Companies:
|
Westat and Westat and Westat and Westat
|
Keywords:
|
Data validation;
Survey methodology
|
Abstract:
|
In-person surveys are susceptible to interviewer falsification and validation is usually conducted as a common practice to help detect interviewer falsification. One typical validation process could be conducted through phone calls to a subsample (e.g. 10 percent) of selected households to verify the results of the interviewer attempts to complete the survey. Because validation may not fully protect a survey from interviewer falsification, additional methods need to be explored. One potential approach is to use the paradata and interview responses to identify suspicious circumstances. This presentation begins by discussing about 24 potential key performance indicators (KPIs) for interviewer falsification suspicion using paradata and interview data. Methodology will be discussed for deriving measures that may lead to suspicions about the validity of the completed interviews. A subset of the KPIs, and derived measures, are evaluated using the U.S. Programme for the International Assessment of Adult Competencies 2017 data. Lastly, visualization displays of the measures will be presented.
|
Authors who are presenting talks have a * after their name.