Using Paradata to Inform Collection Instruments

• Activity Number: 51
• Type: Invited
• Date/Time: Sunday, August 3, 2014 : 4:00 PM to 5:50 PM
• Sponsor: Survey Research Methods Section
• Author(s): Aneesah Williams*+ and Chrishelle Lawrence and Andre Williams
• Companies: U.S. Census Bureau and U.S. Census Bureau and U.S. Census Bureau
• Keywords: Paradata ; Forms Design

Abstract

Paradata are data about the process by which survey data are collected. This paper explores the ways in which Governments (GOVS) Division can use paradata to improve our questionnaires. It looks at paradata from both web-collected surveys and paper survey forms. The 2011 Government Units Survey was collected using the Centurion web instrument, which enables the collection of paradata as respondents are completing their questionnaires online. Paradata such as keystrokes, time stamps of movement, and navigation patterns throughout the questionnaire were captured and analyzed. Some of the things analyzed include the frequency of response changes, time spent on each question, and survey break-off points. Additionally, paper responses to the 2011 Annual Survey of Public Pensions were examined to determine if there were questions that would benefit from further definitions or explanations, questions that were particularly troublesome for respondents, or break-off points on the questionnaire. Respondent call records and emails were also used to identify these problem questions.