Interviewer Effects on a Network-Size Filter Question

• Activity Number: 232
• Type: Topic Contributed
• Date/Time: Monday, August 5, 2013 : 2:00 PM to 3:50 PM
• Sponsor: Survey Research Methods Section
• Author(s): Mark Trappmann*+ and Michael Josten
• Companies: IAB (Institute for Employment Research) and University of Mannheim
• Keywords: interviewer effects ; filter questions ; network generator ; measurement error ; partial falsification

Abstract

There is evidence that survey interviewers may be tempted to edit answers to filter questions in a way that minimizes the number of follow-up questions. This is relevant when data on ego-centered networks are collected in a survey. The number of persons reported on a network generator question can have a huge impact on subsequent interview duration if multiple follow-up questions on each alter are asked. We analyze interviewer effects on a network size filter question in the third wave of the German PASS panel. PASS is a mixed-mode panel survey using CATI as well as CAPI interviews. Applying multilevel models we find no interviewer effects in CATI mode where interviewers were paid by the hour and frequently supervised. In CAPI, however, where interviewers were paid by case and no close supervision is possible, incentives to cheat are considerable. Here we find a strong interviewer effect on network size. As the area-specific network size is known from telephone mode (where allocation to interviewers is random), interviewer effects and area effects can be separated.