Online Program

Mixed-mode experiment in the IAB Establishment panel (308185)

Keywords: mixed mode, panel, item non response, unit non response, triggering rate to filter

The IAB Establishment panel collects representative data of German establishments and provides deep insights into macroeconomic developments in Germany since 1993. Until 2018, interviews were conducted via interviewer-administered paper-and-pencil interviewing (PAPI) to meet the special needs of establishment respondents. Declining response rates and a need to better control the data collection process led to the formation of a new survey tool, which integrates computer-assisted personal interviewing (CAPI) with self-administered Web interviews on one exchange platform. To estimate and optimize the effects of the new software on response rates and data quality we conducted a sequential mixed-mode experiment in 2018 on a refreshment sample of establishment cases. We randomly assigned the establishments to a CAPI-Web, a Web-CAPI, and a PAPI mode (control) group. In the first group, interviewers conducted CAPI interviews and establishments were allowed to finish the interview online. In the second group, establishments were invited via invitation letter to take part in an online interview. If no interview resulted, interviewers visited the companies of both groups to conduct CAPI interviews. In the last group, interviewers visited companies assigned to the control group and conducted PAPI interviews. Companies could also finish the questionnaire via self-administered PAPI. In this paper, we present the results of this experiment and measure the effects of using different modes amongst others on response rates, nonresponse bias, item nonresponse and triggering rates to filter questions. We also report the logistical challenges and “lessons learned” of implementing mixed-mode experiments in a panel survey of establishments in the long run.