A Randomized Experiment Comparing Response Quality in a Single and a Mixed Mode Design Health Survey

• Activity Number: 242
• Type: Contributed
• Date/Time: Monday, August 1, 2011 : 2:00 PM to 3:50 PM
• Sponsor: Section on Survey Research Methods
• Author(s): Johann Carstensen*+ and Peter Kriwy and Gerhard Krug
• Companies: University of Erlangen-Nuremberg and University of Erlangen-Nuremberg and University of Erlangen-Nuremberg
• Keywords: survey design ; mixed mode ; sensitive items ; web survey ; nonresponse ; social desirability

Abstract

Asking sensitive questions in surveys is prone to mode effects. In a randomized experiment we compare a single mode CATI to a mixed mode survey where respondents can chose between a CATI and Web-based mode. Our main focus lies on the consequences of the additional Web-survey option on data quality. Indicators of data quality are the respondent`s tendency towards social desirable answers, satisficing behavior and item non-response. In both modes identical questionnaires are used covering sensitive items such as health behavior and self-reported illness and including auxiliary variables e.g. about item sensitivity and affinity to the internet. However differences in means of sensitive items between single and mixed mode surveys can also be due to differences in unit non-response induced by the Web-option. Therefore we propose a decomposition method. It utilizes statistical matching techniques to estimate even without external validation data the relative strength of selection and mode effects. As the data collection will start in April 2011 we will be able to provide preliminary results by July. The project is funded by the German Robert Koch Institute (FKZ 1362/1-978).