Do Demographics, Basic Needs Security, or Health Affect Online Survey Participation During the COVID-19 Pandemic?

• Activity Number: 231 - SPEED: SPAAC SESSION I
• Type: Topic-Contributed
• Date/Time: Wednesday, August 11, 2021 : 10:00 AM to 11:50 AM
• Sponsor: Survey Research Methods Section
• Author(s): Evidence Simbarashe Matangi* and Ramya Ambikapathi and Yumary Ruiz and Savannah L Froese and Morgan Boncyk and Cristiana K Verissimo and Susmita Ghosh and Lauren Heniff and Nilupa S Gunaratna
• Companies: Purdue University and Purdue University and Purdue University and Purdue University and Purdue University and Purdue University and Purdue University and Purdue University and Purdue University
• Keywords: online surveys; COVID-19; process metrics; participation; disparities; bias

Abstract

Online surveys have been preferred to assess needs during the COVID-19 pandemic. However, pandemic disruptions and disparities among socially vulnerable groups may affect online survey participation. Using data from the Fostering Food Security, Health, and Resilience in Graduate Education (FORGE) survey of graduate students (Nov-Dec 2020), we developed survey participation metrics: overall response rate, percentage of questions answered, time spent responding, and response to open-ended questions. Nonparametric tests identified differences in participation associated with demographics, food or housing insecurity, or mental or physical health. The response rate (21%) was comparable to a pre-pandemic online survey, with demographics similar to total enrollment. Minority students discontinued the survey earlier than white students, answering fewer questions (p< 0.01). Non-gender conforming students and those experiencing insecurity or poor mental or physical health took more time responding (all p< 0.05). Providing open-ended responses also varied by demographics, insecurity, and health status. Social vulnerability can affect online survey participation, potentially biasing estimates.