Saturday, November 12
Pretesting Methods
Sat, Nov 12, 11:00 AM - 12:25 PM
Hibiscus A
Managing and Learning from Iterative, Multi-Method Pretesting

Best Practices in Managing Large-Scale Qualitative Research Projects (303103)

*Martha Stapleton, Westat 
Darby Steiger, Westat 
Mary C. Davis, U.S. Census Bureau 

Keywords: cognitive testing, qualitative research project management, risk management, quality control

Inherent in any large-scale qualitative research project are multiple threats to data quality and the accuracy of results. Addressing these challenges requires a special set of procedures for implementation and management, yet the literature is sparse on theories and best practices for doing so. This paper draws on recent literature and our recent experiences with large and iterative qualitative data collection projects to propose a set of best practices for mitigating risk, ensuring quality, and maintaining consistency across every phase of large-scale qualitative research projects. The recommendations include detailed descriptions of effective approaches to overall management of the project, study design, recruitment, protocol development, training, data collection, data management, analysis, and reporting. We provide strategies for fully utilizing technology, tools, and materials to reinforce communications, enhance vigilant monitoring of progress and results, and facilitate well-defined and detailed procedures. We also describe how the recommended best practices can affect quality at each stage of the project.