Viewing Track 'Pretesting Methods' only

Back to search menu

Thursday, November 10

Thu, Nov 10, 10:45 AM - 12:10 PM
Regency Ballroom-Monroe

CS1 (Invited) - Deciding Which Pretesting Method or Methods to Use
Invited Presentations

Chair(s): Patrick Sturgis, University of Southampton

10:50 AM

A Framework for Making Decisions About Question Evaluation Methods

View Presentation Roger Tourangeau, Westat

11:15 AM

A Compendium of Current Pretesting Methods

View Presentation Emily Geisen, RTI International

11:40 AM

Combining Multiple Evaluation Methods: What Does it Mean When the Data Appear to Conflict?

View Presentation Jo d'Ardenne, NatCen Social Research

12:05 PM

Floor Discussion

Thu, Nov 10, 10:45 AM - 12:10 PM
Hibiscus B

CS3 (Contributed) - Pretesting Methods for Development of Establishment Surveys
Contributed Presentations

Chair(s): Scott Fricker, Bureau of Labor Statistics

10:50 AM

Approaches to Pretesting Electronic Questionnaires at Statistics Canada: Assessing Recent Approaches and Methodologies
Dave Lawrence, Statistics Canada

11:08 AM

Challenges to Developing New Survey Questions: When Cultural Norms Run Counter to Survey Questions

View Presentation Emilola Abayomi, USDA/NASS

11:26 AM

Developing Instruments for All-Electronic Data Collection from Business Establishments: Pretesting Methods and Processes for Re-Engineering the 2017 Economic Census

View Presentation Amy E Anderson Riemer, U.S. Census Bureau

11:44 AM

Floor Discussion

Thu, Nov 10, 1:30 PM - 2:55 PM
Hibiscus A

CS7 (Invited) - Using Pretesting Methods to Develop Standardized Survey Qs for Use in Cross National/Cross Cultural/Multi-Lingual Settings
Invited Presentations

Chair(s): Jose Luis Padilla, University of Granada

1:35 PM

Measuring Disability Equality in Europe: Design and Development of the European Health and Social Integration Survey Questionnaire

View Presentation Amanda Wilmot, Westat

1:53 PM

Cross-Cultural Questionnaire Development and Testing on Child Labor with Emphasis on Assessing Differences Across Culture and Languages
Mousumi Sarkar, IMPAQ International, LLC

2:11 PM

Differential Item Functioning and Person Fit on the PROMIS Pediatric Physical Functioning Items

View Presentation Ron D. Hays, UCLA

2:29 PM

NAEP Questionnaire Pre-Testing Methods: Establishing Standards for Survey Question Pre-Testing in Large-Scale Assessments
Jonas Bertling, Educational Testing Service

2:47 PM

Floor Discussion

Thu, Nov 10, 1:30 PM - 2:55 PM
Orchid AB

CS9 (Contributed) - Mixing and Matching Pretesting Methods
Contributed Presentations

Chair(s): Nancy J. Dickey, National Agricultural Statistics Service

1:35 PM

Tune-Up Time: Using Focus Groups and Cognitive Interviews to Re-Evaluate an Established Survey

View Presentation Carol Cosenza, University of Massachusetts Boston

1:53 PM

Friends or Strangers? Examining an Innovative Focus Group Methodology

View Presentation Kerry Yarkin Levin, Westat

2:11 PM

Respondent-Centric Approach: An Overview of Research at ONS to Motivate and Engage Our Survey Respondents

View Presentation Laura Wilson, Office for National Statistics, UK

2:29 PM

Collecting Previously Reported Data: Testing Telephone Interviewing Techniques in the Occupational Employment Statistics Survey
Carrie K Jones, Bureau of Labor Statistics

2:47 PM

Floor Discussion

Thu, Nov 10, 3:30 PM - 4:55 PM
Hibiscus A

CS11 (Invited) - Developments in the Design and Testing of Establishment Survey Data Collection Instruments
Invited Presentations

Chair(s): Don A. Dillman, Social and Economic Sciences Research Center - Washington State University

3:35 PM

Cognitive Interviewing for Official Establishment Survey Questionnaires

View Presentation Deirdre Giesen, Statistics Netherlands

4:00 PM

Early-Stage Scoping in Establishment Surveys: A How-To Primer on This Qualitative Question Development Technique
Kristin Stettler, U.S. Census Bureau

4:25 PM

Validating the Results of an Establishment Survey of Occupational Requirements Using Direct Job Observations

View Presentation Scott Fricker, Bureau of Labor Statistics

4:50 PM

Floor Discussion

Thu, Nov 10, 3:30 PM - 4:55 PM
Orchid AB

CS13 (Contributed) - Designing and Testing Question Types
Contributed Presentations

Chair(s): Nick Allum, University of Essex

3:50 PM

Instrument Development in the Affective Domain
D. Betsy McCoach, University of Connecticut

4:05 PM

Rank Question Designs and Analysis Methods
Chia-Ling Kuo, University of Connecticut Health Center

4:20 PM

Measuring Political Identity and Religiosity: Does Mode or Presentation Matter?

View Presentation Dag F Gravem, Statistics Norway

4:50 PM

Floor Discussion

Thu, Nov 10, 3:30 PM - 4:55 PM
Orchid C

WK2 (Workshop) - Focus Group Data Gathering: Practical Applications of the Total Quality Framework Approach
Workshop Presentation

Focus Group Data Gathering: Practical Applications of the Total Quality Framework Approach

View Presentation Margaret R. Roller, Roller Marketing Research

Friday, November 11

Fri, Nov 11, 10:30 AM - 11:55 AM
Orchid C

CS18 (Contributed) - New Pretesting Approaches and Designing for the Digital Age
Contributed Presentations

Chair(s): Gentiana D. Roarson, Office for National Statistics

10:35 AM

Development and Implementation Methods of an Offline Survey in Low- and Middle-Income Countries

View Presentation Scott McIntosh, University of Rochester

10:53 AM

Applying Agile Design Methods to Enrich and Accelerate Pretesting Benefits
Eileen M. O’Brien, U.S. EIA

11:11 AM

New Insights on the Cognitive Processing of Agree/Disagree and Item-Specific Questions
Jan Karem Höhne, University of Göttingen

11:29 AM

Using Paradata to Inform the Design of the 2017 Economic Census Electronic Reporting System
Michael Clark Brennan, U.S. Census Bureau

11:47 AM

Floor Discussion

Fri, Nov 11, 2:00 PM - 3:25 PM
Hibiscus A

CS20 (Invited) - Usability Methods
Invited Presentations

Chair(s): Deirdre Giesen, Statistics Netherlands

2:05 PM

Best Practices of Usability Testing Online Questionnaires at the Census Bureau: How Rigorous and Repeatable Testing Can Improve Online Questionnaire Design

View Presentation Elizabeth Nichols, U.S. Census Bureau

2:30 PM

Learning from Mouse Movements: Improving Questionnaires and Respondents’ User Experience Through Passive Data Collection

View Presentation Rachel Horwitz, U.S. Census Bureau

2:55 PM

Empirical Evidence for the Value of Usability Testing Surveys
Jen Romano-Bergstrom, Facebook

3:20 PM

Floor Discussion

Fri, Nov 11, 2:00 PM - 3:25 PM
Orchid AB

CS22 (Contributed) - Web Probing Methods for Pretesting
Contributed Presentations

Chair(s): Florian Keusch, University of Mannheim

2:05 PM

A Comparison of Cognitive Testing Methods and Sources: In-Person Versus Online Nonprobability and Probability Methods

View Presentation Jessica L. Holzberg, U.S. Census Bureau

2:23 PM

Can Web Probing Be Used to Pretest Survey Questions?
Cornelia Eva Neuert, GESIS - Leibniz Institute for the Social Sciences

2:41 PM

Comparing Face-to-Face Cognitive Interviewing with Unmoderated, Online Cognitive Interviewing with Embedded and Follow-Up Probing

View Presentation William Mockovak, Bureau of Labor Statistics

2:59 PM

Necessary but Insufficient: Why Measurement Invariance Tests Need Online Probing as a Complementary Tool (Winner of NCHS Monroe Sirken Award)
Katharina Meitinger, GESIS - Leibniz Institute for the Social Sciences

3:17 PM

Floor Discussion

Fri, Nov 11, 4:00 PM - 5:25 PM
Regency Ballroom-Monroe

CS23 (Invited) - Web Probing: Considerations, Uses, and Practices
Invited Presentations

Chair(s): Frauke Kreuter, University of Maryland/University of Mannheim/IAB

4:05 PM

Cross-Cultural Web Probing and How it Can Enhance Equivalence in Cross-Cultural Studies

View Presentation Dorothée Behr, GESIS - Leibniz Institute for the Social Sciences

4:30 PM

The Practice of Cognitive Interviewing Through Web Probing
Stephanie L Fowler, National Cancer Institute

4:55 PM

Using Targeted Embedded Probes to Quantify Cognitive Interviewing Findings

View Presentation Paul J. Scanlon, CDC

5:20 PM

Floor Discussion

Fri, Nov 11, 4:00 PM - 5:25 PM
Orchid C

WK4 (Workshop) - Practical Guidelines for Translating and Testing a Cross-National Instrument for Developing Countries: A Workshop Session
Workshop Presentation

Practical Guidelines for Translating and Testing a Cross-National Instrument for Developing Countries: A Workshop Session

View Presentation Elizabeth Dean, RTI International; Clark Letterman, RTI International

Saturday, November 12

Sat, Nov 12, 9:00 AM - 10:25 AM
Regency Ballroom-Monroe

CS27 (Invited) - New Approaches to Questionnaire Design and Evaluation
Invited Presentations

Chair(s): Jack Fowler, University of Massachusetts Boston

9:05 AM

Dynamic Question Ordering in Online Surveys

View Presentation Kirstin Early, Carnegie Mellon University

9:23 AM

Conjoint Analysis Versus Split-Ballot Experiments for Survey Research

View Presentation Jennifer Childs, U.S. Census Bureau