|
Activity Number:
|
329
|
|
Type:
|
Contributed
|
|
Date/Time:
|
Tuesday, August 8, 2006 : 2:00 PM to 3:50 PM
|
|
Sponsor:
|
Section on Survey Research Methods
|
| Abstract - #306086 |
|
Title:
|
Comparing Performance and Self-Reported Data on Ease of Use of Surveys
|
|
Author(s):
|
Christine Rho*+
|
|
Companies:
|
Bureau of Labor Statistics
|
|
Address:
|
2 Massachusettes Ave., NE, Washington, DC, 20212,
|
|
Keywords:
|
self-report ; performance measure ; usability ; cognitive interview
|
|
Abstract:
|
During pre-testing of survey questions and websites, qualitative data are collected based on participants' think-alouds and comments, as well as satisfaction and ease of use ratings. During cognitive and usability tests of the Bureau of Labor Statistics surveys and websites, discrepancies were observed between participants' self-reports about the clarity or ease of use of survey questions and their actual performance on those questions. For example, despite encountering difficulties and committing critical errors, participants still reported that a web-based instrument was easy to use. The discrepancy between self-reported and performance data may be attributed to social-desirability and good-subject bias. The analysis summarizes results from several different studies and argues for greater reliance on performance data to evaluate ease of use of surveys.
|
- The address information is for the authors that have a + after their name.
- Authors who are presenting talks have a * after their name.
Back to the full JSM 2006 program |
