JSM 2013 Home
Online Program Home
My Program

Abstract Details

Activity Number: 496
Type: Contributed
Date/Time: Wednesday, August 7, 2013 : 8:30 AM to 10:20 AM
Sponsor: Survey Research Methods Section
Abstract - #308791
Title: Using Response Time to Investigate Students' Test-Taking Behaviors
Author(s): Yue Jia*+ and Yi-Hsuan Lee
Companies: Educational Testing Service and Educational Testing Service
Keywords: Response Time ; Educational Data Mining ; Survey Assessments ; Test-taking Behaviors ; classification
Abstract:

Educational survey assessments have been used for decades to monitor what students know and can do. Such type of assessments is aimed to provide group-level scores for various populations, with little or no consequence to individual students for their test performance. Therefore, the students' test-taking behaviors, particularly the level of test-taking effort, have become a long-standing question. This paper presents a data-mining procedure to examine students' test-taking behaviors using response time collected from a computer-based survey test. An exploratory approach is considered to classify students' responses to test questions as reflecting either solution behavior or rapid-guessing behavior. Results of behavior classification are then summarized by three different statistical measures to show the degree of engagement in solution behavior. Considerations about how to identify response time thresholds and several validity checks to ensure reasonable classification of behaviors are also discussed. The procedure detailed in this paper is applicable to any computer-based assessments or surveys where timing data are available.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2013 program




2013 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

ASA Meetings Department  •  732 North Washington Street, Alexandria, VA 22314  •  (703) 684-1221  •  meetings@amstat.org
Copyright © American Statistical Association.