Online Program Home
My Program

Abstract Details

Activity Number: 403 - SPAAC Poster Competition
Type: Topic Contributed
Date/Time: Tuesday, July 30, 2019 : 2:00 PM to 3:50 PM
Sponsor: Section on Bayesian Statistical Science
Abstract #304177
Title: The Use of Bayesian Methods to Detect Test Fraud
Author(s): Sandip Sinharay* and Matthew Johnson
Companies: Educational Testing Service and Educational Testing Service
Keywords: Bayes factor; Test fraud; item response theory; posterior probability; educational statistics; educational measurement

Score differencing, which is an examination of whether the performance of an examinee is similar over two sets of test questions, is one of the six categories of statistical methods for detecting test fraud (Wollack and Schoenig, 2018). Score differencing can be applied to detect several types of cheating such as cheating on unproctored tests, fraudulent erasures, and benefitting from item preknowledge (Sinharay & Jensen, 2018). The existing methods for score differencing (e.g., Fischer, 2003; Guo & Drasgow, 2010; Sinharay & Jensen, 2018) are frequentist methods with a few exceptions such as Wang, Liu, and Hambleton (2017) and van der Linden and Lewis (2015). A lack of Bayesian statistical methods for score differencing is surprising given that researchers such as Skorupski and Wainer (2017) have called for more research on the application of Bayesian statistical methods for detecting test fraud. This aim of this project is to develop several new Bayesian statistical methods for score differencing. The new methods will be based on posterior probabilities and Bayes factors (e.g., Kass & Raftery, 1995). The methods will be applied to operational data that involve actual test fraud.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2019 program