JSM 2013 Home
Online Program Home
My Program

Abstract Details

Activity Number: 39
Type: Contributed
Date/Time: Sunday, August 4, 2013 : 2:00 PM to 3:50 PM
Sponsor: Social Statistics Section
Abstract - #309126
Title: The Performance of the Linear Logistic Test Model When the Q-Matrix Is Misspecified: A Simulation Study
Author(s): George MacDonald*+ and Jeffrey D. Kromrey and Yi-Hsin Chen
Companies: University of South Florida and University of South Florida and University of South Florida
Keywords: simulation ; linear logistic test model ; cognitive diagnostic assessment
Abstract:

A simulation study was conducted to explore the performance of the linear logistic test model (LLTM) when the relationships between items and cognitive components were misspecified. Marginal maximum likelihood and empirical Bayes were used in SAS to estimate parameters for cognitive components and item difficulty, as well as person ability, respectively. Factors manipulated in the simulation study included overall type of misspecification (under-, balanced-, and over-specification), percent misspecified (1%, 5%, 10%, and 15%), sample size (20, 40, 80, 160, 320, 640, and 1280), Q-matrix density (64% and 46%), skewness of ability distribution (-0.5, 0, and 0.5), and test length (20, 40, and 60 items). Statistical bias, RMSE, CI coverage, and CI width were computed for estimates across the set of replications. As the Q-Matrix moved away from the truth, cognitive components and item difficulty estimates became progressively more biased (positive bias with under-specification, and negative bias for balanced- and over-specification). Results were interpreted for the design factors and recommendations for the application of LLTM in assessment studies were provided.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2013 program




2013 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

ASA Meetings Department  •  732 North Washington Street, Alexandria, VA 22314  •  (703) 684-1221  •  meetings@amstat.org
Copyright © American Statistical Association.