Interactive Animation for Learning IRT and Misfit Identification in Item Response Theory

• Activity Number: 337
• Type: Contributed
• Date/Time: Tuesday, August 8, 2006 : 2:00 PM to 3:50 PM
• Sponsor: Section on Statistical Education
• Author(s): Chong Ho Yu*+ and Roger Freeman and Angel Jannasch-Pennell and Samuel DiGangi and Chang Kim and Victoria Stay and Wenjuo Lo and Lori Long
• Companies: Arizona State University and Paradise Valley Unified School District and Arizona State University and Arizona State University and Arizona State University and Arizona State University and Arizona State University and Arizona State University
• Keywords: item response theory ; misfit ; interface ; assessment ; measurement ; Rasch model

Abstract

Since the introduction of the No Child Left Behind Act, assessment has become a pre-dominant theme in the US K-12 system. However, making assessment results understandable and usable for the K-12 teachers has been a challenge. The objective of this presentation is to illustrate a well-developed interactive tutorial for understanding the complex concepts of assessment based on an interface study. For instance, there will be illustration of misfit identification in Item response theory, such as infit mean squares, outfit mean squares, infit standardized residual, and outfit standardized residual. User feedback is collected from item authors, teachers, and education majors. Usage of the tutorial is tracked by interface study procedures. Obstacles to understanding are identified for refining the tutorial delivery