The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.
Online Program Home
Abstract Details
|
Activity Number:
|
73
|
|
Type:
|
Contributed
|
|
Date/Time:
|
Sunday, July 29, 2012 : 4:00 PM to 5:50 PM
|
|
Sponsor:
|
Section on Statistical Education
|
| Abstract - #306807 |
|
Title:
|
Rating Student Research Across Disciplines: Assessing Reliability
|
|
Author(s):
|
Kristin Duncan*+
|
|
Companies:
|
San Diego State University
|
|
Address:
|
4285 Hawk St, San Diego, CA, 92103-1316, United States
|
|
Keywords:
|
Reliability ;
Bayesian Hierarchical Model ;
Many Facets Rasch
|
|
Abstract:
|
Measures of inter-rater agreement and reliability of rubrics are usually made on a pair-wise basis or when the same set of judges have rated a group of examinees. This paper explores how hierarchical modeling was used to address several research questions involving a university-wide student research symposium. Students presented research in small sessions and were judged by experts in their field. A measure akin to reliability results from the model, allowing organizers to see trends in judging behavior over years and to advise the number of judges per session. Differences in disciplines are examined to determine the "fairness" of the prize scheme.
|
The address information is for the authors that have a + after their name.
Authors who are presenting talks have a * after their name.
Back to the full JSM 2012 program
|
2012 JSM Online Program Home
For information, contact jsm@amstat.org or phone (888) 231-3473.
If you have questions about the Continuing Education program, please contact the Education Department.