Online Program Home
My Program

Abstract Details

Activity Number: 492
Type: Contributed
Date/Time: Wednesday, August 3, 2016 : 8:30 AM to 10:20 AM
Sponsor: Survey Research Methods Section
Abstract #319316 View Presentation
Title: Accuracy in Effect Size Estimation for IID Observations
Author(s): Francis Bilson Darku* and Ken Kelly and Bhargab Chattopadhay
Companies: The University of Texas at Dallas and Mendoza College of Business and The University of Texas at Dallas
Keywords: Effect Size ; Sample Size Planning ; Accuracy in Parameter Estimation ; Sequential Analysis ; Bounded-Width Confidence Interval ; Research Design

Effect sizes are widely used quantitative measures of the strength of a phenomenon, with many potential uses in psychology and related disciplines. In this article, we propose a general theory for a sequential procedure for constructing sufficiently narrow confidence intervals for effect sizes (eg. correlation coefficient, coefficient of variation, etc) using smallest possible sample sizes, importantly without specific distributional assumptions. Fixed sample size planning methods cannot always give a sufficiently narrow width with high coverage probability. The sequential procedure we develop is the first sampling procedure developed for constructing confidence intervals for effect sizes with a prespecified width and coverage probability. We first present a method of planning a pilot sample size after the research goals are specified. Then, after collecting a sample size as large as the estimated pilot sample size, a check is performed to assess if the conditions to stop the data collection have been satisfied. If not, an additional observation is collected and the check is performed again. This process continues, sequentially, until the specified conditions are satisfied.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2016 program

Copyright © American Statistical Association