Abstract Details
Activity Number:
|
26
|
Type:
|
Contributed
|
Date/Time:
|
Sunday, August 3, 2014 : 2:00 PM to 3:50 PM
|
Sponsor:
|
IMS
|
Abstract #312945
|
View Presentation
|
Title:
|
Shrinkage Estimators for Prediction Out-of-Sample: Selection of Estimators and Predictive Inference
|
Author(s):
|
Nina Senitschnig*+ and Hannes Leeb
|
Companies:
|
and University of Vienna
|
Keywords:
|
shrinkage estimators ;
out-of-sample prediction ;
selection of estimators ;
predictive inference
|
Abstract:
|
In a linear regression model with random design, we consider a family of James-Stein-type shrinkage estimators from which we want to select a 'good' estimator for prediction out-of-sample. We focus on the challenging situation where the number of explanatory variables can be of the same order as sample size and where the number of candidate estimators can be much larger than sample size. We develop an estimator for the out-of-sample predictive performance that differs from Stein's well-known unbiased estimator of risk, even asymptotically. Using our performance estimator, we show that the empirically best estimator is asymptotically as good as the truly best (oracle) estimator. Using the empirically best estimator, we construct a prediction interval that is approximately valid and short with high probability, i.e., we show that the actual coverage probability is close to the nominal one and that the length of this prediction interval is close to the length of the shortest but infeasible prediction interval. These findings extend results of Leeb (2009, Ann. Stat. 37:2838-2876) where the underlying estimators are least-squares estimators.
|
Authors who are presenting talks have a * after their name.
Back to the full JSM 2014 program
|
2014 JSM Online Program Home
For information, contact jsm@amstat.org or phone (888) 231-3473.
If you have questions about the Professional Development program, please contact the Education Department.
The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.
Copyright © American Statistical Association.