|
Activity Number:
|
251
|
|
Type:
|
Contributed
|
|
Date/Time:
|
Tuesday, July 31, 2007 : 8:30 AM to 10:20 AM
|
|
Sponsor:
|
Section on Statistical Computing
|
| Abstract - #308294 |
|
Title:
|
Asymptotic Mean Squared Prediction Error of L2Boosting Estimator Under Mis-specified Models
|
|
Author(s):
|
Tzu-Chang Cheng*+ and Ching-Kang Ing
|
|
Companies:
|
University of Illinois at Urbana-Champaign and Academia Sinica
|
|
Address:
|
Department of Economics, No 1306 North Lincoln Avenue, Urbana, IL, 61801,
|
|
Keywords:
|
Asymptotic Mean Squared Prediction Error ; L2Boosting ; Weak greedy algorithm ; Weak greedy orthogonal algorithm
|
|
Abstract:
|
A rigorous analysis of the L2Boosting predictor is given in a high-dimensional linear regression model, in which the number of regressors is much larger than the number of observations. Instead of boosting the predictor using the weak greedy algorithm (WGA) in Buhlmann (2006), this paper focuses on the weak orthogonal greedy algorithm (WOGA) because its statistical properties are more traceable. We explore the variable sequences determined by WOGA, and thereby give an asymptotic expression for the mean-squared prediction error (MSPE) of the corresponding Boosting predictor. This expression shows an algebraic tradeoff between the bias and variance terms. Finally, our simulation results suggest that the Boosting predictor based on WOGA outperforms the one based on WGA in terms of MSPE, offering an interesting direction for future research.
|