Online Program Home
  My Program

Abstract Details

Activity Number: 294 - High-Dimensional Regression
Type: Contributed
Date/Time: Tuesday, August 1, 2017 : 8:30 AM to 10:20 AM
Sponsor: Biometrics Section
Abstract #323761 View Presentation
Title: A focused mean squared error approach for selecting tuning parameters in penalized regression
Author(s): Kristoffer Hellton* and Nils Lid Hjort
Companies: University of Oslo and University of Oslo
Keywords: ridge regression ; focused tuning ; tuning parameters ; personalized prediction ; focused information criterion ; focused model selection
Abstract:

Penalized regression methods depending on one or more tuning parameters require fine-tuning to achieve optimal prediction performance. For ridge regression, which introduces an L2 penalty on the regression coefficients, a range of tuning procedures have been developed, but in practice K-fold cross-validation has become the standard procedure. This paper explores a focused tuning approach for ridge regression where the tuning parameter is made dependent on the covariates of the specific observation to be predicted. The observation-specific tuning parameter is defined as the minimand of the empirical mean square prediction error, obtained by plugging in pilot estimates of the regression coefficients and error variance in the theoretical mean squared error expressions. Several pilot estimates are proposed, and we present risk expressions for the case of an OLS pilot. The focused ridge estimator is compared to standard ridge regression fine-tuned by cross-validation in simulations and a real data set.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2017 program

 
 
Copyright © American Statistical Association