Multiple Choice from Competing Regression Models Under Multicollinearity Based on Standardized Update

• Activity Number: 33
• Type: Contributed
• Date/Time: Sunday, August 4, 2013 : 2:00 PM to 3:50 PM
• Sponsor: Section on Statistical Computing
• Author(s): Yoshinori Kawasaki*+ and Masao Ueki
• Companies: The Institute of Statistical Mathematics and Faculty of Medicine, Yamagata University
• Keywords: Regression model choice ; Multicollinearity ; Standardized update

Abstract

This paper proposes a new method for choosing regression models which may produce multiple models with sufficient explanatory power and parsimony unlike the traditional model selection procedures that aim at obtaining a single best model. The method ensures interpretability of the resulting models even under strong multicollinearity. The algorithm proceeds in the forward stepwise manner with two requirements for the selected regression models to be fulfilled: goodness of fit and the magnitude of update in loss functions. For the latter criterion, the standardized update is newly introduced, which is closely related with the model selection criteria including the Mallows' Cp, Akaike information criterion and Bayesian information criterion. Simulation studies demonstrate that the proposed algorithm works well with and without strong multicollinearity and even with many explanatory variables. Application to real data is also provided.