Empirical Bayes Model Averaging with Influential Observations

• Activity Number: 639 - Influential Observations: Detection and Modeling
• Type: Invited
• Date/Time: Thursday, August 3, 2017 : 10:30 AM to 12:20 PM
• Sponsor: Section on Bayesian Statistical Science
• Author(s): Christopher Hans* and Mario Peruggia and Junyan Wang
• Companies: The Ohio State University and The Ohio State University and The Ohio State University
• Keywords: empirical Bayes ; Bayesian model averaging ; influential observations ; outliers ; model misfit ; regression

Abstract

We investigate the behavior of Bayesian model averaging (BMA) for the normal linear regression model in the presence of influential observations that contribute to model misfit, and propose remedies to attenuate the potential negative impacts of such observations on inference and prediction. The methodology is motivated by the view that well-behaved residuals and good predictive performance often go hand-in-hand. The study focuses on regression models that use variants on Zellner's g prior. By studying the impact of various forms of model misfit on BMA predictions in simple situations we identify prescriptive guidelines for "tuning" Zellner's g prior to obtain optimal predictions. The tuning of the prior distribution is obtained by considering theoretical properties that should be enjoyed by the optimal fits of the various models in the BMA ensemble. The methodology can be thought of as an "Empirical Bayes" approach to modeling, as the data help inform the specification of the prior in an attempt to attenuate the negative impact of model misfit.