Bayesian Sparse Multiple Regression for Simultaneous Rank Reduction and Variable Selection

• Activity Number: 623 - Bayesian Variable Selection
• Type: Contributed
• Date/Time: Thursday, August 3, 2017 : 8:30 AM to 10:20 PM
• Sponsor: Section on Bayesian Statistical Science
• Author(s): Antik Chakraborty* and Anirban Bhattacharya and Bani K. Mallick
• Companies: Texas A&M University and Texas A&M University and Texas A&M University
• Keywords: High dimension ; Low rank ; Reduced rank ; Dimension reduction ; Variable selection

Abstract

We develop a Bayesian methodology aimed at estimating low rank and row sparse matrices in a high dimensional multivariate response linear regression model. Starting with a full rank matrix and thus avoiding any prior specification on the rank, we let our estimate shrink towards the space of low rank matrices using continuous shrinkage priors. For selecting rows we propose a one step post processing scheme derived from putting group lasso penalties on the rows of the coefficient matrix with default choice of tuning parameters. We then provide an adaptive posterior estimate of the rank using a novel optimization function achieving dimension reduction in the covariate space. We exhibit the performance of the proposed methodology in an extensive simulation study and a real data example.