Online Program Home
  My Program

All Times EDT

Abstract Details

Activity Number: 414 - Risk Modeling and Regression Techniques
Type: Contributed
Date/Time: Thursday, August 12, 2021 : 2:00 PM to 3:50 PM
Sponsor: Biometrics Section
Abstract #317760
Title: Cluster-Wise Variational Approach to Variable Selection
Author(s): Liangrui Sun* and Qi Zhang
Companies: University of Nebraska - Lincoln and University of New Hampshire
Keywords: Variational Bayes; Variable selection; High dimensional data; Clustering; Large-scale multiple testing
Abstract:

For under high dimensional linear regression analysis, variable selection (VS) is very helpful. Bayesian variable selection (BVS) methods is both useful and flexible. To determine the posterior is the most important part. However, MCMC becomes slow or intractable when the dimensionality is sufficiently large. For this reason, alternatives including Variational Bayes (VB) have been developed. In VS scenario, application of VB gives VBVS. One popular method of VBVS is to update the regression coefficients element-wise. It is computationally fast. But the literature has shown that it may accumulate errors during the optimization process, and it's sensitive to correlation between the predictors. An alternative is to update all regression coefficients jointly, yielding a batch-wise algorithm. However, it involves large matrix inversion, which may be inaccurate. We propose a cluster-wise VBVS procedure. In the first step, we identify the clusters within the predictors by empirical correlation matrix. In the second step, we apply VBVS to these clusters sequentially. Data examples show cluster-wise VBVS outperforms or ties with its competitors.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2021 program