Online Program Home
My Program

Abstract Details

Activity Number: 679
Type: Topic Contributed
Date/Time: Thursday, August 4, 2016 : 10:30 AM to 12:20 PM
Sponsor: Royal Statistical Society
Abstract #319188 View Presentation
Title: Exact Subset Selection in Regression via Modern Optimization
Author(s): Rahul Mazumder*
Companies: MIT
Keywords: Discrete Optimization ; Variable Selection ; Sparse Regression ; Mathematical Programming ; Computational Statistics ; Lasso
Abstract:

We consider the usual linear regression set up where the task is to find the best least squares fit to data subject to a cardinality constraint in the regression coefficient vector. This problem, popularly dubbed as the best-subset selection problem is known to be NP-hard and has been widely dismissed as computationally intractable. We propose a novel framework via which the best-subset selection problem can indeed be provably solved to global (or near global) accuracy in problems of practical interest. At the core of our proposal is a computationally tractable framework that brings to bear the power of modern discrete optimization methods:(a) Mixed Integer Optimization (MIO) techniques and (b) Discrete first-order methods, which may be viewed as a ``discrete"extension of first order continuous optimization methods. Superiority of best-subset selection procedures over popularly used computationally friendlier alternatives will be discussed. If time permits, we will describe how to address change point detection problems, and another classic but computationally difficult procedure in robust statistics, namely,the Least Median of Squares Regression.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2016 program

 
 
Copyright © American Statistical Association