Abstract:
|
We propose semismooth Newton coordinate descent (SNCD), a fast algorithm for elastic-net penalized robust regression models. SNCD is a novel combination of the semismooth Newton and coordinate descent algorithms. It is designed for loss functions with only first order derivatives, including Huber loss in particular, and is scalable to high-dimensional models. In addition, an adaptive version of the "strong rule" for screening predictors is incorporated to gain extra efficiency. We establish convergence properties of the algorithm. As an important application, we show that SNCD can be adopted to compute the solution paths of penalized quantile regression. Through numerical experiments, we demonstrate that the proposed algorithm works well on high-dimensional data with heavy-tailed errors or high correlations between predictors, and that for quantile regression SNCD is considerably faster than the existing method and has better optimization performance. A breast cancer gene expression dataset is used to illustrate the proposed algorithm.
|
ASA Meetings Department
732 North Washington Street, Alexandria, VA 22314
(703) 684-1221 • meetings@amstat.org
Copyright © American Statistical Association.