This is the program for the 2010 Joint Statistical Meetings in Vancouver, British Columbia.
Abstract Details
Activity Number:
|
400
|
Type:
|
Topic Contributed
|
Date/Time:
|
Tuesday, August 3, 2010 : 2:00 PM to 3:50 PM
|
Sponsor:
|
Section on Statistical Computing
|
Abstract - #308509 |
Title:
|
Multivariate Dyadic Regression Trees for Sparse Learning Problems
|
Author(s):
|
Han Liu+ and Xi Chen*
|
Companies:
|
Carnegie Mellon University and Carnegie Mellon University
|
Address:
|
Gates-Hillman Complex 8008, Pittsburgh, PA, 15213, United States
|
Keywords:
|
Multivariate Regression Trees ;
Dyadic Partition ;
Sparse Learning Problems ;
Penalized Empirical Risk Minimization ;
Sparsity-inducing Penalty ;
Greedy Algorithms
|
Abstract:
|
We propose a new nonparametric learning method based on multivariate dyadic regression trees (MDRTs). Unlike traditional dyadic decision trees (DDTs) or classification and regression trees (CARTs), MDRTsare constructed using penalized empirical risk minimization with a novel sparsity-inducing penalty. Theoretically, we show that MDRTs can simultaneously adapt to the unknown sparsity and smoothness of the true regression functions, and achieve the nearly optimal rates of convergence (in a minimax sense) for the class of $(\alpha, C)$-smooth functions. Empirically, MDRTs can simultaneously conduct function estimation and variable selection in high dimensions. To make MDRTs applicable for large-scale learning problems, we propose a greedy heuristic algorithm and a more effective randomization scheme. The superior performance of MDRTs are demonstrated on both synthetic and real datasets.
|
The address information is for the authors that have a + after their name.
Authors who are presenting talks have a * after their name.
Back to the full JSM 2010 program
|
2010 JSM Online Program Home
For information, contact jsm@amstat.org or phone (888) 231-3473.
If you have questions about the Continuing Education program, please contact the Education Department.