Online Program

Return to main conference page
Friday, May 31
Machine Learning
Machine Learning E-Posters, II
Fri, May 31, 3:00 PM - 4:00 PM
Grand Ballroom Foyer

A Multicategory Kernel Distance Weighted Discrimination Method for Multiclass Classification (306338)

*Boxiang Wang, University of Iowa 
Hui Zou, University of Minnesota 

Keywords: Distance weighted discrimination, fisher consistency, multicategory classification, Nesterov's acceleration, projected gradient descent, reproducing kernel Hilbert space

Distance Weighted Discrimination (DWD) is an interesting large margin classifier that has been shown to enjoy nice properties and empirical successes. The original DWD only handles binary classification with a linear classification boundary. Multiclass classification problems naturally appear in various fields, such as speech recognition, satellite imagery classification, and self-driving vehicles, to name a few. For such complex classification problems, it is desirable to have a flexible multicategory kernel extension of the binary DWD when the optimal decision boundary is highly nonlinear. To this end, we propose a new multicategory kernel DWD that is defined as a margin-vector optimization problem in a reproducing kernel Hilbert space. This formulation is shown to enjoy Fisher consistency. We develop an accelerated projected gradient descent algorithm to fit the multicategory kernel DWD. Simulations and benchmark data applications are used to demonstrate the highly competitive performance of our method, as compared with some popular state-of-the-art multiclass classifiers