Online Program Home
My Program

Abstract Details

Activity Number: 254 - Contributed Poster Presentations: Section on Statistical Learning and Data Science
Type: Contributed
Date/Time: Monday, July 30, 2018 : 2:00 PM to 3:50 PM
Sponsor: Section on Statistical Learning and Data Science
Abstract #329555
Title: Computing Mean Partition and Assessing Uncertainty for Clustering Analysis
Author(s): Beomseok Seo* and Lin Lin and Jia Li
Companies: Penn State University and The Pennsylvania State University and Penn State University
Keywords: Clustering; Unsupervised Learning; Stability Validation of Clustering; Bootstrapping; Robust Clustering

Due to the combinatorial nature of the clustering result, which is a partition rather than a set of parameters or a function, the notions of mean and variance are not clear-cut. This intrinsic difficulty hinders the development of methods to improve clustering by aggregation or to assess the uncertainty of clusters generated. We overcome the barrier by aligning clusters via soft matching solved by optimal transport. Equipped with this technique, we propose a new algorithm to enhance clustering by any baseline method using bootstrap samples. In addition, the cluster alignment enables us to quantify variation in the clustering result at the levels of both overall partitions and individual clusters. Topological relationships between clusters such as match, split, and merge can be revealed. A confidence point set for each cluster, a concept kin to the confidence interval, is proposed. The tools we have developed here will help address the crucial question of whether any cluster is an intrinsic or spurious pattern. Experimental results on both simulated and real data sets are provided.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2018 program