Online Program Home
My Program

Abstract Details

Activity Number: 619
Type: Contributed
Date/Time: Wednesday, August 3, 2016 : 2:00 PM to 3:50 PM
Sponsor: Section on Bayesian Statistical Science
Abstract #318999 View Presentation
Title: The Microclustering Property: When the Cluster Sizes Grow Sublinearly with the Size of the Data Set
Author(s): Abbas Zaidi and Angie Shen*
Companies: Duke University and Duke University
Keywords: Microclustering ; Generative Models ; Bayesian Non-parametrics

Most generative models for clustering implicitly assume that the number of data points in each cluster grows linearly with the total number of data points. Finite mixture models, Dirichlet process mixture models, and Pitman-Yor process mixture models make this assumption, as do all other infinitely exchangeable clustering models. However, this assumption is undesirable in applications for certain tasks such as record linkage and community detection. These tasks therefore require models that yield clusters whose sizes grow sublinearly with the size of the data set. We address this requirement by defining the microclustering property. We introduce one model satisfying this property, showing its promise to both official statistics and simulated data.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2016 program

Copyright © American Statistical Association