JSM 2012 Home

JSM 2012 Online Program

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

Online Program Home

Abstract Details

Activity Number: 240
Type: Contributed
Date/Time: Monday, July 30, 2012 : 2:00 PM to 3:50 PM
Sponsor: Section on Statistics in Marketing
Abstract - #306755
Title: The Use of Inverse Regression, Topic Models, and Sentiment Engines to Tone and Categorize Comments
Author(s): Kurt Pflughoeft*+ and Felix Flory and Carrie Lu
Companies: Maritz and evolve24 and evolve24
Address: W171 N10305 Wild Rose Lane, Germantown, WI, , United States
Keywords: Sentiment engines ; topic models ; inverse regression

Statistical topic models are currently the state of the art in extracting topics from a corpus of documents. The popular unsupervised LDA (Latent Dirichlet Allocation) proposed by Blei et al. has successfully been improved to learn the unknown number of topics, the variation of topics over time and the correlation between the extracted topics. Supervised models such as Inverse Regression for text and Supervised LDA have also been developed to study the relationship between topics and dependent variables (such as sentiment). In this paper, we use both unsupervised and supervised models to extract topics and sentiment from textual comments and ratings collected from hotel review websites. The results are compared to values generated by sentiment engines and scores assigned by humans. The comparison is summarized by several statistics for inter-rater agreement (e.g. Cohen's kappa, Krippendorff's alpha). Furthermore, we compare the results of unsupervised topic model to those of rule based NLP approaches.

The address information is for the authors that have a + after their name.
Authors who are presenting talks have a * after their name.

Back to the full JSM 2012 program

2012 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.