Online Program Home
  My Program

All Times EDT

Abstract Details

Activity Number: 474 - New Advances in Modeling Survey Data
Type: Contributed
Date/Time: Thursday, August 6, 2020 : 10:00 AM to 2:00 PM
Sponsor: Survey Research Methods Section
Abstract #313728
Title: Evaluation of Multi-Class Classification Models for Census Mindsets
Author(s): Mary H. Mulry* and Steven Scheid and Darcy Steeg Morris
Companies: U.S. Census Bureau and U.S. Census Bureau and U.S. Census Bureau
Keywords: multi-class AUC; 2020 CBAMS sample survey; 2020 Census Communications Campaign
Abstract:

The U.S. Census Bureau fielded the 2020 Census Barriers, Attitudes and Motivators Study (CBAMS) sample survey in 2018 to collect data on attitudes and knowledge about the U.S. Census. Data from over 17,000 respondents was used to cluster individuals into one of six psychographic profiles referred to as Census “mindsets.” In social marketing campaigns, mindsets are constructed to reflect an individual’s knowledge, attitudes and opinions toward a topic. The mindsets are then used in developing messages with a call to action. In our case, the requested action is responding to the 2020 Census. We recently re-administered the 2020 CBAMS to a sample selected from an online panel in anticipation of the 2020 Census, but a new classifier is needed to assign new respondents to existing mindsets. We compare several methods for fitting multi-class classification models to assign the mindsets and examine methods for model evaluation and selection. We include the evaluation method for multi-class classification models developed by Hand and Till (2001), which is a generalization of the area under the curve (AUC) for receiver operating curves (ROC) for binary classification models.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2020 program