Online Program Home
  My Program

All Times EDT

Abstract Details

Activity Number: 220603 - Statistical Challenges in Cosmology
Type: Topic Contributed
Date/Time: Wednesday, August 11, 2021 : 3:30 PM to 5:20 PM
Sponsor: Section on Nonparametric Statistics
Abstract #317381
Title: Stratified Learning: A General-Purpose Method for Supervised Learning Under Covariate Shift with Applications to Observational Cosmology
Author(s): Maximilian Autenrieth* and David A van Dyk and Roberto Trotta and David C Stenning
Companies: Imperial College London and Imperial College London and Imperial College London, International School for Advanced Studies (Trieste) and Simon Fraser University
Keywords: Astrostatistics; Propensity Scores; Machine Learning; Domain Adaptation; Bias reduction; Supernovae

Supervised machine learning will be central in the analysis of upcoming large-scale sky surveys. However, selection bias for astronomical objects yields labelled training data that is not representative for the unlabelled target data distribution. This affects the predictive performance with unreliable target predictions.

We propose a novel and statistically principled method to improve supervised learning under such covariate shift conditions, based on propensity score stratification, a well-established methodology in causal inference. We train learners on subgroups ("strata") conditional on the propensity scores, leading to improved covariate balance and much-reduced bias in the model fit.

We demonstrate that our general-purpose method has promising applications in observational cosmology, by improving upon existing conditional density estimation of galaxy redshift from Sloan Data Sky Survey (SDSS) data, as well as improving classification of Supernovae (SNe) type Ia, obtaining the best reported AUC (0.977) on the “SNe photometric classification challenge”. We discuss the embedding of such a classification into a full analysis of SNe data to estimate cosmological parameters.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2021 program