Conference Program Home
  My Program

All Times EDT

Abstract Details

Activity Number: 108 - Innovations in Testing and Inference
Type: Contributed
Date/Time: Monday, August 8, 2022 : 8:30 AM to 10:20 AM
Sponsor: Biometrics Section
Abstract #323144
Title: Permutation-Based Hypothesis Testing for Neural Networks
Author(s): Francesca Mandel* and Ian Barnett
Companies: University of Pennsylvania and University of Pennsylvania
Keywords: neural networks; hypothesis testing; interpretability; partial derivatives
Abstract:

Artificial neural networks (ANNs) are powerful predictive models, but they provide little insight into the nature of relationships between predictors and outcomes. Many methods have been proposed to quantify and qualify the relative contributions of input features in ANNs, generally through feature importance rankings, sensitivity analyses, and input perturbation. Despite these contributions, statistical inference and hypothesis testing of feature associations remain largely unexplored. We propose a permutation-based approach to testing based on partial derivatives of the network output with respect to specific inputs. We develop two tests: one to assess the significance of the input features in a feed-forward ANN and one to test whether significant features are linearly associated with the network output. These tests enhance the explanatory power of ANNs, and combined with powerful predictive capability, extend the applicability of these models.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2022 program