JSM 2015 Preliminary Program

Online Program Home
My Program

Abstract Details

Activity Number: 189
Type: Contributed
Date/Time: Monday, August 10, 2015 : 10:30 AM to 12:20 PM
Sponsor: Section on Statistical Computing
Abstract #316216
Title: A Framework for Monte Carlo--Based Multiple Testing
Author(s): Georg Hahn* and Axel Gandy
Companies: and Imperial College London
Keywords: Framework ; Hypothesis testing ; Algorithm ; Monte Carlo ; Multiple testing procedure ; P value
Abstract:

Most multiple testing procedures assume exact knowledge of all p-values, for instance the ones of Holm, Sidak, Hochberg or Benjamini-Hochberg. We consider multiple testing under the assumption that the p-values are not available and thus have to be approximated using Monte-Carlo simulations. We are interested in obtaining the same rejections and non-rejections as the ones obtained if all p-values had been available. This talk introduces a framework for this common scenario by providing a generic algorithm for a general testing procedure. We establish conditions which guarantee that the rejections and non-rejections obtained through Monte-Carlo simulations are identical to the ones obtained with the unknown p-values. Our framework is applicable to a general class of step-up and step-down procedures. More importantly, we show how to use our framework to improve established methods in such a way as to yield theoretical guarantees on their results. These modifications can easily be implemented in practice and lead to a particular way of reporting multiple testing results as three sets together with an error bound on their correctness, demonstrated exemplarily on a biological dataset.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2015 program





For program information, contact the JSM Registration Department or phone (888) 231-3473.

For Professional Development information, contact the Education Department.

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

2015 JSM Online Program Home