Online Program Home
My Program

Abstract Details

Activity Number: 587 - Post-Selection Inference
Type: Invited
Date/Time: Thursday, August 1, 2019 : 8:30 AM to 10:20 AM
Sponsor: IMS
Abstract #300375
Title: Be Careful What You Ask For: How to Ask Statistically "Cheap" (But Useful) Questions for Your Data
Author(s): Keli Liu*
Companies: Stanford University
Keywords: variable selection; p-values; penalized regression

Investigators often use the data to generate interesting hypotheses and then perform inference for the generated hypotheses. P-values and confidence intervals must account for this explorative data analysis. A fruitful method for doing so is to condition any inferences on the components of the data used to generate the hypotheses, thus preventing information in those components from being used again. Some currently popular methods over-condition leading to wide intervals. We show how to perform the minimal conditioning in a computationally tractable way. In high dimensions, even this minimal conditioning can lead to intervals that are too wide to be useful, suggesting that up to now the cost of hypothesis generation has been underestimated. We show how to generate hypotheses in a strategic manner that sharply reduces the cost of data exploration and results in useful confidence intervals. Our discussion focuses on the problem of post-selection inference after fitting a lasso regression model, but we also outline its extension to a much more general setting.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2019 program