Online Program Home
My Program

Abstract Details

Activity Number: 646 - Experimental Design Thinking for Big Data
Type: Invited
Date/Time: Thursday, August 2, 2018 : 10:30 AM to 12:20 PM
Sponsor: Section on Physical and Engineering Sciences
Abstract #326913 Presentation
Title: Embracing Experimental Design Thinking for Large-Scale Statistical Analysis
Author(s): Peter Chien*
Companies: University of Wisconsin-Madison
Keywords: Big Data; Design of Experiments ; High-dimensional data ; Subsampling

Experimental design is one of the fundamental contributions statisticians made to the society. It has led to major advances in science and engineering. Given the enormous success of experimental design in the past, it is imperative for statisticians to think how to best utilize this thinking in the Big Data era. Data with massive sample size and/or high dimensionality appear in observations, physical or simulation experiments, digital engineering, and many other sources. This work is motivated by the increasing need of subsampling a Hadamard matrix in statistical analysis methods as varied as compressed sensing, leverage score subsampling and matrix completion. The current solution to this problem, which randomly takes a subsample from a Hadamard matrix, suffers from high variability and large coherence. In this talk, we will discuss an experimental design framework to exploit substructures with low coherence in Hadamard matrices to accelerate large-scale statistical analysis. The effectiveness of the proposed framework will be corroborated by theoretical results and illustrated with examples from compressed sensing.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2018 program