JSM 2015 Preliminary Program

Online Program Home
My Program

Abstract Details

Activity Number: 480
Type: Topic Contributed
Date/Time: Wednesday, August 12, 2015 : 8:30 AM to 10:20 AM
Sponsor: Section on Statistical Computing
Abstract #317031
Title: Experimentation at Scale: Lessons from Production at Etsy
Author(s): Hilary Parker*
Companies: Etsy
Keywords: Experimentation ; Technology ; AB testing ; Big Data ; Online Services
Abstract:

Modern technology companies frequently use experimentation in the product development lifecycle. Despite multiple similarities, methods related to clinical trials are not often ported over to the tech environment beyond straightforward statistical testing. Additionally, the set of costs and restraints in a tech environment are highly different than in medicine. In this talk I will outline the similarities I see between medicine and technology product development, as well as the opportunities I see for influence from the statistics community. I then will outline examples of unique statistical problems we have seen at Etsy, including rapid decision-making, meta-analyses of our past production experiments, Poisson-based statistical testing and biases unique to online data.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2015 program





For program information, contact the JSM Registration Department or phone (888) 231-3473.

For Professional Development information, contact the Education Department.

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

2015 JSM Online Program Home