This is the program for the 2010 Joint Statistical Meetings in Vancouver, British Columbia.

Abstract Details

Activity Number: 590
Type: Contributed
Date/Time: Wednesday, August 4, 2010 : 2:00 PM to 3:50 PM
Sponsor: Section on Statistics and Marketing
Abstract - #309148
Title: Online Experimentation: Principles and Practice
Author(s): Roger Longbotham*+ and Ji Chen and Justin Wang
Companies: Microsoft Corporation and Microsoft Corporation and Microsoft Corporation
Address: One Microsoft Way, Redmond, WA, 98052,
Keywords: design of experiments ; online ; software ; web sites ; DOE
Abstract:

Websites and Web services can benefit greatly from well designed and analyzed experiments. Companies such as Amazon, Google, Yahoo, Microsoft and others regularly test changes to their sites prior to release. They have found that a key to successful innovation is having a software platform for conducting experiments. Even though Design of Experiments theory is fully applicable, there are many ways in which online experiments differ from other experiments. This paper will discuss design principles, pitfalls and other lessons learned in this unique software-intensive environment. We will also cover challenges such as highly skewed distributions, effect of webcrawlers, data quality and large sample sizes. We will close with several research questions.


The address information is for the authors that have a + after their name.
Authors who are presenting talks have a * after their name.

Back to the full JSM 2010 program




2010 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.