JSM 2012 Home

JSM 2012 Online Program

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

Online Program Home

Abstract Details

Activity Number: 36
Type: Contributed
Date/Time: Sunday, July 29, 2012 : 2:00 PM to 3:50 PM
Sponsor: Biopharmaceutical Section
Abstract - #304377
Title: Model Combining in a Covariate-Adjusted Response-Adaptive Design
Author(s): Wei Qian*+ and Yuhong Yang
Companies: University of Minnesota and University of Minnesota
Address: 1172 Fifield Ave S1, St. Paul, MN, 55108, United States
Keywords: bandit problem ; clinical trial ; model combining ; sequential estimation ; response adaptive design

Multi-armed bandit problem is an important optimization game with promising applications in clinical trials and web advertising. We consider a setting where the rewards of bandit machines are associated with covariates (also known as covariate-adjusted response-adaptive design), and focus on the performance of \epsilon-greedy, one of the most well-known algorithms for bandit problem. Since many nonparametric and parametric methods in supervised learning may be applied to the sequential reward function estimation, and guidance on how to choose these methods are generally unavailable, we integrate a model combining procedure derived from AFTER algorithm (Yang, 2004) into \epsilon-greedy to obtain robust game-playing results. It is shown that our model combining procedure can maintain the asymptotic optimality of individual methods in terms of the accumulated reward. The benefits of combining various nonparametric methods are also demonstrated in both theory and simulation.

The address information is for the authors that have a + after their name.
Authors who are presenting talks have a * after their name.

Back to the full JSM 2012 program

2012 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.