Online Program Home
My Program

Abstract Details

Activity Number: 46 - Recent Developments in Novel Clinical Trial Design and Analysis for Precision Medicine
Type: Invited
Date/Time: Sunday, July 28, 2019 : 4:00 PM to 5:50 PM
Sponsor: ENAR
Abstract #300024
Title: Adaptive Contrast Weighted Learning and Tree-Based Reinforcement Learning for Multi-Stage Multi-Treatment Decision-Making
Author(s): Lu Wang* and Yebin Tao and Daniel Almirall
Companies: University of Michigan and Google and University of Michigan
Keywords: Dynamic treatment regimes; Adaptive contrast weighted learning; Tree-based reinforcement learning; Personalized health care; Precision medicine; Causal inference

Dynamic treatment regimes (DTRs) are sequential decision rules that focus simultaneously on treatment individualization and adaptation over time. We will first present an adaptive contrast weighted learning (ACWL) for estimating optimal DTRs. At each stage, we develop robust semiparametric regression-based contrasts with the adaptation of treatment effect ordering for each patient, and the adaptive contrasts simplify the problem of optimization with multiple treatment comparisons to a weighted classification problem. We further develop a tree-based reinforcement learning (T-RL) method to directly estimate optimal DTRs in a multi-stage multi-treatment setting. At each stage, T-RL builds an unsupervised decision tree that maintains the nature of batch-mode reinforcement learning. Unlike ACWL, T-RL handles the optimization problem with multiple treatment comparisons directly through the purity measure constructed with augmented inverse probability weighted estimators. T-RL is generally robust, efficient and easy to interpret for the identification of optimal DTRs. However, ACWL seems more robust against tree-type misspecification than T-RL when the true optimal DTR is non-tree-type.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2019 program