Conference Program Home
  My Program

All Times EDT

Abstract Details

Activity Number: 94 - Building Innovative Ethical Health Care Systems via Sequential Approaches
Type: Invited
Date/Time: Monday, August 8, 2022 : 8:30 AM to 10:20 AM
Sponsor: Mental Health Statistics Section
Abstract #320681
Title: Online Decision-Making
Author(s): Gisoo Kim*
Companies: UNIST
Keywords: bandit algorithms; machine learning; personalized interventions; statistical testing; actor-critic; robust tests

Bandit algorithms are widely used in sequential decision problems to maximize the cumulative reward. One potential application is mobile health, where the goal is to promote the user's health through personalized interventions based on user specific information acquired through wearable devices. Important considerations include the type of, and frequency with which data is collected (e.g. GPS, or continuous monitoring), as such factors can severely impact app performance and users’ adherence. In order to balance the need to collect data that is useful with the constraint of impacting app performance, one needs to be able to assess the usefulness of variables. Bandit feedback data are sequentially correlated, so traditional testing procedures developed for independent data cannot apply. Recently, a statistical testing procedure was developed for the actor-critic bandit algorithm (Lei et al., 2017). An actor-critic algorithm maintains two separate models, one for the actor, the action selection policy, and the other for the critic, the reward model. The performance of the algorithm as well as the validity of the test are guaranteed only when the critic model is correctly specified.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2022 program