JSM 2012 Home

JSM 2012 Online Program

The views expressed here are those of the individual authors and not necessarily those of the JSM sponsors, their officers, or their staff.

Online Program Home

Abstract Details

Activity Number: 145
Type: Invited
Date/Time: Monday, July 30, 2012 : 10:30 AM to 12:20 PM
Sponsor: International Chinese Statistical Association
Abstract - #303799
Title: Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies
Author(s): Bin Yu*+ and Shinji Nishimoto and An T. Vu and Thomas Naselaris and Yuval Benjamini and Jack Gallant
Companies: University of California at Berkeley and University of California at Berkeley and University of California at Berkeley and University of California at Berkeley and University of California at Berkeley and University of California at Berkeley
Address: 367 Evans Hall, Berkeley, CA, 94720-3860,
Keywords: fMRI ; natural movie ; encoding ; decoding ; regularization ; Bayesian

Quantitative modeling of human brain activity can provide crucial insights about cortical representations and can form the basis for brain decoding devices. Recent fMRI studies have modeled brain activity elicited by static visual patterns and have reconstructed these patterns from brain activity. However, blood oxygen level-dependent (BOLD) signals via fMRI are very slow, so it has been difficult to model brain activity elicited by dynamic stimuli such as natural movies. In this talk I present a new motion-energy encoding model that largely overcomes this limitation. We recorded BOLD signals in occipitotemporal visual cortex of human subjects who watched natural movies and fit the model separately to individual voxels. Visualization of the fit models reveals how early visual areas represent the information in movies. To demonstrate the power of our approach,we also constructed a Bayesian decoder by combining estimated encoding models with a sampled natural movie prior. The decoder provides remarkable reconstructions of the viewed movies. These results demonstrate that dynamic brain activity measured under naturalistic conditions can be decoded using current fMRI technology.

The address information is for the authors that have a + after their name.
Authors who are presenting talks have a * after their name.

Back to the full JSM 2012 program

2012 JSM Online Program Home

For information, contact jsm@amstat.org or phone (888) 231-3473.

If you have questions about the Continuing Education program, please contact the Education Department.