Online Program Home
  My Program

All Times EDT

Abstract Details

Activity Number: 324 - Causal Inference, Empirical Bayes and Related Topics in Regression
Type: Contributed
Date/Time: Wednesday, August 5, 2020 : 10:00 AM to 2:00 PM
Sponsor: IMS
Abstract #313049
Title: Model Complexity and Prediction Error in Modern Predictive Settings
Author(s): Bo Luan* and Yoonkyung Lee and Yunzhang Zhu
Companies: Ohio State University and Ohio State University and Ohio State University
Keywords: Interpolation; Least squares; Model degrees of freedom
Abstract:

Overparametrized interpolating models have drawn increasing attention from machine learning. Some recent studies suggest that regularized interpolating models can generalize well. This phenomenon seemingly contradicts the conventional wisdom that interpolation tends to overfit the data and performs poorly on test data, and it further appears to defy the bias-variance trade-off. As one of the shortcomings of the existing theory, the classical notion of model degrees of freedom fails to explain the intrinsic difference among the interpolating models since it focuses on estimation of in-sample prediction error. This motivates an alternative measure of model complexity which can differentiate those interpolating models and take different test points into account. In particular, we propose a measure with a proper adjustment based on the squared covariance between the prediction and observations. Our analysis with least squares method reveals some interesting properties of the measure, which can reconcile the “double descent” phenomenon with the classical theory. This opens door to an extended definition of model degrees of freedom in modern predictive settings.


Authors who are presenting talks have a * after their name.

Back to the full JSM 2020 program