Online Program Home
My Program

Abstract Details

Activity Number: 243 - Functional Object Analysis and Beyond
Type: Contributed
Date/Time: Monday, July 29, 2019 : 2:00 PM to 3:50 PM
Sponsor: IMS
Abstract #305168 Presentation
Title: Efficient Multivariate Functional Estimation and the Super-Oracle Phenomenon
Author(s): Thomas Berrett* and Richard Samworth
Companies: University of Cambridge and University of Cambridge
Keywords: Entropy; Divergence; Density functional; Nearest neighbours; Efficiency

We consider the estimation of two-sample density functionals

T(f,g) = \int f(x)\phi (f(x),g(x),x) dx,

based on independent d-dimensional random vectors X_1,...,X_m with density f and Y_1,...,Y_n with density g. The interest in such functionals arises from many applications: for instance, many divergences such as the KL divergence, total variation and Hellinger distances are of this form.

The estimators we consider can be expressed as weighted sums of preliminary estimators based on nearest neighbour distances. We provide conditions under which these estimators are efficient, in the sense of achieving the local asymptotic minimax lower bound, and under which they are asymptotically normal. As well as the significant theoretical contributions in this work, we also show how our results enable the construction of asymptotically valid confidence intervals. Our results also reveal an interesting phenomenon in which the natural `oracle' estimator, requiring knowledge of f and g, can be outpeformed by our estimators. For some functionals of interest we show that the asymptotic limit of the ratio of the L2 risks is strictly less than one, uniformly over suitable classes of densities.

Authors who are presenting talks have a * after their name.

Back to the full JSM 2019 program