13/04/2021

Minimax optimal regression over sobolev spaces via laplacian regularization on neighborhood graphs

Alden Green, Sivaraman Balakrishnan, Ryan Tibshirani

Keywords:

Abstract: In this paper we study the statistical properties of Laplacian smoothing, a graph-based approach to nonparametric regression. Under standard regularity conditions, we establish upper bounds on the error of the Laplacian smoothing estimator \widehat{f}, and a goodness-of-fit test also based on \widehat{f}. These upper bounds match the minimax optimal estimation and testing rates of convergence over the first-order Sobolev class H^1(\mathcal{X}), for \mathcal{X} \subseteq \mathbb{R}^d and 1 \leq d < 4; in the estimation problem, for d = 4, they are optimal modulo a \log n factor. Additionally, we prove that Laplacian smoothing is manifold-adaptive: if \mathcal{X} \subseteq \mathbb{R}^d is an m-dimensional manifold with m < d, then the error rate of Laplacian smoothing (in either estimation or testing) depends only on m, in the same way it would if \mathcal{X} were a full-dimensional set in \mathbb{R}^m.

 0
 0
 0
 0
This is an embedded video. Talk and the respective paper are published at AISTATS 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers