03/05/2021

Deep Neural Tangent Kernel and Laplace Kernel Have the Same RKHS

Lin Chen, Sheng Xu

Keywords: Laplace kernel, Reproducing kernel Hilbert space, Neural tangent kernel, Singularity analysis

Abstract Paper Similar Papers

Abstract: We prove that the reproducing kernel Hilbert spaces (RKHS) of a deep neural tangent kernel and the Laplace kernel include the same set of functions, when both kernels are restricted to the sphere $\mathbb{S}^{d-1}$. Additionally, we prove that the exponential power kernel with a smaller power (making the kernel less smooth) leads to a larger RKHS, when it is restricted to the sphere $\mathbb{S}^{d-1}$ and when it is defined on the entire $\mathbb{R}^d$.

 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ICLR 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 13:40 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 14:50 
 0
 0
 0
 0
 16:21 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 2:55 
 0
 0
 0
 0
 12:11 
 0
 0
 0
 0
 16:25 
 0
 0
 0
 0
 3:33 
 0
 0
 0
 0
 3:33 
 0
 0
 0
 0
 14:36 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 5:56 
 0
 0
 0
 0
 12:15 
 0
 0
 0
 0
 8:40 
 0
 0
 0
 0
 15:10 
 0
 0
 0
 0
 13:56 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 13:38 
 0
 0
 0
 0
 17:51 
 0
 0
 0
 0
 3:05 
 0
 0
 0
 0
 18:46 
 0
 0
 0
 0
 4:49 
 0
 0
 0
 0
 3:13 
 0
 0
 0
 0
 4:48 
 0
 0
 0
 0
 12:37 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 15:17 
 0
 0
 0
 0
 3:12 
 0
 0
 0
 0
 14:08 
 0
 0
 0
 0
 11:18 
 0
 0
 0
 0
 13:34 
 0
 0
 0
 0
 17:12 
 0
 0
 0
 0
 15:03 
 0
 0
 0
 0
 5:19 
 0
 0
 0
 0
 14:11 
 0
 0
 0
 0
 12:38 
 0
 0
 0
 0
 5:07