02/02/2021

Regret Bounds for Online Kernel Selection in Continuous Kernel Space

Xiao Zhang, Shizhong Liao, Jun Xu, Ji-Rong Wen

Keywords:

Abstract Paper Similar Papers

Abstract: Regret bounds of online kernel selection in a finite kernel set have been well studied, having at least an order O( √ NT) of magnitude after T rounds, where N is the number of candidate kernels. But it is still an unsolved problem to achieve sublinear regret bounds of online kernel selection in a continuous kernel space under different learning frameworks. In this paper, to represent different learning frameworks of online kernel selection, we divide online kernel selection approaches in a continuous kernel space into two categories according to the order of selection and training at each round. Then we construct a surrogate hypothesis space that contains all the candidate kernels with bounded norms and inner products, representing the continuously varying hypothesis space. Finally, we decompose the regrets of the proposed online kernel selection categories into different types of instantaneous regrets in the surrogate hypothesis space, and derive optimal regret bounds of order O( √ T) of magnitude under mild assumptions, independent of the cardinality of the continuous kernel space. Empirical studies verified the correctness of the theoretical regret analyses.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948096
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 2:51 
 0
 0
 0
 0
 15:41 
 0
 0
 0
 0
 16:04 
 1
 1
 1
 1
 3:09 
 0
 0
 0
 0
 20:29 
 1
 1
 0
 0
 14:58 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 18:32 
 0
 0
 0
 0
 17:09 
 0
 0
 0
 0
 15:16 
 0
 0
 0
 0
 15:12 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 14:28 
 0
 0
 0
 0
 14:58 
 0
 0
 0
 0
 14:13 
 0
 0
 0
 0
 5:13 
 0
 0
 0
 0
 4:19 
 1
 1
 0
 1
 3:12 
 0
 0
 0
 0
 11:05 
 0
 0
 0
 0
 2:10 
 1
 1
 0
 0
 3:29 
 0
 0
 0
 0
 15:47 
 0
 0
 0
 0
 6:19 
 0
 0
 0
 0
 7:44 
 0
 0
 0
 0
 5:58 
 1
 1
 0
 1
 3:11 
 0
 0
 0
 0
 16:44 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 5:13 
 0
 0
 0
 0
 20:10 
 0
 0
 0
 0
 16:03 
 0
 0
 0
 0
 9:34 
 0
 0
 0
 0
 18:34 
 0
 0
 0
 0
 13:07 
 0
 0
 0
 0
 14:30 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 2:52 
 0
 0
 0
 0
 13:32 
 0
 0
 0
 0
 4:35 
 0
 0
 0
 0
 17:25