26/08/2020

Conditional Importance Sampling for Off-Policy Learning

Mark Rowland, Anna Harutyunyan, Hado van Hasselt, Diana Borsa, Tom Schaul, Remi Munos, Will Dabney

Keywords:

Abstract Paper Similar Papers

Abstract: The principal contribution of this paper is a conceptual framework for off-policy reinforcement learning, based on conditional expectations of importance sampling ratios. This framework yields new perspectives and understanding of existing off-policy algorithms, and reveals a broad space of unexplored algorithms. We theoretically analyse this space, and concretely investigate several algorithms that arise from this framework.

 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AISTATS 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 3:11 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 15:41 
 0
 0
 0
 0
 13:49 
 0
 0
 0
 0
 12:55 
 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 14:09 
 1
 0
 0
 0
 5:06 
 0
 0
 0
 0
 18:11 
 0
 0
 0
 0
 3:08 
 0
 0
 0
 0
 14:35 
 0
 0
 0
 0
 5:16 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 14:10 
 0
 0
 0
 0
 4:10 
 0
 0
 0
 0
 3:15 
 0
 0
 0
 0
 4:51 
 0
 0
 0
 0
 11:25 
 0
 0
 0
 0
 15:50 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 2:42 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 8:39 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 3:25 
 0
 0
 0
 0
 20:10 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 3:14 
 0
 0
 0
 0
 12:18 
 0
 0
 0
 0
 16:53 
 0
 0
 0
 0
 11:29 
 0
 0
 0
 0
 3:23 
 0
 0
 0
 0
 8:44 
 0
 0
 0
 0
 11:42 
 0
 0
 0
 0
 13:10 
 0
 0
 0
 0
 9:52 
 0
 0
 0
 0
 15:49 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 14:49 
 0
 0
 0
 0
 4:44