02/02/2021

GLIB: Efficient Exploration for Relational Model-Based Reinforcement Learning via Goal-Literal Babbling

Rohan Chitnis, Tom Silver, Joshua B. Tenenbaum, Leslie Pack Kaelbling, Tomás Lozano-Pérez

Keywords:

Abstract Paper Similar Papers

Abstract: We address the problem of efficient exploration for transition model learning in the relational model-based reinforcement learning setting without extrinsic goals or rewards. Inspired by human curiosity, we propose goal-literal babbling (GLIB), a simple and general method for exploration in such problems. GLIB samples relational conjunctive goals that can be understood as specific, targeted effects that the agent would like to achieve in the world, and plans to achieve these goals using the transition model being learned. We provide theoretical guarantees showing that exploration with GLIB will converge almost surely to the ground truth model. Experimentally, we find GLIB to strongly outperform existing methods in both prediction and planning on a range of tasks, encompassing standard PDDL and PPDDL planning benchmarks and a robotic manipulation task implemented in the PyBullet physics simulator. Video: https://youtu.be/F6lmrPT6TOY Code: https://git.io/JIsTB

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948591
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 12:25 
 0
 0
 0
 0
 8:13 
 0
 0
 0
 0
 15:25 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 9:11 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 10:01 
 0
 0
 0
 0
 6:48 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 11:48 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 8:25 
 0
 0
 0
 0
 15:18 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 8:36 
 0
 0
 0
 1
 9:09 
 0
 0
 0
 0
 13:00 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 5:16 
 0
 0
 0
 0
 4:51 
 0
 0
 0
 0
 3:12 
 0
 0
 0
 0
 5:24 
 0
 0
 0
 0
 16:03 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 19:45 
 0
 0
 0
 1
 14:20 
 0
 0
 0
 0
 15:45 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 16:25 
 0
 0
 0
 0
 14:37 
 0
 0
 0
 0
 15:31 
 0
 0
 0
 0
 15:15