17/08/2020

Catch & carry: Reusable neural controllers for vision-guided whole-body tasks

Josh Merel, Saran Tunyasuvunakool, Arun Ahuja, Yuval Tassa, Leonard Hasenclever, Vu Pham, Tom Erez, Greg Wayne, Nicolas Heess

Keywords: reinforcement learning, object interaction, motor control, physics-based character

Abstract Paper Similar Papers

Abstract: We address the longstanding challenge of producing flexible, realistic humanoid character controllers that can perform diverse whole-body tasks involving object interactions. This challenge is central to a variety of fields, from graphics and animation to robotics and motor neuroscience. Our physics-based environment uses realistic actuation and first-person perception - including touch sensors and egocentric vision - with a view to producing active-sensing behaviors (e.g. gaze direction), transferability to real robots, and comparisons to the biology. We develop an integrated neural-network based approach consisting of a motor primitive module, human demonstrations, and an instructed reinforcement learning regime with curricula and task variations. We demonstrate the utility of our approach for several tasks, including goal-conditioned box carrying and ball catching, and we characterize its behavioral robustness. The resulting controllers can be deployed in real-time on a standard PC.1

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3386569.3392474#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at SIGGRAPH 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 13:27 
 0
 0
 0
 0
 4:51 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 15:17 
 0
 0
 0
 0
 13:42 
 0
 0
 0
 0
 4:52 
 0
 0
 0
 0
 9:58 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 14:38 
 0
 0
 0
 0
 3:12 
 0
 0
 0
 0
 5:13 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 3:06 
 0
 0
 0
 0
 10:01 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 14:54 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 14:02 
 0
 0
 0
 0
 10:53 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 18:00 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 5:24