02/02/2021

Exploration via State influence Modeling

Yongxin Kang, Enmin Zhao, Kai Li, Junliang Xing

Keywords:

Abstract Paper Similar Papers

Abstract: This paper studies the challenging problem of reinforcement learning (RL) in hard exploration tasks with sparse rewards. It focuses on the exploration stage before the agent gets the first positive reward, in which case, traditional RL algorithms with simple exploration strategies often work poorly. Unlike previous methods using some attribute of a single state as the intrinsic reward to encourage exploration, this work leverages the social influence between different states to permit more efficient exploration. It introduces a general intrinsic reward construction method to evaluate the social influence of states dynamically. Three kinds of social influence are introduced for a state: conformity, power, and authority. By measuring the state’s social influence, agents quickly find the focus state during the exploration process. The proposed RL framework with state social influence evaluation works well in hard exploration task. Extensive experimental analyses and comparisons in Grid Maze and many hard exploration Atari 2600 games demonstrate its high exploration efficiency.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38947745
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 14:37 
 0
 0
 0
 0
 5:30 
 0
 0
 0
 0
 5:12 
 0
 0
 0
 0
 12:25 
 0
 0
 0
 0
 4:22 
 0
 0
 0
 0
 16:03 
 0
 0
 0
 0
 3:14 
 0
 0
 0
 0
 5:16 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 13:56 
 0
 0
 0
 0
 4:50 
 0
 0
 0
 0
 5:41 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 4:19 
 0
 0
 0
 0
 14:48 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 3:31 
 0
 0
 0
 0
 13:42 
 0
 0
 0
 0
 5:52 
 0
 0
 0
 0
 8:17 
 0
 0
 0
 0
 20:17 
 0
 0
 0
 0
 14:51 
 0
 0
 0
 0
 3:12 
 0
 0
 0
 0
 14:40 
 0
 0
 0
 0
 15:11 
 0
 0
 0
 0
 5:51 
 0
 0
 0
 0
 3:11 
 0
 0
 0
 0
 5:12 
 0
 0
 0
 0
 12:10 
 0
 0
 0
 0
 14:28 
 0
 0
 0
 0
 14:15 
 0
 0
 0
 0
 4:38 
 0
 0
 0
 0
 13:52 
 0
 0
 0
 0
 3:43 
 0
 0
 0
 0
 7:25 
 0
 0
 0
 0
 4:48 
 0
 0
 0
 0
 15:43 
 0
 0
 0
 0
 3:11 
 0
 0
 0
 0
 11:34