02/02/2021

Value-Decomposition Multi-Agent Actor-Critics

Jianyu Su, Stephen Adams, Peter Beling

Keywords:

Abstract Paper Similar Papers

Abstract: The exploitation of extra state information has been an active research area in multi-agent reinforcement learning (MARL). QMIX represents the joint action-value using a non-negative function approximator and achieves the best performance on the StarCraft II micromanagement testbed, a common MARL benchmark. However, our experiments demonstrate that, in some cases, QMIX performs sub-optimally with the A2C framework, a training paradigm that promotes algorithm training efficiency. To obtain a reasonable trade-off between training efficiency and algorithm performance, we extend value-decomposition to actor-critic methods that are compatible with A2C and propose a novel actor-critic framework, value-decomposition actor-critic (VDAC). We evaluate VDAC on the StarCraft II micromanagement task and demonstrate that the proposed framework improves median performance over other actor-critic methods. Furthermore, we use a set of ablation experiments to identify the key factors that contribute to the performance of VDAC.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948137
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 15:50 
 0
 0
 0
 0
 14:35 
 0
 0
 0
 0
 13:10 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 5:34 
 0
 0
 0
 1
 9:03 
 0
 0
 0
 0
 4:38 
 0
 0
 0
 0
 2:42 
 0
 0
 0
 0
 13:11 
 0
 0
 0
 0
 13:24 
 0
 0
 0
 0
 15:45 
 0
 0
 0
 0
 5:16 
 0
 0
 0
 0
 4:52 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 20:06 
 0
 0
 0
 0
 14:15 
 0
 0
 0
 0
 13:51 
 0
 0
 0
 0
 18:46 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 2:44 
 0
 0
 0
 0
 6:42 
 0
 0
 0
 0
 4:38 
 1
 0
 0
 0
 5:06 
 0
 0
 0
 0
 14:49 
 0
 0
 0
 0
 13:45 
 0
 0
 0
 0
 8:13 
 0
 0
 0
 0
 13:17 
 0
 0
 0
 0
 5:38 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 4:10 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 15:04 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 12:04 
 0
 0
 0
 0
 14:31 
 0
 0
 0
 0
 16:11 
 0
 0
 0
 0
 12:25