02/02/2021

Complexity and Algorithms for Exploiting Quantal Opponents in Large Two-Player Games

David Milec, Jakub Černý, Viliam Lisý, Bo An

Keywords:

Abstract Paper Similar Papers

Abstract: Solution concepts of traditional game theory assume entirely rational players; therefore, their ability to exploit subrational opponents is limited. One type of subrationality that describes human behavior well is the quantal response. While there exist algorithms for computing solutions against quantal opponents, they either do not scale or may provide strategies that are even worse than the entirely-rational Nash strategies. This paper aims to analyze and propose scalable algorithms for computing effective and robust strategies against a quantal opponent in normal-form and extensive-form games. Our contributions are: (1) we define two different solution concepts related to exploiting quantal opponents and analyze their properties; (2) we prove that computing these solutions is computationally hard; (3) therefore, we evaluate several heuristic approximations based on scalable counterfactual regret minimization (CFR); and (4) we identify a CFR variant that exploits the bounded opponents better than the previously used variants while being less exploitable by the worst-case perfectly-rational opponent.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948488
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 16:07 
 0
 0
 0
 0
 15:52 
 0
 0
 0
 0
 17:15 
 0
 0
 0
 0
 4:49 
 0
 0
 0
 0
 15:16 
 1
 1
 0
 0
 3:29 
 0
 0
 0
 0
 17:09 
 0
 0
 0
 0
 18:34 
 0
 0
 0
 0
 5:12 
 0
 0
 0
 0
 14:59 
 0
 0
 0
 0
 11:21 
 0
 0
 0
 0
 15:07 
 1
 0
 0
 0
 14:01 
 0
 0
 0
 0
 12:57 
 0
 0
 0
 0
 20:29 
 0
 0
 0
 0
 18:07 
 0
 0
 0
 0
 13:27 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 15:55 
 0
 0
 0
 0
 17:06 
 0
 0
 0
 0
 23:42 
 0
 0
 0
 0
 5:29 
 0
 0
 0
 0
 11:52 
 0
 0
 0
 0
 14:32 
 0
 0
 0
 0
 5:18 
 0
 0
 0
 0
 9:41 
 0
 0
 0
 0
 17:43 
 0
 0
 0
 1
 3:28 
 0
 0
 0
 0
 3:11 
 0
 0
 0
 0
 16:35 
 0
 0
 0
 0
 21:56 
 0
 0
 0
 0
 14:29 
 0
 0
 0
 0
 4:52 
 0
 0
 0
 0
 16:33 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 16:50 
 0
 0
 0
 0
 15:21 
 0
 0
 0
 0
 16:47 
 0
 0
 0
 0
 3:15