02/02/2021

Meta-Learning Effective Exploration Strategies for Contextual Bandits

Amr Sharaf, Hal Daumé III

Keywords:

Abstract Paper Similar Papers

Abstract: In contextual bandits, an algorithm must choose actions given ob- served contexts, learning from a reward signal that is observed only for the action chosen. This leads to an exploration/exploitation trade-off: the algorithm must balance taking actions it already believes are good with taking new actions to potentially discover better choices. We develop a meta-learning algorithm, Mêlée, that learns an exploration policy based on simulated, synthetic con- textual bandit tasks. Mêlée uses imitation learning against these simulations to train an exploration policy that can be applied to true contextual bandit tasks at test time. We evaluate Mêlée on both a natural contextual bandit problem derived from a learning to rank dataset as well as hundreds of simulated contextual ban- dit problems derived from classification tasks. Mêlée outperforms seven strong baselines on most of these datasets by leveraging a rich feature representation for learning an exploration strategy.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948422
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 11:34 
 0
 0
 0
 0
 5:30 
 0
 0
 0
 0
 13:57 
 0
 0
 0
 0
 11:33 
 0
 0
 0
 0
 14:37 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 4:19 
 0
 0
 0
 1
 5:10 
 0
 0
 0
 0
 3:11 
 0
 0
 0
 0
 12:14 
 0
 0
 0
 0
 16:03 
 0
 0
 0
 0
 3:10 
 0
 0
 0
 0
 15:55 
 0
 0
 0
 0
 2:59 
 0
 0
 0
 0
 16:53 
 0
 0
 0
 0
 10:21 
 0
 0
 0
 0
 12:25 
 0
 0
 0
 0
 2:47 
 0
 0
 0
 0
 17:05 
 0
 0
 0
 0
 14:44 
 0
 0
 0
 0
 11:42 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 19:29 
 0
 0
 0
 0
 15:04 
 0
 0
 0
 0
 15:26 
 0
 0
 0
 0
 14:03 
 0
 0
 0
 0
 14:40 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 5:12 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 18:27 
 0
 0
 0
 0
 3:04 
 0
 0
 0
 0
 14:14 
 0
 0
 0
 0
 11:33 
 0
 0
 0
 0
 14:31 
 0
 0
 0
 0
 16:26 
 0
 0
 0
 0
 15:03 
 0
 0
 0
 0
 14:17