25/07/2020

Balancing reinforcement learning training experiences in interactive information retrieval

Limin Chen, Zhiwen Tang, Grace Hui Yang

Keywords: deep reinforcement learning, interactive IR, dynamic search

Abstract Paper Similar Papers

Abstract: Interactive Information Retrieval (IIR) and Reinforcement Learning (RL) share many commonalities, including an agent who learns while interacts, a long-term and complex goal, and an algorithm that explores and adapts. To successfully apply RL methods to IIR, one challenge is to obtain sufficient relevance labels to train the RL agents, which are infamously known as sample inefficient. However, in a text corpus annotated for a given query, it is not the relevant documents but the irrelevant documents that predominate. This would cause very unbalanced training experiences for the agent and prevent it from learning any policy that is effective. Our paper addresses this issue by using domain randomization to synthesize more relevant documents for the training. Our experimental results on the Text REtrieval Conference (TREC) Dynamic Domain (DD) 2017 Track show that the proposed method is able to boost an RL agent’s learning effectiveness by 22

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3397271.3401200#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at SIGIR 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 15:28 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 15:39 
 0
 0
 0
 0
 3:55 
 0
 0
 0
 0
 12:32 
 0
 0
 0
 1
 3:21 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 15:02 
 0
 0
 0
 0
 11:57 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 1
 5:10 
 0
 0
 0
 0
 4:51 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 13:00 
 0
 0
 0
 0
 13:17 
 0
 0
 0
 0
 15:07 
 0
 0
 0
 0
 5:18 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 13:42 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 5:16 
 0
 0
 0
 0
 10:57 
 0
 0
 0
 0
 3:15 
 0
 0
 0
 0
 11:15 
 0
 0
 0
 0
 10:30 
 0
 0
 0
 0
 5:20 
 0
 0
 0
 0
 3:43 
 0
 0
 0
 0
 7:25 
 0
 0
 0
 0
 13:31 
 0
 0
 0
 0
 19:21 
 0
 0
 0
 0
 6:56 
 1
 0
 0
 0
 5:08 
 0
 0
 0
 0
 11:40 
 0
 0
 0
 1
 16:40 
 0
 0
 0
 0
 3:00 
 0
 0
 0
 0
 14:26 
 0
 0
 0
 0
 11:51 
 0
 0
 0
 0
 4:19 
 0
 0
 0
 0
 14:21