25/07/2020

A reinforcement learning framework for relevance feedback

Ali Montazeralghaem, Hamed Zamani, James Allan

Keywords: reinforcement learning, query language model, relevance feedback model, neural network

Abstract Paper Similar Papers

Abstract: We present RML, the first known general reinforcement learning framework for relevance feedback that directly optimizes any desired retrieval metric, including precision-oriented, recall-oriented, and even diversity metrics: RML can be easily extended to directly optimize any arbitrary user satisfaction signal. Using the RML framework, we can select effective feedback terms and weight them appropriately, improving on past methods that fit parameters to feedback algorithms using heuristic approaches or methods that do not directly optimize for retrieval performance. Learning an effective relevance feedback model is not trivial since the true feedback distribution is unknown. Experiments on standard TREC collections compare RML to existing feedback algorithms, demonstrate the effectiveness of RML at optimizing for MAP and α-n DCG, and show the impact on related measures.

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3397271.3401099#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at SIGIR 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 1
 9:03 
 0
 0
 0
 0
 6:40 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 15:50 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 5:43 
 0
 0
 0
 0
 20:10 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 19:02 
 0
 0
 0
 0
 11:27 
 0
 0
 0
 0
 16:11 
 0
 0
 0
 0
 14:06 
 0
 0
 0
 0
 15:12 
 0
 0
 0
 0
 19:12 
 0
 0
 0
 0
 9:48 
 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 5:08 
 0
 1
 0
 0
 4:59 
 0
 0
 0
 0
 14:35 
 0
 0
 0
 0
 15:19 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 21:30 
 0
 0
 0
 0
 11:18 
 0
 0
 0
 0
 18:39 
 0
 0
 0
 0
 4:49 
 0
 0
 0
 0
 4:33 
 0
 0
 0
 0
 11:55 
 0
 0
 0
 0
 10:45 
 0
 0
 0
 0
 5:59 
 0
 0
 0
 0
 5:18 
 0
 0
 0
 0
 15:00 
 0
 0
 0
 0
 9:58 
 0
 0
 0
 0
 0:57 
 0
 0
 0
 0
 4:31 
 0
 0
 0
 0
 15:18 
 0
 0
 0
 0
 6:40 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 12:21 
 0
 0
 0
 0
 5:34