19/10/2020

ORCAS: 20 million clicked query-document pairs for analyzing search

Nick Craswell, Daniel Campos, Bhaskar Mitra, Emine Yilmaz, Bodo Billerbeck

Keywords: user behavior data, web search, deep learning

Abstract Paper Similar Papers

Abstract: Users of Web search engines reveal their information needs through queries and clicks, making click logs a useful asset for information retrieval. However, click logs have not been publicly released for academic use, because they can be too revealing of personally or commercially sensitive information. This paper describes a click data release related to the TREC Deep Learning Track document corpus. After aggregation and filtering, including a k -anonymity requirement, we find 1.4 million of the TREC DL URLs have 18 million connections to 10 million distinct queries. Our dataset of these queries and connections to TREC documents is of similar size to proprietary datasets used in previous papers on query mining and ranking. We perform some preliminary experiments using the click data to augment the TREC DL training data, offering by comparison: 28x more queries, with 49x more connections to 4.4x more URLs in the corpus. We present a description of the dataset’s generation process, characteristics, use in ranking and other potential uses.

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3340531.3412779#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at CIKM 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 10:21 
 0
 0
 0
 0
 9:58 
 0
 0
 0
 0
 11:48 
 0
 0
 0
 0
 9:24 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 10:28 
 0
 0
 0
 0
 10:01 
 0
 0
 0
 0
 9:38 
 0
 0
 0
 0
 14:41 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 13:25 
 0
 0
 0
 0
 11:23 
 0
 0
 0
 0
 14:44 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 4:47 
 0
 0
 0
 0
 9:53 
 0
 0
 0
 0
 10:40 
 0
 0
 0
 0
 15:43 
 0
 0
 0
 0
 10:14 
 0
 0
 0
 0
 11:58 
 0
 0
 0
 0
 7:16 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 8:46 
 0
 0
 0
 0
 14:21 
 0
 0
 0
 0
 9:16 
 0
 0
 0
 0
 6:38 
 0
 0
 0
 0
 3:07 
 0
 0
 0
 0
 11:35 
 0
 0
 0
 0
 16:13 
 0
 0
 0
 0
 12:04 
 0
 0
 0
 0
 11:32 
 0
 0
 0
 0
 9:00 
 0
 0
 0
 0
 11:07 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 11:15 
 0
 0
 0
 0
 1:02 
 0
 0
 0
 0
 16:27 
 0
 0
 0
 0
 6:58 
 0
 0
 0
 0
 11:05