25/07/2020

The curious case of IR explainability: Explaining document scores within and across ranking models

Procheta Sen, Debasis Ganguly, Manisha Verma, Gareth J. F. Jones

Keywords: regression, ranking model, explainability

Abstract Paper Similar Papers

Abstract: It is often useful for an IR practitioner to analyze the similarity function of an IR model, or for a non-technical search engine user to understand why a document was shown at a certain rank, in terms of the three fundamental aspects of a similarity function, namely the a) frequency of a term in a document, b) frequency of a term in a collection and c) the length of a document. We propose a general methodology of approximating an IR model as the coefficients of a linear function of these three fundamental aspects (and an additional aspect of semantic similarity between terms for neural models), which potentially can help IR practitioners to optimize the relative importance of each aspect on specific document collection and types of queries. Our analysis shows that the coefficients, which represent the relative importance of the three fundamental aspects, are useful to compare a model’s different parametric instantiations or compare across different models.

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3397271.3401286#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at SIGIR 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 17:45 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 4:48 
 0
 0
 0
 0
 10:03 
 0
 0
 0
 0
 6:34 
 0
 0
 0
 0
 7:04 
 0
 0
 0
 0
 10:12 
 0
 0
 0
 0
 15:19 
 0
 0
 0
 0
 2:51 
 0
 0
 0
 0
 14:50 
 0
 0
 0
 0
 7:52 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 13:18 
 0
 0
 0
 0
 12:03 
 0
 0
 0
 0
 10:46 
 0
 0
 0
 0
 5:34 
 0
 0
 0
 0
 15:43 
 0
 0
 0
 0
 13:27 
 0
 0
 0
 0
 12:44 
 0
 0
 0
 0
 16:18 
 0
 0
 0
 0
 14:34 
 0
 0
 0
 0
 11:47 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 26:26 
 0
 0
 0
 0
 14:48 
 0
 0
 0
 0
 10:19 
 0
 0
 0
 0
 3:18 
 0
 0
 0
 0
 5:26 
 0
 0
 0
 0
 16:34 
 0
 0
 0
 0
 11:57 
 0
 0
 0
 0
 6:28 
 0
 0
 0
 0
 11:30 
 0
 0
 0
 0
 6:47 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 3:28 
 0
 0
 0
 0
 11:54 
 0
 0
 0
 0
 14:35 
 0
 0
 0
 0
 10:03 
 0
 0
 0
 0
 10:53