25/07/2020

Query/task satisfaction and grid-based evaluation metrics under different image search intents

Kosetsu Tsukuda, Masataka Goto

Keywords: search intent, image search, search satisfaction, evaluation metrics

Abstract Paper Similar Papers

Abstract: People use web image search with various search intents: from serious demands for work to just passing time by browsing images of a favorite actor. Such a diversity of intents can influence user satisfaction and evaluation metrics, both of which are important factors for providing a better image search environment. In this paper, we investigate this influence by using a publicly available one-month field study dataset. With respect to satisfaction, we take into consideration both query-level and task-level satisfaction provided by search users. Regarding the evaluation metrics, we use grid-based evaluation metrics that incorporate user behavior specific to image search. The results of our analysis indicate that both query/task satisfaction and grid-based evaluation metrics are influenced by the image search intent. Based on the results, we show possibilities to support users’ search processes according to their search intents. We also discuss that there is still room for improvement in evaluation metrics through the development of intent-aware evaluation metrics in image search.

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3397271.3401295#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at SIGIR 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 1:33 
 0
 0
 0
 0
 10:08 
 0
 0
 0
 0
 6:09 
 0
 0
 0
 0
 5:40 
 0
 0
 0
 0
 13:55 
 0
 0
 0
 0
 14:58 
 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 14:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 15:12 
 0
 0
 0
 0
 6:38 
 0
 0
 0
 0
 13:38 
 0
 0
 0
 0
 11:24 
 0
 0
 0
 0
 14:59 
 0
 0
 0
 0
 2:28 
 0
 0
 0
 0
 11:26 
 0
 0
 0
 0
 12:48 
 0
 0
 0
 0
 10:59 
 0
 0
 0
 0
 19:11 
 0
 0
 0
 0
 15:04 
 0
 0
 0
 0
 19:21 
 0
 0
 0
 0
 14:14 
 0
 0
 0
 0
 15:07 
 0
 0
 0
 0
 13:59 
 0
 0
 0
 0
 19:21 
 0
 0
 0
 0
 5:08 
 0
 0
 0
 0
 13:15 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 16:07 
 0
 0
 0
 0
 10:06 
 0
 0
 0
 0
 3:15 
 0
 0
 0
 0
 1:02 
 0
 0
 0
 0
 9:33 
 0
 0
 0
 0
 4:24 
 0
 0
 0
 0
 15:43 
 0
 0
 0
 0
 14:52 
 0
 0
 0
 0
 5:34 
 0
 0
 0
 0
 2:25 
 0
 0
 0
 0
 19:54