19/10/2020

A toolkit for managing multiple crowdsourced top-k queries

Caihua Shan, Leong Hou U, Nikos Mamoulis, Reynold Cheng

Keywords: top-k query, crowdsourcing, query management

Abstract Paper Similar Papers

Abstract: Crowdsourced ranking and top-k queries have attracted significant attention recently. Their goal is to combine human cognitive abilities and machine intelligence to rank computer hostile but human friendly items. Many task assignment algorithms and inference approaches have been proposed to publish suitable micro-tasks to the crowd, obtain informative answers, and aggregate the rank from noisy human answers. However, they are all focused on single query processing. To the best of our knowledge, no prior work helps users manage multiple crowdsourced top-k queries. We propose a toolkit, which seamlessly works with most existing inference and task assignment methods, for crowdsourced top-k query management. Our toolkit attempts to optimize human resource allocation and continuously monitors query quality at any stage of the crowdsourcing process. A user can terminate a query early, if the estimated quality already fulfills her requirements. Besides, the toolkit provides user-friendly interfaces for users to initialize queries, monitor execution status, and do more operations by hand.

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3340531.3417415#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at CIKM 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 14:19 
 0
 0
 0
 0
 3:23 
 0
 0
 0
 0
 19:59 
 0
 0
 0
 0
 12:16 
 0
 0
 0
 0
 4:53 
 0
 0
 0
 0
 12:11 
 0
 0
 0
 0
 21:09 
 0
 0
 0
 0
 13:48 
 0
 0
 0
 0
 14:21 
 0
 0
 0
 0
 13:07 
 0
 0
 0
 0
 8:04 
 0
 0
 0
 0
 9:36 
 0
 0
 0
 0
 8:40 
 0
 0
 0
 0
 10:34 
 0
 0
 0
 0
 11:57 
 0
 0
 0
 0
 11:37 
 0
 0
 0
 0
 4:47 
 0
 0
 0
 0
 13:19 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 7:16 
 0
 0
 0
 0
 4:47 
 0
 0
 0
 1
 11:33 
 0
 0
 0
 0
 21:12 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 8:11 
 0
 0
 0
 0
 10:25 
 0
 0
 0
 0
 9:58 
 0
 0
 0
 0
 4:23 
 0
 0
 0
 0
 9:49 
 0
 0
 0
 0
 3:10 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 11:32 
 0
 0
 0
 0
 14:11 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 11:07 
 0
 0
 0
 0
 11:48 
 0
 0
 0
 0
 4:36 
 0
 0
 0
 0
 9:41 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 15:23