16/11/2020

Comparative Evaluation of Label-Agnostic Selection Bias in Multilingual Hate Speech Datasets

Nedjma Ousidhoum, Yangqiu Song, Dit-Yan Yeung

Keywords: classification, data process, topic models, selection bias

Abstract Paper Similar Papers

Abstract: Work on bias in hate speech typically aims to improve classification performance while relatively overlooking the quality of the data. We examine selection bias in hate speech in a language and label independent fashion. We first use topic models to discover latent semantics in eleven hate speech corpora, then, we present two bias evaluation metrics based on the semantic similarity between topics and search words frequently used to build corpora. We discuss the possibility of revising the data collection process by comparing datasets and analyzing contrastive case studies.

 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at EMNLP 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 1
 1
 0
 0
 7:09 
 0
 0
 0
 0
 8:03 
 0
 0
 0
 0
 11:43 
 0
 0
 0
 0
 12:59 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 8:05 
 0
 0
 0
 0
 3:12 
 0
 0
 0
 0
 10:59 
 0
 0
 0
 0
 15:22 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 11:18 
 0
 0
 0
 0
 10:56 
 0
 0
 0
 0
 10:54 
 0
 0
 0
 0
 8:51 
 0
 0
 0
 0
 10:52 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 17:44 
 0
 0
 0
 0
 2:06 
 0
 0
 0
 0
 2:51 
 0
 0
 0
 0
 10:55 
 0
 0
 0
 0
 11:19 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 2:51 
 0
 0
 0
 0
 18:26 
 0
 0
 0
 0
 18:28 
 0
 0
 0
 0
 2:47 
 0
 0
 0
 0
 15:11 
 0
 0
 0
 0
 15:13 
 0
 0
 0
 0
 11:33 
 0
 0
 0
 0
 12:41 
 0
 0
 0
 0
 10:42 
 0
 0
 0
 0
 12:18 
 0
 0
 0
 0
 12:44 
 0
 0
 0
 0
 11:42 
 0
 0
 0
 0
 8:45 
 0
 0
 0
 0
 12:07 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 7:08 
 0
 0
 0
 0
 13:58 
 0
 0
 0
 0
 11:16