16/11/2020

An Analysis of Natural Language Inference Benchmarks through the Lens of Negation

Md Mosharaf Hossain, Venelin Kovatchev, Pranoy Dutta, Tiffany Kao, Elizabeth Wei, Eduardo Blanco

Keywords: natural inference, inference judgments, transformers, negation

Abstract Paper Similar Papers

Abstract: Negation is underrepresented in existing natural language inference benchmarks. Additionally, one can often ignore the few negations in existing benchmarks and still make the right inference judgments. In this paper, we present a new benchmark for natural language inference in which negation plays a critical role. We also show that state-of-the-art transformers struggle making inference judgments with the new pairs.

 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at EMNLP 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 13:17 
 0
 0
 0
 0
 11:59 
 0
 0
 0
 0
 14:09 
 0
 0
 0
 1
 11:09 
 0
 0
 0
 0
 7:02 
 0
 0
 0
 0
 12:39 
 0
 0
 0
 0
 11:26 
 0
 0
 0
 0
 16:46 
 0
 0
 0
 0
 15:05 
 0
 0
 0
 0
 11:39 
 0
 0
 0
 0
 15:03 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 9:13 
 0
 0
 0
 0
 11:11 
 0
 0
 0
 0
 18:56 
 0
 0
 0
 0
 4:22 
 0
 0
 0
 0
 15:34 
 0
 0
 0
 0
 4:20 
 0
 0
 0
 0
 9:11 
 0
 0
 0
 0
 3:04 
 0
 0
 0
 0
 14:33 
 0
 0
 0
 0
 18:33 
 0
 0
 0
 0
 15:07 
 0
 0
 0
 0
 11:43 
 0
 0
 0
 0
 14:54 
 0
 0
 0
 0
 4:29 
 0
 0
 0
 0
 9:06 
 0
 0
 0
 0
 11:12 
 0
 0
 0
 0
 14:31 
 0
 0
 0
 0
 11:42 
 0
 0
 0
 0
 11:34 
 0
 0
 0
 0
 12:43 
 0
 0
 0
 0
 17:57 
 0
 0
 0
 0
 13:17 
 0
 0
 0
 0
 11:26 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 14:56 
 0
 0
 0
 0
 6:38 
 0
 0
 0
 0
 10:12 
 0
 0
 0
 0
 4:37