08/12/2020

Seeing the World through Text: Evaluating Image Descriptions for Commonsense Reasoning in Machine Reading Comprehension

Diana Galvan-Sosa, Jun Suzuki, Kyosuke Nishida, Koji Matsuda, Kentaro Inui

Keywords:

Abstract Paper Similar Papers

Abstract: Despite recent achievements in natural language understanding, reasoning over commonsense knowledge still represents a big challenge to AI systems. As the name suggests, common sense is related to perception and as such, humans derive it from experience rather than from literary education. Recent works in the NLP and the computer vision field have made the effort of making such knowledge explicit using written language and visual inputs, respectively. Our premise is that the latter source fits better with the characteristics of commonsense acquisition. In this work, we explore to what extent the descriptions of real-world scenes are sufficient to learn common sense about different daily situations, drawing upon visual information to answer script knowledge questions.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6568-seeing-the-world-through-text-evaluating-image-descriptions-for-commonsense-reasoning-in-machine-reading-comprehension
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING Workshops 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 12:17 
 0
 0
 0
 0
 3:23 
 0
 0
 0
 0
 3:04 
 0
 0
 0
 0
 11:55 
 0
 0
 0
 0
 11:03 
 0
 0
 0
 0
 10:29 
 0
 0
 0
 0
 20:36 
 0
 0
 0
 0
 12:08 
 0
 0
 0
 0
 17:52 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 19:17 
 0
 0
 0
 0
 12:43 
 0
 0
 0
 0
 13:55 
 0
 0
 0
 0
 12:16 
 0
 0
 0
 0
 10:33 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 7:31 
 0
 0
 0
 0
 14:48 
 0
 0
 0
 0
 9:04 
 0
 0
 0
 0
 14:54 
 0
 0
 0
 0
 4:43 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 4:29 
 0
 0
 0
 0
 11:24 
 0
 0
 0
 0
 11:20 
 0
 0
 0
 0
 16:06 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 11:24 
 0
 0
 0
 0
 13:17 
 0
 0
 0
 0
 17:44 
 0
 0
 0
 0
 21:03 
 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 12:31 
 0
 0
 0
 0
 11:16 
 0
 0
 0
 0
 6:59 
 0
 0
 0
 0
 11:26 
 0
 0
 0
 0
 5:43