02/02/2021

Semantics-Aware Inferential Network for Natural Language Understanding

Shuiliang Zhang, Hai Zhao, Junru Zhou, Xi Zhou, Xiang Zhou

Keywords:

Abstract Paper Similar Papers

Abstract: For natural language understanding tasks, either machine reading comprehension or natural language inference, both semantics-aware and inference are favorable features of the concerned modeling for better understanding performance. Thus we propose a Semantics-Aware Inferential Network (SAIN) to meet such a motivation. Taking explicit contextualized semantics as a complementary input, the inferential module of SAIN enables a series of reasoning steps over semantic clues through an attention mechanism. By stringing these steps, the inferential network effectively learns to perform iterative reasoning which incorporates both explicit semantics and contextualized representations. In terms of well pre-trained language models as front-end encoder, our model achieves significant improvement on 11 tasks including machine reading comprehension and natural language inference.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38949184
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 9:42 
 0
 0
 0
 0
 13:55 
 0
 0
 0
 0
 11:41 
 0
 0
 0
 0
 8:58 
 0
 0
 0
 0
 16:04 
 0
 0
 0
 0
 6:16 
 0
 0
 0
 0
 13:17 
 0
 0
 0
 0
 7:17 
 0
 0
 0
 0
 4:25 
 0
 0
 0
 0
 3:51 
 0
 0
 0
 0
 12:16 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 14:41 
 0
 0
 0
 0
 19:21 
 0
 0
 0
 0
 11:04 
 0
 0
 0
 0
 5:21 
 0
 0
 0
 0
 9:08 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 12:00 
 0
 0
 0
 0
 10:16 
 0
 0
 0
 0
 14:47 
 0
 0
 0
 0
 8:30 
 0
 0
 0
 0
 13:16 
 0
 0
 0
 0
 4:13 
 0
 0
 0
 0
 7:22 
 0
 0
 0
 0
 10:59 
 0
 0
 0
 0
 15:55 
 0
 0
 0
 0
 12:06 
 0
 0
 0
 0
 8:53 
 0
 0
 0
 0
 16:25 
 0
 0
 0
 0
 8:48 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 17:06 
 0
 0
 0
 0
 12:06 
 0
 0
 0
 0
 15:00 
 0
 0
 0
 0
 17:37 
 0
 0
 0
 0
 2:59 
 0
 0
 0
 0
 6:36 
 0
 0
 0
 0
 11:16 
 0
 0
 0
 0
 7:02