04/07/2020

The Unstoppable Rise of Computational Linguistics in Deep Learning

James Henderson

Keywords: Deep Learning, natural tasks, natural understanding, neural networks

Abstract Paper Similar Papers

Abstract: In this paper, we trace the history of neural networks applied to natural language understanding tasks, and identify key contributions which the nature of language has made to the development of neural network architectures. We focus on the importance of variable binding and its instantiation in attention-based models, and argue that Transformer is not a sequence model but an induced-structure model. This perspective leads to predictions of the challenges facing research in deep learning architectures for natural language understanding.

 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACL 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 11:03 
 0
 0
 0
 0
 9:42 
 0
 0
 0
 0
 7:00 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 5:15 
 0
 0
 0
 0
 9:08 
 0
 0
 0
 0
 11:48 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 12:09 
 0
 0
 0
 0
 14:44 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 14:25 
 0
 0
 0
 0
 15:32 
 0
 0
 0
 0
 10:59 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 14:26 
 0
 0
 0
 0
 14:44 
 0
 0
 0
 0
 14:46 
 0
 0
 0
 0
 11:59 
 0
 0
 0
 0
 8:19 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 14:30 
 0
 0
 0
 0
 3:28 
 0
 0
 0
 0
 11:55 
 0
 0
 0
 0
 10:13 
 0
 0
 0
 0
 15:08 
 0
 0
 0
 0
 11:05 
 0
 0
 0
 0
 10:53 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 12:12 
 0
 0
 0
 0
 11:47 
 0
 0
 0
 0
 10:57 
 0
 0
 0
 0
 12:00 
 0
 0
 0
 0
 12:01 
 0
 0
 0
 0
 9:58 
 0
 0
 0
 0
 15:43 
 0
 0
 0
 0
 10:58 
 0
 0
 0
 0
 7:31