01/07/2020

A Generative Approach to Titling and Clustering Wikipedia Sections

Anjalie Field, Sascha Rothe, Simon Baumgartner, Cong Yu, Abe Ittycheriah

Keywords:

Abstract Paper Similar Papers

Abstract: We evaluate the performance of transformer encoders with various decoders for information organization through a new task: generation of section headings for Wikipedia articles. Our analysis shows that decoders containing attention mechanisms over the encoder output achieve high-scoring results by generating extractive text. In contrast, a decoder without attention better facilitates semantic encoding and can be used to generate section embeddings. We additionally introduce a new loss function, which further encourages the decoder to generate high-quality embeddings.

 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACL Workshops virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 1
 2:44 
 0
 0
 0
 0
 11:53 
 0
 0
 0
 0
 11:23 
 0
 0
 0
 0
 12:01 
 0
 0
 0
 0
 12:05 
 0
 0
 0
 0
 12:20 
 0
 0
 0
 0
 12:19 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 13:48 
 0
 0
 0
 0
 15:11 
 0
 0
 0
 0
 17:38 
 0
 0
 0
 0
 3:24 
 0
 0
 0
 0
 11:33 
 0
 0
 0
 0
 10:14 
 0
 0
 0
 0
 19:25 
 0
 0
 0
 0
 29:54 
 0
 0
 0
 0
 5:18 
 0
 0
 0
 0
 10:25 
 0
 0
 0
 0
 8:44 
 0
 0
 0
 0
 19:21 
 0
 0
 0
 0
 11:16 
 0
 0
 0
 0
 12:01 
 0
 0
 0
 0
 19:28 
 0
 0
 0
 0
 14:48 
 0
 0
 0
 0
 14:27 
 0
 0
 0
 0
 14:19 
 0
 0
 0
 0
 7:03 
 0
 0
 0
 0
 12:41 
 0
 0
 0
 0
 7:01 
 0
 0
 0
 0
 17:06 
 0
 0
 0
 1
 11:55 
 0
 0
 0
 0
 11:37 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 14:34 
 0
 0
 0
 0
 16:10 
 0
 0
 0
 0
 13:29 
 0
 0
 0
 0
 14:01 
 0
 0
 0
 0
 12:11 
 0
 0
 0
 0
 6:14 
 0
 0
 0
 0
 6:41