02/02/2021

Data Augmentation for Abstractive Query-Focused Multi-Document Summarization

Ramakanth Pasunuru, Asli Celikyilmaz, Michel Galley, Chenyan Xiong, Yizhe Zhang, Mohit Bansal, Jianfeng Gao

Keywords:

Abstract Paper Similar Papers

Abstract: The progress in Query-focused Multi-Document Summarization (QMDS) has been limited by the lack of sufficient largescale high-quality training datasets. We present two QMDS training datasets, which we construct using two data augmentation methods: (1) transferring the commonly used single-document CNN/Daily Mail summarization dataset to create the QMDSCNN dataset, and (2) mining search-query logs to create the QMDSIR dataset. These two datasets have complementary properties, i.e., QMDSCNN has real summaries but queries are simulated, while QMDSIR has real queries but simulated summaries. To cover both these real summary and query aspects, we build abstractive end-to-end neural network models on the combined datasets that yield new state-of-the-art transfer results on DUC datasets. We also introduce new hierarchical encoders that enable a more efficient encoding of the query together with multiple documents. Empirical results demonstrate that our data augmentation and encoding methods outperform baseline models on automatic metrics, as well as on human evaluations along multiple attributes.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38949305
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 11:30 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 15:39 
 0
 0
 0
 0
 12:54 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 9:51 
 0
 0
 0
 0
 17:40 
 0
 0
 0
 0
 5:13 
 0
 0
 0
 0
 12:05 
 0
 0
 0
 0
 12:15 
 0
 0
 0
 0
 9:59 
 0
 0
 0
 0
 3:25 
 0
 0
 0
 0
 12:14 
 0
 0
 0
 0
 15:00 
 0
 0
 0
 0
 8:42 
 0
 0
 0
 0
 4:37 
 0
 0
 0
 0
 20:00 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 12:56 
 0
 0
 0
 0
 10:57 
 0
 0
 0
 0
 11:16 
 0
 0
 0
 0
 15:08 
 0
 0
 0
 1
 9:57 
 0
 0
 0
 0
 11:56 
 0
 0
 0
 0
 10:38 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 19:14 
 0
 0
 0
 0
 20:05 
 0
 0
 0
 0
 4:52 
 0
 0
 0
 0
 6:48 
 0
 0
 0
 0
 2:56 
 0
 0
 0
 0
 12:46 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 6:36 
 0
 0
 0
 0
 18:19 
 0
 0
 0
 0
 13:40 
 0
 0
 0
 0
 6:17 
 0
 0
 0
 0
 9:11 
 0
 0
 0
 0
 15:59