04/07/2020

Parallel Sentence Mining by Constrained Decoding

Pinzhen Chen, Nikolay Bogoychev, Kenneth Heafield, Faheem Kirefu

Keywords: Parallel Mining, decoding, Constrained Decoding, neural translation

Abstract Paper Similar Papers

Abstract: We present a novel method to extract parallel sentences from two monolingual corpora, using neural machine translation. Our method relies on translating sentences in one corpus, but constraining the decoding by a prefix tree built on the other corpus. We argue that a neural machine translation system by itself can be a sentence similarity scorer and it efficiently approximates pairwise comparison with a modified beam search. When benchmarked on the BUCC shared task, our method achieves results comparable to other submissions.

 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACL 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 11:30 
 0
 0
 0
 0
 14:32 
 0
 0
 0
 0
 6:31 
 0
 0
 0
 0
 14:32 
 0
 0
 0
 0
 14:24 
 0
 0
 0
 0
 7:18 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 8:03 
 0
 0
 0
 0
 10:57 
 0
 0
 0
 0
 9:30 
 0
 0
 0
 0
 14:05 
 0
 0
 0
 0
 12:00 
 0
 0
 0
 0
 5:51 
 0
 0
 0
 0
 10:18 
 0
 0
 0
 0
 5:22 
 0
 0
 0
 0
 12:35 
 0
 0
 0
 0
 3:24 
 0
 0
 0
 0
 11:37 
 0
 0
 0
 0
 12:07 
 0
 0
 0
 0
 6:48 
 0
 0
 0
 0
 10:10 
 0
 0
 0
 0
 10:00 
 0
 0
 0
 0
 9:34 
 0
 0
 0
 0
 16:00 
 0
 0
 0
 0
 12:20 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 11:36 
 0
 0
 0
 0
 8:39 
 0
 0
 0
 0
 12:09 
 0
 0
 0
 0
 4:50 
 0
 0
 0
 0
 17:39 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 18:52 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 12:05 
 0
 0
 0
 0
 6:45 
 0
 0
 0
 0
 11:11 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 16:47 
 0
 0
 0
 0
 13:53