25/07/2020

Improving contextual language models for response retrieval in multi-turn conversation

Junyu Lu, Xiancong Ren, Yazhou Ren, Ao Liu, Zenglin Xu

Keywords: pre-trained language model, augmentation, response retrieval

Abstract Paper Similar Papers

Abstract: As an important branch of current dialogue systems, retrieval-based chatbots leverage information retrieval to select proper predefined responses. Various promising architectures have been designed for boosting response retrieval, however, few researches exploit the effectiveness of the pre-trained contextual language models. In this paper, we propose two approaches to adapt contextual language models in dialogue response selection task. In detail, the Speaker Segmentation approach is designed to discriminate different speakers to fully utilize speaker characteristics. Besides, we propose the Dialogue Augmentation approach, i.e., cutting off real conversations at different time points, to enlarge the training corpora. Compared with previous works which use utterance-level representations, our augmented contextual language models are able to obtain top-hole contextual dialogue representations for deeper semantic understanding. Evaluation on three large-scale datasets has demonstrated that our proposed approaches yield better performance than existing models.

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3397271.3401255#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at SIGIR 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 1
 16:40 
 0
 0
 0
 0
 18:11 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 9:58 
 0
 0
 0
 0
 11:22 
 0
 0
 0
 0
 14:09 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 14:24 
 0
 0
 0
 1
 9:39 
 0
 0
 0
 0
 5:44 
 0
 0
 0
 1
 15:55 
 0
 0
 0
 0
 17:37 
 0
 0
 0
 0
 10:27 
 0
 0
 0
 0
 14:43 
 0
 0
 0
 0
 11:01 
 0
 0
 0
 1
 9:18 
 0
 0
 0
 1
 10:53 
 0
 0
 0
 0
 11:26 
 0
 0
 0
 0
 9:15 
 0
 0
 0
 0
 15:12 
 0
 0
 0
 0
 11:24 
 0
 0
 0
 1
 10:01 
 0
 0
 0
 0
 16:08 
 0
 0
 0
 0
 11:12 
 0
 0
 0
 0
 14:45 
 0
 0
 0
 0
 12:06 
 0
 0
 0
 0
 8:33 
 0
 0
 0
 0
 11:26 
 0
 0
 0
 0
 8:33 
 0
 0
 0
 0
 19:17 
 0
 0
 0
 0
 11:42 
 0
 0
 0
 0
 12:07 
 0
 0
 0
 0
 16:40 
 0
 0
 0
 0
 14:26 
 1
 0
 0
 0
 11:29 
 0
 0
 0
 0
 6:58 
 0
 0
 0
 0
 5:51 
 0
 0
 0
 0
 15:13 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 11:36