08/12/2020

Leveraging User Paraphrasing Behavior In Dialog Systems To Automatically Collect Annotations For Long-Tail Utterances

Tobias Falke, Markus Boese, Daniil Sorokin, Caglar Tirkaz, Patrick Lehnen

Keywords:

Abstract Paper Similar Papers

Abstract: In large-scale commercial dialog systems, users express the same request in a wide variety of alternative ways with a long tail of less frequent alternatives. Handling the full range of this distribution is challenging, in particular when relying on manual annotations. However, the same users also provide useful implicit feedback as they often paraphrase an utterance if the dialog system failed to understand it. We propose MARUPA, a method to leverage this type of feedback by creating annotated training examples from it. MARUPA creates new data in a fully automatic way, without manual intervention or effort from annotators, and specifically for currently failing utterances. By re-training the dialog system on this new data, accuracy and coverage for long-tail utterances can be improved. In experiments, we study the effectiveness of this approach in a commercial dialog system across various domains and three languages.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6112-leveraging-user-paraphrasing-behavior-in-dialog-systems-to-automatically-collect-annotations-for-long-tail-utterances
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING Workshops 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 16:08 
 1
 0
 0
 0
 3:29 
 0
 0
 0
 0
 14:56 
 0
 0
 0
 0
 12:42 
 0
 0
 0
 0
 11:58 
 0
 0
 0
 0
 17:37 
 0
 0
 0
 0
 6:52 
 0
 0
 0
 0
 11:27 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 11:28 
 0
 0
 0
 0
 12:16 
 0
 0
 0
 0
 12:55 
 0
 0
 0
 0
 11:09 
 0
 0
 0
 0
 10:04 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 10:16 
 0
 0
 0
 0
 9:57 
 0
 0
 0
 0
 11:16 
 0
 0
 0
 0
 11:18 
 0
 0
 0
 0
 6:05 
 0
 0
 0
 0
 12:03 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 6:54 
 0
 0
 0
 0
 11:38 
 0
 0
 0
 0
 11:29 
 0
 0
 0
 0
 11:52 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 5:13 
 0
 0
 0
 0
 14:47 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 1
 9:39 
 0
 0
 0
 0
 6:58 
 0
 0
 0
 1
 3:14 
 0
 0
 0
 0
 23:21 
 0
 0
 0
 0
 14:41 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 14:09 
 0
 0
 0
 0
 3:21 
 0
 0
 0
 0
 7:04