08/12/2020

Best Practices for Data-Efficient Modeling in NLG:How to Train Production-Ready Neural Models with Less Data

Ankit Arun, Soumya Batra, Vikas Bhardwaj, Ashwini Challa, Pinar Donmez, Peyman Heidari, Hakan Inan, Shashank Jain, Anuj Kumar, Shawn Mei, Karthik Mohan, Michael White

Keywords:

Abstract Paper Similar Papers

Abstract: Natural language generation (NLG) is a critical component in conversational systems, owing to its role of formulating a correct and natural text response. Traditionally, NLG components have been deployed using template-based solutions. Although neural network solutions recently developed in the research community have been shown to provide several benefits, deployment of such model-based solutions has been challenging due to high latency, correctness issues, and high data needs. In this paper, we present approaches that have helped us deploy data-efficient neural solutions for NLG in conversational systems to production. We describe a family of sampling and modeling techniques to attain production quality with light-weight neural network models using only a fraction of the data that would be necessary otherwise, and show a thorough comparison between each. Our results show that domain complexity dictates the appropriate approach to achieve high data efficiency. Finally, we distill the lessons from our experimental findings into a list of best practices for production-level NLG model development, and present them in a brief runbook. Importantly, the end products of all of the techniques are small sequence-to-sequence models (~2Mb) that we can reliably deploy in production. These models achieve the same quality as large pretrained models (~1Gb) as judged by human raters.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6116-best-practices-for-data-efficient-modeling-in-nlghow-to-train-production-ready-neural-models-with-less-data
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING Workshops 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 5:59 
 0
 0
 0
 0
 10:53 
 0
 0
 0
 0
 15:04 
 0
 0
 0
 1
 9:29 
 0
 0
 1
 1
 4:58 
 0
 0
 0
 0
 11:48 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 16:58 
 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 12:12 
 0
 0
 0
 1
 10:41 
 0
 0
 0
 0
 14:45 
 0
 0
 0
 0
 15:39 
 0
 0
 0
 0
 8:46 
 0
 0
 0
 0
 12:32 
 0
 0
 0
 0
 6:36 
 0
 0
 0
 0
 19:10 
 0
 0
 0
 0
 10:13 
 0
 0
 0
 0
 10:57 
 0
 0
 0
 0
 12:47 
 0
 0
 0
 0
 18:56 
 0
 0
 0
 0
 4:59 
 1
 1
 0
 0
 14:02 
 0
 0
 0
 0
 12:02 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 11:54 
 0
 0
 0
 0
 14:27 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 6:02 
 0
 0
 0
 0
 6:52 
 0
 0
 0
 0
 17:37 
 0
 0
 0
 0
 17:06 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 12:23 
 0
 0
 0
 0
 8:01 
 0
 0
 0
 0
 12:08 
 0
 0
 0
 0
 10:28 
 0
 0
 0
 0
 9:55 
 0
 0
 0
 0
 8:45