04/07/2020

jiant: A Software Toolkit for Research on General-Purpose Text Understanding Models

Yada Pruksachatkun, Phil Yeres, Haokun Liu, Jason Phang, Phu Mon Htut, Alex Wang, Ian Tenney, Samuel R. Bowman

Keywords: multitask learning, probing, transfer learning, multitask training

Abstract Paper Similar Papers

Abstract: We introduce jiant, an open source toolkit for conducting multitask and transfer learning experiments on English NLU tasks. jiant enables modular and configuration driven experimentation with state-of-the-art models and a broad set of tasks for probing, transfer learning, and multitask training experiments. jiant implements over 50 NLU tasks, including all GLUE and SuperGLUE benchmark tasks. We demonstrate that jiant reproduces published performance on a variety of tasks and models, e.g., RoBERTa and BERT.

 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACL 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 10:36 
 0
 0
 0
 0
 8:51 
 0
 0
 0
 0
 4:03 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 4:42 
 0
 0
 0
 0
 8:30 
 0
 0
 0
 0
 15:28 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 7:00 
 0
 0
 0
 0
 29:33 
 0
 0
 0
 0
 14:00 
 0
 0
 0
 0
 11:43 
 0
 0
 0
 0
 15:00 
 0
 0
 0
 0
 6:45 
 0
 0
 0
 0
 10:22 
 0
 0
 0
 0
 9:52 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 11:18 
 0
 0
 0
 0
 11:05 
 0
 0
 0
 0
 10:40 
 0
 0
 0
 0
 5:58 
 0
 0
 0
 0
 15:41 
 0
 0
 0
 0
 4:42 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 2:49 
 0
 0
 0
 0
 8:03 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 13:09 
 0
 0
 0
 0
 3:23 
 0
 0
 0
 0
 10:06 
 0
 0
 0
 0
 16:17 
 0
 0
 0
 0
 11:55 
 0
 0
 0
 0
 11:15 
 0
 0
 0
 0
 6:16 
 0
 0
 0
 0
 14:48 
 0
 0
 0
 0
 10:32 
 0
 0
 0
 0
 4:28 
 0
 0
 0
 0
 6:59 
 0
 0
 0
 0
 9:14 
 0
 0
 0
 0
 10:44