08/12/2020

Hitachi at SemEval-2020 Task 7: Stacking at Scale with Heterogeneous Language Models for Humor Recognition

Terufumi Morishita, Gaku Morio, Hiroaki Ozaki, Toshinori Miyoshi

Keywords:

Abstract Paper Similar Papers

Abstract: This paper describes the winning system for SemEval-2020 task 7: Assessing Humor in Edited News Headlines. Our strategy is Stacking at Scale (SaS) with heterogeneous pre-trained language models (PLMs) such as BERT and GPT-2. SaS first performs fine-tuning on numbers of PLMs with various hyperparameters and then applies a powerful stacking ensemble on top of the fine-tuned PLMs. Our experimental results show that SaS outperforms a naive average ensemble, leveraging weaker PLMs as well as high-performing PLMs. Interestingly, the results show that SaS captured non-funny semantics. Consequently, the system was ranked 1st in all subtasks by significant margins compared with other systems.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6394-hitachi-at-semeval-2020-task-7-stacking-at-scalewith-heterogeneous-language-models-for-humor-recognition
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING Workshops 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 7:57 
 0
 0
 0
 0
 4:17 
 0
 0
 0
 0
 13:03 
 0
 0
 0
 0
 11:46 
 0
 0
 0
 0
 9:50 
 0
 0
 0
 0
 12:54 
 0
 0
 0
 0
 19:02 
 0
 0
 0
 0
 14:59 
 0
 0
 0
 0
 5:56 
 0
 0
 0
 0
 12:15 
 0
 0
 0
 0
 10:36 
 0
 0
 0
 0
 24:42 
 0
 0
 0
 0
 11:05 
 0
 0
 0
 0
 4:15 
 0
 0
 0
 0
 19:28 
 0
 0
 0
 0
 14:27 
 0
 0
 0
 0
 3:10 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 13:54 
 0
 0
 0
 0
 11:06 
 0
 0
 0
 0
 4:43 
 0
 0
 0
 0
 3:24 
 0
 0
 0
 0
 4:35 
 0
 0
 0
 0
 11:13 
 0
 0
 0
 0
 4:48 
 0
 0
 0
 0
 13:01 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 5:17 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 11:21 
 0
 0
 0
 0
 3:15 
 0
 0
 0
 0
 19:57 
 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 11:26 
 0
 0
 0
 0
 5:23 
 0
 0
 0
 0
 4:52 
 0
 0
 0
 0
 13:42 
 0
 0
 0
 0
 20:06