08/12/2020

SentiX: A Sentiment-Aware Pre-Trained Model for Cross-Domain Sentiment Analysis

Jie Zhou, Junfeng Tian, Rui Wang, Yuanbin Wu, Wenming Xiao, Liang He

Keywords:

Abstract Paper Similar Papers

Abstract: Pre-trained language models have been widely applied to cross-domain NLP tasks like sentiment analysis, achieving state-of-the-art performance. However, due to the variety of users’ emotional expressions across domains, fine-tuning the pre-trained models on the source domain tends to overfit, leading to inferior results on the target domain. In this paper, we pre-train a sentiment-aware language model (SentiX) via domain-invariant sentiment knowledge from large-scale review datasets, and utilize it for cross-domain sentiment analysis task without fine-tuning. We propose several pre-training tasks based on existing lexicons and annotations at both token and sentence levels, such as emoticons, sentiment words, and ratings, without human interference. A series of experiments are conducted and the results indicate the great advantages of our model. We obtain new state-of-the-art results in all the cross-domain sentiment analysis tasks, and our proposed SentiX can be trained with only 1% samples (18 samples) and it achieves better performance than BERT with 90% samples.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6177-sentix-a-sentiment-aware-pre-trained-model-for-cross-domain-sentiment-analysis
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 14:47 
 0
 0
 0
 0
 12:23 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 16:08 
 0
 0
 0
 0
 8:10 
 0
 0
 0
 0
 13:57 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 11:44 
 0
 0
 0
 0
 9:41 
 0
 0
 0
 0
 6:56 
 0
 0
 0
 0
 11:39 
 0
 0
 0
 0
 3:23 
 0
 0
 0
 0
 12:03 
 0
 0
 0
 0
 10:16 
 0
 0
 0
 0
 11:42 
 0
 0
 0
 0
 9:54 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 19:06 
 0
 0
 0
 0
 5:21 
 0
 0
 0
 0
 8:47 
 0
 0
 0
 0
 11:58 
 0
 0
 0
 0
 17:37 
 0
 0
 0
 0
 14:27 
 0
 0
 0
 0
 15:44 
 0
 0
 0
 0
 11:46 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 14:40 
 0
 0
 0
 0
 12:24 
 0
 0
 0
 0
 12:53 
 0
 0
 0
 0
 14:51 
 0
 0
 0
 0
 14:47 
 0
 0
 0
 0
 6:58 
 0
 0
 0
 0
 11:24 
 0
 0
 0
 0
 6:38 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 11:27 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 11:21 
 0
 0
 0
 0
 10:32 
 0
 0
 0
 0
 11:39