02/02/2021

Curriculum-Meta Learning for Order-Robust Continual Relation Extraction

Tongtong Wu, Xuekai Li, Yuan-Fang Li, Gholamreza Haffari, Guilin Qi, Yujin Zhu, Guoqiang Xu

Keywords:

Abstract Paper Similar Papers

Abstract: Continual relation extraction is an important task that focuses on extracting new facts incrementally from unstructured text. Given the sequential arrival order of the relations, this task is prone to two serious challenges, namely catastrophic forgetting and order-sensitivity. We propose a novel curriculum-meta learning method to tackle the above two challenges in continual relation extraction. We combine meta learning and curriculum learning to quickly adapt model parameters to a new task and to reduce interference of previously seen tasks on the current task. We design a novel relation representation learning method through the distribution of domain and range types of relations. Such representations are utilized to quantify the difficulty of tasks for the construction of curricula. Moreover, we also present novel difficulty-based metrics to quantitatively measure the extent of order-sensitivity of a given model, suggesting new ways to evaluate model robustness. Our comprehensive experiments on three benchmark datasets show that our proposed method outperforms the state-of-the-art techniques. The code is available at the anonymous GitHub repository: https://github.com/wutong8023/AAAI_CML.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948498
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 15:09 
 0
 0
 0
 0
 7:26 
 0
 0
 0
 0
 14:52 
 0
 0
 0
 0
 9:11 
 0
 0
 0
 0
 9:54 
 0
 0
 0
 0
 6:17 
 0
 0
 0
 0
 5:08 
 0
 0
 0
 0
 11:10 
 0
 0
 0
 0
 12:35 
 0
 0
 0
 0
 14:46 
 0
 0
 0
 0
 11:27 
 0
 0
 0
 1
 5:10 
 0
 0
 0
 0
 16:14 
 0
 0
 0
 0
 12:54 
 0
 0
 0
 0
 12:03 
 0
 0
 0
 0
 11:49 
 0
 0
 0
 0
 3:29 
 0
 0
 0
 0
 11:16 
 0
 0
 0
 0
 12:03 
 0
 0
 0
 0
 10:53 
 0
 0
 0
 0
 8:40 
 1
 1
 0
 0
 5:13 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 17:34 
 0
 0
 0
 0
 8:27 
 0
 0
 0
 0
 10:25 
 0
 0
 0
 0
 9:51 
 0
 0
 0
 0
 14:05 
 0
 0
 0
 0
 11:55 
 0
 0
 0
 0
 6:55 
 0
 0
 0
 0
 4:45 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 14:26 
 0
 0
 0
 0
 11:05 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 17:06 
 0
 0
 0
 0
 15:08