08/12/2020

Multi-Task Learning for Knowledge Graph Completion with Pre-trained Language Models

Bosung Kim, Taesuk Hong, Youngjoong Ko, Jungyun Seo

Keywords:

Abstract Paper Similar Papers

Abstract: As research on utilizing human knowledge in natural language processing has attracted considerable attention in recent years, knowledge graph (KG) completion has come into the spotlight. Recently, a new knowledge graph completion method using a pre-trained language model, such as KG-BERT, is presented and showed high performance. However, its scores in ranking metrics such as Hits@k are still behind state-of-the-art models. We claim that there are two main reasons: 1) failure in sufficiently learning relational information in knowledge graphs, and 2) difficulty in picking out the correct answer from lexically similar candidates. In this paper, we propose an effective multi-task learning method to overcome the limitations of previous works. By combining relation prediction and relevance ranking tasks with our target link prediction, the proposed model can learn more relational properties in KGs and properly perform even when lexical similarity occurs. Experimental results show that we not only largely improve the ranking performances compared to KG-BERT but also achieve the state-of-the-art performances in Mean Rank and Hits@10 on the WN18RR dataset.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6245-multi-task-learning-for-knowledge-graph-completion-with-pre-trained-language-models
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 8:54 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 13:59 
 0
 0
 0
 0
 14:47 
 0
 0
 0
 0
 11:30 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 11:55 
 0
 0
 0
 0
 18:24 
 0
 0
 0
 0
 19:22 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 11:27 
 0
 0
 0
 0
 11:43 
 0
 0
 0
 0
 5:15 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 8:41 
 0
 0
 0
 0
 14:45 
 0
 0
 0
 0
 16:31 
 0
 0
 0
 0
 11:05 
 0
 0
 0
 0
 12:22 
 1
 0
 0
 0
 14:01 
 0
 0
 0
 0
 13:09 
 1
 1
 0
 0
 15:13 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 1
 10:52 
 0
 0
 0
 0
 14:56 
 0
 0
 0
 0
 9:18 
 0
 0
 0
 0
 13:52 
 0
 0
 0
 0
 14:26 
 0
 0
 0
 0
 11:58 
 0
 0
 0
 0
 3:28 
 0
 0
 0
 0
 18:58 
 0
 0
 0
 0
 12:01 
 0
 0
 0
 0
 12:16 
 0
 0
 0
 0
 13:45 
 0
 0
 0
 0
 5:51 
 0
 0
 0
 0
 6:40 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 6:53 
 0
 0
 0
 0
 5:10 
 0
 0
 0
 0
 14:07