19/10/2020

Evaluating the impact of knowledge graph context on entity disambiguation models

Isaiah Onando Mulang’, Kuldeep Singh, Chaitali Prabhu, Abhishek Nadgeri, Johannes Hoffart, Jens Lehmann

Keywords: roberta, knowledge graph, context, pretrained transformers, named entity disambiguation, xlnet, wikidata

Abstract Paper Similar Papers

Abstract: Pretrained Transformer models have emerged as state-of-the-art approaches that learn contextual information from the text to improve the performance of several NLP tasks. These models, albeit powerful, still require specialized knowledge in specific scenarios. In this paper, we argue that context derived from a knowledge graph (in our case: Wikidata) provides enough signals to inform pretrained transformer models and improve their performance for named entity disambiguation (NED) on Wikidata KG. We further hypothesize that our proposed KG context can be standardized for Wikipedia, and we evaluate the impact of KG context on the state of the art NED model for the Wikipedia knowledge base. Our empirical results validate that the proposed KG context can be generalized (for Wikipedia), and providing KG context in transformer architectures considerably outperforms the existing baselines, including the vanilla transformer models.

The video of this talk cannot be embedded. You can watch it here:
https://dl.acm.org/doi/10.1145/3340531.3412159#sec-supp
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at CIKM 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 3:25 
 0
 0
 0
 1
 4:45 
 0
 0
 0
 0
 11:15 
 0
 0
 0
 0
 10:09 
 0
 0
 0
 0
 11:58 
 0
 0
 0
 0
 10:28 
 0
 0
 0
 0
 6:54 
 0
 0
 0
 0
 10:14 
 0
 0
 0
 0
 11:53 
 0
 0
 0
 0
 17:52 
 0
 0
 0
 0
 19:22 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 14:15 
 0
 0
 1
 1
 4:58 
 0
 0
 0
 0
 14:28 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 3:23 
 1
 0
 0
 0
 14:01 
 0
 0
 0
 0
 9:14 
 0
 0
 0
 0
 10:46 
 0
 0
 0
 0
 11:18 
 0
 0
 0
 0
 17:26 
 0
 0
 0
 0
 5:21 
 0
 0
 0
 0
 4:43 
 0
 0
 0
 0
 10:28 
 0
 0
 0
 0
 14:06 
 0
 0
 0
 0
 9:31 
 0
 0
 0
 0
 15:39 
 0
 0
 0
 0
 14:44 
 0
 0
 0
 0
 12:45 
 0
 0
 0
 0
 12:49 
 0
 0
 0
 0
 13:54 
 0
 0
 0
 0
 14:48 
 0
 0
 0
 0
 10:41 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 1
 2:44 
 0
 0
 0
 0
 18:49 
 0
 0
 0
 0
 12:35