08/12/2020

AprilE: Attention with Pseudo Residual Connection for Knowledge Graph Embedding

Yuzhang Liu, Peng Wang, Yingtai Li, Yizhan Shao, Zhongkai Xu

Keywords:

Abstract Paper Similar Papers

Abstract: Knowledge graph embedding maps entities and relations into low-dimensional vector space. However, it is still challenging for many existing methods to model diverse relational patterns, especially symmetric and antisymmetric relations. To address this issue, we propose a novel model, AprilE, which employs triple-level self-attention and pseudo residual connection to model relational patterns. The triple-level self-attention treats head entity, relation, and tail entity as a sequence and captures the dependency within a triple. At the same time the pseudo residual connection retains primitive semantic features. Furthermore, to deal with symmetric and antisymmetric relations, two schemas of score function are designed via a position-adaptive mechanism. Experimental results on public datasets demonstrate that our model can produce expressive knowledge embedding and significantly outperforms most of the state-of-the-art works.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6157-aprile-attention-with-pseudo-residual-connection-for-knowledge-graph-embedding
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 8:49 
 0
 0
 0
 0
 14:00 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 5:14 
 0
 0
 0
 0
 14:36 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 11:38 
 0
 0
 0
 0
 12:01 
 0
 0
 0
 0
 11:06 
 0
 0
 0
 0
 13:36 
 0
 0
 0
 0
 18:59 
 0
 0
 0
 0
 3:09 
 0
 0
 0
 0
 15:24 
 0
 0
 0
 0
 15:25 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 15:41 
 0
 1
 0
 1
 3:01 
 0
 0
 0
 0
 14:14 
 0
 0
 0
 0
 12:01 
 0
 0
 0
 0
 5:28 
 0
 0
 0
 0
 7:43 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 11:50 
 0
 0
 0
 0
 10:33 
 0
 0
 0
 0
 2:42 
 0
 0
 0
 0
 14:08 
 0
 0
 0
 0
 12:47 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 16:53 
 0
 0
 0
 0
 12:20 
 0
 0
 0
 0
 0:58 
 0
 0
 0
 0
 3:11 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 19:51 
 0
 0
 0
 0
 14:40 
 0
 0
 0
 0
 9:49 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 7:45 
 0
 0
 0
 0
 11:20