02/02/2021

Improving the Efficiency and Effectiveness for BERT-based Entity Resolution

Bing Li, Yukai Miao, Yaoshu Wang, Yifang Sun, Wei Wang

Keywords:

Abstract Paper Similar Papers

Abstract: BERT has set a new state-of-the-art performance on entity resolution (ER) task, largely owed to fine-tuning pre-trained language models and the deep pair-wise interaction. Albeit being remarkably effective, it comes with a steep increase in computational cost, as the deep-interaction requires to exhaustively compute every tuple pair to search for co-references. For ER task, it is often prohibitively expensive due to the large cardinality to be matched. To tackle this, we introduce a siamese network structure that independently encodes tuples using BERT but delays the pair-wise interaction via an enhanced alignment network. This siamese structure enables a dedicated blocking module to quickly filter out obviously dissimilar tuple pairs, and thus drastically reduces the cardinality of fine-grained matching. Further, the blocking and entity matching are integrated into a multi-task learning framework for facilitating both tasks. Extensive experiments on multiple datasets demonstrate that our model significantly outperforms state-of-the-art models (including BERT) in both efficiency and effectiveness.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948870
(Link will open in new window)
 0
 1
 1
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 10:53 
 0
 0
 0
 0
 11:36 
 0
 0
 0
 1
 5:10 
 0
 0
 0
 0
 11:43 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 10:20 
 0
 0
 0
 0
 3:20 
 0
 0
 0
 0
 2:59 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 10:51 
 0
 0
 0
 0
 14:48 
 0
 0
 0
 0
 11:47 
 0
 0
 0
 0
 12:12 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 11:12 
 0
 0
 0
 0
 5:15 
 0
 0
 0
 0
 12:26 
 0
 0
 0
 0
 12:15 
 0
 0
 0
 0
 11:51 
 0
 0
 0
 0
 9:59 
 0
 0
 0
 0
 14:35 
 0
 0
 0
 0
 3:02 
 0
 0
 0
 0
 11:05 
 0
 0
 0
 0
 19:14 
 0
 0
 0
 0
 11:28 
 0
 0
 0
 0
 11:04 
 0
 0
 0
 0
 11:54 
 0
 0
 0
 0
 12:26 
 0
 0
 0
 0
 8:41 
 0
 0
 0
 0
 6:49 
 1
 0
 0
 1
 5:03 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 15:21 
 0
 0
 0
 0
 3:28 
 0
 0
 0
 0
 10:38 
 0
 0
 0
 0
 15:08 
 0
 0
 0
 0
 12:10 
 0
 0
 0
 0
 12:27 
 0
 0
 0
 0
 3:01