08/12/2020

Enhancing Neural Models with Vulnerability via Adversarial Attack

Rong Zhang, Qifei Zhou, Bo An, Weiping Li, Tong Mo, Bo Wu

Keywords:

Abstract Paper Similar Papers

Abstract: Natural Language Sentence Matching (NLSM) serves as the core of many natural language processing tasks. 1) Most previous work develops a single specific neural model for NLSM tasks. 2) There is no previous work considering adversarial attack to improve the performance of NLSM tasks. 3) Adversarial attack is usually used to generate adversarial samples that can fool neural models. In this paper, we first find a phenomenon that different categories of samples have different vulnerabilities. Vulnerability is the difficulty degree in changing the label of a sample. Considering the phenomenon, we propose a general two-stage training framework to enhance neural models with Vulnerability via Adversarial Attack (VAA). We design criteria to measure the vulnerability which is obtained by adversarial attack. VAA framework can be adapted to various neural models by incorporating the vulnerability. In addition, we prove a theorem and four corollaries to explain the factors influencing vulnerability effectiveness. Experimental results show that VAA significantly improves the performance of neural models on NLSM datasets. The results are also consistent with the theorem and corollaries. The code is released on https://github.com/rzhangpku/VAA.

The video of this talk cannot be embedded. You can watch it here:
https://underline.io/lecture/6129-enhancing-neural-models-with-vulnerability-via-adversarial-attack
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at COLING 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 11:41 
 0
 0
 0
 0
 10:57 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 14:49 
 0
 0
 0
 0
 5:21 
 0
 0
 0
 0
 9:34 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 4:52 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 11:35 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 12:23 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 9:56 
 0
 0
 0
 0
 5:20 
 0
 0
 0
 0
 13:27 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 12:36 
 0
 0
 0
 0
 5:14 
 1
 0
 0
 1
 3:22 
 0
 0
 0
 0
 3:15 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 11:56 
 0
 0
 0
 0
 11:52 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 12:49 
 0
 0
 0
 0
 13:33 
 0
 0
 0
 0
 14:43 
 0
 0
 0
 0
 3:21 
 0
 0
 0
 0
 15:00 
 0
 0
 0
 0
 12:27 
 0
 0
 0
 0
 5:01 
 0
 0
 1
 1
 6:15 
 0
 0
 0
 0
 3:12 
 0
 0
 0
 0
 10:19 
 0
 0
 0
 0
 2:58 
 0
 0
 0
 0
 15:04 
 0
 0
 0
 0
 5:19