02/02/2021

Local Relation Learning for Face Forgery Detection

Shen Chen, Taiping Yao, Yang Chen, Shouhong Ding, Jilin Li, Rongrong Ji

Keywords:

Abstract Paper Similar Papers

Abstract: With the rapid development of facial manipulation techniques, face forgery has received considerable attention in digital media forensics due to security concerns. Most existing methods formulate face forgery detection as a classification problem and utilize binary labels or manipulated region masks as supervision. However, without considering the correlation between local regions, these global supervisions are insufficient to learn a generalized feature and prone to overfitting. To address this issue, we propose a novel perspective of face forgery detection via local relation learning. Specifically, we propose a Multi-scale Patch Similarity Module (MPSM), which measures the similarity between features of local regions and forms a robust and generalized similarity pattern. Moreover, we propose an RGB-Frequency Attention Module (RFAM) to fuse information in both RGB and frequency domains for more comprehensive local feature representation, which further improves the reliability of the similarity pattern. Extensive experiments show that the proposed method consistently outperforms the state-of-the-arts on widely-used benchmarks. Furthermore, detailed visualization shows the robustness and interpretability of our method.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948054
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 9:28 
 0
 0
 0
 0
 12:46 
 0
 0
 0
 0
 6:12 
 0
 0
 0
 0
 5:36 
 0
 0
 0
 0
 5:28 
 0
 0
 0
 0
 6:50 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 0:58 
 0
 0
 0
 0
 16:50 
 0
 0
 0
 0
 13:25 
 0
 0
 0
 0
 13:12 
 0
 0
 0
 0
 14:39 
 0
 0
 0
 0
 2:19 
 0
 0
 0
 0
 10:10 
 0
 0
 0
 0
 12:01 
 0
 0
 0
 0
 15:02 
 0
 0
 0
 0
 13:21 
 0
 0
 0
 0
 15:15 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 13:50 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 17:17 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 15:17 
 0
 0
 0
 0
 3:14 
 0
 0
 0
 0
 14:17 
 0
 0
 0
 0
 9:11 
 0
 0
 0
 0
 2:24 
 0
 0
 0
 0
 1:03 
 0
 0
 0
 0
 7:13 
 0
 0
 0
 0
 7:41 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 6:53 
 0
 0
 0
 0
 0:58 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 4:57