02/02/2021

DecAug: Augmenting HOI Detection via Decomposition

Hao-Shu Fang, Yichen Xie, Dian Shao, Yong-Lu Li, Cewu Lu

Keywords:

Abstract Paper Similar Papers

Abstract: Human-object interaction (HOI) detection requires a large amount of annotated data. Current algorithms suffer from insufficient training samples and category imbalance within datasets. To increase data efficiency, in this paper, we propose an efficient and effective data augmentation method called DecAug for HOI detection. Based on our proposed object state similarity metric, object patterns across different HOIs are shared to augment local object appearance features without changing their states. Further, we shift spatial correlation between humans and objects to other feasible configurations with the aid of a pose-guided Gaussian Mixture Model while preserving their interactions. Experiments show that our method brings up to 3.3 mAP and 1.6 mAP improvements on V-COCO and HICO-DET dataset for two advanced models. Specifically, interactions with fewer samples enjoy more notable improvement. Our method can be easily integrated into various HOI detection models with negligible extra computational consumption.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948569
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 17:44 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 4:43 
 0
 0
 0
 0
 18:32 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 15:49 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 11:20 
 0
 0
 0
 0
 15:02 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 3:01 
 0
 0
 0
 0
 7:09 
 0
 0
 0
 0
 19:54 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 9:03 
 0
 0
 0
 0
 3:14 
 0
 0
 0
 0
 7:17 
 0
 0
 0
 0
 13:21 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 4:13 
 0
 0
 0
 0
 21:47 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 16:57 
 0
 0
 0
 0
 9:35 
 0
 0
 0
 0
 16:58 
 0
 0
 0
 0
 4:54 
 0
 0
 0
 0
 14:56 
 0
 0
 0
 0
 15:02 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 8:23 
 0
 0
 0
 0
 18:06