30/11/2020

Learning End-to-End Action Interaction by Paired-Embedding Data Augmentation

Ziyang Song, Zejian Yuan, Chong Zhang, Wanchao Chi, Yonggen Ling, Shenghao Zhang

Keywords:

Abstract Paper Similar Papers

Abstract: In recognition-based action interaction, robots' responses to human actions are often pre-designed according to recognized categories and thus stiff.In this paper, we specify a new Interactive Action Translation (IAT) task which aims to learn end-to-end action interaction from unlabeled interactive pairs, removing explicit action recognition.To enable learning on small-scale data, we propose a Paired-Embedding (PE) method for effective and reliable data augmentation.Specifically, our method first utilizes paired relationships to cluster individual actions in an embedding space.Then two actions originally paired can be replaced with other actions in their respective neighborhood, assembling into new pairs.An Act2Act network based on conditional GAN follows to learn from augmented data.Besides, IAT-test and IAT-train scores are specifically proposed for evaluating methods on our task.Experimental results on two datasets show impressive effects and broad application prospects of our method.

The video of this talk cannot be embedded. You can watch it here:
https://accv2020.github.io/miniconf/poster_123.html
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 3:09 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 14:38 
 0
 0
 0
 0
 4:47 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 4:51 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 19:59 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 10:53 
 0
 0
 0
 0
 9:11 
 0
 0
 0
 0
 5:20 
 0
 0
 0
 0
 15:27 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 5:05 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 14:52 
 0
 0
 0
 0
 6:45 
 0
 0
 0
 0
 13:53 
 0
 0
 0
 0
 15:41 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 4:42 
 0
 0
 0
 0
 7:25 
 0
 0
 0
 0
 3:21 
 0
 0
 0
 0
 14:21 
 0
 0
 0
 0
 5:04 
 0
 0
 0
 0
 8:36 
 0
 0
 0
 0
 9:47 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 5:24