02/02/2021

DASZL: Dynamic Action Signatures for Zero-shot Learning

Tae Soo Kim, Jonathan Jones, Michael Peven, Zihao Xiao, Jin Bai, Yi Zhang, Weichao Qiu, Alan Yuille, Gregory D. Hager

Keywords:

Abstract Paper Similar Papers

Abstract: There are many realistic applications of activity recognition where the set of potential activity descriptions is combinatorially large. This makes end-to-end supervised training of a recognition system impractical as no training set is practically able to encompass the entire label set. In this paper, we present an approach to fine-grained recognition that models activities as compositions of dynamic action signatures. This compositional approach allows us to reframe fine-grained recognition as zero-shot activity recognition, where a detector is composed "on the fly" from simple first-principles state machines supported by deep-learned components. We evaluate our method on the Olympic Sports and UCF101 datasets, where our model establishes a new state of the art under multiple experimental paradigms. We also extend this method to form a unique framework for zero-shot joint segmentation and classification of activities in video and demonstrate the first results in zero- shot decoding of complex action sequences on a widely-used surgical dataset. Lastly, we show that we can use off-the-shelf object detectors to recognize activities in completely de-novo settings with no additional training.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948134
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 2:54 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 15:58 
 0
 0
 0
 0
 14:57 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 6:45 
 0
 0
 0
 0
 4:59 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 6:28 
 0
 0
 0
 0
 9:11 
 0
 0
 0
 0
 6:58 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 13:00 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 14:52 
 0
 0
 0
 0
 14:20 
 0
 0
 0
 0
 5:16 
 0
 0
 0
 0
 4:47 
 0
 0
 0
 0
 0:58 
 0
 0
 0
 0
 14:37 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 4:55 
 0
 0
 0
 0
 5:45 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:03 
 0
 0
 0
 0
 4:54 
 0
 0
 0
 0
 7:36 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 3:21 
 0
 0
 0
 0
 14:47 
 0
 0
 0
 0
 3:04 
 0
 0
 0
 0
 19:40 
 0
 0
 0
 0
 5:06