30/11/2020

Transforming Multi-Concept Attention into Video Summarization

Yen-Ting Liu, Yu-Jhe Li, Yu-Chiang Frank Wang

Keywords:

Abstract Paper Similar Papers

Abstract: Video summarization is among challenging tasks in computer vision, which aims at identifying highlight frames or shots over a lengthy video input. In this paper, we propose an novel attention-based framework for video summarization with complex video data. Unlike previous works which only apply attention mechanism on the correspondence between frames, our multi-concept video self-attention (MC-VSA) model is presented to identify informative regions across temporal and concept video features, which jointly exploit context diversity over time and space for summarization purposes. Together with consistency between video and summary enforced in our framework, our model can be applied to both labeled and unlabeled data, making our method preferable to real-world applications. Extensive and complete experiments on two benchmarks demonstrate the effectiveness of our model both quantitatively and qualitatively, and confirms its superiority over the state-of-the-arts.

The video of this talk cannot be embedded. You can watch it here:
https://accv2020.github.io/miniconf/poster_36.html
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 10:56 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:05 
 0
 0
 0
 0
 16:24 
 0
 0
 0
 0
 14:06 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 13:20 
 0
 0
 0
 0
 17:28 
 0
 0
 0
 0
 14:29 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 5:30 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 2:55 
 0
 0
 0
 0
 14:02 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 14:55 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 2:46 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:18 
 0
 0
 0
 0
 13:41 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 3:01 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 1
 14:34 
 0
 0
 0
 0
 5:36 
 0
 0
 0
 0
 8:16 
 0
 0
 0
 0
 1:02 
 0
 0
 0
 0
 9:44 
 0
 0
 0
 0
 9:07 
 0
 0
 0
 0
 5:18 
 0
 0
 0
 0
 4:08 
 0
 0
 0
 0
 14:10 
 0
 0
 0
 0
 14:21 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 16:48 
 0
 0
 0
 0
 8:46 
 0
 0
 0
 0
 9:50 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 5:00