30/11/2020

Condensed Movies: Story Based Retrieval with Contextual Embeddings

Max Bain, Arsha Nagrani, Andrew Brown, Andrew Zisserman

Keywords:

Abstract Paper Similar Papers

Abstract: Our objective in this work is the long range understandingof the narrative structure of movies. Instead of considering the entire movie, we propose to learn from the `key scenes' of the movie, providing a condensed look at the full storyline. To this end, we make the following three contributions: (i) We create the Condensed Movie Dataset (CMD) consisting of the key scenes from over 3K movies: each key scene is accompanied by a high level semantic description of the scene, character face tracks, and metadata about the movie. Our dataset is scalable, obtained automatically from YouTube, and is freely available for anybody to download and use. It is also an order of magnitude larger than existing movie datasets in the number of movies; (ii) We provide a deep network baseline for text-to-video retrieval on our dataset, combining character, speech and visual cues into a single video embedding; and finally (iii) We demonstrate how the addition of context from other video clips improves retrieval performance.

The video of this talk cannot be embedded. You can watch it here:
https://accv2020.github.io/miniconf/poster_13.html
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 6:37 
 0
 0
 0
 0
 12:15 
 0
 0
 0
 0
 4:08 
 0
 0
 0
 0
 6:33 
 1
 0
 0
 0
 3:25 
 0
 0
 0
 0
 3:24 
 0
 0
 0
 0
 4:50 
 0
 0
 0
 0
 10:51 
 0
 0
 0
 0
 3:05 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 12:02 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 10:13 
 0
 0
 0
 0
 11:47 
 0
 0
 0
 0
 9:59 
 0
 0
 0
 0
 6:14 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 16:24 
 0
 0
 0
 0
 18:15 
 0
 0
 0
 0
 12:22 
 0
 0
 0
 0
 14:19 
 0
 0
 0
 0
 9:07 
 0
 0
 0
 0
 10:05 
 0
 0
 0
 0
 4:34 
 0
 0
 0
 1
 8:13 
 0
 0
 0
 0
 4:49 
 0
 0
 0
 0
 13:31 
 0
 0
 0
 0
 17:51 
 0
 0
 0
 0
 14:19 
 0
 0
 0
 0
 9:07 
 0
 0
 0
 0
 7:40 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 8:46 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 15:58 
 0
 0
 0
 0
 13:00 
 0
 0
 0
 0
 2:55