25/04/2020

GAZED– Gaze-guided Cinematic Editing of Wide-Angle Monocular Video Recordings

K. L. Moorthy, Moneish Kumar, Ramanathan Subramanian, Vineet Gandhi

Keywords: eye gaze, cinematic video editing, stage performance, static wide-angle recording, gaze potential, shot selection, dynamic programming

Abstract Paper Similar Papers

Abstract: We present GAZED– eye GAZe-guided EDiting for videos captured by a solitary, static, wide-angle and high-resolution camera. Eye-gaze has been effectively employed in computational applications as a cue to capture interesting scene content; we employ gaze as a proxy to select shots for inclusion in the edited video. Given the original video, scene content and user eye-gaze tracks are combined to generate an edited video comprising cinematically valid actor shots and shot transitions to generate an aesthetic and vivid representation of the original narrative. We model cinematic video editing as an energy minimization problem over shot selection, whose constraints capture cinematographic editing conventions. Gazed scene locations primarily determine the shots constituting the edited video. Effectiveness of GAZED against multiple competing methods is demonstrated via a psychophysical study involving 12 users and twelve performance videos.

The video of this talk cannot be embedded. You can watch it here:
https://www.youtube.com/watch?v=dZVvqJVuMEQ
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at CHI 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 7:39 
 0
 0
 0
 0
 5:15 
 0
 0
 0
 0
 7:07 
 0
 0
 0
 0
 2:43 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 7:14 
 0
 0
 0
 0
 6:14 
 0
 0
 0
 0
 14:06 
 0
 0
 0
 0
 9:44 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 3:05 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 16:49 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 3:02 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 8:30 
 0
 0
 0
 0
 10:42 
 0
 0
 0
 0
 1:02 
 0
 0
 0
 0
 3:02 
 0
 0
 0
 0
 5:30 
 0
 0
 0
 0
 2:51 
 0
 0
 0
 0
 17:28 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 1
 8:13 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 18:25 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 6:44 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 2:49 
 0
 0
 0
 0
 2:02 
 0
 0
 0
 0
 14:10 
 0
 0
 0
 0
 12:50 
 0
 0
 0
 0
 10:56 
 0
 0
 0
 0
 5:01