30/11/2020

Active Learning for Video Description With Cluster-Regularized Ensemble Ranking

David M. Chan, Sudheendra Vijayanarasimhan, David A. Ross, John F. Canny

Keywords:

Abstract Paper Similar Papers

Abstract: Automatic video captioning aims to train models to generate text descriptions for all segments in a video, however, the most effective approaches require large amounts of manual annotation which is slow and expensive. Active learning is a promising way to efficiently build a training set for video captioning tasks while reducing the need to manually label uninformative examples. In this work we both explore various active learning approaches for automatic video captioning and show that a cluster-regularized ensemble strategy provides the best active learning approach to efficiently gather training sets for video captioning. We evaluate our approaches on the MSR-VTT and LSMDC datasets using both transformer and LSTM based captioning models and show that our novel strategy can achieve high performance while using up to 60% fewer training data than the strong state of the art random selection baseline.

The video of this talk cannot be embedded. You can watch it here:
https://accv2020.github.io/miniconf/poster_556.html
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 6:39 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 19:40 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 0:55 
 0
 0
 0
 0
 11:47 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 2:46 
 0
 0
 0
 0
 7:40 
 0
 0
 0
 0
 0:57 
 0
 0
 0
 0
 21:03 
 0
 0
 0
 0
 7:58 
 0
 0
 0
 0
 8:07 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:18 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 3:04 
 0
 0
 0
 0
 4:46 
 0
 0
 0
 0
 6:14 
 0
 0
 0
 0
 9:23 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 12:15 
 0
 0
 0
 0
 5:02 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 6:20 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 18:21 
 0
 0
 0
 0
 3:00 
 0
 0
 0
 0
 19:03 
 0
 0
 0
 0
 6:14 
 0
 0
 0
 0
 9:40 
 0
 0
 0
 0
 14:42 
 0
 0
 0
 0
 4:34 
 0
 0
 0
 0
 3:05 
 0
 0
 0
 0
 9:57 
 0
 0
 0
 0
 4:44 
 0
 0
 0
 0
 3:21