30/11/2020

Modeling Cross-Modal interaction in a Multi-detector, Multi-modal Tracking Framework

Yiqi Zhong, Suya You, Ulrich Neumann

Keywords:

Abstract Paper Similar Papers

Abstract: Different modalities have their own advantages and disadvantages. In a tracking-by-detection framework, fusing data from multiple modalities would ideally improve tracking performance than using a single modality, but this is a challenge. This study builds upon previous research in this area. We propose a deep-learning based tracking-by-detection pipeline that uses multiple detectors and multiple sensors. For the input, we associate object proposals from 2D and 3D detectors. Through a cross-modal attention module, we optimize interaction between the 2D RGB and 3D point clouds features of each proposal. This helps to generate 2D features with suppressed irrelevant information for boosting performance. Through experiments on a published benchmark, we prove the value and ability of our design in introducing a multi-modal tracking solution to the current research on Multi-Object Tracking (MOT).

The video of this talk cannot be embedded. You can watch it here:
https://accv2020.github.io/miniconf/poster_236.html
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 18:06 
 0
 0
 0
 0
 8:43 
 0
 0
 0
 0
 10:03 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:03 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:00 
 0
 0
 0
 0
 7:09 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 2:49 
 0
 0
 0
 0
 15:13 
 0
 0
 0
 0
 5:28 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 3:30 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 4:37 
 0
 0
 0
 0
 1:39 
 0
 0
 0
 0
 4:53 
 0
 0
 0
 0
 14:23 
 0
 0
 0
 0
 6:32 
 0
 0
 0
 0
 13:57 
 0
 0
 0
 0
 2:53 
 0
 0
 0
 0
 0:51 
 0
 0
 0
 0
 14:15 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 5:07 
 0
 0
 0
 0
 17:44 
 0
 0
 0
 0
 4:34 
 0
 0
 0
 0
 2:59 
 0
 0
 0
 0
 10:03 
 0
 0
 0
 0
 3:06 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 1
 9:03 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 14:39 
 0
 0
 0
 0
 7:41