30/11/2020

HDD-Net: Hybrid Detector Descriptor with Mutual Interactive Learning

Axel Barroso-Laguna, Yannick Verdie, Benjamin Busam, Krystian Mikolajczyk

Keywords:

Abstract Paper Similar Papers

Abstract: Local feature extraction remains an active research area due to the advances in fields such as SLAM, 3D reconstructions, or AR applications. The success in these applications relies on the performance of the feature detector, descriptor, and its matching process. While the trend of detector-descriptor interaction of most methods is based on unifying the two into a single network, we propose an alternative approach that treats both components independently and focuses on their interaction during the learning process. We formulate the classical hard-mining triplet loss as a new detector optimisation term to improve keypoint positions based on the descriptor map. Moreover, we introduce a dense descriptor that uses a multi-scale approach within the architecture and a hybrid combination of hand-crafted and learnt features to obtain rotation and scale robustness by design. We evaluate our method extensively on several benchmarks and show improvements over the state of the art in terms of image matching and 3D reconstruction quality while keeping on par in camera localisation tasks.

The video of this talk cannot be embedded. You can watch it here:
https://accv2020.github.io/miniconf/poster_253.html
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 9:19 
 0
 0
 0
 0
 4:57 
 0
 0
 0
 0
 3:17 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 4:05 
 0
 0
 0
 0
 5:30 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:16 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 11:48 
 0
 0
 0
 0
 2:49 
 0
 0
 0
 0
 8:03 
 0
 0
 0
 0
 4:34 
 0
 0
 0
 0
 10:03 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 5:15 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 1:03 
 0
 0
 0
 0
 0:57 
 0
 0
 0
 0
 3:15 
 0
 0
 0
 0
 3:00 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 12:20 
 0
 0
 0
 0
 6:47 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 3:13 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 3:03 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 1
 9:03 
 0
 0
 0
 0
 12:29 
 0
 0
 0
 0
 3:23 
 0
 0
 0
 0
 5:28 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 4:30 
 0
 0
 0
 0
 9:57