D2D: Keypoint Extraction with Describe to Detect Approach

30/11/2020

D2D: Keypoint Extraction with Describe to Detect Approach

Yurun Tian, Vassileios Balntas, Tony Ng, Axel Barroso-Laguna, Yiannis Demiris, Krystian Mikolajczyk

Keywords:

Abstract Paper Similar Papers

Abstract: In this paper, we present a novel approach that exploits the information within the descriptor space to propose keypoint locations. Detect then describe, or detect and describe jointly are two typical strategies for extracting local descriptors. In contrast, we propose an approach that inverts this process by first describing and then detecting the keypoint locations. Describe-to-Detect (D2D) leverages successful descriptor models without the need for any additional training. Our method selects keypoints as salient locations with high information content which is defined by the descriptors rather than some independent operators. We perform experiments on multiple benchmarks including image matching, camera localisation, and 3D reconstruction. The results indicate that our method improves the matching performance of various descriptors and that it generalises across methods and tasks.

The video of this talk cannot be embedded. You can watch it here:

https://accv2020.github.io/miniconf/poster_261.html

(Link will open in new window)

0

0

0

0

Share

This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment

no comments yet

Similar Papers

22/11/2021

Two Heads are Better than One: Geometric-Latent Attention for Point Cloud Classification and Segmentation

Hanz Cuevas, Antonio-Javier Gallego, Robert B Fisher

Keywords Paper

point cloud, point cloud segmentation, 3D, point cloud classification, shape classification, deep 3D segmentation, deep learning, scene understanding, 3D scene understanding, light network, local agregation, gnn

0

0

0

0

2:57

14/06/2020

PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection

Shaoshuai Shi, Chaoxu Guo, Li Jiang and
Zhe Wang, Jianping Shi, Xiaogang Wang, Hongsheng Li

Keywords Paper

3d object detection, point cloud, 3d scene understanding, lidar, autonomous driving, kitti dataset, waymo open dataset

0

0

0

0

1:01

14/06/2020

What You See is What You Get: Exploiting Visibility for 3D Object Detection

Peiyun Hu, Jason Ziglar, David Held, Deva Ramanan

Keywords Paper

freespace reasoning, 3d object detection, lidar processing, autonomous driving

0

0

0

0

5:01

14/06/2020

PVN3D: A Deep Point-Wise 3D Keypoints Voting Network for 6DoF Pose Estimation

Yisheng He, Wei Sun, Haibin Huang and
Jianran Liu, Haoqiang Fan, Jian Sun

Keywords Paper

6d pose estimation, 3d instance segmentation, 3d semantic segmentation, 3d keypoint, 3d scene understanding, vision for robotics, 3d single view, rgbd, 3d computer vision

0

0

0

0

1:01

14/06/2020

Deep 3D Capture: Geometry and Reflectance From Sparse Multi-View Images

Sai Bi, Zexiang Xu, Kalyan Sunkavalli and
David Kriegman, Ravi Ramamoorthi

Keywords Paper

appearance acquisition, 3d reconstruction, multi-view stereo

0

0

0

0

1:01

02/02/2021

Object-Centric Image Generation from Layouts

Tristan Sylvain, Pengchuan Zhang, Yoshua Bengio and
R Devon Hjelm, Shikhar Sharma

Keywords Paper

0

0

0

0

17:44

30/11/2020

DeepVoxels++: Enhancing the Fidelity of Novel View Synthesis from 3D Voxel Embeddings

Tong He, John Collomosse, Hailin Jin, Stefano Soatto

Keywords Paper

0

0

0

0

7:47

30/11/2020

HDD-Net: Hybrid Detector Descriptor with Mutual Interactive Learning

Axel Barroso-Laguna, Yannick Verdie, Benjamin Busam, Krystian Mikolajczyk

Keywords Paper

0

0

0

0

10:03

22/11/2021

Multi-Modality Task Cascade for 3D Object Detection

Jinhyung Park, Xinshuo Weng, Yunze Man, Kris Kitani

Keywords Paper

Multi Modality Learning, Object Detection, Semantic Segmentation

0

0

0

0

3:03

06/12/2021

Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects

Denys Rozumnyi, Martin R. Oswald, Vittorio Ferrari, Marc Pollefeys

Keywords Paper

optimization

0

0

0

0

10:44

14/06/2020

On Joint Estimation of Pose, Geometry and svBRDF From a Handheld Scanner

Carolin Schmitt, Simon Donné, Gernot Riegler and
Vladlen Koltun, Andreas Geiger

Keywords Paper

3d reconstruction, mobile lightstage, mulitview photometric stereo, svbrdf estimation, shape from shading, material segmentation, handheld 3d sensor, non-lambertian surfaces

0

0

0

0

1:01

14/06/2020

SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimization

Yue Jiang, Dantong Ji, Zhizhong Han, Matthias Zwicker

Keywords Paper

differentiable rendering, signed distance field, image-based 3d reconstruction, 3d shape optimization, deep learning, inverse graphics

0

0

0

0

5:01

06/12/2020

Generative View Synthesis: From Single-view Semantics to Novel-view Images

Tewodros Amberbir Habtegebrial, Varun Jampani, Orazio Gallo, Didier Stricker

Keywords Paper

0

0

0

0

3:20

16/11/2020

Range Conditioned Dilated Convolutions for Scale Invariant 3D Object Detection

Alex Bewley, Pei Sun, Thomas Mensink and
Dragomir Anguelov, Cristian Sminchisescu

Keywords Paper

0

0

0

0

5:06

06/12/2021

A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis

Xingang Pan, Xudong XU, Chen Change Loy and
Christian Theobalt, Bo Dai

Keywords Paper

generative model

0

0

0

0

11:15

14/06/2020

Anisotropic Convolutional Networks for 3D Semantic Scene Completion

Jie Li, Kai Han, Peng Wang and
Yu Liu, Xia Yuan

Keywords Paper

semantic scene completion, dense voxel prediction, shape completion, semantic segmentation, rgb-d, anisotropic convolution, voxel-wise receptive fields, 3d convolution

0

0

0

0

1:01

14/06/2020

Lightweight Multi-View 3D Pose Estimation Through Camera-Disentangled Representation

Edoardo Remelli, Shangchen Han, Sina Honari and
Pascal Fua, Robert Wang

Keywords Paper

3d pose estimation, multi-view fusion, disentangled representation learning, direct linear triangulation

0

0

0

0

1:00

30/11/2020

3D Guided Weakly Supervised Semantic Segmentation

Weixuan Sun, Jing Zhang, Nick Barnes

Keywords Paper

0

0

0

0

9:20

14/06/2020

Novel View Synthesis of Dynamic Scenes With Globally Coherent Depths From a Monocular Camera

Jae Shin Yoon, Kihwan Kim, Orazio Gallo and
Hyun Soo Park, Jan Kautz

Keywords Paper

view synthesis, depth estimation, dynamic scene, depth fusion, globally coherent depth, monocular camera

0

0

0

0

1:00

14/06/2020

Hierarchical Scene Coordinate Classification and Regression for Visual Localization

Xiaotian Li, Shuzhe Wang, Yi Zhao and
Jakob Verbeek, Juho Kannala

Keywords Paper

visual localization, camera relocalization, scene coordinate regression

0

0

0

0

1:01

07/09/2020

Image Harmonization with Attention-based Deep Feature Modulation

Guoqing Hao, Satoshi Iizuka, Kazuhiro Fukui

Keywords Paper

image harmonization, feature map modulation, attention

0

0

0

0

5:03

14/06/2020

Joint Texture and Geometry Optimization for RGB-D Reconstruction

Yanping Fu, Qingan Yan, Jie Liao, Chunxia Xiao

Keywords Paper

rgb-d reconstruction, 3d reconstruction, texture optimization, geometry optimization, joint texture and geometry optimization

0

0

0

0

0:57

06/12/2020

Pixel-Level Cycle Association: A New Perspective for Domain Adaptive Semantic Segmentation

Guoliang Kang, Yunchao Wei, Yi Yang and
Yueting Zhuang, Alexander Hauptmann

Keywords Paper

0

0

0

0

3:16

06/12/2021

DIB-R++: Learning to Predict Lighting and Material with a Hybrid Differentiable Renderer

Wenzheng Chen, Joey Litalien, Jun Gao and
Zian Wang, Clement Fuji Tsang, Sameh Khamis, Or Litany, Sanja Fidler

Keywords Paper

graph learning

0

0

0

0

14:37

03/05/2021

Bowtie Networks: Generative Modeling for Joint Few-Shot Recognition and Novel-View Synthesis

Zhipeng Bao, Yu-Xiong Wang, Martial Hebert

Keywords Paper

adversarial training, computer vision, object recognition, few-shot learning, generative models

0

0

0

0

5:11

02/02/2021

Self-Paced Two-dimensional PCA

Jiangxin Li, Zhao Kang, Chong Peng, Wenyu Chen

Keywords Paper

0

0

0

0

17:01

22/11/2021

FETNet: Feature Exchange Transformer Network for RGB-D Object Detection

Zhibin Xiao, Jing-Hao Xue, Pengwei Xie, Guijin Wang

Keywords Paper

RGB-D object detection, Multi-modal Fusion, Vision Transformer, Feature Exchange

0

0

0

0

2:54

19/08/2021

Spline Positional Encoding for Learning 3D Implicit Signed Distance Fields

Peng-Shuai Wang, Yang Liu, Yu-Qi Yang, Xin Tong

Keywords Paper

Computer Vision, 2D and 3D Computer Vision

0

0

0

0

9:42

06/12/2021

Learnable Fourier Features for Multi-dimensional Spatial Positional Encoding

Yang Li, Si Si, Gang Li and
Cho-Jui Hsieh, Samy Bengio

Keywords Paper

machine learning, transformers, vision

0

0

0

0

10:54

25/07/2020

Regional relation modeling for visual place recognition

Yingying Zhu, Biao Li, Jiong Wang, Zhou Zhao

Keywords Paper

convolutional neural network, visual place recognition, content-based image retrieval, relation modeling

0

0

0

0

14:11

06/12/2021

Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesis

Tianchang Shen, Jun Gao, Kangxue Yin and
Ming-Yu Liu, Sanja Fidler

Keywords Paper

deep learning, optimization, generative model

0

0

0

0

14:32

14/06/2020

Learning Fused Pixel and Feature-Based View Reconstructions for Light Fields

Jinglei Shi, Xiaoran Jiang, Christine Guillemot

Keywords Paper

light field, view synthesis, feature-based reconstruction, pixel-based reconstruction, deep learning, angular super-resolution

0

0

0

0

4:56

30/11/2020

Recursive Bayesian Filtering for Multiple Human Pose Tracking from Multiple Cameras

Oh-Hun Kwon, Julian Tanke, Jürgen Gall

Keywords Paper

0

0

0

0

9:33

06/12/2020

Discover, Hallucinate, and Adapt: Open Compound Domain Adaptation for Semantic Segmentation

KwanYong Park, Sanghyun Woo, Inkyu Shin, In So Kweon

Keywords Paper

Probabilistic Methods -> Bayesian Nonparametrics, Algorithms -> Meta-Learning

0

0

0

0

3:25

06/12/2020

Swapping Autoencoder for Deep Image Manipulation

Taesung Park, Jun-Yan Zhu, Oliver Wang and
Jingwan Lu, Eli Shechtman, Alexei Efros, Richard Zhang

Keywords Paper

0

0

0

0

3:20

06/12/2021

Sparse Steerable Convolutions: An Efficient Learning of SE(3)-Equivariant Features for Estimation and Tracking of Object Poses in 3D Space

Jiehong Lin, Hongyang Li, Ke Chen and
Jiangbo Lu, Kui Jia

Keywords Paper

vision

0

0

0

0

12:29

14/06/2020

3D Photography Using Context-Aware Layered Depth Inpainting

Meng-Li Shih, Shih-Yang Su, Johannes Kopf, Jia-Bin Huang

Keywords Paper

computational photography, novel view synthesis

0

0

0

0

1:01

14/06/2020

PointRend: Image Segmentation As Rendering

Alexander Kirillov, Yuxin Wu, Kaiming He, Ross Girshick

Keywords Paper

instance segmentation, semantic segmentation, high-resolution, implicit function, rendering

0

0

0

0

4:59

12/07/2020

Latent Space Factorisation and Manipulation via Matrix Subspace Projection

Xiao Li, Chenghua Lin, Ruizhe Li and
Chaozheng Wang, Frank Guerin

Keywords Paper

Deep Learning - Generative Models and Autoencoders

0

0

0

0

12:54

26/04/2020

Neural Outlier Rejection for Self-Supervised Keypoint Learning

Jiexiong Tang, Hanme Kim, Vitor Guizilini and
Sudeep Pillai, Rares Ambrus

Keywords Paper

Self-Supervised Learning, Keypoint Detection, Outlier Rejection, Deep Learning

0

0

0

0

4:55