02/02/2021

Depth Privileged Object Detection in Indoor Scenes via Deformation Hallucination

Zhijie Zhang, Yan Liu, Junjie Chen, Li Niu, Liqing Zhang

Keywords:

Abstract Paper Similar Papers

Abstract: RGB-D object detection has achieved significant advance, because depth provides complementary geometric information to RGB images. Considering depth images are unavailable in some scenarios, we focus on depth privileged object detection in indoor scenes, where the depth images are only available in the training phase. Under this setting, one prevalent research line is modality hallucination, in which depth image and depth feature are the common choices for hallucinating. In contrast, we choose to hallucinate depth deformation, which is explicit geometric information and efficient to hallucinate. Specifically, we employ the deformable convolution layer with augmented offsets as our deformation module and regard the offsets as geometric deformation, because the offsets enable flexibly sampling over the object and transforming to a canonical shape for ease of detection. In addition, we design a quality-based mechanism to avoid negative transfer of depth deformation. Experimental results and analyses on NYUDv2 and SUN RGB-D demonstrate the effectiveness of our method against the state-of-the-art methods for depth privileged object detection.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948243
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 12:29 
 0
 0
 0
 0
 6:47 
 0
 0
 0
 0
 18:27 
 0
 0
 0
 0
 9:58 
 0
 0
 0
 0
 18:54 
 0
 0
 0
 0
 11:15 
 0
 0
 0
 0
 3:01 
 0
 0
 0
 0
 3:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 0:57 
 0
 0
 0
 0
 8:27 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 5:03 
 0
 0
 0
 0
 15:02 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 3:03 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 4:48 
 0
 0
 0
 0
 5:11 
 0
 0
 0
 0
 4:54 
 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 5:23 
 0
 0
 0
 0
 10:00 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 8:14 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 2:55 
 0
 0
 0
 0
 16:09 
 0
 0
 0
 0
 5:26 
 0
 0
 0
 0
 5:09 
 0
 0
 0
 0
 17:44 
 0
 0
 0
 0
 11:39 
 0
 0
 0
 0
 19:26 
 0
 0
 0
 0
 1:01