02/02/2021

Learning Local Neighboring Structure for Robust 3D Shape Representation

Zhongpai Gao, Junchi Yan, Guangtao Zhai, Juyong Zhang, Yiyan Yang, Xiaokang Yang

Keywords:

Abstract Paper Similar Papers

Abstract: Mesh is a powerful data structure for 3D shapes. Representation learning for 3D meshes is important in many computer vision and graphics applications. The recent success of convolutional neural networks (CNNs) for structured data (e.g., images) suggests the value of adapting insight from CNN for 3D shapes. However, 3D shape data are irregular since each node's neighbors are unordered. Various graph neural networks for 3D shapes have been developed with isotropic filters or predefined local coordinate systems to overcome the node inconsistency on graphs. However, isotropic filters or predefined local coordinate systems limit the representation power. In this paper, we propose a local structure-aware anisotropic convolutional operation (LSA-Conv) that learns adaptive weighting matrices for each node according to the local neighboring structure and performs shared anisotropic filters. In fact, the learnable weighting matrix is similar to the attention matrix in random synthesizer -- a new Transformer model for natural language processing (NLP). Comprehensive experiments demonstrate that our model produces significant improvement in 3D shape reconstruction compared to state-of-the-art methods.

The video of this talk cannot be embedded. You can watch it here:
https://slideslive.com/38948272
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at AAAI 2021 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 10:27 
 0
 0
 0
 0
 4:39 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 3:03 
 0
 0
 0
 0
 19:03 
 0
 0
 0
 0
 3:25 
 0
 0
 0
 0
 1:02 
 0
 0
 0
 0
 10:41 
 0
 0
 0
 0
 3:22 
 0
 0
 0
 0
 10:43 
 0
 0
 0
 0
 4:41 
 0
 0
 0
 0
 14:18 
 0
 0
 0
 0
 3:08 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 16:58 
 0
 0
 0
 0
 16:11 
 0
 0
 0
 0
 13:25 
 0
 0
 0
 0
 5:00 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 2:58 
 0
 0
 0
 0
 12:23 
 0
 0
 0
 0
 9:53 
 0
 0
 0
 0
 15:12 
 0
 0
 0
 0
 4:56 
 0
 0
 0
 0
 11:35 
 0
 0
 0
 0
 3:08 
 0
 0
 0
 0
 12:05 
 0
 0
 0
 0
 14:05 
 0
 0
 0
 0
 14:47 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 5:08 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 3:18 
 0
 0
 0
 0
 5:06 
 0
 0
 0
 0
 12:22 
 0
 0
 0
 0
 3:16