30/11/2020

Bi-Directional Attention for Joint Instance and Semantic Segmentation in Point Clouds

guangnan wu, Zhiyi Pan, Peng Jiang, Changhe Tu

Keywords:

Abstract Paper Similar Papers

Abstract: Instance segmentation in point clouds is one of the most fine-grained ways to understand the 3D scene. Due to its close relationship to semantic segmentation, many works approach these two tasks simultaneously and leverage the benefits of multi-task learning. However, most of them only considered simple strategies such as element-wise feature fusion, which may not lead to mutual promotion. In this work, we build a Bi-Directional Attention module on backbone neural networks for 3D point cloud perception, which uses similarity matrix measured from features for one task to help aggregate non-local information for the other task, avoiding the potential feature exclusion and task conflict. From comprehensive experiments, ablation studies and efficiency studies on the S3DIS dataset and the PartNet dataset, the superiority of our method is verified. Moreover, the mechanism of how bi-directional attention module helps joint instance and semantic segmentation is also analyzed.

The video of this talk cannot be embedded. You can watch it here:
https://accv2020.github.io/miniconf/poster_509.html
(Link will open in new window)
 0
 0
 0
 0
  Share    
This is an embedded video. Talk and the respective paper are published at ACCV 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment
no comments yet
code of conduct: tbd Characters remaining: 140

Similar Papers

 0
 0
 0
 0
 2:57 
 0
 0
 0
 0
 14:24 
 0
 0
 0
 0
 9:45 
 0
 0
 0
 0
 3:04 
 0
 0
 0
 0
 2:51 
 0
 0
 0
 0
 2:51 
 0
 0
 0
 0
 10:43 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 11:20 
 0
 0
 0
 0
 4:48 
 0
 0
 0
 0
 13:21 
 0
 0
 0
 0
 3:03 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 2:30 
 0
 0
 0
 0
 2:58 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 16:30 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 4:58 
 0
 0
 0
 0
 5:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 1:01 
 0
 0
 0
 0
 17:44 
 0
 0
 0
 0
 6:49 
 0
 0
 0
 0
 1:00 
 0
 0
 0
 0
 14:37 
 0
 0
 0
 0
 19:54 
 0
 0
 0
 0
 6:36 
 0
 0
 0
 0
 20:35 
 0
 0
 0
 0
 5:29 
 0
 0
 0
 0
 15:02 
 0
 0
 0
 0
 3:19 
 0
 0
 0
 0
 2:53 
 0
 0
 0
 0
 8:45 
 0
 0
 0
 0
 0:59 
 0
 0
 0
 0
 15:01 
 0
 0
 0
 0
 2:56 
 0
 0
 0
 0
 1:03 
 0
 0
 0
 0
 3:22