Pano2Scene: 3D Indoor Semantic Scene Reconstruction from a Single Indoor Panorama Image

07/09/2020

Pano2Scene: 3D Indoor Semantic Scene Reconstruction from a Single Indoor Panorama Image

Wei Zeng, Sezer Karaoglu, Theo Gevers

Keywords: 3D point cloud, 3D reconstruction, panorama, scene reconstruction, single image reconstruction, scene understanding, semantic scene reconstruction

Abstract Paper Similar Papers

Abstract: 3D indoor semantic scene reconstruction from 2D images is challenging as it requires both scene understanding and object reconstruction. Compared to perspective images, panoramas provide larger field of view and carry more scene information. In this paper, to reconstruct the 3D indoor semantic scene from a single panorama image, we propose a pipeline that jointly learns to predict the 3D scene layout, complete the object shapes and reconstruct the full scene point cloud. Experiments on the Stanford 2D-3D dataset demonstrate the generality and suitability of the proposed method.

0

0

0

0

Share

This is an embedded video. Talk and the respective paper are published at BMVC 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment

no comments yet

Similar Papers

14/06/2020

Total3DUnderstanding: Joint Layout, Object Pose and Mesh Reconstruction for Indoor Scenes From a Single Image

Yinyu Nie, Xiaoguang Han, Shihui Guo and
Yujian Zheng, Jian Chang, Jian Jun Zhang

Keywords Paper

scene understanding, single-view reconstruction, 3d deep learning

0

0

0

0

4:59

05/01/2021

Dynamic Plane Convolutional Occupancy Networks

Stefan Lionar, Daniil Emtsev, Dusan Svilarkovic, Songyou Peng

Keywords Paper

0

0

0

0

4:59

06/12/2021

Panoptic 3D Scene Reconstruction From a Single RGB Image

Manuel Dahnert, Ji Hou, Matthias Niessner, Angela Dai

Keywords Paper

vision

0

0

0

0

6:06

22/11/2021

GaussiGAN: Controllable Image Synthesis with 3D Gaussians from Unposed Silhouettes

Youssef Alami Mejjati, Isa Milefchik, Aaron K Gokaslan and
Oliver Wang, Kwang In Kim, James Tompkin

Keywords Paper

structured representation, 3D representation, 3D Gaussians, image generation, image synthesis, image editing, controlled generation, GANs

0

0

0

0

2:49

14/06/2020

SynSin: End-to-End View Synthesis From a Single Image

Olivia Wiles, Georgia Gkioxari, Richard Szeliski, Justin Johnson

Keywords Paper

single image view synthesis, view synthesis, differentiable rendering, point cloud, convolutional neural networks, generative networks

0

0

0

0

4:58

07/09/2020

Centroid Based Concept Learning for RGB-D Indoor Scene Classification

Ali Ayub, Alan Wagner

Keywords Paper

cognitively-inspired learning, RGBD analysis, scene classification, category merging, labeling flaws analysis

0

0

0

0

10:03

14/06/2020

Geometric Structure Based and Regularized Depth Estimation From 360 Indoor Imagery

Lei Jin, Yanyu Xu, Jia Zheng and
Junfei Zhang, Rui Tang, Shugong Xu, Jingyi Yu, Shenghua Gao

Keywords Paper

depth estimation, 360 indoor imagery, geometric structure, with and without furniture

0

0

0

0

1:00

05/01/2021

Local to Global: Efficient Visual Localization for a Monocular Camera

Sang Jun Lee, Deokhwa Kim, Sung Soo Hwang, Donghwan Lee

Keywords Paper

0

0

0

0

4:54

06/12/2021

ATISS: Autoregressive Transformers for Indoor Scene Synthesis

Despoina Paschalidou, Amlan Kar, Maria Shugrina and
Karsten Kreis, Andreas Geiger, Sanja Fidler

Keywords Paper

transformers, generative model

0

0

0

0

14:52

06/12/2021

Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Image

Feng Liu, Xiaoming Liu

Keywords Paper

vision

0

0

0

0

9:19

14/06/2020

Single-View View Synthesis With Multiplane Images

Richard Tucker, Noah Snavely

Keywords Paper

view synthesis, monocular, multiplane image, image-based rendering, 3d deep learning, scale invariance

0

0

0

0

1:01

12/07/2020

MoNet3D: Towards Accurate Monocular 3D Object Localization in Real Time

XICHUAN ZHOU, YiCong Peng, Chunqiao Long and
Fengbo Ren, Cong Shi

Keywords Paper

Applications - Computer Vision

0

0

0

0

11:57

05/01/2021

Learning to Generate Dense Point Clouds With Textures on Multiple Categories

Tao Hu, Geng Lin, Zhizhong Han, Matthias Zwicker

Keywords Paper

0

0

0

0

4:57

14/06/2020

Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation

Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu

Keywords Paper

online segmentation, scene understanding, semantic segmentation, point cloud, 3d vision

0

0

0

0

1:01

30/11/2020

SDP-Net: Scene Flow Based Real-time Object Detection and Prediction from Sequential 3D Point Clouds

Yi Zhang, Yuwen Ye, Zhiyu Xiang, Jiaqi Gu

Keywords Paper

0

0

0

0

9:45

14/06/2020

Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF From a Single Image

Zhengqin Li, Mohammad Shafiei, Ravi Ramamoorthi and
Kalyan Sunkavalli, Manmohan Chandraker

Keywords Paper

physically-motivated learning, single-image inverse rendering, spatially-varying lighting, svbrdf, global light transport, mobile augmented reality

0

0

0

0

4:57

14/06/2020

Associate-3Ddet: Perceptual-to-Conceptual Association for 3D Point Cloud Object Detection

Liang Du, Xiaoqing Ye, Xiao Tan and
Jianfeng Feng, Zhenbo Xu, Errui Ding, Shilei Wen

Keywords Paper

3d object detection, domain adaptation, associative recognition, lidar, point cloud, convolutional neural network, autonomous driving

0

0

0

0

1:01

14/06/2020

KeyPose: Multi-View 3D Labeling and Keypoint Estimation for Transparent Objects

Xingyu Liu, Rico Jonschkowski, Anelia Angelova, Kurt Konolige

Keywords Paper

pose estimation, stereo, keypoint, transparent object, robotic manipulation, depth sensor, dataset

0

0

0

0

1:00

03/05/2021

Variational State-Space Models for Localisation and Dense 3D Mapping in 6 DoF

Atanas Mirchev, Baris Kayalibay, Patrick van der Smagt, Justin Bayer

Keywords Paper

SLAM, Deep learning, Variational inference, Bayesian inference, Generative models

0

0

0

0

5:04

14/06/2020

PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection

Shaoshuai Shi, Chaoxu Guo, Li Jiang and
Zhe Wang, Jianping Shi, Xiaogang Wang, Hongsheng Li

Keywords Paper

3d object detection, point cloud, 3d scene understanding, lidar, autonomous driving, kitti dataset, waymo open dataset

0

0

0

0

1:01

14/06/2020

Cascaded Human-Object Interaction Recognition

Tianfei Zhou, Wenguan Wang, Siyuan Qi and
Haibin Ling, Jianbing Shen

Keywords Paper

human-object interaction recognition, cascade reasoning, fine-grained relation segmentation

0

0

0

0

1:01

14/06/2020

FaceScape: A Large-Scale High Quality 3D Face Dataset and Detailed Riggable 3D Face Prediction

Haotian Yang, Hao Zhu, Yanru Wang and
Mingkai Huang, Qiu Shen, Ruigang Yang, Xun Cao

Keywords Paper

3d face dataset, face prediction, riggable model, 3d morphable model, dynamic details, deep neural network, displacement map

0

0

0

0

1:00

22/11/2021

PlaneRecNet: Multi-Task Learning with Cross-Task consistency for Piece-Wise Plane Detection and Reconstruction from a Single RGB Image

Yaxu Xie, Fangwen Shu, Jason Rambach and
A. Pagani, Didier Stricker

Keywords Paper

planar reconstruction, multi-task learning, cross-task consistency, instance segmentation, monocular depth estimation

0

0

0

0

2:54

19/08/2021

IMENet: Joint 3D Semantic Scene Completion and 2D Semantic Segmentation through Iterative Mutual Enhancement

Jie Li, Laiyan Ding, Rui Huang

Keywords Paper

Computer Vision, 2D and 3D Computer Vision

0

0

0

0

13:47

30/11/2020

HDD-Net: Hybrid Detector Descriptor with Mutual Interactive Learning

Axel Barroso-Laguna, Yannick Verdie, Benjamin Busam, Krystian Mikolajczyk

Keywords Paper

0

0

0

0

10:03

06/12/2020

Multi-Plane Program Induction with 3D Box Priors

Yikai Li, Jiayuan Mao, Xiuming Zhang and
Bill Freeman, Josh Tenenbaum, Noah Snavely, Jiajun Wu

Keywords Paper

0

0

0

0

3:24

06/12/2021

Modality-Agnostic Topology Aware Localization

Farhad G. Zanjani, Ilia Karmanov, Hanno Ackermann and
Daniel Dijkman, Simone Merlin, Max Welling, Fatih Porikli

Keywords Paper

optimal transport

0

0

0

0

11:06

06/12/2020

Multiview Neural Surface Reconstruction by Disentangling Geometry and Appearance

Lior Yariv, Yoni Kasten, Dror Moran and
Meirav Galun, Matan Atzmon, Basri Ronen, Yaron Lipman

Keywords Paper

0

0

0

0

3:21

02/02/2021

Embodied Visual Active Learning for Semantic Segmentation

David Nilsson, Aleksis Pirinen, Erik Gärtner, Cristian Sminchisescu

Keywords Paper

0

0

0

0

18:49

14/06/2020

Learning Generative Models of Shape Handles

Matheus Gadelha, Giorgio Gori, Duygu Ceylan and
Radomír Měch, Nathan Carr, Tamy Boubekeur, Rui Wang, Subhransu Maji

Keywords Paper

3d shapes, shape generation, generative models, shape handles, editing, shape parsing

0

0

0

0

1:00

14/09/2020

A 3D-Advert Creation System for Product Placements

Ivan Bacher, Hossein Javidnia, Soumyabrata Dev and
Rahul Agrahari, Murhaf Hossari, Matthew Nicholson, Clare Conran, Jian Tang, Peng Song, David Corrigan, Francois Pitie

Keywords Paper

advertisement, augmented reality, deep learning

0

0

0

0

12:19

14/06/2020

Hierarchical Scene Coordinate Classification and Regression for Visual Localization

Xiaotian Li, Shuzhe Wang, Yi Zhao and
Jakob Verbeek, Juho Kannala

Keywords Paper

visual localization, camera relocalization, scene coordinate regression

0

0

0

0

1:01

30/11/2020

3D Guided Weakly Supervised Semantic Segmentation

Weixuan Sun, Jing Zhang, Nick Barnes

Keywords Paper

0

0

0

0

9:20

14/06/2020

Scene Recomposition by Learning-Based ICP

Hamid Izadinia, Steven M. Seitz

Keywords Paper

3d scene recomposition, 3d scene reconstruction, deep reinforcement learning, learning-based icp (licp), 3d geometry learning, 3d cad models, 3d shapes, room layout estimation, 3d geometry deep network, iterative closest point

0

0

0

0

1:01

14/06/2020

OccuSeg: Occupancy-Aware 3D Instance Segmentation

Lei Han, Tian Zheng, Lan Xu, Lu Fang

Keywords Paper

instance segmentation, multi-task learning, occupancy

0

0

0

0

1:02

06/12/2020

Neural Star Domain as Primitive Representation

Yuki Kawana, Yusuke Mukuta, Tatsuya Harada

Keywords Paper

0

0

0

0

3:15

14/06/2020

DeepFaceFlow: In-the-Wild Dense 3D Facial Motion Estimation

Mohammad Rami Koujan, Anastasios Roussos, Stefanos Zafeiriou

Keywords Paper

3d flow, dense 3d facial motion capture, optical flow, scene flow, 3d reconstruction and tracking, in-the-wild monocular tracking, facial reenactment, expression recognition, performance capture, non-rigid facial deformations

0

0

0

0

1:01

14/06/2020

PVN3D: A Deep Point-Wise 3D Keypoints Voting Network for 6DoF Pose Estimation

Yisheng He, Wei Sun, Haibin Huang and
Jianran Liu, Haoqiang Fan, Jian Sun

Keywords Paper

6d pose estimation, 3d instance segmentation, 3d semantic segmentation, 3d keypoint, 3d scene understanding, vision for robotics, 3d single view, rgbd, 3d computer vision

0

0

0

0

1:01

22/11/2021

Higher-Order Implicit Fairing Networks for 3D Human Pose Estimation

Jianning Quan, Abdessamad Ben Hamza

Keywords Paper

Human pose estimation, higher-order graph convolution, implicit fairing, Jacobi method

0

0

0

0

3:26

26/04/2020

Learning to Move with Affordance Maps

William Qi, Ravi Teja Mullapudi, Saurabh Gupta, Deva Ramanan

Keywords Paper

navigation, exploration

0

0

0

0

5:28