Learning a Neural 3D Texture Space From 2D Exemplars

14/06/2020

Learning a Neural 3D Texture Space From 2D Exemplars

Philipp Henzler, Niloy J. Mitra, Tobias Ritschel

Keywords: texture synthesis, neural texture, solid texturing, implicit representation

Abstract Paper Similar Papers

Abstract: We suggest a generative model of 2D and 3D natural textures with diversity, visual fidelity and at high computational efficiency. This is enabled by a family of methods that extend ideas from classic stochastic procedural texturing (Perlin noise) to learned, deep, non-linearities. Our model encodes all exemplars from a diverse set of textures without a need to be re-trained for each exemplar. Applications include texture interpolation, and learning 3D textures from 2D exemplars.

0

0

0

0

Share

This is an embedded video. Talk and the respective paper are published at CVPR 2020 virtual conference. If you are one of the authors of the paper and want to manage your upload, see the question "My papertalk has been externally embedded..." in the FAQ section.

Comments

Post Comment

no comments yet

Similar Papers

14/06/2020

End-to-End Optimization of Scene Layout

Andrew Luo, Zhoutong Zhang, Jiajun Wu, Joshua B. Tenenbaum

Keywords Paper

scene graph, scene synthesis, differentiable rendering, object layout, deep learning

0

0

0

0

4:58

06/12/2020

GramGAN: Deep 3D Texture Synthesis From 2D Exemplars

Tiziano Portenier, Siavash Arjomand Bigdeli, Orcun Goksel

Keywords Paper

0

0

0

0

3:17

06/12/2021

MarioNette: Self-Supervised Sprite Learning

Dmitriy Smirnov, MICHAEL GHARBI, Matthew Fisher and
Vitor Guizilini, Alexei A Efros, Justin Solomon

Keywords Paper

deep learning, self-supervised learning, graph learning

0

0

0

0

9:14

14/06/2020

SDFDiff: Differentiable Rendering of Signed Distance Fields for 3D Shape Optimization

Yue Jiang, Dantong Ji, Zhizhong Han, Matthias Zwicker

Keywords Paper

differentiable rendering, signed distance field, image-based 3d reconstruction, 3d shape optimization, deep learning, inverse graphics

0

0

0

0

5:01

17/08/2020

Deep geometric texture synthesis

Amir Hertz, Rana Hanocka, Raja Giryes, Daniel Cohen-Or

Keywords Paper

surface reconstruction, shape analysis, geometric deep learning

0

0

0

0

16:08

30/11/2020

Novel-View Human Action Synthesis

Mohamed Ilyes Lakhal, Davide Boscaini, Fabio Poiesi and
Oswald Lanz, Andrea Cavallaro

Keywords Paper

0

0

0

0

4:34

26/04/2020

Semantically-Guided Representation Learning for Self-Supervised Monocular Depth

Vitor Guizilini, Rui Hou, Jie Li and
Rares Ambrus, Adrien Gaidon

Keywords Paper

computer vision, machine learning, deep learning, monocular depth estimation, self-supervised learning

0

0

0

0

4:30

14/06/2020

SG-NN: Sparse Generative Neural Networks for Self-Supervised Scene Completion of RGB-D Scans

Angela Dai, Christian Diller, Matthias Nießner

Keywords Paper

3d vision, self-supervised training, generative 3d learning, 3d reconstruction

0

0

0

0

1:00

14/06/2020

DIST: Rendering Deep Implicit Signed Distance Function With Differentiable Sphere Tracing

Shaohui Liu, Yinda Zhang, Songyou Peng and
Boxin Shi, Marc Pollefeys, Zhaopeng Cui

Keywords Paper

differentiable rendering, 3d reconstruction, implicit representations, multi-view reconstruction, depth completion, 3d deep learning

0

0

0

0

1:01

30/11/2020

3D Object Detection and Pose Estimation of Unseen Objects in Color Images with Local Surface Embeddings

Giorgia Pitteri, Aureélie Bugeau, Slobodan Ilic, Vincent Lepetit

Keywords Paper

0

0

0

0

9:17

14/06/2020

Scene Recomposition by Learning-Based ICP

Hamid Izadinia, Steven M. Seitz

Keywords Paper

3d scene recomposition, 3d scene reconstruction, deep reinforcement learning, learning-based icp (licp), 3d geometry learning, 3d cad models, 3d shapes, room layout estimation, 3d geometry deep network, iterative closest point

0

0

0

0

1:01

12/07/2020

PolyGen: An Autoregressive Generative Model of 3D Meshes

Charlie Nash, Yaroslav Ganin, S. M. Ali Eslami, Peter Battaglia

Keywords Paper

Deep Learning - Generative Models and Autoencoders

0

0

0

0

12:20

06/12/2020

BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Images

Thu Nguyen-Phuoc, Christian Richardt, Long Mai and
Yongliang Yang, Niloy Mitra

Keywords Paper

0

0

0

0

3:24

30/11/2020

DeepVoxels++: Enhancing the Fidelity of Novel View Synthesis from 3D Voxel Embeddings

Tong He, John Collomosse, Hailin Jin, Stefano Soatto

Keywords Paper

0

0

0

0

7:47

22/11/2021

GaussiGAN: Controllable Image Synthesis with 3D Gaussians from Unposed Silhouettes

Youssef Alami Mejjati, Isa Milefchik, Aaron K Gokaslan and
Oliver Wang, Kwang In Kim, James Tompkin

Keywords Paper

structured representation, 3D representation, 3D Gaussians, image generation, image synthesis, image editing, controlled generation, GANs

0

0

0

0

2:49

14/06/2020

Learning Texture Invariant Representation for Domain Adaptation of Semantic Segmentation

Myeongjin Kim, Hyeran Byun

Keywords Paper

domain adaptation, segmentation, texture

0

0

0

0

1:01

18/07/2021

Learning disentangled representations via product manifold projection

Marco Fumero, Luca Cosmo, Simone Melzi, Emanuele Rodola

Keywords Paper

Applications, Matrix and Tensor Factorization, Optimization; Optimization, Non-Convex Optimization, Deep Learning, Embedding and Representation learning

0

0

0

0

5:20

14/06/2020

SynSin: End-to-End View Synthesis From a Single Image

Olivia Wiles, Georgia Gkioxari, Richard Szeliski, Justin Johnson

Keywords Paper

single image view synthesis, view synthesis, differentiable rendering, point cloud, convolutional neural networks, generative networks

0

0

0

0

4:58

14/06/2020

3D Photography Using Context-Aware Layered Depth Inpainting

Meng-Li Shih, Shih-Yang Su, Johannes Kopf, Jia-Bin Huang

Keywords Paper

computational photography, novel view synthesis

0

0

0

0

1:01

02/02/2021

Self-Supervised Sketch-to-Image Synthesis

Bingchen Liu, Yizhe Zhu, Kunpeng Song, Ahmed Elgammal

Keywords Paper

0

0

0

0

14:42

06/12/2021

Voxel-based 3D Detection and Reconstruction of Multiple Objects from a Single Image

Feng Liu, Xiaoming Liu

Keywords Paper

vision

0

0

0

0

9:19

18/07/2021

Sharf: Shape-conditioned Radiance Fields from a Single View

Konstantinos Rematas, Ricardo Martin-Brualla, Vittorio Ferrari

Keywords Paper

Applications, Computer Vision

0

0

0

0

5:11

14/06/2020

Unsupervised Learning of Intrinsic Structural Representation Points

Nenglun Chen, Lingjie Liu, Zhiming Cui and
Runnan Chen, Duygu Ceylan, Changhe Tu, Wenping Wang

Keywords Paper

3d point cloud learning, structure point, unsupervised learning

0

0

0

0

1:00

06/12/2020

DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation

Alexandre Carlier, Martin Danelljan, Alexandre Alahi, Radu Timofte

Keywords Paper

0

0

0

0

3:23

14/06/2020

Learning Unsupervised Hierarchical Part Decomposition of 3D Objects From a Single RGB Image

Despoina Paschalidou, Luc Van Gool, Andreas Geiger

Keywords Paper

3d reconstruction, primitive-based representations, structure-aware representations, part-based decomposition, primitives, semantic shape abstractions, single-view 3d reconstruction, unsupervised learning, 3d deep learning

0

0

0

0

1:01

14/06/2020

Multi-Path Learning for Object Pose Estimation Across Domains

Martin Sundermeyer, Maximilian Durner, En Yen Puang and
Zoltan-Csaba Marton, Narunas Vaskevicius, Kai O. Arras, Rudolph Triebel

Keywords Paper

object pose estimation, encodings, multi object, synthetic data, symmetries, autoencoder, embedding, 6d object detection, t-less, relative pose estimation

0

0

0

0

1:01

05/01/2021

Learning to Generate Dense Point Clouds With Textures on Multiple Categories

Tao Hu, Geng Lin, Zhizhong Han, Matthias Zwicker

Keywords Paper

0

0

0

0

4:57

03/05/2021

Bowtie Networks: Generative Modeling for Joint Few-Shot Recognition and Novel-View Synthesis

Zhipeng Bao, Yu-Xiong Wang, Martial Hebert

Keywords Paper

adversarial training, computer vision, object recognition, few-shot learning, generative models

0

0

0

0

5:11

30/11/2020

HDD-Net: Hybrid Detector Descriptor with Mutual Interactive Learning

Axel Barroso-Laguna, Yannick Verdie, Benjamin Busam, Krystian Mikolajczyk

Keywords Paper

0

0

0

0

10:03

06/12/2020

Swapping Autoencoder for Deep Image Manipulation

Taesung Park, Jun-Yan Zhu, Oliver Wang and
Jingwan Lu, Eli Shechtman, Alexei Efros, Richard Zhang

Keywords Paper

0

0

0

0

3:20

06/12/2021

Generative Occupancy Fields for 3D Surface-Aware Image Synthesis

Xudong XU, Xingang Pan, Dahua Lin, Bo Dai

Keywords Paper

generative model

0

0

0

0

6:47

06/12/2020

Learning Deformable Tetrahedral Meshes for 3D Reconstruction

Jun Gao, Wenzheng Chen, Tommy Xiang and
Alec Jacobson, Morgan McGuire, Sanja Fidler

Keywords Paper

Applications -> Computer Vision; Deep Learning -> CNN Architectures, Applications -> Body Pose, Face, and Gesture Analysis

0

0

0

0

3:22

26/04/2020

Higher-Order Function Networks for Learning Composable 3D Object Representations

Eric Mitchell, Selim Engin, Volkan Isler, Daniel D Lee

Keywords Paper

computer vision, 3d reconstruction, deep learning, representation learning

0

0

0

0

5:28

06/12/2020

Canonical 3D Deformer Maps: Unifying parametric and non-parametric methods for dense weakly-supervised category reconstruction

David Novotny, Roman Shapovalov, Andrea Vedaldi

Keywords Paper

0

0

0

0

3:20

14/06/2020

Neural Voxel Renderer: Learning an Accurate and Controllable Rendering Tool

Konstantinos Rematas, Vittorio Ferrari

Keywords Paper

neural rendering, image synthesis

0

0

0

0

1:00

18/07/2021

NeRF-VAE: A Geometry Aware 3D Scene Generative Model

Adam Kosiorek, Heiko Strathmann, Daniel Zoran and
Pol Moreno, Rosalia Schneider, Sona Mokra, Danilo J. Rezende

Keywords Paper

Deep Learning, Generative Models

0

0

0

0

17:23

14/06/2020

Deep Geometric Functional Maps: Robust Feature Learning for Shape Correspondence

Nicolas Donati, Abhishek Sharma, Maks Ovsjanikov

Keywords Paper

shape matching, 3d deep learning, functional maps, point clouds, computational geometry, 3d correspondence, 3d feature extraction

0

0

0

0

4:59

06/12/2020

One-sample Guided Object Representation Disassembling

Zunlei Feng, Yongming He, Xinchao Wang and
Xin Gao, Jie Lei, Cheng Jin, Mingli Song

Keywords Paper

Deep Learning -> Efficient Inference Methods, Deep Learning

0

0

0

0

3:24

06/12/2020

Generative View Synthesis: From Single-view Semantics to Novel-view Images

Tewodros Amberbir Habtegebrial, Varun Jampani, Orazio Gallo, Didier Stricker

Keywords Paper

0

0

0

0

3:20

06/12/2021

Recognizing Vector Graphics without Rasterization

XINYANG JIANG, LU LIU, Caihua Shan and
Yifei Shen, Xuanyi Dong, Dongsheng Li

Keywords Paper

deep learning, machine learning, vision, graph learning

0

0

0

0

15:02