Towards occlusion-aware multifocal displays

Abstract: The human visual system uses numerous cues for depth perception, including disparity, accommodation, motion parallax and occlusion. It is incumbent upon virtual-reality displays to satisfy these cues to provide an immersive user experience. Multifocal displays, one of the classic approaches to satisfy the accommodation cue, place virtual content at multiple focal planes, each at a different depth. However, the content on focal planes close to the eye do not occlude those farther away; this deteriorates the occlusion cue as well as reduces contrast at depth discontinuities due to leakage of the defocus blur. This paper enables occlusion-aware multifocal displays using a novel ConeTilt operator that provides an additional degree of freedom — tilting the light cone emitted at each pixel of the display panel. We show that, for scenes with relatively simple occlusion configurations, tilting the light cones provides the same effect as physical occlusion. We demonstrate that ConeTilt can be easily implemented by a phase-only spatial light modulator. Using a lab prototype, we show results that demonstrate the presence of occlusion cues and the increased contrast of the display at depth edges.

02/02/2021

segmentation, video object segmentation, referring segmentation, referring video object segmentation, video object segmentation from referring expressions, referring image segmentation, referring image comprehension, optical flow, visual grounding

2:57

14/06/2020

light field, view synthesis, feature-based reconstruction, pixel-based reconstruction, deep learning, angular super-resolution

4:56

14/06/2020

rgb-d reconstruction, 3d reconstruction, texture optimization, geometry optimization, joint texture and geometry optimization

0:57

26/04/2020

Lei Han, Tian Zheng, Lan Xu, Lu Fang

cylindrical convolutional networks, viewpoint variation, object detection, viewpoint estimation, convolutional neural networks

1:01

26/04/2020

stereo matching, wavelet coefficients, inverse wavelet transform, supervised learning, deep representation, multi-scale features, multi-resolution cost volume, wavelet regression, disparity reconstruction, disparity refinement

1:01

22/11/2021

motion blur, spatially varying, attention, dynamic filter, adaptive, dynamic scene, deformable, encoder decoder, hierarchical, convolutional neural network

1:00

22/11/2021

point cloud, point cloud segmentation, 3D, point cloud classification, shape classification, deep 3D segmentation, deep learning, scene understanding, 3D scene understanding, light network, local agregation, gnn

2:57

05/01/2021

3d human pose estimation, self-supervised learning, disentangling factors of variation, human puppet model, pose transfer, novel view synthesis, human part segmentation

5:00

05/01/2021