Three-Dimensional Visualization Technique of Occluded Objects Using Integral Imaging with Plenoptic Camera

Min-Chul Lee; Kotaro Inoue; Masaharu Tashiro; Myungjin Cho
September 2017
Journal of Information & Communication Convergence Engineering;Sep2017, Vol. 15 Issue 3, p193
Academic Journal
In this study, we propose a three-dimensional (3D) visualization technique of occluded objects using integral imaging with a plenoptic camera. In previous studies, depth map estimation from elemental images was used to remove occlusion. However, the resolution of these depth maps is low. Thus, the occlusion removal accuracy is not efficient. Therefore, we use a plenoptic camera to obtain a high-resolution depth map. Hence, individual depth map for each elemental image can also be generated. Finally, we can regenerate a more accurate depth map for 3D objects with these separate depth maps, allowing us to remove the occlusion layers more efficiently. We perform optical experiments to prove our proposed technique. Moreover, we use MSE and PSNR as a performance metric to evaluate the quality of the reconstructed image. In conclusion, we enhance the visual quality of the reconstructed image after removing the occlusion layers using the plenoptic camera.


Related Articles

  • Multiple Depth Maps Integration for 3D Reconstruction Using Geodesic Graph Cuts. Zheng, Jiangbin; Zuo, Xinxin; Ren, Jinchang; Wang, Sen // International Journal of Software Engineering & Knowledge Engine;Apr2015, Vol. 25 Issue 3, p473 

    Depth images, in particular depth maps estimated from stereo vision, may have a substantial amount of outliers and result in inaccurate 3D modelling and reconstruction. To address this challenging issue, in this paper, a graph-cut based multiple depth maps integration approach is proposed to...

  • A Method of Reconstruction Based on Kinect Depth Camera. Li Guangsong; Luo Jiehong // Journal of Applied Sciences;2013, Vol. 13 Issue 19, p3968 

    3D point cloud modeling technology is one of the important research contents of computer vision field. We analyze Microsoft's Kinect depth camera as a 3D measuring device and present a new method to build 3D points cloud model based on depth maps of Kinect sensor and the OpenGL libraries. In...

  • A taxonomy of depth map creation methods used in multiview video compression. Ayatollahi, Seyed; Moghadam, Amir; Hosseini, Monireh // Multimedia Tools & Applications;Sep2014, Vol. 72 Issue 2, p1887 

    In this paper, we propose a taxonomy of depth map creation methods which are used in multiview video compression. The focus is on investigation of approaches that used in 3D video compression. 3D videos provide a more realistic and extended view that leads to achievement more details about the...

  • A Novel Method to Automatically Generate Depth Maps Based on Trace Points. Tianqi Zhao; Xinzhu Sang; Yangdong Liu; Chongxiu Yu; Daxiong Xu; Xunbo Yu; Guozhong Shi // Applied Mechanics & Materials;2014, Issue 513-517, p3890 

    A novel method to automatically generate the depth map is presented, when the depth maps of reference images located before and after the target image in the same image sequence are given. A novel grid dividing method and a joint feature response model are proposed to adaptively select trace...

  • Human Action Recognition Using Motion History Image Based Temporal Segmentation. Lin, Shou-Jen; Chao, Mei-Hsuan; Lee, Chao-Yang; Yang, Chu-Sing // International Journal of Pattern Recognition & Artificial Intell;Jul2016, Vol. 30 Issue 6, p-1 

    A human action recognition system based on image depth is proposed in this paper. Depth information features are not easily disturbed by noise; and due to this characteristic, the system can quickly extract foreground targets. Moreover, the target data, namely, depth and two-dimensional (2D)...

  • 3D Multi-Copter Navigation and Mapping Using GPS, Inertial, and LiDAR. Dill, Evan T.; Uijt de Haag, Maarten // Navigation (0028-1522);Summer2016, Vol. 63 Issue 2, p205 

    As the use of unmanned aerial vehicles has become more prevalent, the need for a reliable three-dimensional positioning and navigation capability is required to enable operation in challenging environments where the Global Positioning System (GPS) may not be available. For many of these...

  • Application of Structural Methods for Stereo Depth Map Improvement. Malashin, Roman; Peterson, Maxim; Lutsiv, Vadim // AIP Conference Proceedings;Jun2013, Vol. 1537 Issue 1, p27 

    The paper describes an approach to integrating the structural methods in correlation algorithms for dense depth map construction from a stereo pair. The main idea is to modify the matrix of correlation energy according to the result of structural analysis. The modified matrix forces the Graph...

  • Integrating wavelet transformation with Markov random field analysis for the depth estimation of light-field images. Wei-Yu Lee; Chi-Ying Li; Jia-Yush Yen // IET Computer Vision;2017, Vol. 11 Issue 5, p358 

    This study addresses the problem of recovering the three-dimensional depth data from the images taken by a lightfield camera. Unlike the conventional approach to extract the depth information from the spatial and the angular gradients in the epipolar plane images (EPIs), this study proposes to...

  • Reducing the gap between Augmented Reality and 3D modeling with real-time depth imaging. Kahn, Svenja // Virtual Reality;Jun2013, Vol. 17 Issue 2, p111 

    Whereas 3D surface models are often used for augmented reality (e.g., for occlusion handling or model-based camera tracking), the creation and the use of such dense 3D models in augmented reality applications usually are two separated processes. The 3D surface models are often created in offline...

  • Auto-Covariance Analysis for Depth Map Coding. Lei Liu; Yao Zhao; Chunyu Lin; Huihui Bai // KSII Transactions on Internet & Information Systems;Sep2014, Vol. 8 Issue 9, p3146 

    Efficient depth map coding is very crucial to the multi-view plus depth (MVD) format of 3-D video representation, as the quality of the synthesized virtual views highly depends on the accuracy of the depth map. Depth map contains smooth area within an object but distinct boundary, and these...


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics