Journal of University of Chinese Academy of Sciences >
A novel method of depth-image-based view synthesis
Received date: 2010-02-05
Revised date: 2010-04-12
Online published: 2010-09-15
Against the ghosting and holes problem, this study proposes a novel method of depth-image-based view synthesis. First, we present a simultaneous rendering mechanism to generate the depth and image of virtual view at the same time, and then erase the ghosting by the depth comparison. Secondly, by means of depth-based hole filling and boundary treatment, we remove the holes in virtual view and boundary distortion. Experimental results show that, the PSNR of virtual view using this method is 2dB higher than that using MPEG-3DV/FTV reference method.
YU Li , GUO Li , YUAN Hong-Xing . A novel method of depth-image-based view synthesis[J]. Journal of University of Chinese Academy of Sciences, 2010 , 27(5) : 638 -644 . DOI: 10.7523/j.issn.2095-6134.2010.5.009
[1] Yang Y, Yue M, Jiang G Y. Survey on interactive three-dimensional video systems
[J]. Journal of Computer-aided Design & Computer Graphics , 2009,21(5):569-578(in Chinese). 杨 铀,郁 梅,蒋刚毅. 交互式三维视频系统研究进展
[J]. 计算机辅助设计与图形学学报,2009,21(5):569-578.
[2] Smolic A,Muller K, Merkle P, et al. 3D video and free viewpoint video-technologies, applications and MPEG standards //Proceedings of International Conference on Multimedia and Expo . 2006: 2161-2164.
[3] Pulli K, Cohen M, Duchamp T, et al. View-based rendering: visualizing real objects from scanned range and color data
[M]. Eurographics Rendering Workshop , 1997:23-24.
[4] Tanimoto M, Wildeboer M. Frameworks for FTV coding //Proceedings of the 27th Conference on Picture Coding Symposium . 2009:1-4.
[5] Oliveira M M, Bishop G, McAllister D. Relief texture mapping //Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques . 2000:359-368.
[6] Min D, Kim D, Sohn K. Virtual view rendering system for 3DTV //Proceedings of 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video. 2008: 249 - 252.
[7] Jo S, Lee D, Kim Y, et al. Development of a simple free viewpoint video system //Proceedings of International Conference on Multimedia and Expo . 2008: 1577-1580.
[8] Mori Y, Fukushima N, Fujii T, et al. View generation with 3D warping using depth information for FTV
[J]. Signal Processing: Image Communication , 2009, 24: 65-72.
[9] ISO/IEC JTC1/SC29/WG11, Reference softwares for depth estimation and view synthesis . Doc. M15377, 2008
[10] Middlebury stereo matching evaluation site . .http://vision.middlebury.edu/stereo.
[11] Telea A. An image inpainting technique based on the fast marching method
[J]. Proceedings of Journal of Graphics Tools , 2004(9):25-36.
[12] MSR 3D video Sequences . .http://research.microsoft.com/en-us/um/people/sbkang/3dvideodownload/.
/
| 〈 |
|
〉 |