收稿日期: 2010-02-05
修回日期: 2010-04-12
网络出版日期: 2010-09-15
基金资助
教育部-英特尔信息技术专项科研基金(MOE-INTEL-08-08)资助
A novel method of depth-image-based view synthesis
Received date: 2010-02-05
Revised date: 2010-04-12
Online published: 2010-09-15
针对虚拟视点合成中存在的伪影和空洞问题,提出一种基于深度图像的视点绘制新方法.该方法首先使用视点同步生成机制得到虚拟视点的图像和深度信息,并根据深度信息擦除背景伪影;其次,通过基于深度的空洞填补和边界处理方法进一步消除视点图像中的空洞和前景边缘失真.实验结果表明,与MPEG 的3DV/FTV标准参考方法相比,该方法生成的虚拟视点PSNR值提高了2dB.
关键词： 视点合成; 3D变换; 基于深度图像的绘制; 3D视频/自由视点电视
郁理 , 郭立 , 袁红星 . 基于深度图像的视点绘制新方法[J]. 中国科学院大学学报, 2010 , 27(5) : 638 -644 . DOI: 10.7523/j.issn.2095-6134.2010.5.009
Against the ghosting and holes problem, this study proposes a novel method of depth-image-based view synthesis. First, we present a simultaneous rendering mechanism to generate the depth and image of virtual view at the same time, and then erase the ghosting by the depth comparison. Secondly, by means of depth-based hole filling and boundary treatment, we remove the holes in virtual view and boundary distortion. Experimental results show that, the PSNR of virtual view using this method is 2dB higher than that using MPEG-3DV/FTV reference method.
[1] Yang Y, Yue M, Jiang G Y. Survey on interactive three-dimensional video systems
[J]. Journal of Computer-aided Design & Computer Graphics , 2009,21(5):569-578(in Chinese). 杨 铀,郁 梅,蒋刚毅. 交互式三维视频系统研究进展
[J]. 计算机辅助设计与图形学学报,2009,21(5):569-578.
[2] Smolic A,Muller K, Merkle P, et al. 3D video and free viewpoint video-technologies, applications and MPEG standards //Proceedings of International Conference on Multimedia and Expo . 2006: 2161-2164.
[3] Pulli K, Cohen M, Duchamp T, et al. View-based rendering: visualizing real objects from scanned range and color data
[M]. Eurographics Rendering Workshop , 1997:23-24.
[4] Tanimoto M, Wildeboer M. Frameworks for FTV coding //Proceedings of the 27th Conference on Picture Coding Symposium . 2009:1-4.
[5] Oliveira M M, Bishop G, McAllister D. Relief texture mapping //Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques . 2000:359-368.
[6] Min D, Kim D, Sohn K. Virtual view rendering system for 3DTV //Proceedings of 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video. 2008: 249 - 252.
[7] Jo S, Lee D, Kim Y, et al. Development of a simple free viewpoint video system //Proceedings of International Conference on Multimedia and Expo . 2008: 1577-1580.
[8] Mori Y, Fukushima N, Fujii T, et al. View generation with 3D warping using depth information for FTV
[J]. Signal Processing: Image Communication , 2009, 24: 65-72.
[9] ISO/IEC JTC1/SC29/WG11, Reference softwares for depth estimation and view synthesis . Doc. M15377, 2008
[10] Middlebury stereo matching evaluation site . .http://vision.middlebury.edu/stereo.
[11] Telea A. An image inpainting technique based on the fast marching method
[J]. Proceedings of Journal of Graphics Tools , 2004(9):25-36.
[12] MSR 3D video Sequences . .http://research.microsoft.com/en-us/um/people/sbkang/3dvideodownload/.
/
| 〈 |
|
〉 |
