Advances in light field photography technique

doi:10.7523/j.issn.2095-6134.2011.5.001

Abstract

Abstract:

Light field is a representation of full four-dimensional radiance of all rays with spatial and angular information in free space, and capture of light field data enables many new development potentials for computational imaging. The historical development of light field photography is summarized, and typical light field photography devices are categorized in view of capture methods for 4D light field. Based on the principles of light field camera, computational imaging theorem, refocusing theory, synthetic aperture refocusing algorithm, and light field microscopic technology are emphatically described. Finally, the promising application perspectives and existing critical issues of light field imaging are discussed.

Key words: light field camera, digital refocusing, synthetic aperture photography, light field microscopy

CLC Number:

TB879

NIE Yun-Feng, XIANGLI Bin, ZHOU Zhi-Liang. Advances in light field photography technique[J]. , 2011, 28(5): 563-572.

References

[1] Ives F. Parallax stereogram and process of making same: US, 725567 . 1902-09-25 .http://www.google.com/patents.

[2] Lippmann G. Reversible prints integral photographs
[J]. Academy of Sciences, 1908(7): 821-825.

[3] Gershun A. The light field
[J]. Journal of Mathematics and Physics, 1939(18): 51-151.

[4] Gabor D. A new microscopic principle
[J]. Nature, 1948(161): 777-778.

[5] Okoshi T. Three-dimensional imaging and television
[J].J IECET, 1968, 51(10): 1247-1257.

[6] Okoshi T. Optimum parameters and depth resolution of lens-sheet and projection-type three-dimensional displays
[J]. App Opt, 1971, 10(10): 2284-2291.

[7] Dudnikov Y A. Autostereoscopy and integral photography
[J]. Opt Tech, 1970, 37(7): 422- 425.

[8] Dudnikov Y A. Elimination of image pseudoscopy in integral photography
[J]. Opt Tech, 1971, 38(3): 140-143.

[9] Dudnikov Y A, Rozhkov B K. Selecting the parameters of the lens-array photographing system inintegral photography
[J]. Sov J Opt Tech, 1978, 45(6): 349-351.

[10] Dudnikov Y A, Rozhkov B K, Antipova E N. Obtaining a portrait of a person by the integral photography method
[J]. Sov J Opt Tech, 1980, 47(9): 562-563.

[11] Dudley L. Methods of integral photography: US, 3675553 . 1970-10-12 . http://www.google.com/patents.

[12] Dudley L. Stereoscopic photography: US, 3683773 . 1972-08-15 . http://www.google.com/patents.

[13] Montebello de. Integral photography: US 3503315 . 1966-12-12 .http://www.google.com/patents.

[14] Adelson E, Wang Y A. Single lens stereo with a plenoptic camera
[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1992, 14(2): 99-106.

[15] Levoy M, Hanrahan P. Light field rendering //Proc SIGGRAPH. New York: ACM Press, 1996: 31- 42.

[16] Ng R, Levoy M, Bredif M. Light field photography with a hand-held plenoptic camera . Tech Rep CSTR: Stanford Computer Science Tech Report CSTR, 2005.

[17] Levoy M, Ng R, Adams A. Light field microscopy //Proc SIGGRAPH. New York: ACM Press, 2006, 25(3): 924-934.

[18] Kak A C, Slaney M. Principles of computerized tomographic imaging
[M]. Philadelphia: Society for Industrial Mathematics, 2001.

[19] Chamgoulov R O, Lane P M. Optical computed-tomography microscope using digital spatial light modulation //Three-Dimensional and Multidimensional Microscopy. Washington D C: SPIE, 2004, 5324:182-192.

[20] Fife K, Gamal A. Integrated multi-aperture imaging //Proc SIGGRAPH. New York: ACM Press, 2008: 563-574.

[21] Fife K, Gamal A. A 3D multi-aperture image sensor architecture //Custom Integrated Circuits Conference. Washington D C: IEEE, 2006: 281-284.

[22] Georgiev T, Lumsdaine A. Resolution in plenoptic cameras //Computational Optical Sensing and Imaging (COSI). Washington D C: OSA, 2009:10.

[23] Georgiev T, Lumsdaine A. High dynamic range image capture with plenoptic 2.0 camera //Signal Recovery and Synthesis. Washington D C: OSA, 2009.

[24] Georgiev T, Intwala C, Goma S. Light field camera design for integral view photography: Adobe tech report . 2006.

[25] Wilburn B, Joshi N, Vaish V, et al. High performance imaging using large camera arrays //Proc SIGGRAPH. New York: ACM Press, 2005: 765-776.

[26] Isaksen A, McMillan L, Gortler S. Dynamically reparameterized light fields //Proc SIGGRAPH. New York: ACM Press, 2000: 297-306.

[27] Yang J C, Everett M, Buchler C, et al. A real-time distributed light field camera //Proc of the 13th Eurographics Workshop on Rendering. New York: ACM Press, 2002: 1-10.

[28] Kanade T, Saito H, Vedula S. The 3d room: digitizing time-varying 3d events by synchronized multiple video streams: technical report CMURITR-98-34 . Department of Computer Sciences, Carnegie Mellon University, 1998.

[29] Veeraraghavan A, Raslar R, Agraval A, et al. Dappled photography: Mask enhanced cameras for heterodyned light fields and coded aperture refocusing //Proc SIGGRAPH. New York: ACM press, 2007, 26(3):69-80.

[30] Liang C K, Liu G, Chen H. Light field acquisition using programmable aperture camera //Proc IEEE International Conference on Image Processing. Washington D C: IEEE Press, 2007, 5:233-236.

[31] Levin A, Fergus R, Durand F, et al. Image and depth from a conventional camera with a coded aperture //Proc SIGGRAPH. New York: ACM Press, 2007, 26(3):70-75.

[32] Liang C K, Lin T H, Wong B Y, et al. Programmable aperture photography: multiplexed light field acquisition //Proc SIGGRAPH. New York: ACM Press, 2008, 27(3): 55.

[33] Green P, Sun W, Matusik W, et al. Multi-aperture photography //Proc SIGGRAPH. New York: ACM Press, 2007, 26(3): 68.

[34] Xiao X G, Wang Z H, Sun C D, et al. A range focusing measurement technology based on light field photography
[J]. Acta Photonica Sinica, 2008, 37(12): 2539-2543(in Chinese). 肖相国,王忠厚,孙传东,等. 基于光场摄像技术的对焦测距方法的研究
[J]. 光子学报,2008, 37(12): 2539-2543.

[35] Yuan Y, Zhou Y,Hu H H. Registration error analysis for microlens array and photosensor in light field camera
[J]. Acta Photonica Sinica, 2010, 39(1): 123-126(in Chinese). 袁艳,周宇,胡煌华. 光场相机中微透镜阵列与探测器配准误差分析
[J]. 光子学报,2010, 39(1): 123-126.

[36] Ng R. Fourier slice photography //Proc SIGGRAPH. New York: ACM Press, 2005, 24: 735-744.

[37] Yang J C. Design and analysis of a two-dimensional camera array . Boston: Massachusetts Institute of Technology, 2005.

[38] Vaish V, Garg G, Talvala E V, et al. Synthetic aperture focusing using a shear-warp factorization of the viewing transform //Proc Workshop on Advanced 3D Imaging for Safety and Security. Washington D C: IEEE Press, 2005, 3:129-136.

[39] Levoy M, Zhang Z, Mcdowall I. Recording and controlling the 4D light field in a microscope using microlens arrays
[J]. Journal of Microscopy, 2009, 235:144-162.

[40] Castleman K R. Digital image processing
[M]. New Jersey: Prentice Hall, 1979.

[41] Swedlow J R, Sedat J W, Agard A. Deconvolution in optical microscopy
[J]. Optical Engineering, 1997,36(11): 284-309.

[42] Pawley J B.Handbook of biological confocal microscopy
[M]//Holmes T J, Bhattacharyya S. Light microscopic images reconstructed by maximum likelihood deconvolution. New York: Plenum Press, 1995: 389- 402.

[43] Bass M. Handbook of optics
[M]. 2ed.//Inoue S, Oldenbourg R. Microscopes. Columbus: McGraw-Hill, 1995: 477-492.

[44] Levoy M. Light fields and computational imaging
[J]. Computer, 2006, 39(8):46-55.

[45] Ng R, Hanrahan P. Digital correction of lens aberrations in light field photography //International Optical Design Conference. Washington D C: OSA Press, 2006, 6342: 3421.

[46] Georgiev T. Spatioangular resolution trade-off in integral photography //Eurographics Symposium on Rendering, 2006 . http://www.tgeorgiev.net.

[47] Lumsdaine A, Georgiev T. Full resolution lightfield rendering: adobe technical report . California: Adobe Press, 2008.

[48] Story D, Whitmire E, Georgiev T. The future of photography: adobe technical report . California: Adobe Press, 2008.

[49] Adams A, Talvala E V, Park S H, et al. The Frankencamera: An experimental platform for computational photography //Proc SIGGRAPH. New York: ACM Press, 2010: 1-12.