A new method to create depth information based on lighting analysis for 2D/3D conversion

Abstract

A new method creating depth information for 2D/3D conversion was proposed. The distance between objects is determined by the distances between objects and light source position which is estimated by the analysis of the image. The estimated lighting value is used to normalize the image. A threshold value is determined by some weighted operation between the original image and the normalized image. By applying the threshold value to the original image, background area is removed. Depth information of interested area is calculated from the lighting changes. The final 3D images converted with the proposed method are used to verify its effectiveness.

Keywords

lighting analysis / depth information / focus/defocus information / 2D/3D conversion

References

[1] CaoX, LiZ, DaiQ-hai. Semi-automatic 2D-to-3D conversion using disparity propagation [J]. IEEE Transaction on Broadcasting, 2011, 57(2): 491-499

[2] YuF-l, LiuJ, RenY-n, SunJ-d, GaoY-l, LiuWei. Depth generation method for 2D to 3D conversion [C]. 3DTV Conference: The True Vision — Capture, Transmission and Display of 3D Video (3DTV-CON). Antalya, 20111-4

[3] LinG-s, Cheng-yingY, ChenW-chih. A 2D to 3D conversion scheme based on depth cues analysis for MPEG videos [C]. IEEE International Conference on Multimedia and Expo ICME. Suntec City, 20101141-1145

[4] ChengC-c, LiC-t, ChenL-gee. A novel 2D-to-3D conversion system using edge information [J]. IEEE Transactions on Consumer Electronics, 2010, 56(3): 1739-1745

[5] RossJ T. Stereopsis by binocular delay [J]. Nature, 1974, 248: 363-364

[6] HanH-h, LeeG-s, LeeS-hun. 2D/3D image conversion method using simplification of level and reduction of noise for optical flow and information of edge [J]. Journal of The Korea Academia-Industrial Cooperation Society, 2012, 13(2): 827-833

[7] HanH-h, LeeG s, LeeJ-y, LeeS-hun. A study on create depth map using focus/defocus in single frame [J]. The Korea Society of Digital Policy & Management, 2012, 10(4): 191-198

[8] ChenY-c, WuY-c, LiuC-h, SunW-c, ChenY-chang. Depth map generation based on depth from focus [C]. 2010 International Conference on Electronic Devices Systems and Applications (ICEDSA2010). Kuala Lumpur, 201059-63

[9] KamolratB, FernandoW A C, MrakM, KondozA. 3D motion estimation for depth image coding in 3D video coding [J]. IEEE Transactions on Consumer Electronics, 2009, 55(2): 824-830

[10] ZhangL, VázquezC, KnorrS. 3D-TV content creation: automatic 2D-to-3D video conversion [J]. IEEE Transactions on Broadcasting, 2011, 57(2): 372-383

[11] KuoT-y, LoY-chung. Depth estimation from a monocular view of the outdoors [J]. IEEE Transactions on Consumer Electronics, 2011, 57(2): 817-822

[12] FengY, RenJ-c, JiangJ-min. Object-based 2D-to-3D video conversion for effective stereoscopic content generation in 3D-TV applications [J]. IEEE Transactions on Broadcasting, 2011, 57(2): 500-509

[13] UrhanO, ErtürkS. Constrained one-bit transform for low complexity block motion estimation [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2007, 17(4): 478-482

[14] SunD-q, RothS, Black MichaelJ. Secret of optical flow estimation and their principles [C]. 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). San Francisco, CA, USA, 20102432-2439

[15] MiledW, PesquetJ, ParentM. A convex optimization approach for depth estimation under illumination variation [J]. IEEE Transaction on Image Processing, 2009, 18(4): 813-830

[16] AchantaR, HemamiS, EstradaF, SüsstrunkS. Frequency-tuned salient region detection [C]. IEEE Conference on Computer Vision and Pattern Recognition. Miami, FL, USA, 20091597-1604