JSEA  Vol.5 No.12 B , December 2012
A Fast Depth-Map Generation Algorithm based on Motion Search from 2D Video Contents
Abstract: Generation of a depth-map from 2D video is the kernel of DIBR (Depth Image Based Rendering) in 2D-3D video conversion systems. However it occupies over most of the system resource where the motion search module takes up 90% time-consuming in typical motion estimation-based depth-map generation algorithms. In order to reduce the computational complexity, in this paper a new fast depth-map generation algorithm based on motion search is developed, in which a fast diamond search algorithm is adopted to decide whether a 16x16 or 4x4 block size is used based on Sobel operator in the motion search module to obtain a sub-depth-map. Then the sub-depth-map will be fused with the sub-depth-maps gotten from depth from color component Cr and depth from linear perspective modules to compensate and refine detail of the depth-map, finally obtain a better depth-map. The simulation results demonstrate that the new approach can greatly reduce over 50% computational complexity compared to other existing methods.
Cite this paper: W. Wang and Y. Zhu, "A Fast Depth-Map Generation Algorithm based on Motion Search from 2D Video Contents," Journal of Software Engineering and Applications, Vol. 5 No. 12, 2012, pp. 144-148. doi: 10.4236/jsea.2012.512B028.

[1]   M. Op de Beeck, and A. Redert, “Three Dimensional video for the Home,” Proceedings of International Con-ference on Augmented, Virtual Environments and Three-Dimensional Image, May-June 2001, pp. 188-191.

[2]   Fehn, C.: Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. SPIE, vol.5291, no.2, pp. 93-104 2004.

[3]   P. Harman, J. Flack, S. Fox, M. Dowley.: Rapid 2D to 3D Conversion. Proceedings of SPIE, vol. 4660, pp. 78-86, 2002

[4]   Wa James Tam, Carlos Vázquez, Filippo Speranza.: Three-dimensional TV: A novel method for generating surrogate depth maps using color information. Proc. SPIE Electronics Imaging-stereoscopic Displays and Applications XX, 2009.

[5]   D. Kim, D. Min, K. Sohn.: Stereoscopic video generation method using mo-tion analysis. in Proceedings of the 3DTV Conference, pp. 1–4, Kos Island, May 2007.

[6]   Sung-Fang Tsai, Chao-Chung Cheng, Chung-Te Li, Liang-Gee Chen.:A Real-Time 1080p 2D-to-3D Video Conversion System. IEEE Transactions on Consumer Electronics, Vol. 57, No. 2, pp. 803–804, May 2011.

[7]   I. Ideses, L. P. Ya-roslavsky, B. Fishbain.: Real-time 2D to 3D video con-version. Journal of Real-Time Image Processing, vol. 2, no.1, pp. 3–9, 2007.

[8]   C. Tomasi, R. Manduchi.: Bilateral Filtering for Gray and Color Images. Proceedings of the IEEE International Conference on Computer Vision, Bombay, India, pp.839-846, Bombay January 1998.

[9]   M. T. Pourazad, P. Nasiopoulos, and R. K. Ward.: An H.264-based scheme for 2D to 3D video conversion. IEEE Transactions on Consumer Electronics, vol.55, no.2, pp. 742–748, 2009.

[10]   A.-M. Huang, T. Nguyen.: Motion vector processing using the color information. IEEE International Conference on Image Processing, ICIP, pp. 1605-1608, Cairo, 2009.

[11]   W. J. Tam, f. Speranza, L. Zhang, R. Renaud, J. Chan, C. Vazquez.: Depth Image Based Rendering for Multiview Stereoscopic Displays: Role of Information at Object Boundaries. Three-Dimensional TV, Video, and Display IV, vol. 6016, pp. 75-85, 2005.

[12]   L. Po, X. Xu, Y. Zhu, S. Zhang: Automatic 2D-to-3D video conversion technique based on depth-from-motion and color segmentation. IEEE International Conference on Signal Processing, ICSP, pp.1000-1003, 2010.

[13]   J. Chen, Yuesheng Zhu and X. Liu.: A New Block-Matching Based Approach for Automatic 2D to 3D Conversion. The 4th International Conference on Computer Engineering and Technology, ICCET, pp. 109-113,Thailand,2012.

[14]   D. Wu, S. Wu, K. Lim, F. Pan, Z. Li, X. Lin: Block INTER mode decision for fast encoding of H.264. IEEE International Conference on Acoustics, Speech, and Signal Processing, 2004. Proceedings. (ICASSP '04). vol.3, 2004 pp. iii- 181.

[15]   F. Pan, X. Lin, R. Susanto, K. P. Lim, Z. G. Li, G. N. Feng,D. J. Wu, and S. Wu.: Fast Mode Decision Algorithm for Intra Prediction in JVT. 7th JVT meeting, JVT-G013, Thailand, March 2003.

[16]   K. R. Castleman.: Digital Image Processing. Prentice Hall Inc, 1996.

[17]   Shan Zhu, Kai-Kuang Ma.: A new diamond search algorithm for fast block-matching motion estimation. IEEE Transactions on Image Processing, vol.9, no.2, pp.287-290, Feb 2000.