PID-based bit allocation strategy for asymmetric stereoscopic video coding with fuzzy quality controller

Abstract

Asymmetric stereoscopic video coding can take advantage of binocular suppression in human vision by representing one of the two views in lower quality. This paper proposes a bit allocation strategy for asymmetric stereoscopic video coding. In order to improve the accuracy of bit allocation and rate control in the left view, a proportionalintegral-derivative controller is adopted. Meanwhile, to control the quality fluctuation between consecutive frames of the left view, a quality controller is adopted. Besides, a fuzzy controller is proposed to control the variation in quality between the left and right views by comparing the PSNR disparity of two views with a fixed threshold, which is used to quantize the binocular psycho-visual redundancy and adjust the quantization parameter (QP) of the right view correspondingly. The proposed algorithm has been implemented in H.264/AVC video codec, and the experimental results show its effectiveness in rate control while keeping a good quality for the left view, and fewer bits are allocated for the right view so that the overall bit rate is saved by 7.2% at most without the loss of subjective visual quality for stereoscopic video.

Keywords

stereoscopic video / bit allocation / proportional-integral-derivative (PID) controller / fuzzy controller / asymmetric coding

References

[1] Ahmad I. Multi-view video: Get ready for next-generation television [J]. IEEE Distributed Systems Online, 2007, 8(3): 1-5.

[2] Chen Y, Hannuksela M, Zhu L, et al. Coding techniques in multiview video coding and joint multiview video model [C]. Picture Coding Symp (PCS). Chicago, Illinois, USA, 2009 1-4.

[3] Saygili G, Gürler C G, Tekalp A M. Evaluation of asymmetric stereo video coding and rate scaling for adaptive 3D video streaming [J]. IEEE Transactions on Broadcasting, 2011, 57(2): 593-601.

[4] Meegan D V, Stelmach L B, Tam W J. Unequal weighting of monocular inputs in binocular combination: Implications for the compression of stereoscopic imagery [J]. Journal of Experimental Psychology: Applied, 2001, 7(2): 143-153.

[5] Shen L, Hou Chunping. Objective assessment of stereo images based on full human visual characteristics[J]. Journal of Tianjin University, 2012, 45(8): 682-687.

[6] Stelmach L, Tam W J, Meegan D, et al. Stereo image quality: Effects of mixed spatio-temporal resolution [J]. IEEE Transactions on Circuits and Systems Video Technology, 2000, 10(2): 188-193.

[7] Ozbek N, Tekalp A M. Unequal inter-view rate allocation using scalable stereo video coding and an objective stereo video quality measure [C]. IEEE International Conference on Multimedia and Expo. Hannover, Germany, 2008 1113-1116.

[8] Fehn C, Kauff P, Sukhee C, et al. Asymmetric coding of stereoscopic video for transmission over T-DMB [C]. 3DTV Conference. Kos Island, Greece, 2007

[9] Shao F, Jiang G, Wang X, et al. Stereoscopic video coding with asymmetric luminance and chrominance qualities [J]. IEEE Transactions on Consumer Electronics, 2010, 54(6): 2460-2468.

[10] ISO-IEC AVC-491. TM5: MPEG-2 Test Model 5 [S]. 1993

[11] ISO/IEC JTC1/SC29/WG11 W1796. Text of ISO/IEC 14 496-2 MPEG4 Video VM -Version 8. 0 [S]. 1997

[12] Cote G, Erol B, Gallant M, et al. H.263+: video coding at low bit rates [J]. IEEE Transactions on Circuits and Systems for Video Technology, 1998, 8(7): 849-866.

[13] Li Z G, Pan F, Lim K P, et al. Adaptive basic unit layer rate control for JVT[C]. Proceedings of the 7th Meeting on Joint Video Team of ISO/IEC MPEG and ITU-T VCEG, JVT-G012. Pattaya, Thailand, 2003 7-14.

[14] Leontaris A, Tourapis A L. Rate Control Reorganization in the Joint Model (JM) Reference Software [DB/OL]. 2009-04-15.

[15] Woontack W, Ortega A. Optimal blockwise dependent quantization for stereo image coding [J]. IEEE Transactions on Circuits and Systems for Video Technology, 1999, 9(6): 861-867.

[16] Zhu Z, Liang F, Jiang G, et al. Bit allocation and rate control for stereoscopic video coding [C]. 3DTV Conference. Kos Island, Greece, 2007

[17] Shao F, Jiang G, Yu M, et al. A novel control technique for asymmetric-quality stereoscopic video [J]. IEEE Transactions on Consumer Electronics, 2011, 57(4): 1823-1829.

[18] Sun Y, Ahmad I. A robust and adaptive rate control algorithm for object-based video coding [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2004, 14(10): 1167-1182.

[19] Zhou Y, Sun Y, Feng Z, et al. PID-based bit allocation strategy for H. 264/AVC rate control [J]. IEEE Transactions on Circuits and Systems II: Express Briefs, 2011, 58(3): 184-188.

[20] Rezaei M, Hannuksela M M, Gabbouj M. Semi-fuzzy rate controller for variable bit rate video [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2008, 18(5): 633-645.

[21] Shafei M, Rezaei M, Tavakoli S, et al. A fuzzy bit allocation algorithm for variable bit rate video coding [C]. Machine Vision and Image Processing(MVIP). Zahedan, Iran, 2011 1-4.

[22] Shen L, Zhang Z, Li Y, et al. Improved H. 264 GOP-level bit allocation by incremental PID algorithm [C]. IET Conference on Wireless, Mobile and Sensor Networks, 2007(CCWMSN07). Shanghai, China, 2007 521-525.

[23] Xu P, Zou S, Li Y, et al. A new linear rate control algorithm for H. 264 based on PID controller [C]. 2nd IEEE Conference on Industrial Electronics and Applications. Harbin, China, 2007 2058-2061.

[24] Chiang T, Zhang Y Q. A new rate control scheme using quadratic rate distortion model [J]. IEEE Transactions on Circuits and Systems for Video Technology, 1997, 7(1): 246-250.

[25] Keelan B W, Urabe H. ISO 20462: A psychophysical image quality measurement standard [C]. Proc. SPIE 5294: Image Quality and System Performance. San Jose, California, USA, 2004 181-189.

[26] Byung-Jae C, Seong-Woo K, Kook K B. Design and stability analysis of single-input fuzzy logic controller [J]. IEEE Transactions on Systems, Man, and Cybernetics(Part B): Cybernetics, 2000, 30(2): 303-309.