Improved rate-distortion optimized video coding using non-integer bit estimation and multiple Lambda search

Abstract

Many modern video encoders use the Lagrangian rate-distortion optimization (RDO) algorithm for mode decisions during the compression procedure. For each encoding stage, this approach involves minimizing a cost, which is a function of rate, distortion and a multiplier called Lambda. This paper proposes to improve the RDO process by applying two modifications. The first modification is to increase the accuracy of rate estimation, which is achieved by computing a non-integer number of bits for arithmetic coding of the syntax elements. This leads to a more accurate cost computation and therefore a better mode decision. The second modification is to search and adjust the value of Lambda based on the characteristics of each coding stage. For the encoder used, this paper proposes to search multiple values of Lambda for the intra-4×4mode decision. Moreover, a simple shift in Lambda value is proposed for motion estimation. Each of these modifications offers a certain gain in RDO performance, and, when all are combined, an average bit-rate saving of up to 7.0% can be achieved for the H.264/AVC codec while the same concept is applicable to the H.265/HEVC codec as well. The extra added complexity is contained to a certain level, and is also adjustable according to the processing resources available.

Keywords

rate distortion optimization / Lambda adjustment / non-integer bit estimation / H.264/AVC / H265/HEVC video coding

References

[1] ITU-T Recommendation H.265. Series H: audiovisual and multimedia systems: infrastructure of audiovisual services — coding of moving video. High Efficiency Video Coding, 2013

[2] ITU-T Recommendation H.264. Advanced video coding for generic audiovisual services. ISO/IEC, 2013

[3] Sullivan G J, Wiegand T.Rate-distortion optimization for video compression. IEEE Signal Processing Magazine, 1998, 15(6): 74–90

[4] Wiegand T, Schwarz H, Joch A, Kossentini F, Sullivan G J.Rateconstrained coder control and comparison of video coding standards.IEEE Transactions on Circuits and Systems for Video Technology, 2003, 13(7): 688–703

[5] An C, Nguyen T Q.Iterative rate-distortion optimization of H.264 with constant bit rate constraint. IEEE Transactions on Image Processing, 2008, 17(9): 1605–1615

[6] You J, Choi C, Jeong J. Modified rate distortion optimization using inter-block dependence for H.264/AVC intra coding. IEEE Transactions on Consumer Electronics, 2008, 54(3): 1383–1388

[7] Li B, Xu J, Zhang D, Li H.QP refinement according to Lagrange multiplier for high efficiency video coding. In: Proceedings of 2013 IEEE International Symposium on Circuits and Systems (ISCAS). 2013, 477–480

[8] Wu S, Liu P, Huang Y, Liu Q, Ikenaga T.On bit allocation and Lagrange Multiplier adjustment for rate-distortion optimized H. 264 rate control. In: Proceedings of IEEE International Workshop on Multimedia Signal Processing. 2009, 1–6

[9] Lee Y M, Sun Y T, Lin Y.SATD-based intra mode decision for H.264/AVC video coding. IEEE Transactions on Circuits and Systems for Video Technology, 2010, 20(3): 463–469

[10] Ghandi M M, Ghanbari M.A Lagrangian optimized rate control algorithm for the H. 264/AVC encoder. In: Processings of 2004 International Conference on Image Processing. 2004, 123–126

[11] Zhang J, Yi X, Ling N, Shang W.Context adaptive Lagrange multiplier (CALM) for rate-distortion optimal motion estimation in video coding. IEEE Transactions on Circuits and Systems for Video Technology, 2010, 20(6): 820–828

[12] Li X, Oertel N, Hutter A, Kaup A.Laplace distribution based Lagrangian rate distortion optimization for hybrid video coding. IEEE Transactions on Circuits and Systems for Video Technology, 2009, 19(2): 193–205

[13] Marpe D, Schwarz H,Wiegand T.Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard. IEEE Transactions on Circuits and Systems for Video Technology, 2003, 13(7): 620–636

[14] Sze V, Budagavi M.High throughput CABAC entropy coding in HEVC. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(12): 1778–1791

[15] Richardson I E.The H.264 Advanced Video Compression Standard. New York: John Wiley & Sons, 2011

[16] Ugur K, Andersson K, Fuldseth A, Bjontegaard G, Endresen L P, Lainema J, Wu Z.High performance, low complexity video coding and the emerging HEVC standard. IEEE Transactions on Circuits and Systems for Video Technology, 2010, 20(12): 1688–1697

[17] Han W J, Min J, Kim I K, Alshina E, Alshin A, Lee T, Park J H.Improved video compression efficiency through flexible unit representation and corresponding extension of coding tools. IEEE Transactions on Circuits and Systems for Video Technology, 2010, 20(12): 1709–1720

[18] Wiegand T.WD3: working draft 3 of high-efficiency video coding. Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO. IEC JTC1/SC29/WG11, 2011

[19] Shannon C E, Weaver W.The Mathematical Theory of Communication. Urbana: The University of Illinois Press, 1949

[20] Senzaki K, Chono K, Aoki H, Tajime J, Senda Y. BD-PSNR/Rate computation tool for five data points, In: Proceedings of the Meeting of Joint Collaborative Team on Video Coding. 2010

[21] Im S K, Ghandi M M, Lam C T.Non-integer bit estimation for ratedistortion optimized video coding. In: Processings of 2012 IEEE International Conference on Consumer Electronics. 2012, 88–89

[22] Li Z, Tourapis A M.Motion estimation with entropy coding considerations in H. 264/AVC. In: Processings of the 15th IEEE International Conference on Image Processing. 2008, 2140–2143

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag Berlin Heidelberg