Content based error resilience coding using redundant coding, reference frame modification, and mode decision

Abstract

Quality degradation occurs during transmission of video streaming over the error-prone network. By jointly using redundant slice, reference frame selection, and intra/inters mode decision, a content and end-to-end rate-distortion based error resilience method is proposed. Firstly, the intra/inter mode decision is implemented using macro-block (MB) refresh, and then redundant picture and reference frame selection are utilized together to realize the redundant coding. The estimated error propagation distortion and bit consumption of refresh MB are used for the mode and reference frame decision of refresh MB. Secondly, by analyzing the statistical property in the successive frames, the error propagation distortion and bit consumption are formulated as a function of temporal distance. Encoding parameters of the current frame is determined by the estimated error propagation distortion and bit consumption. Thirdly, by comparing the rate-distortion cost of different combinations, proper selection of error resilience method is performed before the encoding process of the current frame. Finally, the MB mode and bit distribution of the primary picture are analyzed for the derivation of the texture information. The motion information is subsequently incorporated for the calculation of video content complexity to implement the content based redundant coding. Experimental results demonstrate that the proposed algorithm achieves significant performance gains over the LA-RDO and HRP method when video is transmitted over error-prone channel.

Keywords

error resilience coding / redundant picture / macro-block (MB) refresh / reference frame selection / error propagation distortion

References

[1] ShuH-y, ChauL P. Intra/inter macroblock mode decision for error-resilient transcoding [J]. IEEE Transactions on Multimedia, 2008, 10(1): 97-104

[2] MaH-j, ZhouF, JiangR-x, ChenY-wu. A network-aware error-resilient method using prioritized intra refresh for wireless video communications [J]. Journal of Zhejiang University Science A, 2009, 10(8): 1169-1176

[3] FrossardP, VerscheureO. AMISP: a complete content-based MPEG-2 error-resilient scheme [J]. IEEE Transactions on Circuits and System for Video Technology, 2001, 11(9): 989-998

[4] XiaoJ-m, TilloT, LinC-y, ZhaoYao. Error-resilient video coding with end-to-end rate distortion optimized at macroblock level [J]. EURASIP Journal on Advances in Signal Processing, 201180

[5] ChanY-L, CheungH-K, SiuW-Chi. Compressed-domain techniques for error-resilient video transcoding using RPS [J]. IEEE Transactions on Image Processing, 2009, 18(2): 357-370

[6] PsannisK E, IshibashiY. Efficient error resilient algorithm for H.264/AVC: Mobility management in wireless video streaming [J]. Telecommunication Systems, 2009, 41(2): 65-76

[7] ZhouY-r, ChenY-wu. Error-resilient video coding of H.264/AVC based on network-adaptive intra refresh and reference selection refresh [J]. Optical Engineering, 2010, 49(7): 077401

[8] TilloT, GrangettoM, OlmoG. Redundant slice optimal allocation for H.264 multiple description coding [J]. IEEE Trans Circuits Syst Video Technol, 2008, 18(1): 59-70

[9] RadulovicI, FrossardP, WangY-k, HannukselaM M, HallapuroA. Multiple description video coding with H.264/AVC redundant pictures [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2010, 20(1): 144-148

[10] XuY-y, ZhuCe. End-to-end rate-distortion optimized description generation for H.264 multiple description video coding [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2013, 23(9): 1523-1536

[11] RaneS, BaccichetP, GirodB. Systematic lossy error protection of video signals [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2008, 18(10): 1347-1360

[12] ZhuC-b, WangY-K, HannukselaM M, LiH-qiang. Error resilient video coding using redundant pictures [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2009, 19(1): 3-14

[13] PierreF, DimitrisA, DavidB. A video error resilience redundant slices algorithm and its performance relative to other fixed redundancy schemes [J]. Signal Processing: Image Communication, 2010, 25(3): 163-178

[14] SchmidtJ C, RoseK. Jointly optimized mode decisions in redundant video streaming [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(4): 513-518

[15] MoironS, AliI, GhanbariM, FleuryM. limitations of multiple reference frames with cyclic intra-refresh line for H.264 AVC [J]. Electronics Letters, 2011, 47(2): 103-104

[16] ChenZ-f, WuD-peng. Prediction of transmission distortion for wireless video communication: Analysis [J]. IEEE Transactions on Image Processing, 2012, 21(3): 1123-1137

[17] KimM J, HongM C. Fast rate control algorithm in frame-layer for H.264/AVC video coding [J]. IEEE Transactions on Consumer Electronics, 2012, 58(3): 872-879

[18] YangH, RoseK. Optimizing motion compensated prediction for error resilient video coding [J]. IEEE Transactions on Image Processing, 2010, 19(1): 108-118

[19] ReibmanA R, VaishampayanV A, SermadeviY. Quality monitoring of video over a packet network [J]. IEEE Transactions on Multimedia, 2004, 6(2): 327-334

[20] WangY, WuZ-y, BoyceJ M. Modeling of transmission-loss induced distortion in decoded video [J]. IEEE Trans Circuits Syst Video Technol, 2006, 16(6): 716-732

[21] FarberN, StuhlmullerK, GirodB. Analysis of error propagation in hybrid video coding with application to error resilience [C]. IEEE International Conference on Image Processing (ICIP), 1999, Kobe, Japan, IEEE: 550-554

[22] JinX-s, ZhaoZ-j, LuX, LinM-liu. Error propagation model for 5/3-based motion compensated temporal filtering [C]. IEEE 10th International Conference on Signal Processing (ICSP), 2010, Beijing, China, IEEE: 1125-1128

[23] ChenZ F, WuD. Prediction of transmission distortion for wireless video communication: Algorithm and application [J]. Journal of Visual Communication and Image Representation, 2010, 21(8): 948-964

[24] LeontarisA, CosmanP C. Compression efficiency and delay tradeoffs for hierarchical B-pictures and pulsed-quality frames [J]. IEEE Transactions on Image Processing, 2007, 16(7): 1726-1740

[25] RibascorberaJ, ShawminL. Rate control in DCT video coding for low-delay communications [J]. IEEE Transactions on Circuits and Systems for Video Technology, 1999, 9(1): 172-185

[26] TanY-h, YeoC-h, LiZ-guo. Single-pass rate control with texture and non-texture rate-distortion models [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(8): 1236-1245

[27] ReiningerR C, GibsonJ D. Distributions of the two-dimensional DCT coefficients for images [J]. IEEE Transactions on Communications, 1983, 31(6): 835-839

[28] LinX-y, MaH-j, ChenY-wu. No-reference video quality assessment in the compressed domain [J]. IEEE Transactions on Consumer Electronics, 2012, 58(2): 505-512

[29] GaoT, LiuZ-g, YueS-h, ZhangJ, MeiJ-q, GaoW-chun. Robust background subtraction in traffic video sequence [J]. Journal of Central South University of Technology, 2010, 17(1): 187-195

[30] CaiQ, AggarwalJ. Tracking human motion in structured environments using a distributed-camera system [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1999, 21(11): 1241-1247

[31] LiuS, YanZ-d, KimJ-won. Hybrid global/local motion-compensated frame interpolation for low bitrate video [J]. Journal of Visual Communication and Image Representation, 2003, 14: 61-79

[32] SuY-p, SunM-t, HsuV. Global motion estimation from coarsely sampled motion vector field and the applications [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2005, 15(2): 232-242