Conversational video coding and transmission on resource-constrained mobile phones has been a key technology. We propose a novel error resilient scheme for conversational video transmission in HEVC which is based on the fast extraction for region-of-interest (ROI) according to skin color, motion, and texture information and adjustments for the ROI weights using the packet-loss rate. The simulation results show that, compared to the random frame refresh method, the proposed scheme improves PSNR of the ROI by at least 0.7dB and reduces coding time by 20%-40% when the video coding and delivery is over the channel with the packet-loss rate of 5%-20%. At the same time the actual bitrate matches the target bitrate.
HE Zhitao
,
ZHANG Can
,
CHEN Deyuan
. Region-of-interest based error resilient scheme for HEVC conversational video transmission[J]. Journal of University of Chinese Academy of Sciences, 2018
, 35(3)
: 425
-431
.
DOI: 10.7523/j.issn.2095-6134.2018.03.018
[1] Sullivan G J, Ohm J, Han W, et al. Overview of the high efficiency video coding (HEVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(12):1649-1668.
[2] Zhang R, Regunathan S L, Rose K. Video coding with optimal inter/intra-mode switching for packet loss resilience[J]. IEEE Journal on Selected Areas in Communications, 2000, 18(6):966-976.
[3] Stockhammer T, Hannuksela M M, Wiegand T. H.264/AVC in wireless environments[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2003, 13(7):657-673.
[4] Yuan Z, Wen G, Yan L, et al. Joint source-channel rate-distortion optimization for H.264 video coding over error-prone networks[J]. IEEE Transactions on Multimedia, 2007, 9(3):445-454.
[5] Zhifeng C, Dapeng W. Prediction of transmission distortion for wireless video communication:analysis[J]. IEEE Transactions on Image Processing, 2012, 21(3):1123-1137.
[6] Kulupana G, Talagala D S, Arachchi H K, et al. Error resilience aware motion estimation and mode selection for HEVC video transmission[C]//2016 IEEE International Conference on Consumer Electronics (ICCE):IEEE, 2016:85-86.
[7] Joint Video Team(JVT) of ISO/IEC MPEG & ITU-T VCEG. H.264 reference software JM[CP/OL]. (2016-07-15)[2017-04-20]. http://iphome.hhi.de/suehring/tml/.
[8] Nyamweno S, Satyan R, Labeau F. Intra-distance derived weighted distortion for error resilience[C]//200916th IEEE International Conference on Image Processing (ICIP):IEEE, 2009:1057-1060.
[9] Chen Q, Chen Z, Gu X, et al. Attention-based adaptive intra refresh for error-prone video transmission[J]. IEEE Communications Magazine, 2007, 45(1):52-60.
[10] Maung H M, Aramvith S, Miyanaga Y. Region-of-interest based error resilient method for HEVC video transmission[C]//201515th International Symposium on Communications and Information Technologies (ISCIT):IEEE, 2015:241-244.
[11] Meddeb M, Cagnazzo M, Pesquet-Popescu B. ROI-based rate control using tiles for an HEVC encoded video stream over a lossy network[C]//2015 IEEE International Conference on Image Processing (ICIP):IEEE, 2015:1389-1393.
[12] Joint Collaborative Team on Video Coding (JCT-VC). HEVC reference software HM(HEVC test model)[CP/OL]. (2013-04-01)[2016-07-15]. https://hevc.hhi.fraunhofer.de/.
[13] Li B, Li H, Li L, et al. λ domain rate control algorithm for high efficiency video coding[J]. IEEE Transactions on Image Processing, 2014, 23(9):3841-3854.
[14] Hsu R L, Abdel-Mottaleb M, Jain A K. Face detection in color images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(5):696-706.
