在计算和传输资源受限的智能手机上编码传输实时会话视频一直是引人关注的关键技术。在采用肤色、运动和纹理信息快速提取感兴趣区域并且使用丢包率修正感兴趣区域权重的基础上，提出一种HEVC会话视频容错编码方案。仿真结果表明，该方案在丢包率5%~20%的网络中编码传输时，会话视频的感兴趣区峰值信噪比PSNR比现存的随机帧内刷新方法至少提高0.7 dB，编码时间减少20%~40%。实际比特率符合目标比特率要求。
Conversational video coding and transmission on resource-constrained mobile phones has been a key technology. We propose a novel error resilient scheme for conversational video transmission in HEVC which is based on the fast extraction for region-of-interest (ROI) according to skin color, motion, and texture information and adjustments for the ROI weights using the packet-loss rate. The simulation results show that, compared to the random frame refresh method, the proposed scheme improves PSNR of the ROI by at least 0.7dB and reduces coding time by 20%-40% when the video coding and delivery is over the channel with the packet-loss rate of 5%-20%. At the same time the actual bitrate matches the target bitrate.
[1] Sullivan G J, Ohm J, Han W, et al. Overview of the high efficiency video coding (HEVC) standard[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2012, 22(12):1649-1668.
[2] Zhang R, Regunathan S L, Rose K. Video coding with optimal inter/intra-mode switching for packet loss resilience[J]. IEEE Journal on Selected Areas in Communications, 2000, 18(6):966-976.
[3] Stockhammer T, Hannuksela M M, Wiegand T. H.264/AVC in wireless environments[J]. IEEE Transactions on Circuits and Systems for Video Technology, 2003, 13(7):657-673.
[4] Yuan Z, Wen G, Yan L, et al. Joint source-channel rate-distortion optimization for H.264 video coding over error-prone networks[J]. IEEE Transactions on Multimedia, 2007, 9(3):445-454.
[5] Zhifeng C, Dapeng W. Prediction of transmission distortion for wireless video communication:analysis[J]. IEEE Transactions on Image Processing, 2012, 21(3):1123-1137.
[6] Kulupana G, Talagala D S, Arachchi H K, et al. Error resilience aware motion estimation and mode selection for HEVC video transmission[C]//2016 IEEE International Conference on Consumer Electronics (ICCE):IEEE, 2016:85-86.
[7] Joint Video Team(JVT) of ISO/IEC MPEG & ITU-T VCEG. H.264 reference software JM[CP/OL]. (2016-07-15)[2017-04-20]. http://iphome.hhi.de/suehring/tml/.
[8] Nyamweno S, Satyan R, Labeau F. Intra-distance derived weighted distortion for error resilience[C]//200916th IEEE International Conference on Image Processing (ICIP):IEEE, 2009:1057-1060.
[9] Chen Q, Chen Z, Gu X, et al. Attention-based adaptive intra refresh for error-prone video transmission[J]. IEEE Communications Magazine, 2007, 45(1):52-60.
[10] Maung H M, Aramvith S, Miyanaga Y. Region-of-interest based error resilient method for HEVC video transmission[C]//201515th International Symposium on Communications and Information Technologies (ISCIT):IEEE, 2015:241-244.
[11] Meddeb M, Cagnazzo M, Pesquet-Popescu B. ROI-based rate control using tiles for an HEVC encoded video stream over a lossy network[C]//2015 IEEE International Conference on Image Processing (ICIP):IEEE, 2015:1389-1393.
[12] Joint Collaborative Team on Video Coding (JCT-VC). HEVC reference software HM(HEVC test model)[CP/OL]. (2013-04-01)[2016-07-15]. https://hevc.hhi.fraunhofer.de/.
[13] Li B, Li H, Li L, et al. λ domain rate control algorithm for high efficiency video coding[J]. IEEE Transactions on Image Processing, 2014, 23(9):3841-3854.
[14] Hsu R L, Abdel-Mottaleb M, Jain A K. Face detection in color images[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(5):696-706.
