ERROR RESILIENCE OF H.264/AVC CODING STRUCTURES FOR DELIVERY OVER WIRELESS NETWORKS

DILSHER I.   MUSTAFA; ISMAIL A.  ALI

doi:10.26682/sjuod.2022.25.2.11

DILSHER I. MUSTAFA Dept. of Electrical and Computer Engineering, College of Engineering, University of Duhok, Kurdistan Region-Iraq
ISMAIL A. ALI Dept. of Electrical and Computer Engineering, College of Engineering, University of Duhok, Kurdistan Region-Iraq

DOI: https://doi.org/10.26682/sjuod.2022.25.2.11

Keywords: H.264/AVC, Video Coding, Error Resilience, Wireless Communication, NS-3

Abstract

Video content represents a large portion of global network traffic, and it is expected that this trend will continue as 4K video streaming becomes more popular and more applications such as entertainment and surveillance become available. Wireless networks are becoming the most important technologies for delivering cost-effective content, including video. The unpredictability of wireless channels, as well as the sensitivity of video content to packet losses, errors, and delays makes video delivery over wireless network difficult. Furthermore, when compared to wire links, congestion and complex traffic patterns make wireless channels much worse. Packet losses and network errors can be mitigated with the help of modern codecs. This study looks at the modern video codec H.264/Advanced Video Coding (AVC) and how to use the built-in error resilience tools to improve end-to-end video quality over simulated wireless networks. Network Simulator 3 (NS-3) was used and a framework for video quality assessment based on EvalVid 2.7 tools was employed. We tested the performance of several coding structures in the presence of different intra coding techniques. Results for less active video sequences showed that the IBP coding structure with intra period of 18 achieved best performance at lower loss rates. The addition of an intra MB line or extra random intra MBs did not seem to offer extra protection against errors for these sequences. For more active video sequences, IBBBP coding structure without or with an intra MB line performed better than all other configurations at all loss rates

Downloads

Download data is not yet available.

References

Adeyemi-Ejeye, Anthony O, Mohammed Alreshoodi, Laith Al-Jobouri, and Martin Fleury. 2019a. 'Impact of packet loss on 4K UHD video for portable devices', Multimedia tools and applications, 78: 31733-55.
Adeyemi-Ejeye, Anthony Olufemi, Mohammed Alreshoodi, Laith Al-Jobouri, and Martin Fleury. 2019b. 'Prospects for live higher resolution video streaming to mobile devices: achievable quality across wireless links', Journal of Real-Time Image Processing, 16: 127-41.
Alfaqheri, Taha Tareq. 2019. 'Error control strategies in H. 265| HEVC video transmission', Brunel University London.
Ali, Ismail, Martin Fleury, and Mohammed Ghanbari. 2012. "Content-aware intra-refresh for video streaming over lossy links." In 2012 IEEE International Conference on Consumer Electronics (ICCE), 118-19. IEEE.
Ali, Ismail, Martin Fleury, Sandro Moiron, and Mohammed Ghanbari. 2011. "Enhanced prioritization for video streaming over QoS-enabled wireless networks." In 2011 Wireless Advanced, 268-72. IEEE.
Bing, Benny. 2015. Next-generation video coding and streaming (John Wiley & Sons).
Calafate, CM, and Manuel P Malumbres. 2003. "Testing the H. 264 error-resilience on wireless ad-hoc networks." In Proceedings EC-VIP-MC 2003. 4th EURASIP Conference focused on Video/Image Processing and Multimedia Communications (IEEE Cat. No. 03EX667), 789-96. IEEE.
Chen, Haoming, Chen Zhao, Ming-Ting Sun, and Aaron Drake. 2015. 'Adaptive intra-refresh for low-delay error-resilient video coding', Journal of Visual Communication and Image Representation, 31: 294-304.
Dai, Qin, and Ralf Lehnert. 2010. "Impact of packet loss on the perceived video quality." In 2010 2nd International Conference on Evolving Internet, 206-09. IEEE.
doxygen. 'FFMPEG documentation'. http://ffmpeg.org/doxygen/trunk/index.html.
'FFMPEG '. 2013. Accessed 2013-02-04. http://ffmpeg.org/.
Flynn, David, Detlev Marpe, Matteo Naccari, Tung Nguyen, Chris Rosewarne, Karl Sharman, Joel Sole, and Jizheng Xu. 2015. 'Overview of the range extensions for the HEVC standard: Tools, profiles, and performance', IEEE Transactions on Circuits and systems for video technology, 26: 4-19.
Gang, Hui-Seon, Goo-Rak Kwon, and Jae-Young Pyun. 2016. 'Network-Aware Reference Frame Control for Error-Resilient H. 264/AVC Video Streaming Service', Mobile Information Systems, 2016.
Grange, Adrian, Peter De Rivaz, and Jonathan Hunt. 2016. 'VP9 bitstream & decoding process specification', WebM Project.
Halbach, Till, and Steffen Olsen. 2004. "Error robustness evaluation of H. 264/MPEG-4 AVC." In Visual Communications and Image Processing 2004, 617-27. International Society for Optics and Photonics.
Jeanlf. 2022. 'MP4Box packager'. https://github.com/gpac/gpac/wiki/MP4Box.
Kazemi, Mohammad, Mohammad Ghanbari, and Shervin Shirmohammadi. 2019. 'Intra coding strategy for video error resiliency: behavioral analysis', IEEE Transactions on Multimedia, 22: 2193-206.
Kumar, Sunil, Liyang Xu, Mrinal K Mandal, and Sethuraman Panchanathan. 2006. 'Error resiliency schemes in H. 264/AVC standard', Journal of Visual Communication and Image Representation, 17: 425-50.
Lee, Yung-Lyul, Ki-Hun Han, and Gary J Sullivan. 2006. 'Improved lossless intra coding for H. 264/MPEG-4 AVC', IEEE transactions on image processing, 15: 2610-15.
Moiron, Sandro, Ismail Ali, Mohammed Ghanbari, and Martin Fleury. 2011. "Enhanced slicing for robust video transmission." In 2011 IEEE EUROCON-International Conference on Computer as a Tool, 1-4. IEEE.
Nunes, Paulo, Luis Ducla Soares, and Fernando Pereira. 2008. "Error resilient macroblock rate control for H. 264/AVC video coding." In 2008 15th IEEE International Conference on Image Processing, 2132-35. IEEE.
Psannis, Kostas E. 2016. 'HEVC in wireless environments', Journal of Real-Time Image Processing, 12: 509-16.
Stockhammer, Thomas, Miska M Hannuksela, and Thomas Wiegand. 2003. 'H. 264/AVC in wireless environments', IEEE Transactions on Circuits and systems for video technology, 13: 657-73.
Sullivan, Gary J, and Thomas Wiegand. 2005. 'Video compression-from concepts to the H. 264/AVC standard', Proceedings of the IEEE, 93: 18-31.
Tan, Keyu, and Alan Pearmain. 2010. "An improved FMO slice grouping method for error resilience in H. 264/AVC." In 2010 IEEE International Conference on Acoustics, Speech and Signal Processing, 1442-45. IEEE.
UHRINA, MIROSLAV, JAROSLAV FRNDA, LUKÁŠ ŠEVČÍK, and MARTIN VACULÍK. 2014. 'The impact of GOP pattern and packet loss on the video quality of H. 264/AVC compression standard', Advances in Neural Networks, Fuzzy Systems and Artificial Intelligence, 21.
university, Arizona State University and Aalborg. 2014. 'Video Trace Library and YUV Video Sequences', Accessed 2014 Saturday, April 5. http://trace.eas.asu.edu/yuv/.
'VP9 Video Codec'. 2017. https://www.webmproject.org/vp9/.
Wolf, Stephen, and Margaret Pinson. 2002. 'Video quality measurement techniques', 2002.
Zatt, Bruno, Marcelo Porto, Jacob Scharcanski, and Sergio Bampi. 2010. "Gop structure adaptive to the video content for efficient H. 264/AVC encoding." In 2010 IEEE International Conference on Image Processing, 3053-56. IEEE.
Ze-Nian Li, Mark S. Drew, and Jiangchuan Liu. 2014. Fundamentals of Multimedia.
Zhou, Wang. 2004. 'Image quality assessment: from error measurement to structural similarity', IEEE transactions on image processing, 13: 600-13.