Final Report – Spring 2014 Course: EE5359 – Multimedia Processing Performance Comparison of HEVC & H.264 using various test sequences Under the guidance of K.R.Rao Submitted by Akula Venkata Harish UTA ID # 1000864859 email Id: venkatahari.akula@mavs.uta.edu

Contents Objective About HEVC About H.264 Metrics used for the performance comparison Profiles used for the performance comparison Test Sequences Results Acronyms References

Objective This project discusses the performance comparison of HEVC and H.264 using various test sequences based on various metrics such as PSNR, BD-rates and computational time.

About HEVC High Efficiency Video Coding (HEVC) is currently being developed as the latest video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. [9] The HEVC standard is intended to provide significantly better compression capability than the existing H.264/MPEG-4 AVC standard.[9] HEVC is said to double the data compression ratio compared to H.264/MPEG-4 AVC at the same level of video quality.[9]

HEVC Encoder Diagram

HEVC Decoder Diagram

Subdivision of a CTB into CB and TB

Subdivision of Picture into Slices and Tiles

About H.264 H.264 is a block oriented motion compensation based video compression standard developed by ITU-T Video Coding experts group (VCEG) together with the ISO/IEC JTC1 moving pictures experts group (MPEG). It is best known as being one of the video encoding standards for Blu-ray Discs.[8]

H.264 Encoder Block Diagram[7]

Salient Features of H.264 [13] Variable block-size motion estimation. It subdivides the frame into non overlapping fixed size blocks. Quarter –pixel accuracy motion estimation. Motion vectors over picture boundaries. Multiple reference frame facility.

Metrics to be used for the Performance Comparison Peak Signal to Noise Ratio (PSNR) BD- rates Implementation Complexity

Profiles to be used for comparison The following are the profiles used for the comparison of HEVC and H.264 in this project: HM 13.0 main profile[18] JM 18.6 high profile[20]

Test Sequences The following test sequences [21] are used for study in the project: KristenAndSara_1280x720_60

Test Sequences BQSquare_416x240_60

Test Sequences BQMall_832x480_60

Test Sequences BasketballDrill_832x480_50.yuv

RESULTS KristenAndSara_1280x720_60

Results BQSquare_416x240_60

Results BQMall_832x480_60

Results BasketballDrill_832x480_50

Bitrate Comparison of HEVC and H.264

PSNR Comparison of HEVC and H.264

Computational time comparison of HEVC and H.264

Bitrate Comparison of HEVC and H.264

PSNR Comparison of HEVC and H.264

Computational time comparison of HEVC and H.264

Bitrate Comparison of HEVC and H.264

PSNR Comparison of HEVC and H.264

Computational time comparison of HEVC and H.264

Bitrate Comparison of HEVC and H.264

PSNR Comparison of HEVC and H.264

Computational time comparison of HEVC and H.264

BD- rates Comparison of HEVC and H.264

BD- rates Comparison of HEVC and H.264

Conclusion The performance comparison of HEVC and H.264 is done based on various metrics such as bitrate, PSNR and total encoding time at different QP values. The encoding time decreases as QP value increases. Various graphs are plotted on the comparison of HEVC and H.264. As per the observations the bitrate of HEVC is higher when compared to H.264. HEVC takes more time for encoding when compared to H.264 and PSNR is high for HEVC than H.264. HEVC is more complex when compared to H.264.

Acronyms AI: All Intra AVC: advanced video coding BD-BR: Bjontegaard Delta Bitrate BD-PSNR: Bjontegaard Delta Peak Signal to Noise Ratio CfP: Call for proposals GOP: group of pictures HD: High Definition HM: HEVC Model IEC: International Electro-technical Commission IPTV: Internet Protocol Television ISO: International Standards Organisation ITU: international telecommunication union JM: H.264 Joint Test Model JTC: Joint Technical Commitee

Acronyms LD: low delay PSNR: peak signal to noise ratio RA: Random Access SSIM: Structural Similarity Index UHD: ultra-high definition VCEG: video coding experts group VGA: Video Graphics Array

References [1] ITU-T Q6/16 VCEG and ISO/IEC JTC1/SC29/WG11 MPEG, “Joint Call for Proposals on Video Compression Technology,” Document VCEG-AM91, Kyoto, JP, Jan. 2010. [2] G. J. Sullivan and J.-R. Ohm “Recent Developments in Standardization of High Efficiency Video Coding (HEVC),” SPIE Applications of Digital Image Proc. XXXIII, Proc. SPIE, Vol. 7798, paper 7798-30, Aug. 2010. [3] S. Park, J. Park and B. Jeon, “Report on the evaluation of HM versus JM,” Document JCTVC-D181, Daegu, KR, Jan. 2011. [4] Joint Model 18.0, available for download at http://iphome.hhi.de/suehring/tml/download/. [5] HEVC Model 4.0, available for download at http://hevc.kw.bbc.co.uk/trac/browser/jctvc-hm/tags/HM-4.0. [6] F. Bossen, “Common test conditions and software reference configurations,” Document JCTVC-F900, Torino, Italy, July 2011. [7] [http://cs.haifa.ac.il/~nimrod/Compression/Video/v9-h264-2003] URL for H.264 block Diagram [8] [http://en.wikipedia.org/wiki/H.264/MPEG-4_AVC] URL for H.264 [9] [http://en.wikipedia.org/wiki/High_Efficiency_Video_Coding] URL for HEVC and its encoder and decoder block diagrams [10] [http://en.wikipedia.org/wiki/Peak_signal-to-noise_ratio] URL for PSNR

References (Continued) [11] [http://en.wikipedia.org/wiki/SSIM] URL for SSIM [12] X.Li et al, “Rate-complexity-distortion evaluation for hybrid video coding”, IEEE international Conference on Multimedia and Expo (ICME), pp. 685-690, July 2010. [13] NPTEL video: For H.264 and its salient features [http://www.youtube.com/watch?v=f9n-7mgNsNQ ] [14] D.Grois et al, “Performance Comparison of H.265/MPEG-HEVC, VP9, and H.264/MPEG-AVC Encoders”, available on: http://iphome.hhi.de/marpe/download/Performance_HEVC_VP9_X264_PCS_2013_preprint.pdf [15] G. Sullivan et al, “Standardized Extensions of High Efficiency Video Coding(HEVC)”, IEEE Journal of selected topics in Signal Processing, Vol. 7, No. 6, pp. 1001-1016, Dec. 2013. [16] B.Li, G.J.Sullivan, and J.Xu “Compression performance of high efficiency video coding (HEVC) working draft 4”, IEEE ISCAS, pp. 886-889, session B1 L-H, seoul, Korea, May 2012. [17] [http://vcodex.blogspot.com/2013/04/comparing-hevc-and-h264-quality-using.html] URL for qualitative comparison of HEVC and H.264 [18] G.J.Sullivan et al, “Overview of High Efficiency Video Coding (HEVC) Standard” IEEE transactions on circuits and systems for video technology, vol.22, No. 12, pp 1649-1668, Dec. 2012 [19] [http://courses.cs.washington.edu/courses/csep590a/07au/lectures/rahullarge.pdf] URL for the quarter pixel motion estimation [20] G.J.Sullivan et al, “Overview of the H.264/AVC video coding standard” IEEE transactions on circuits and systems for video technology, vol 13, No. 7, pp 560-576, July 2003

References (continued) [21] Test sequences: ftp://ftp.kw.bbc.co.uk/hevc/hm-11.0-anchors/bitstreams/ [22] B.Bross et al, “High Efficiency Video Coding (HEVC) Text specification draft 10” Document JCTVC-L1003, ITU-T/ISO/IEC Joint Collaborative Team on Video Coding (JCT-VC) . Mar. 2013 available on http://phenix.it-sudparis.eu/jct/docenduser/current document.php?id=7243 [23] Special issue on emerging research and standards in next generation video coding, IEEE Transactions on Circuits and Systems for Video Technology (CSVT), vol. 22, pp. 1646-1909, Dec. 2012. [24] Special issue on emerging research and standards in next generation video coding, IEEE Transactions on Circuits and Systems for Video Technology (CSVT), vol. 23, pp. 2009-2142, Dec. 2013. [25] IEEE Journal of Selected Topics in Signal Processing, vol. 7, Dec. 2013 [26] K.R.Rao, D.N.Kim and J.J.Huang, “Video Coding Standards H.264/MPEG-4”, Springer, 2014.  

THANK YOU 