Download presentation
Presentation is loading. Please wait.
1
Objective Video quality assessment of Dirac and H.265 SPRING 2016 INSTRUCTOR: Dr.K.R Rao. Satya sai krishna kumar Avasarala 1001090898
2
Acronyms AVC Advanced Video coding BBC-British Broadcast Corporation BD-Bjontegaard Delta HEVC-High Efficiency Video Coding HM-HEVC Test Model ISO-International Standards Organization IEC-International Electrotechnical Commission ITU-International Telecommunication Union JSVM-Joint Scalable Video Model MPEG-Moving Picture Experts Group MOS –Mean Opinion of Scores. PSNR-Peak Signal to noise ratio PWSSIM- Perceptual Weighted Structural similarity SSIM-Structural similarity VCEG-Video Coding Experts Group.
3
MOTIVATION: An increasing demand for video. Increased used of applications, content, fidelity, etc. -Need higher coding efficiency. [1] 25 times increase in mobile data traffic over next five years. Video is a “must have” on portable devices. - Need lower power.[3] Network operators find very difficult to store huge amounts of data during transmission – therefore need for higher coding gain [6]
4
OBJECTIVE: The objective of this project is to study video coding standards DIRAC and H.265 and implement their performance in broadcasting environments especially in the areas of objective quality, delay, and complexity.[5] To evaluate the performance of these video coding standards various criteria are used such as PSNR, computational time, SSIM, BD-Bitrate and BD-PSNR.[6] The HM, Schroedinger softwares are used to evaluate various test sequences to determine the performance of HEVC,DIRAC respectively.
![OBJECTIVE: The objective of this project is to study video coding standards DIRAC and H.265 and implement their performance in broadcasting environments especially in the areas of objective quality, delay, and complexity.[5] To evaluate the performance of these video coding standards various criteria are used such as PSNR, computational time, SSIM, BD-Bitrate and BD-PSNR.[6] The HM, Schroedinger softwares are used to evaluate various test sequences to determine the performance of HEVC,DIRAC respectively.](http://images.slideplayer.com./39/10974959/slides/slide_4.jpg "OBJECTIVE: The objective of this project is to study video coding standards DIRAC and H.265 and implement their performance in broadcasting environments especially in the areas of objective quality, delay, and complexity.[5] To evaluate the performance of these video coding standards various criteria are used such as PSNR, computational time, SSIM, BD-Bitrate and BD-PSNR.[6] The HM, Schroedinger softwares are used to evaluate various test sequences to determine the performance of HEVC,DIRAC respectively.")
5
H.265/HEVC High Efficiency Video Coding (HEVC) is the latest video coding standard for video compression developed by ISO/IEC MPEG (Moving Picture Experts Group) in collaboration with ITU-T VCEG (Video Coding Experts Group). [3] It has higher compression efficiency than that of H.264/AVC Video Coding standard which is currently in use, by being able to reduce the bit rate by 50% and retaining the same video quality.[1]
6
H.265 ENCODER : Figure 2 : HEVC encoder block diagram [6]
![H.265 ENCODER : Figure 2 : HEVC encoder block diagram [6]](http://images.slideplayer.com./39/10974959/slides/slide_6.jpg "H.265 ENCODER : Figure 2 : HEVC encoder block diagram [6]")
7
HEVC DECODER: Figure 3 : HEVC decoder block diagram[7]
![HEVC DECODER: Figure 3 : HEVC decoder block diagram[7]](http://images.slideplayer.com./39/10974959/slides/slide_7.jpg "HEVC DECODER: Figure 3 : HEVC decoder block diagram[7]")
8
KEY FEATURES : Partitioning Prediction Transform and Quantization Entropy Coding [1]
![KEY FEATURES : Partitioning Prediction Transform and Quantization Entropy Coding [1]](http://images.slideplayer.com./39/10974959/slides/slide_8.jpg "KEY FEATURES : Partitioning Prediction Transform and Quantization Entropy Coding [1]")
9
DIRAC Dirac is open and royalty free video compression standard developed by BBC research group which was finalized in January 2008.[8] It is named after the two physicists Paul Dirac and Erwin Schrödinger. It is used to provide high compression for the video resolutions of Ultra HDTV and beyond. This standard was first implemented by BBC to transmit HDTV pictures in Beijing Olympics in year 2008. Aimed to provide significant savings in data rate and improvements in quality over video compression formats such as MPEG-2 Part 2, MPEG-4 Part 2.[10]
![DIRAC Dirac is open and royalty free video compression standard developed by BBC research group which was finalized in January 2008.[8] It is named after the two physicists Paul Dirac and Erwin Schrödinger.](http://images.slideplayer.com./39/10974959/slides/slide_9.jpg "It is used to provide high compression for the video resolutions of Ultra HDTV and beyond. This standard was first implemented by BBC to transmit HDTV pictures in Beijing Olympics in year Aimed to provide significant savings in data rate and improvements in quality over video compression formats such as MPEG-2 Part 2, MPEG-4 Part 2.[10].")
10
DIRAC ENCODER Figure 6 : Dirac encoder block diagram [1]
![DIRAC ENCODER Figure 6 : Dirac encoder block diagram [1]](http://images.slideplayer.com./39/10974959/slides/slide_10.jpg "DIRAC ENCODER Figure 6 : Dirac encoder block diagram [1]")
11
DIRAC DECODER Figure 7: Dirac decoder Block diagram [10]
![DIRAC DECODER Figure 7: Dirac decoder Block diagram [10]](http://images.slideplayer.com./39/10974959/slides/slide_11.jpg "DIRAC DECODER Figure 7: Dirac decoder Block diagram [10]")
12
Performance Metrics OBJECTIVE METRICS 1.PSNR 2.BD-PSNR 3.BD-Rate 4.SSIM 5.PWSSIM SUBJECTIVE METRICS 1.MOS ( Mean Opinion of Scores)
13
PSNR – PSNR YUV is mostly used to evaluate the video quality for 4:2:0 format only.[21] -- (1) while the individual values for PSNR Y,PSNR U, PSNR V are calculated as follows [17] --(2) where B= number of bits per sample MSE= Mean squared error
![PSNR – PSNR YUV is mostly used to evaluate the video quality for 4:2:0 format only.[21] -- (1) while the individual values for PSNR Y,PSNR U, PSNR V are calculated as follows [17] --(2) where B= number of bits per sample MSE= Mean squared error](http://images.slideplayer.com./39/10974959/slides/slide_13.jpg "PSNR – PSNR YUV is mostly used to evaluate the video quality for 4:2:0 format only.[21] -- (1) while the individual values for PSNR Y,PSNR U, PSNR V are calculated as follows [17] --(2) where B= number of bits per sample MSE= Mean squared error")
14
BD-PSNR – This computes the average PSNR differences in dB for the same bit rate.[17] The average PSNR difference between two R-D curves is approximated by the difference between the integrals of the fitted R-D curves divided by the integration interval (delta D). BD –Bit rate – This computes the bit difference between the two R-D curves for a given bit rate.[17]
![BD-PSNR – This computes the average PSNR differences in dB for the same bit rate.[17] The average PSNR difference between two R-D curves is approximated by the difference between the integrals of the fitted R-D curves divided by the integration interval (delta D).](http://images.slideplayer.com./39/10974959/slides/slide_14.jpg "BD –Bit rate – This computes the bit difference between the two R-D curves for a given bit rate.[17].")
15
SSIM - It is calculated as the below formula [15] α, β, and γ are parameters that mediate the relative importance of the three components µ x and µ y = local sample means of x and y respectively σ x and σ y = local sample standard deviations of x and y respectively σ xy = local sample correlation coefficient between x and y C1, C2, and C3 = constants that stabilize the computations when denominators become small
![SSIM - It is calculated as the below formula [15] α, β, and γ are parameters that mediate the relative importance of the three components µ x and µ y = local sample means of x and y respectively σ x and σ y = local sample standard deviations of x and y respectively σ xy = local sample correlation coefficient between x and y C1, C2, and C3 = constants that stabilize the computations when denominators become small](http://images.slideplayer.com./39/10974959/slides/slide_15.jpg "SSIM - It is calculated as the below formula [15] α, β, and γ are parameters that mediate the relative importance of the three components µ x and µ y = local sample means of x and y respectively σ x and σ y = local sample standard deviations of x and y respectively σ xy = local sample correlation coefficient between x and y C1, C2, and C3 = constants that stabilize the computations when denominators become small")
16
PWSSIM- It uses perceptual spatial information as a way of weighting the most important visual regions.[17] Spatial Information is calculated as follows. ---(10) PWSSIM is given by : ---(11) µs = mean of the gradient magnitude of a block N=Number of pixels in the block.
![PWSSIM- It uses perceptual spatial information as a way of weighting the most important visual regions.[17] Spatial Information is calculated as follows.](http://images.slideplayer.com./39/10974959/slides/slide_16.jpg "---(10) PWSSIM is given by : ---(11) µs = mean of the gradient magnitude of a block N=Number of pixels in the block..")
17
PROFILES USED FOR ASSESSMENT The HM 16.3 [16] and Schroedinger 1.0.11 [20] are the softwares that will be used for HEVC and Dirac respectively in this project. Various test sequences will be encoded in this project with the necessary profile settings to get the results.
![PROFILES USED FOR ASSESSMENT The HM 16.3 [16] and Schroedinger [20] are the softwares that will be used for HEVC and Dirac respectively in this project.](http://images.slideplayer.com./39/10974959/slides/slide_17.jpg "Various test sequences will be encoded in this project with the necessary profile settings to get the results..")
18
Test sequences data Test sequenceResolutionFrame rate (Fps) BasketballDrill_832x480_50.yuv832x48050 Foreman_352x288_30.yuv352x28830 Cactus_1920x1080_30.yuv1920x108030 RaceHorses_416x240_30.yuv416x24030
19
Test sequences Basketballdrive [18] BasketballDrill_832x480_50.yuv Foreman [19] Foreman_352x288_30.yuv
![Test sequences Basketballdrive [18] BasketballDrill_832x480_50.yuv Foreman [19] Foreman_352x288_30.yuv](http://images.slideplayer.com./39/10974959/slides/slide_19.jpg "Test sequences Basketballdrive [18] BasketballDrill_832x480_50.yuv Foreman [19] Foreman_352x288_30.yuv")
20
Cactus [20] Cactus_1920x1080_30.yuv Racehorses [19] RaceHorses_416x240_30.yuv
![Cactus [20] Cactus_1920x1080_30.yuv Racehorses [19] RaceHorses_416x240_30.yuv](http://images.slideplayer.com./39/10974959/slides/slide_20.jpg "Cactus [20] Cactus_1920x1080_30.yuv Racehorses [19] RaceHorses_416x240_30.yuv")
21
Conclusions For a given video sequence the HEVC codec will perform much better in terms of bit rate, coding gain, compression efficiency than Dirac video codecs. At the same time the encoder complexity was fairly high. [17] [7]
22
References [1] K. R. Rao, et al. “Video Coding Standards: AVS China, H.264/MPEG-4Part10, HEVC, VP6, DIRAC and VC-1”, Springer, 2014. [2] J-R Ohm, et al. "Comparison of the Coding Efficiency of Video Coding Standards - including High Efficiency Video Coding (HEVC) ", IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, Issue: 12, pp. 1669 -1684, Dec.2012 [3]https://en.wikipedia.org/wiki/High_Efficiency_Video_Coding –Website on HEVC [4] I.E.G Richardson, The H.264 advanced video compression standard. Chichester, West Sussex: Wiley, 2010. [5] K.R.Rao and J.J.Hwang, “Techniques and standards for Image Video and Audio Coding”, Prentice Hall, 1996. [6]F. Bossen, et al. "HEVC Complexity and Implementation Analysis", IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp. 1685-1696, Dec.2012. [7] V. Sze, M. Budagavi and G. J.Sullivan "High Efficiency Video Coding (HEVC) : Algorithms and Architectures", Springer, 2014. [8]https://en.wikipedia.org/wiki/Dirac_(video_compression_format) -Website on Dirac [9]J. Choi and Y. Ho, "Efficient residual data coding in CABAC for HEVC lossless video compression", Signal, Image and Video Processing, vol. 9, no. 5, pp. 1055-1066, Dec.2013. [10] A. Ravi and K.R Rao, "Performance Analysis and Comparison of the Dirac Video Codec with H.264/MPEG-4 Part 10 AVC", Int. J. Wavelets Multi resolution Inf. Process., vol. 09, no. 04, pp. 635-654, July.2011 [11] G.J. Sullivan et al, “Standardized Extensions of High Efficiency Video Coding (HEVC)”, IEEE Journal of selected topics in Signal Processing, Vol. 7, No. 6, pp. 1001-1016, Dec. 2013. [12] Access to JM 19.0 Reference Software: http://iphome.hhi.de/suehring/tml/
![References [1] K. R. Rao, et al.](http://images.slideplayer.com./39/10974959/slides/slide_22.jpg "Video Coding Standards: AVS China, H.264/MPEG-4Part10, HEVC, VP6, DIRAC and VC-1 , Springer, [2] J-R Ohm, et al. Comparison of the Coding Efficiency of Video Coding Standards - including High Efficiency Video Coding (HEVC) , IEEE Transactions on Circuits and Systems for Video Technology, vol. 22, Issue: 12, pp , Dec.2012 [3] –Website on HEVC [4] I.E.G Richardson, The H.264 advanced video compression standard. Chichester, West Sussex: Wiley, [5] K.R.Rao and J.J.Hwang, Techniques and standards for Image Video and Audio Coding , Prentice Hall, [6]F. Bossen, et al. HEVC Complexity and Implementation Analysis , IEEE Trans. Circuits Syst. Video Technol., vol. 22, no. 12, pp , Dec [7] V. Sze, M. Budagavi and G. J.Sullivan High Efficiency Video Coding (HEVC) : Algorithms and Architectures , Springer, [8] -Website on Dirac [9]J. Choi and Y. Ho, Efficient residual data coding in CABAC for HEVC lossless video compression , Signal, Image and Video Processing, vol. 9, no. 5, pp , Dec [10] A. Ravi and K.R Rao, Performance Analysis and Comparison of the Dirac Video Codec with H.264/MPEG-4 Part 10 AVC , Int. J. Wavelets Multi resolution Inf. Process., vol. 09, no. 04, pp , July.2011 [11] G.J. Sullivan et al, Standardized Extensions of High Efficiency Video Coding (HEVC) , IEEE Journal of selected topics in Signal Processing, Vol. 7, No. 6, pp , Dec [12] Access to JM 19.0 Reference Software:")
23
[13] T. Wiegand, et al, “Overview of the H.264/AVC Video Coding Standard”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, pp.560-576, July 2000. [14] Visual studio download for students for free- www.dreamspark.com. [15] Z. Wang et al, “Image Quality Assessment: From Error Visibility to Structural Similarity”, IEEE Transactions on Image Processing, Vol. 13, No. 4, pp. 600-612, Apr. 2004. [16] Access to HM 16.3 Reference Software: http://hevc.hhi.fraunhofer.de/ [17]P. Hanhart and T. Ebrahimi, "Calculation of average coding efficiency based on subjective quality scores", Journal of Visual Communication and Image Representation, vol. 25, no. 3, pp. 555-564, Apr 2014. [18] https://hevc.aes.tu-berlin.de/web/testsuite -HEVC test sequences. [19] https://media.xiph.org/video/derf/ -test sequences [20] http://diracvideo.org/2012/01/schroedinger-1-0-11/ - Access to DIRAC reference software. [21] G. Bjøntegaard, Calculation of Average PSNR Differences Between RD Curves, document VCEG-M33, ITU-T SG 16/Q 6, Austin, TX, Apr.2001. [22] B. Li, G. J. Sullivan, and J. Xu, “Compression performance of high efficiency video coding (HEVC) working draft 4,” in Proc. IEEE Int. Conf. Circuits Syst., pp. 886–889, May 2012. [23] K. Ramchandran and M. Vetterli, “Rate-distortion optimal fast thresholding with complete JPEG/MPEG decoder compatibility,” IEEE Trans. Image Process., vol. 3, no. 5, pp. 700–704, Sep. 1994. [24] Tortoise SVN download- http://tortoisesvn.net/downloads.html
![[13] T.](http://images.slideplayer.com./39/10974959/slides/slide_23.jpg "Wiegand, et al, Overview of the H.264/AVC Video Coding Standard , IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, pp , July [14] Visual studio download for students for free- [15] Z. Wang et al, Image Quality Assessment: From Error Visibility to Structural Similarity , IEEE Transactions on Image Processing, Vol. 13, No. 4, pp , Apr [16] Access to HM 16.3 Reference Software: [17]P. Hanhart and T. Ebrahimi, Calculation of average coding efficiency based on subjective quality scores , Journal of Visual Communication and Image Representation, vol. 25, no. 3, pp , Apr [18] -HEVC test sequences. [19] -test sequences [20] - Access to DIRAC reference software. [21] G. Bjøntegaard, Calculation of Average PSNR Differences Between RD Curves, document VCEG-M33, ITU-T SG 16/Q 6, Austin, TX, Apr [22] B. Li, G. J. Sullivan, and J. Xu, Compression performance of high efficiency video coding (HEVC) working draft 4, in Proc. IEEE Int. Conf. Circuits Syst., pp. 886–889, May [23] K. Ramchandran and M. Vetterli, Rate-distortion optimal fast thresholding with complete JPEG/MPEG decoder compatibility, IEEE Trans. Image Process., vol. 3, no. 5, pp. 700–704, Sep [24] Tortoise SVN download-")
24
[25] Tut6. D. Grois, et al, “HEVC/H.265 Video Coding Standard including the Range Extensions, Scalable Extensions, and Multiview Extensions,” (Tutorial), IEEE ICCE, Berlin, Germany, 6 – 9 Sept. 2015. [26] Tut7. D. Grois, et al, “HEVC/H.265 Video Coding Standard (Version 2) including the Range Extensions, Scalable Extensions, and Multiview Extensions,” (Tutorial) Sunday 27 Sept 2015, 9:00 am to 12:30 pm), IEEE ICIP, Quebec City, Canada, 27 – 30 Sept. 2015. The tutorial below is for personal use only. Password: a2FazmgNK https://datacloud.hhi.fraunhofer.de/owncloud/public.php?service=files&t=8e dc97d26d46d4458a9c1a17964bf881https://datacloud.hhi.fraunhofer.de/owncloud/public.php?service=files&t=8e dc97d26d46d4458a9c1a17964bf881.
![[25] Tut6. D.](http://images.slideplayer.com./39/10974959/slides/slide_24.jpg "Grois, et al, HEVC/H.265 Video Coding Standard including the Range Extensions, Scalable Extensions, and Multiview Extensions, (Tutorial), IEEE ICCE, Berlin, Germany, 6 – 9 Sept [26] Tut7. D. Grois, et al, HEVC/H.265 Video Coding Standard (Version 2) including the Range Extensions, Scalable Extensions, and Multiview Extensions, (Tutorial) Sunday 27 Sept 2015, 9:00 am to 12:30 pm), IEEE ICIP, Quebec City, Canada, 27 – 30 Sept The tutorial below is for personal use only. Password: a2FazmgNK service=files&t=8e dc97d26d46d4458a9c1a17964bf881https://datacloud.hhi.fraunhofer.de/owncloud/public.php service=files&t=8e dc97d26d46d4458a9c1a17964bf881..")
Similar presentations
