1. Overview on Scalable Video Coding - II Chuan-Yu Cho

2. Outline HHI and MS SVC Codecs Scalable Video Model 3.0

3. SVC: 68th meeting 14 full proposals in two categories Category 1: MCTF/2D Wavelet Category 2: AVC based (incl. AVC/MCTF) Core Experiments (CE) Reference model (software) = the best performing scheme in each category Category 1: (MCTF/2DWT) Microsoft Research Asia Category 2: (AVC/MCTF) HHI Result of Core Experiments will be used for decision to adopt one complete codec architecture into the WD. From: NCTU 69th MPEG meeting report

4. HHI and MS SVC Codecs Chuan-Yu Cho

5. Motion Compensation Temporal Filtering (MCTF)

7. Wavelet tree with reduction of spatial size throughout the temporal levels

8. Motion Adaptive Filtering

9. Motion Compensation Temporal Filtering (MCTF)

10. Adaptive vs Non-adaptive MCTF

11. 3D Sub-band Video Coding using Barbell lifting Status Proposal Source MSRA Asia IM group, MS CMPT group Authors Jizheng Xu, Ruiqin Xiong, Bo Feng, Gary Sullivan, Ming-Chieh Lee, Feng Wu, Shipeng Li

12. 3-D Wavelet/Subband (Interframe Wavelet) Method Temporal Scalability Spatial Scalibility

13. Barbell lifting

14. Lifting scheme Prediction stage Update stage

15. L4: 256Kbps QCIF 15 L5: 512Kbps QCIF 15

16. L1: 48Kbps QCIF 7.5 L2: 64Kbps QCIF 15 L3: 128Kbps QCIF 15

17. Scalable Extension of H.264/AVC Status Proposal => SVM 3.0 Source Fraunhofer Institute for Telecommunications - Herinrich Hertz Institute (HHI) Authors Heiko Schwarz, Detlev Marpe, and Thomas Wiegand

18. HHI Joint Scalability

19. HHI Temporal Scalability

20. HHI SNR Scalability

21. HHI Joint Scalability

22. I P PIBB Layer 0 & 1 1 0 32kbps 48kbps

23. HHI Joint Scalability

24. PB (Up sample) 2 1

25. HHI Joint Scalability

26. Intra prediction for intra MB 2 1 Intra prediction for intra MB Inter Prediction H L 96Kbps

27. HHI Joint Scalability

29. 4 3 SNR Scalability (QP) Temporal Scalability (Motion Compensation) H00H00 L21L21 L22L22

30. HHI Joint Scalability

31. 4 3 SNR Scalability (QP) Temporal Scalability (Motion Compensation) H00H00 H21H21 H22H22

32. Scalable Video Model 3.0 Tomas Wiegand Fraunhofer Institute for Telecommunications – Heinrich Hertz Institute (HHI) To be published in VCIP ‘05

33. Outline

34. Introduction

35. MCTF using the Lifting Representation

36. Motion model of H.264/MPEG-4 AVC

37. Prediction and Update operators

38. Derivation of Update Operators

39. Temporal Coding Structure

40. Temporal Decomposition Structure

41. Impacts on H.264/MPEG-4 AVC

42. Simulation Results for the MCTF Extension

44. SNR-Scalable Extension

45. Adjustment of the Quantization Parameter

46. Impacts on H.264/MPEG-4 AVC

47. Results for Layered SNR-Scalability

49. Spatial Scalability

50. Spatial Prediction of Data

51. Results for Layered Combined Scalability

53. Fine Granular Scalability

56. Simulation Results: City

57. Simulation Results: Crew

58. Summary

59. References “MCTF and Scalability Extension of H.264/AVC and its Application to Video Transmission, Storage, and Surveillance” R. Schäfer, H. Schwarz, D. Marpe, T. Schierl, and T. Wiegand, Fraunhofer Institute for Telecommunications – Heinrich Hertz Institute (HHI) To be published at VCIP ‘05