Overview on Scalable Video Coding - II Chuan-Yu Cho
Outline HHI and MS SVC Codecs Scalable Video Model 3.0
SVC: 68th meeting 14 full proposals in two categories Category 1: MCTF/2D Wavelet Category 2: AVC based (incl. AVC/MCTF) Core Experiments (CE) Reference model (software) = the best performing scheme in each category Category 1: (MCTF/2DWT) Microsoft Research Asia Category 2: (AVC/MCTF) HHI Result of Core Experiments will be used for decision to adopt one complete codec architecture into the WD. From: NCTU 69th MPEG meeting report
HHI and MS SVC Codecs Chuan-Yu Cho
Motion Compensation Temporal Filtering (MCTF)
Wavelet tree with reduction of spatial size throughout the temporal levels
Motion Adaptive Filtering
Motion Compensation Temporal Filtering (MCTF)
Adaptive vs Non-adaptive MCTF
3D Sub-band Video Coding using Barbell lifting Status Proposal Source MSRA Asia IM group, MS CMPT group Authors Jizheng Xu, Ruiqin Xiong, Bo Feng, Gary Sullivan, Ming-Chieh Lee, Feng Wu, Shipeng Li
3-D Wavelet/Subband (Interframe Wavelet) Method Temporal Scalability Spatial Scalibility
Barbell lifting
Lifting scheme Prediction stage Update stage
L4: 256Kbps QCIF 15 L5: 512Kbps QCIF 15
L1: 48Kbps QCIF 7.5 L2: 64Kbps QCIF 15 L3: 128Kbps QCIF 15
Scalable Extension of H.264/AVC Status Proposal => SVM 3.0 Source Fraunhofer Institute for Telecommunications - Herinrich Hertz Institute (HHI) Authors Heiko Schwarz, Detlev Marpe, and Thomas Wiegand
HHI Joint Scalability
HHI Temporal Scalability
HHI SNR Scalability
HHI Joint Scalability
I P PIBB Layer 0 & kbps 48kbps
HHI Joint Scalability
PB (Up sample) 2 1
HHI Joint Scalability
Intra prediction for intra MB 2 1 Intra prediction for intra MB Inter Prediction H L 96Kbps
HHI Joint Scalability
4 3 SNR Scalability (QP) Temporal Scalability (Motion Compensation) H00H00 L21L21 L22L22
HHI Joint Scalability
4 3 SNR Scalability (QP) Temporal Scalability (Motion Compensation) H00H00 H21H21 H22H22
Scalable Video Model 3.0 Tomas Wiegand Fraunhofer Institute for Telecommunications – Heinrich Hertz Institute (HHI) To be published in VCIP ‘05
Outline
Introduction
MCTF using the Lifting Representation
Motion model of H.264/MPEG-4 AVC
Prediction and Update operators
Derivation of Update Operators
Temporal Coding Structure
Temporal Decomposition Structure
Impacts on H.264/MPEG-4 AVC
Simulation Results for the MCTF Extension
SNR-Scalable Extension
Adjustment of the Quantization Parameter
Impacts on H.264/MPEG-4 AVC
Results for Layered SNR-Scalability
Spatial Scalability
Spatial Prediction of Data
Results for Layered Combined Scalability
Fine Granular Scalability
Simulation Results: City
Simulation Results: Crew
Summary
References “MCTF and Scalability Extension of H.264/AVC and its Application to Video Transmission, Storage, and Surveillance” R. Schäfer, H. Schwarz, D. Marpe, T. Schierl, and T. Wiegand, Fraunhofer Institute for Telecommunications – Heinrich Hertz Institute (HHI) To be published at VCIP ‘05