The MPEG-4 Fine-Grained Scalable Video Coding Method for Multimedia Streaming Over IP Hayder Radha,Mihaela van der Schaar and Yingwei Chen IEEE TRANSACTIONS ON MULTIMEDIA, VOL.3, NO.1,MARCH 2001
Outline Introduction SNR FGS Video Coding Method FGS Coding with Adaptive Quantization Hybrid Temporal-SNR Scalability with an All FGS Structure Conclusions
Introduction Video-Coding and Networking Minimal real-time processing and rate control when large number of unicast Highly adaptable to unpredictable bandwidth Low-complexity decoding and low- memory requirements
Introduction(2) Able to support both multicast and unicast applications Scalable bitstream must be resilient to packet loss events
SNR FGS Video Coding [ R min = R b, R max = R b + R e ]
SNR FGS Video Coding(2)
SNR FGS Video Coding - encoder Two encoders base layer->motion compensation enhancement layer->fine-granular Each DCT FGS-residual frame consists of N BP bitplanes
SNR FGS Video Coding - scanning order
Architecture for the SNR FGS Video Coding -decoder
SNR FGS Video Coding - performance Compared with traditional SNR scalability video coding
SNR FGS Video Coding - performance(2)
SNR FGS Video Coding - performance(3)
SNR FGS Video Coding - conclusions FGS exploits temporal redundancy only at the base layer FGS is good for high motion sequences such as “movie trailers”,certain commercials and news clips with high-action content
SNR FGS Video Coding - conclusions Base-layer could have a major impact on the overall performance of FGS [R 2,R max ] could be significantly better than the average performance over the wider range[R 1,R max ]
FGS Coding with Adaptive Quantization FGS-based AQ is achieved through bitplane shifting Selected macroblocks within an FGS enhancement layer frame Selected coefficients within the 8 * 8 blocks
Adaptive Quantization- Selective Enhancement
Adaptive Quantization- frequency weighting
Adaptive Quantization- combine SE with FW
Adaptive Quantization-notice SE : macroblock-by-macroblock basis FW : use the same FW matrix Selective enhancement is a relative operation Up-shifting operation does not guarantee that a particular SE macroblock gets scanned earlier(MSB)
Adaptive Quantization- evaluation Not improve the rate-distortion performance,but rather to improve the visual quality SE can be used to enhance a particular region FW can reduce some of blockiness, but may softening some of the sharp edges and other finedetails
Adaptive Quantization- evaluation(2)
Hybrid Temporal-SNR Scalability Temporal scalability : Enhance the motion smoothness of compressed video F = F BL + F EL Provide the flexibility of choosing between temporal scalability and SNR scalability (Users’ performance and real-time bandwidth)
all-FGS hybrid temporal-SNR scalability structure
Architecture for the all-FGS hybrid temporal-SNR scalability encoder
Architecture for the all-FGS hybrid temporal-SNR scalability decoder
Performance Evaluation of the Hybrid FGS Scalability Method
Conclusions MPEG-4 FGS framework Supporting unicast and multicast Internet video application Adaptive quantization Hybrid temporal-SNR scalability method