Rate-Distortion Analysis and Streaming of SP and SI Frames Eric Setton and Bernd Girod CSVT, 2006

Outline Introduction RD Analysis of SP and SI Frames Rate-Distortion Performance Optimal Setting for Streaming Performance Analysis

Introduction SP/SI frame –Part of H.264 Ext Profile. –Reconstructed without drift by using different predictors. Drift-free bitstream switching. PP SP PP SP 1 P SI P SP 2 P SP 12 Bitstream 1 Bitstream 2 P Primary SPSecondary SP 12 3 MV 12 Reference frame Current frame Frames_Design_for_H.264_AVC.ppthttp://vc.cs.nthu.edu.tw/home/paper/codfiles/cycho/ /The_SP-_and_SI- Frames_Design_for_H.264_AVC.ppt by CYCho

RD Analysis of SP and SI Frames (1) RD function of an ideal video encoder – –Y. Wang, J. Ostermann, and Y.-Q. Zhang, Video Processing And Communications. Prentice Hall, 2002, pp Power spectral density (PSD) of zero-mean Gaussian signal a. Intermediate parameter Spatial frequency Input zero-mean Gaussian signal

RD Analysis of SP and SI Frames (2) RD analysis of primary SP pictures  Rate  Distortion Assumptions   D SP1 = D 1 + D 2  (at high rates) D1D1 D2D2

RD Analysis of SP and SI Frames (3) RD analysis of SI and secondary SP pictures  Rate  Distortion 33  3 >  1 if switching up  3 <  1 if switching down

Rate-Distortion Performance Theoretical vs. experimental RD performance  2 = 0.9  1,  3 = 1.2  1 for switching up, and  3 = 0.5  1 for switching down. QCIF, Foreman, 30fps SP ≒ 1.9P SI ≒ 1.35I

Optimal Setting for Streaming (1) Minimize s.t. Minimize s.t. PP SP P SI P x : The probability of transmitting an SI frame D : The distortion of rest stream At high rates, Solution:  D = D SP1 = D 1 + D 2

Optimal Setting for Streaming (2) = =

Performance Analysis SP BBBPBBBPBBBPBBB I BBBPBBBPBBBPBBB I SI BBBPBBBPBBBPBBB

Streaming of SP and SI Pictures dfiles/cycho/ /Video_strea ming_with_SP_and_SI_frames.ppthttp://vc.cs.nthu.edu.tw/home/paper/co dfiles/cycho/ /Video_strea ming_with_SP_and_SI_frames.ppt