1 Department of Electrical Engineering, Stanford University Anne Aaron, Shantanu Rane, David Rebollo-Monedero and Bernd Girod Systematic Lossy Forward Error Protection for Video Waveforms
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Overview Error Resilient Digital Video Broadcasting Systematic Lossy Forward Error Protection Embedded Wyner-Ziv Coding Improved Wyner-Ziv Video Codec
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Error-Resilient Digital Video Broadcasting Terrestrial broadcast Cable TV Satellite Broadcast uplink Forward Error Correction (FEC) “Cliff” effect For graceful degradation, Priority Encoding Transmission (PET) [Albanese, et al., 1996] Layered representation incurs a rate-distortion penalty Forward Error Protection (FEP) Protects the video waveform Graceful degradation without layered representation
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Encoder Related Work Channel A DecoderChannel D X X*X* Y Bounds for systematic lossy source-channel coding [Shamai, Verdu and Zamir, 1998] Enhancing analog transmission systems using digital side information [Pradhan and Ramchandran, 2001] Robust predictive coding [Sehgal and Ahuja, 2003] Side information uncoded
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, S*S* Reconstruction Slepian- Wolf Encoder Slepian- Wolf Decoder Side information Coarse Quantizer Scalar Quantizer Turbo Encoder Turbo Decoder Systematic Lossy Forward Error Protection MPEG Encoder MPEG Decoder with Error Concealment Error-Prone channel S S’ Protects the original video waveform “Lossy” protection Wyner-Ziv Decoder Wyner-Ziv Encoder
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Results Carphone: CIF, 50 30fps 1 Mbps, 1% macroblock loss
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Error Concealment only (No WZ bits) Wyner-Ziv Coding (16 quantization levels, 0.75bpp) Carphone: CIF, 1 Mbps, 1% macroblock loss
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Embedded Wyner-Ziv Codec MPEG Encoder MPEG Decoder with Error Concealment Error-Prone channel S S’ S*S* Wyner-Ziv Encoder A Wyner-Ziv Decoder A S ** Wyner-Ziv Encoder B Wyner-Ziv Decoder B Graceful degradation of video quality Does not require layered representation … …
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Results 2-level Wyner-Ziv Codec Carphone: CIF, 50 30fps 1 Mbps, 1% macroblock loss
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Systematic Lossy Forward Error Protection MPEG Encoder MPEG Decoder with Error Concealment Error-Prone channel S S’ Wyner-Ziv Decoder Coarse Quantizer Wyner-Ziv Encoder Reconstruction Slepian- Wolf Encoder Slepian- Wolf Decoder S*S*
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Improved Wyner-Ziv Coder Error-Prone channel MPEG Encoder MPEG Decoder with Error Concealment S S’ MPEG Encoder Common reference frame MPEG Encoder [Rane, Aaron, Girod (submitted to VCIP ’04)] Parity symbols R-S Encoder R-S Decoder Side information S*S* Wyner-Ziv Encoder Wyner-Ziv Decoder MPEG Decoder Common reference frame Fallback to coarse representation
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Systematic Lossy FEP vs. FEC Foreman.cif FEC Main Mbps FEC (n,k) = (40,36) FEC bitrate = 120 Kbps Total = 1.2 Mbps Proposed Scheme Main Mbps WZ 270 Kbps FEP (n,k) = (52,36) WZ bitrate = 120 Kbps Total = 1.2 Mbps
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Mbps kbps FEC (33.03 db) Foreman: CIF, 50 frames, symbol error rate = Mbps kbps FEP (38.40 db)
Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Summary A novel systematic lossy forward error protection scheme for error-resilient video broadcasting Wyner-Ziv coding applied to forward error protection Advantages More robust than FEC over a wide range of error rates Graceful degradation without layered video representation Backward-compatible