1 Department of Electrical Engineering, Stanford University Anne Aaron, Shantanu Rane, David Rebollo-Monedero and Bernd Girod Systematic Lossy Forward.

Slides:



Advertisements
Similar presentations
International Telecommunication Union Workshop on Standardization in E-health Geneva, May 2003 MPEG-4 video transmission for ambulatory application.
Advertisements

Video Coding For Compression... and Beyond Bernd Girod Information Systems Laboratory Department of Electrical Engineering Stanford University.
2005/01/191/14 Overview of Fine Granularity Scalability in MPEG-4 Video Standard Weiping Li Fellow, IEEE IEEE Transactions on Circuits and Systems for.
Digital Fountain Codes V. S
1 Distributed Source Coding Trial Lecture Fredrik Hekland 1. June 2007.
Tomorrow: Uplink Video Transmission Today: Downlink Video Broadcast Changing Landscape of Multimedia Applications.
Advances in Network-adaptive Video Streaming Bernd Girod J. Chakareski, M. Kalman, Y. J. Liang, E. Setton, R. Zhang Information Systems Laboratory Department.
Bernd Girod. Joint Source-Network Coding for Real-time Media 1 Joint Source-Network Coding for Real-time Media Bernd Girod Information Systems Laboratory.
Limin Liu, Member, IEEE Zhen Li, Member, IEEE Edward J. Delp, Fellow, IEEE CSVT 2009.
Overview of Error Resiliency Schemes in H.264/AVC Standard Sunil Kumar, Liyang Xu, Mrinal K. Mandal, and Sethuraman Panchanathan Elsevier Journal of Visual.
Department of Electrical Engineering Stanford University Yi Liang, Eric Setton and Bernd Girod Channel-Adaptive Video Streaming Using Packet Path Diversity.
An Error-Resilient GOP Structure for Robust Video Transmission Tao Fang, Lap-Pui Chau Electrical and Electronic Engineering, Nanyan Techonological University.
Reinventing Compression: The New Paradigm of Distributed Video Coding Bernd Girod Information Systems Laboratory Stanford University.
Multiple Description Coding and Distributed Source Coding: Unexplored Connections in Information Theory and Coding Theory S. Sandeep Pradhan Department.
Rate-Distortion Optimized Layered Coding with Unequal Error Protection for Robust Internet Video Michael Gallant, Member, IEEE, and Faouzi Kossentini,
Distributed Video Coding Bernd Girod, Anne Margot Aagon and Shantanu Rane, Proceedings of IEEE, Jan, 2005 Presented by Peter.
Wyner-Ziv Coding of Motion Video
Encoder and Decoder Optimization for Source-Channel Prediction in Error Resilient Video Transmission Hua Yang and Kenneth Rose Signal Compression Lab ECE.
Efficient Fine Granularity Scalability Using Adaptive Leaky Factor Yunlong Gao and Lap-Pui Chau, Senior Member, IEEE IEEE TRANSACTIONS ON BROADCASTING,
Video Streaming: An FEC-Based Novel Approach Jianfei Cai, Chang Wen Chen Electrical and Computer Engineering, Canadian Conference on.
ATSC Digital Television
Wyner-Ziv Residual Coding of Video Anne Aaron, David Varodayan and Bernd Girod Information Systems Laboratory Stanford University.
Seamless Switching of Scalable Video Bitstreams for Efficient Streaming Xiaoyan Sun, Feng Wu, Shipeng Li, Wen, Gao, and Ya-Qin Zhang.
Investigation of Motion-Compensated Lifted Wavelet Transforms Information Systems Laboratory Department of Electrical Engineering Stanford University Markus.
1 Department of Electrical Engineering Stanford University Anne Aaron, Shantanu Rane and Bernd Girod Wyner-Ziv Video Coding with Hash-Based Motion Compensation.
` 1 Department of Electrical Engineering, Stanford University Anne Aaron, Prashant Ramanathan and Bernd Girod Wyner-Ziv Coding of Light Fields for Random.
Multi-Path Transport of FGS Video Jian Zhou, Huai-Rong Shao, Chia Shen and Ming-Ting Sun ICME 2003.
4/24/2002SCL UCSB1 Optimal End-to-end Distortion Estimation for Drift Management in Scalable Video Coding H. Yang, R. Zhang and K. Rose Signal Compression.
1 Department of Electrical Engineering, Stanford University Anne Aaron, Shantanu Rane, Eric Setton and Bernd Girod Transform-domain Wyner-Ziv Codec for.
Compression with Side Information using Turbo Codes Anne Aaron and Bernd Girod Information Systems Laboratory Stanford University Data Compression Conference.
Distributed Video Coding Bernd Girod, Anne Margot Aaron, Shantanu Rane, and David Rebollo-Monedero IEEE Proceedings 2005.
Distributed Video Coding VLBV, Sardinia, September 16, 2005 Bernd Girod Information Systems Laboratory Stanford University.
09/24/02ICIP20021 Drift Management and Adaptive Bit Rate Allocation in Scalable Video Coding H. Yang, R. Zhang and K. Rose Signal Compression Lab ECE Department.
Error-Resilient Coding and Decoding Strategies for Video Communication Thomas Stockhammer and Waqar Zia Presented by Li Ma.
January 26, Nick Feamster Development of a Transcoding Algorithm from MPEG to H.263.
Arko Barman Computer Vision & Artificial Intelligence Lab Department of Electrical Engineering Indian Institute of Science, Bangalore.
Doc.: IEEE /0717r0 Submission June 2008 Graham Smith, DSP GroupSlide Packets and MPEG Frames Background to Graceful degradation of audio.
Electrical Engineering National Central University Video-Audio Processing Laboratory Data Error in (Networked) Video M.K.Tsai 04 / 08 / 2003.
Channel Coding Part 1: Block Coding
Introduction Compression Performance Conclusions Large Camera Arrays Capture multi-viewpoint images of a scene/object. Potential applications abound: surveillance,
Error control in video Streaming. Introduction Development of different types of n/ws such as internet, wireless and mobile networks has created new applications.
Abhik Majumdar, Rohit Puri, Kannan Ramchandran, and Jim Chou /24 1 Distributed Video Coding and Its Application Presented by Lei Sun.
Distributed Source Coding
A Robust Resolution-Enhancement Scheme for Video Transmission Over Mobile Ad-Hoc Networks Authors : Source : IEEE TRANSACTIONS ON BROADCASTING, VOL. 54,
Adaptive Multi-path Prediction for Error Resilient H.264 Coding Xiaosong Zhou, C.-C. Jay Kuo University of Southern California Multimedia Signal Processing.
TM Paramvir Bahl Microsoft Corporation Adaptive Region-Based Multi-Scaled Motion- Compensated Video Coding for Error Prone Communication.
Sub pixel motion estimation for Wyner-Ziv side information generation Subrahmanya M V (Under the guidance of Dr. Rao and Dr.Jin-soo Kim)
Rate-distortion Optimized Mode Selection Based on Multi-channel Realizations Markus Gärtner Davide Bertozzi Classroom Presentation 13 th March 2001.
Brief Overview of Wyner-Ziv CODEC and Research Plan Jin-soo KIM.
Yufeng Shan, Su Yi, Shivkumar Kalyanaraman and John W. Woods
Unequal Protection of JPEG2000 Code-Streams in Wireless Channels
Rate-distortion Optimized Mode Selection Based on Multi-path Channel Simulation Markus Gärtner Davide Bertozzi Project Proposal Classroom Presentation.
Wyner-Ziv Coding of Motion Video Presented by fakewen.
MPEG4 Fine Grained Scalable Multi-Resolution Layered Video Encoding Authors from: University of Georgia Speaker: Chang-Kuan Lin.
Video Compression—From Concepts to the H.264/AVC Standard
A Very Low Bit Rate Protection Layer to Increase the Robustness of the AMR- WB+ Codec against Bit Errors Philippe Gournay Université de Sherbrooke Département.
C.K. Kim, D.Y. Suh, J. Park, B. Jeon ha 強壯 !. DVC bitstream reorganiser.
Fundamentals of Multimedia Chapter 17 Wireless Networks 건국대학교 인터넷미디어공학부 임 창 훈.
1 Department of Electrical Engineering, Stanford University Anne Aaron, Shantanu Rane, Rui Zhang and Bernd Girod Wyner-Ziv Coding for Video: Applications.
1 Department of Electrical Engineering, Stanford University EE 392J Final Project Presentation Shantanu Rane Hash-Aided Motion Estimation & Rate Control.
Digital Communications
BITS Pilani Pilani Campus EEE G612 Coding Theory and Practice SONU BALIYAN 2017H P.
Wednesday, Jan 21, 1:30 to 3:10 pm, Session 15 : Image/Video Transmission I (First Talk, Other topics deal with error-resilience and error-concealment)
Limitations of Traditional Error-Resilience Methods
Wyner-Ziv Coding of Video - Towards Practical Distributed Coding -
Standards Presentation ECE 8873 – Data Compression and Modeling
Contrast and Brightness Adjusted Images
Electrical Communications Systems ECE Spring 2019
Electrical Communications Systems ECE
Presentation transcript:

1 Department of Electrical Engineering, Stanford University Anne Aaron, Shantanu Rane, David Rebollo-Monedero and Bernd Girod Systematic Lossy Forward Error Protection for Video Waveforms

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Overview  Error Resilient Digital Video Broadcasting  Systematic Lossy Forward Error Protection  Embedded Wyner-Ziv Coding  Improved Wyner-Ziv Video Codec

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Error-Resilient Digital Video Broadcasting Terrestrial broadcast Cable TV Satellite Broadcast uplink Forward Error Correction (FEC)  “Cliff” effect  For graceful degradation, Priority Encoding Transmission (PET) [Albanese, et al., 1996]  Layered representation incurs a rate-distortion penalty Forward Error Protection (FEP)  Protects the video waveform  Graceful degradation without layered representation

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Encoder Related Work Channel A DecoderChannel D X X*X* Y Bounds for systematic lossy source-channel coding [Shamai, Verdu and Zamir, 1998] Enhancing analog transmission systems using digital side information [Pradhan and Ramchandran, 2001] Robust predictive coding [Sehgal and Ahuja, 2003] Side information uncoded

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, S*S* Reconstruction Slepian- Wolf Encoder Slepian- Wolf Decoder Side information Coarse Quantizer Scalar Quantizer Turbo Encoder Turbo Decoder Systematic Lossy Forward Error Protection MPEG Encoder MPEG Decoder with Error Concealment Error-Prone channel S S’  Protects the original video waveform  “Lossy” protection Wyner-Ziv Decoder Wyner-Ziv Encoder

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Results Carphone: CIF, 50 30fps 1 Mbps, 1% macroblock loss

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Error Concealment only (No WZ bits) Wyner-Ziv Coding (16 quantization levels, 0.75bpp) Carphone: CIF, 1 Mbps, 1% macroblock loss

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Embedded Wyner-Ziv Codec MPEG Encoder MPEG Decoder with Error Concealment Error-Prone channel S S’ S*S* Wyner-Ziv Encoder A Wyner-Ziv Decoder A S ** Wyner-Ziv Encoder B Wyner-Ziv Decoder B Graceful degradation of video quality Does not require layered representation … …

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Results 2-level Wyner-Ziv Codec Carphone: CIF, 50 30fps 1 Mbps, 1% macroblock loss

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Systematic Lossy Forward Error Protection MPEG Encoder MPEG Decoder with Error Concealment Error-Prone channel S S’ Wyner-Ziv Decoder Coarse Quantizer Wyner-Ziv Encoder Reconstruction Slepian- Wolf Encoder Slepian- Wolf Decoder S*S*

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Improved Wyner-Ziv Coder Error-Prone channel MPEG Encoder MPEG Decoder with Error Concealment S S’ MPEG Encoder Common reference frame MPEG Encoder [Rane, Aaron, Girod (submitted to VCIP ’04)] Parity symbols R-S Encoder R-S Decoder Side information S*S* Wyner-Ziv Encoder Wyner-Ziv Decoder MPEG Decoder Common reference frame Fallback to coarse representation

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Systematic Lossy FEP vs. FEC Foreman.cif FEC Main Mbps FEC (n,k) = (40,36) FEC bitrate = 120 Kbps Total = 1.2 Mbps Proposed Scheme Main Mbps WZ 270 Kbps FEP (n,k) = (52,36) WZ bitrate = 120 Kbps Total = 1.2 Mbps

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Mbps kbps FEC (33.03 db) Foreman: CIF, 50 frames, symbol error rate = Mbps kbps FEP (38.40 db)

Aaron, Rane, Rebollo-Monedero, Girod: Forward Error Protection of Video Sept. 15, Summary A novel systematic lossy forward error protection scheme for error-resilient video broadcasting Wyner-Ziv coding applied to forward error protection Advantages  More robust than FEC over a wide range of error rates  Graceful degradation without layered video representation  Backward-compatible