Presentation is loading. Please wait.

Presentation is loading. Please wait.

Error Recovery.

Published byJoy Higgins Modified over 6 years ago

Similar presentations

Presentation on theme: "Error Recovery."— Presentation transcript:

1 Error Recovery

2 Problems with Internet
Limited Bandwidth Varying Conditions Delay Jitter Packet Loss Delay Heterogeneity : NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

3 You Are Here Encoder Decoder Middlebox Sender Receiver Network
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

4 Overview Characteristics of the Internet General techniques
Error recovery for audio Effect of loss on MPEG Error recovery for MPEG NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

5 Loss Characteristics of The Internet

6 Characteristics of Internet
60-70% of paths do not show any loss Those with loss have an average of 4.5 – 6% packet loss [Paxson97] End-to-end Internet packet dynamics NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

7 Packet Loss Pattern Number of Occurrences 1000 Burst Length 30
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

8 Characteristics of Internet
Bursts of loss are typically short (2-3 consecutively loss packets) Long bursts do occur Bursts may occur periodically NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

9 Wireless Link Loss rate measured in my office 10 ~ 20%
Up to 50% reported! NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

10 Gilbert Model This model is used to simulate packet losses that may include packet trains. GOOD BAD NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

11 A Survey of Packet-Loss Recovery Techniques for Streaming Audio
Perkins, Hodson and Hardman IEEE Network Magazine 1998

12 Three Fundamental Techniques
Retransmission Redundant data Error concealment Note: The optimal error recovery technique may be different for frame-based protocols (RTP) and chunk-based protocols (DASH). NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

13 Retransmission X 1 2 3 4 3 1 2 4 3 NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

14 Redundant Data 1 2 2 3 3 4 4 5 1 2 2 3 3 4 5 NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

15 Error Concealment 1 2 3 4 1 2 4 NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

16 Retransmission for audio

17 Pros/Cons of Retransmissions
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

18 Scalable Retransmission
On packet loss T = random(0, RTT) wait for T multicast NACK On receiving NACK from others suppress own NACK NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

19 Retransmit when Group size is small, or with DASH Loss rate is low
Large latency acceptable NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

20 Selective Retransmission
Retransmission based on priority of packets Important/urgent packets are retransmitted first Packets are only retransmitted when there is enough time [Papadopoulos and Parulkar, NOSSDAV 1996] NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

21 Redundant Data for audio

22 Parity Forward Error Correction
XOR NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

23 Parity Forward Error Correction
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

24 Parity FEC Ordering NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

25 Parity FEC Ordering NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

26 Parity FEC Ordering NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

27 Parity FEC Ordering NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

28 Parity FEC Ordering NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

29 Reed-Solomon Code RS(n,k) RS Data symbols Parity symbols n k
(popular: n = 223) (popular: k = 32) NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

30 Reed-Solomon Code Data block (length n+k, e.g., 255)
Can correct up to 16 corrupted symbols per block (32/2) NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

31 Media Specific FEC Transmit low quality chunk i+1 and high quality chunk i together. 1 2 2 3 3 4 4 5 1 2 2 3 3 4 5 NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

32 Pros/Cons of Redundant Data
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

33 Interleaving NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

34 Pros/Cons of Interleaving
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

35 Error Concealment

36 Recreate Lost Information
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

37 Effect of Loss on Audio Speech Human ears can interpolate
Loss up to length of phoneme can still be tolerable NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

38 Insertion-based Repair
Splice Silence Substitution Noise Substitution Repetition NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

39 Other Repair Methods Interpolation Regeneration NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

40 Error Concealment More complex error concealment algorithms provide better performance (i.e., playback quality) NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

41 Colin’s Recommendations

42 Non-Interactive Apps Interleaving FEC Retransmission for unicast only
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

43 Interactive Applications
Media Specific FEC NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

44 Error Concealment Repeat NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

45 Packet Loss Effects on MPEG Video Sent over the Public Internet
Jill Boyce and Robert Gaglianello ACM Multimedia 1998

46 Measurement-based Study
Need to understand the problem before proposing solution NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

47 Data Gathering Method From: NYC13 , Austin21, London18 To: Holmdel, NJ
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

48 Data Gathering Method Video: Two 5-mins MPEG 30 fps
384 kbps and 1 Mbps GOP: IBBPBBPBBPBBPBB QSIF 176x112 and SIF 352x240 One row per slice NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

49 Average Packet Loss NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

50 Frames Affected by Errors (1)
% Frames in Error Packet Loss Rate NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

51 Frames Affected by Errors (2)
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

52 Overview of Error Recovery for Video

53 Methods Retransmission Interleaving Error Concealment FEC
Limiting Error Propagation Reference Frame Selection Changing Temporal Pattern NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

54 Case Study: HD video conferencing
Korean Air, Inha University (Seoul), University of Southern California, Pratt & Whitney

55 USC-Inha Two-way Experiments USC (Powell Hall of Engineering)
July 2005 USC-Inha Two-way Experiments USC (Powell Hall of Engineering) © PWICE, 2006

56 USC-Inha Two-way Experiments Inha University (Memorial Library)
July 2005 USC-Inha Two-way Experiments Inha University (Memorial Library) © PWICE, 2006

57 KAL Network Infrastructure
December 2005 KAL Network Infrastructure Korean Air network infrastructure between Incheon, Kimpo, and Pusan KAL network & external ISP (KT) 1 Gbps: ICN-GMP 50 Mbps: GMP-PUS © PWICE, 2006

58 November 2005 Network Measurements End-to-end packet loss rates of the network path between Kimpo (GMP) and Incheon (ICN) observed during November 15-16, 2005 Network is shared with other business traffic Loss rates are quite low © PWICE, 2006

59 Hardware Preparation 3 computers purchased in Korea
December 2005 Hardware Preparation 3 computers purchased in Korea Computers sent to USC with KAL Software setup in the IMSC laboratories Linux installation RCS software installation Retransmission configuration End-to-end equipment test with local JVC cameras and displays Computers sent back to KAL HQ © PWICE, 2006

60 Hardware Test at KAL Re-configuration for Sony HDR-HC1 cameras
December 2005 Hardware Test at KAL Re-configuration for Sony HDR-HC1 cameras Local area network tests © PWICE, 2006

61 Experiments: ICN ◄▬► GMP
December 2005 Experiments: ICN ◄▬► GMP Asymmetric environment: 88 Mb/s & 50 Mb/s Conclusion: ICN - GMP: sufficient BW for HD video Sufficient headroom for data applications Bandwidth measurements Visual quality Required by RCS © PWICE, 2006

62 Experiments: ICN ◄▬► PUS
December 2005 Experiments: ICN ◄▬► PUS Asymmetric environment: 6 Mb/s & 1 Mb/s GMP - PUS: initially insufficient BW for HD video Investigated network routers with KAL IT help Conclusion: replaced router to improve throughput; to be re-tested Bandwidth measurements Visual quality © PWICE, 2006

63 Measurements: Packet Loss Rate
December 2005 Measurements: Packet Loss Rate Path: ICN - PUS Two packet sizes: 564 bytes and 940 bytes Conclusion: GMP - PUS loss rate very high One-way packet loss rate Two-way packet loss rate © PWICE, 2006

64 Packet Loss Error Recovery
Selective retransmission protocol is used to recover from lost data Effectiveness of protocol is tested in lab environment Gilbert Model is used to induce losses into transmission Transmission delay is chosen to be 10 ms (expected latency in Korea) © PWICE, 2006

65 Packet Loss Error Recovery
Sept. - Dec. 2005 Packet Loss Error Recovery Selective retransmission protocol (ICN-GMP Link) 10% Loss Rate 5% Loss Rate 1% Loss Rate With Retransmissions With Retransmissions With Retransmissions © PWICE, 2006

66 Current Hardware Codecs
Hauppauge HD-PVR Cavium PureVu™ CNW31XX NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

67 HD-PVR H.264 Encoder NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

68 NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

69 Error Control Techniques for Interactive Low Bitrate Video Transmission over The Internet
Injong Rhee SIGCOMM ‘98

70 Basic Idea “Better Late Than Never!”, or Late packet is still useful
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

71 MPEG Frame Pattern I B B P B B P I P B B P B B NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

72 H.261 Error Propagation X X X X X X X X X X I P P P P P P loss I P
retransmission NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

73 H.261 Frame Pattern X I P P P P P P loss NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

74 H.261 Frame Pattern X X X I P retransmission loss NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

75 PTDD Periodic Temporal Dependency Distance Large PTDD
Higher Chance of Repair Longer Error Propagations Less Temporal Redundancy NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

76 QAL I P P P Enhancement Layer I P P P Base Layer NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

77 QAL X I P P P Enhancement Layer I P P P Base Layer + FEC
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

78 QAL + PTDD I P P P Enhancement Layer I P P P Base Layer
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

79 Error Propagation NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

80 Recovery from Error Propagation
NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

81 Frame “quality” PSNR = NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

82 PSNR vs. Loss Rate PSNR Packet Loss Rate NUS.SOC.CS5248-2015
Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

83 Today’s Summary

84 How to recover packet loss
Retransmission FEC Error Concealment NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

85 Limit the damage of error
Interleaving Key frame selection Change reference frame NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang)

Download ppt "Error Recovery."

Similar presentations

Streaming Video over the Internet

Streaming Video over the Internet
NUS.SOC.CS5248-2014 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Peer-to-Peer Streaming.

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) Peer-to-Peer Streaming.
NUS.SOC.CS5248 Ooi Wei Tsang 1 Adaptive Playout. NUS.SOC.CS5248 Ooi Wei Tsang 2 You are Here Network Encoder Sender Middlebox Receiver Decoder.

NUS.SOC.CS5248 Ooi Wei Tsang 1 Adaptive Playout. NUS.SOC.CS5248 Ooi Wei Tsang 2 You are Here Network Encoder Sender Middlebox Receiver Decoder.
1 Wireless Sensor Networks Akyildiz/Vuran Administration Issues  Take home Mid-term Exam  Assign April 2, Due April 7  Individual work is required 

1 Wireless Sensor Networks Akyildiz/Vuran Administration Issues  Take home Mid-term Exam  Assign April 2, Due April 7  Individual work is required 
NUS.SOC.CS5248-2007 Roger Zimmermann (based on slides by Ooi Wei Tsang) MPEG + RTP.

NUS.SOC.CS Roger Zimmermann (based on slides by Ooi Wei Tsang) MPEG + RTP.
An Improved UDP Protocol for Video Transmission Over Internet-to-wireless Networks Haitao Zheng, Jill Boyce IEEE Transaction on Multimedia, VOL.3, NO.3,

An Improved UDP Protocol for Video Transmission Over Internet-to-wireless Networks Haitao Zheng, Jill Boyce IEEE Transaction on Multimedia, VOL.3, NO.3,
A Survey of Packet-Loss Recovery Techniques Colin Perkins, Orion Hodson and Vicky Hardman Department of Computer Science University College London (UCL)

A Survey of Packet-Loss Recovery Techniques Colin Perkins, Orion Hodson and Vicky Hardman Department of Computer Science University College London (UCL)
1 NUS.SOC.CS5248 OOI WEI TSANG Playout Buffer Management.

1 NUS.SOC.CS5248 OOI WEI TSANG Playout Buffer Management.
NUS.SOC.CS5248-2014 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) 1 Adaptive Playout.

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) 1 Adaptive Playout.
Yi Liang Department of Electrical Engineering Stanford University April 19, 2000 Loss Recovery and Adaptive Playout Control for Packet Voice Communications.

Yi Liang Department of Electrical Engineering Stanford University April 19, 2000 Loss Recovery and Adaptive Playout Control for Packet Voice Communications.
A Layered Hybrid ARQ Scheme for Scalable Video Multicast over Wireless Networks Zhengye Liu, Joint work with Zhenyu Wu.

A Layered Hybrid ARQ Scheme for Scalable Video Multicast over Wireless Networks Zhengye Liu, Joint work with Zhenyu Wu.
NUS.SOC.CS5248-2014 Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media.

NUS.SOC.CS Roger Zimmermann (based on slides by Ooi Wei Tsang) Systems Support for Continuous Media.
Measurement Study of Low- bitrate Internet Video Streaming Dmitri Loguinov and Hayder Radha CS Dept at CUNY NY and EE/ECE at MSU. In Proceedings of ACM.

Measurement Study of Low- bitrate Internet Video Streaming Dmitri Loguinov and Hayder Radha CS Dept at CUNY NY and EE/ECE at MSU. In Proceedings of ACM.
Video Streaming: An FEC-Based Novel Approach Jianfei Cai, Chang Wen Chen Electrical and Computer Engineering, 2001. Canadian Conference on.

Video Streaming: An FEC-Based Novel Approach Jianfei Cai, Chang Wen Chen Electrical and Computer Engineering, Canadian Conference on.
1/12 Quantitative Characterization of Content-Based FEC Techniques on Interactive-Audio Transmissions over Wireless Networks José María González

1/12 Quantitative Characterization of Content-Based FEC Techniques on Interactive-Audio Transmissions over Wireless Networks José María González
A Survey of Packet-Loss Recovery Techniques Colin Perkins, Orion Hodson and Vicky Hardman Department of Computer Science University College London (UCL)

A Survey of Packet-Loss Recovery Techniques Colin Perkins, Orion Hodson and Vicky Hardman Department of Computer Science University College London (UCL)
Using Redundancy and Interleaving to Ameliorate the Effects of Packet Loss in a Video Stream Yali Zhu, Mark Claypool and Yanlin Liu Department of Computer.

Using Redundancy and Interleaving to Ameliorate the Effects of Packet Loss in a Video Stream Yali Zhu, Mark Claypool and Yanlin Liu Department of Computer.
A Survey of Packet Loss Recovery Techniques for Streaming Audio Colin Perkins, Orion Hodson, and Vicky Hardman University College London IEEE Network.

A Survey of Packet Loss Recovery Techniques for Streaming Audio Colin Perkins, Orion Hodson, and Vicky Hardman University College London IEEE Network.
Multiple Sender Distributed Video Streaming Nguyen, Zakhor IEEE Transactions on Multimedia April 2004.

Multiple Sender Distributed Video Streaming Nguyen, Zakhor IEEE Transactions on Multimedia April 2004.
Advanced Multimedia University of Palestine University of Palestine Eng. Wisam Zaqoot Eng. Wisam Zaqoot October 2010 October 2010 Ref: Computer Networking:

Advanced Multimedia University of Palestine University of Palestine Eng. Wisam Zaqoot Eng. Wisam Zaqoot October 2010 October 2010 Ref: Computer Networking:

Similar presentations

Ads by Google