Presentation is loading. Please wait.

Presentation is loading. Please wait.

Project Proposal Due Next Mon. Submit by

Published byAmy Short Modified over 6 years ago

Similar presentations

Presentation on theme: "Project Proposal Due Next Mon. Submit by"— Presentation transcript:

1 Project Proposal Due Next Mon. Submit by Email
Reminder Project Proposal Due Next Mon. Submit by

2 Problems with Internet
Limited Bandwidth Varying Bandwidth Delay Delay Jitter Packet Loss Heterogeneity : NUS.SOC.CS5248 OOI WEI TSANG

3 Error Recovery

4 You Are Here Encoder Decoder Middlebox Sender Receiver Network
NUS.SOC.CS5248 OOI WEI TSANG

5 Overview Characteristics of the Internet General techniques
Error recovery for audio Effect of loss on MPEG Error recovery for MPEG NUS.SOC.CS5248 OOI WEI TSANG

6 Loss Characteristics of The Internet

7 Characteristics of Internet
60-70% of paths do not show any loss Those with loss have an average of 4.5 – 6% packet loss [Paxson97] End-to-end Internet packet dynamics NUS.SOC.CS5248 OOI WEI TSANG

8 Packet Loss Pattern 1000 30 NUS.SOC.CS5248 OOI WEI TSANG

9 Characteristic of Internet
Bursts of loss are typically short (2-3 consecutively loss packets) Long burst do occur Burst may occur periodically NUS.SOC.CS5248 OOI WEI TSANG

10 Wireless Link Loss rate measured in my office 10 ~ 20%
up to 50% reported! NUS.SOC.CS5248 OOI WEI TSANG

11 A Survey of Packet-Loss Recovery Techniques for Streaming Audio
Perkins, Hodson and Hardman IEEE Network Magazine 1998

12 Retransmission 1 2 3 4 3 1 2 4 3 NUS.SOC.CS5248 OOI WEI TSANG

13 Redundant Data 1 2 2 3 3 4 4 5 1 2 2 3 3 4 5 NUS.SOC.CS5248
OOI WEI TSANG

14 Error Concealment 1 2 3 4 1 2 4 NUS.SOC.CS5248 OOI WEI TSANG

15 Pros and Cons retransmission redundant data error concealment
NUS.SOC.CS5248 OOI WEI TSANG

16 Retransmission for audio

17 Retransmission is Bad Need scalable feedback NACK consumes bandwidth
May need to retransmit frequently Retransmission maybe useless NUS.SOC.CS5248 OOI WEI TSANG

18 Retransmission is Good
Only retransmit when needed NUS.SOC.CS5248 OOI WEI TSANG

19 Scalable Retransmission
On packet loss T = random(0, RTT) wait for T multicast NACK On receiving NACK from others suppress own NACK NUS.SOC.CS5248 OOI WEI TSANG

20 Retransmit when group size is small loss rate is low
large latency acceptable NUS.SOC.CS5248 OOI WEI TSANG

21 Redundant Data for audio

22 Parity FEC 1011001 1000010 0010010 0001001 XOR NUS.SOC.CS5248
OOI WEI TSANG

23 Parity FEC NUS.SOC.CS5248 OOI WEI TSANG

24 Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG

25 Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG

26 Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG

27 Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG

28 Parity FEC Ordering NUS.SOC.CS5248 OOI WEI TSANG

29 Reed-Solomon Code RS(n,k) RS NUS.SOC.CS5248 OOI WEI TSANG

30 Reed-Solomon Code NUS.SOC.CS5248 OOI WEI TSANG

31 Media Specific FEC 1 2 2 3 3 4 4 5 1 2 2 3 3 4 5 NUS.SOC.CS5248
OOI WEI TSANG

32 Interleaving NUS.SOC.CS5248 OOI WEI TSANG

33 Error Concealment

34 Effect of Loss on Audio Speech Human ears can interpolate
Loss up to length of phoneme can still be tolerable NUS.SOC.CS5248 OOI WEI TSANG

35 Insertion-based Repair
Splice Silence Substitution Noise Substitution Repetition NUS.SOC.CS5248 OOI WEI TSANG

36 Other Repair Methods Interpolation Regeneration NUS.SOC.CS5248
OOI WEI TSANG

37 Colin’s Recommendations

38 Non-Interactive Apps Interleaving FEC Retransmission for unicast only
NUS.SOC.CS5248 OOI WEI TSANG

39 Interactive Applications
Media Specific FEC NUS.SOC.CS5248 OOI WEI TSANG

40 Error Concealment Repeat NUS.SOC.CS5248 OOI WEI TSANG

41 Packet Loss Effects on MPEG Video Sent over the Public Internet
Jill Boyce and Robert Gaglianello ACM Multimedia 1998

42 Measurement-based Study
Need to understand the problem before proposing solution NUS.SOC.CS5248 OOI WEI TSANG

43 NUS.SOC.CS5248 OOI WEI TSANG

44 Data Gathering Method From: NYC13 , Austin21, London18 To: Holmdel, NJ
NUS.SOC.CS5248 OOI WEI TSANG

45 Data Gathering Method Video: Two 5-mins MPEG 30 fps
384 kbps and 1 Mbps IBBPBBPBBPBBPBB QSIF 176x112 and SIF 352x240 One row per slice NUS.SOC.CS5248 OOI WEI TSANG

46 Average Packet Loss NUS.SOC.CS5248 OOI WEI TSANG

47 Packet Loss vs Time NUS.SOC.CS5248 OOI WEI TSANG

48 How to Fill Packets B 1 frame 1 packet P 1 slice 1 packet
I 1 slice 1 packet NUS.SOC.CS5248 OOI WEI TSANG

49 Packet Size Distributions
NUS.SOC.CS5248 OOI WEI TSANG

50 Packet Size vs Loss Rate
NUS.SOC.CS5248 OOI WEI TSANG

51 Lesson 1 slice per packet even if larger than MTU
If smaller packets means higher loss rate: fill packet until MTU Else one slice per MTU Alt: Change size of slice NUS.SOC.CS5248 OOI WEI TSANG

52 Frame Effected by Errors
NUS.SOC.CS5248 OOI WEI TSANG

53 Correlation of Packet Loss
NUS.SOC.CS5248 OOI WEI TSANG

54 Overview of Error Recovery for Video

55 Methods Retransmission Error Concealment FEC
Limiting Error Propagation Reference Frame Selection NUS.SOC.CS5248 OOI WEI TSANG

56 Reference Frame Selection
I P B B P I X NUS.SOC.CS5248 OOI WEI TSANG

57 Methods Retransmission Error Concealment FEC
Limiting Error Propagation Reference Frame Selection Changing Temporal Pattern NUS.SOC.CS5248 OOI WEI TSANG

58 Error Control Techniques for Interactive Low Bitrate Video Transmission over The Internet
Injong Rhee SIGCOMM ‘98

59 Basic Idea “Better Late Than Never!”, or Late packet is still useful
NUS.SOC.CS5248 OOI WEI TSANG

60 MPEG Frame Pattern I B B P B B P I P B B P B B NUS.SOC.CS5248
OOI WEI TSANG

61 H.261 Error Propagation X X X X X X X X X X I P P P P P P loss I P
retransmission NUS.SOC.CS5248 OOI WEI TSANG

62 H.261 Frame Pattern I P P P P P P X loss NUS.SOC.CS5248 OOI WEI TSANG

63 H.261 Frame Pattern X X X I P retransmission loss NUS.SOC.CS5248
OOI WEI TSANG

64 PTDD Periodic Temporal Dependency Distance Large PTDD Later Deadlines
Longer Error Propagations Less Temporal Dependencies NUS.SOC.CS5248 OOI WEI TSANG

65 QAL I P P P Enhancement Layer I P P P Base Layer NUS.SOC.CS5248
OOI WEI TSANG

66 QAL X I P P P Enhancement Layer I P P P Base Layer + FEC
NUS.SOC.CS5248 OOI WEI TSANG

67 QAL + PTDD I P P P Enhancement Layer I P P P Base Layer NUS.SOC.CS5248
OOI WEI TSANG

68 Error Propagation

69 Recovery from Error Propagation

70 Packet Loss Recovery for Streaming Video
N. Feamster, H. Balakrishnan PV’02

71 Overview An analytical model for packet loss SR-RTP Post Processing
NUS.SOC.CS5248 OOI WEI TSANG

72 Mathematical Model Lets model packet loss effects and see what it can tell us NUS.SOC.CS5248 OOI WEI TSANG

73 SI : mean num. of packets in I-frames P(I) : prob. frame type is I
p : prob. packet loss SI : mean num. of packets in I-frames P(I) : prob. frame type is I P(F): prob. frame is useless NUS.SOC.CS5248 OOI WEI TSANG

74 SP : mean num. of packets in P-frames Np : number of P-frames in GOP
p : prob. packet loss SP : mean num. of packets in P-frames Np : number of P-frames in GOP P(P): prob. frame type is P P(F): prob. frame is useless NUS.SOC.CS5248 OOI WEI TSANG

75 SB : mean num. of packets in B-frames NB : number of B-frames in GOP
p : prob. packet loss SB : mean num. of packets in B-frames NB : number of B-frames in GOP P(B): prob. frame type is B P(F): prob. frame is useless NUS.SOC.CS5248 OOI WEI TSANG

76 Average Frame Rate NUS.SOC.CS5248 OOI WEI TSANG

77 Is it accurate? NUS.SOC.CS5248 OOI WEI TSANG

78 SR-RTP Extensions to RTP for selective reliability NUS.SOC.CS5248
OOI WEI TSANG

79 SR-RTP Length ADU Sequence Number ADU Length ADU Offset Priority
Length ADU Sequence Number ADU Length ADU Offset Priority Layer Number NUS.SOC.CS5248 OOI WEI TSANG

80 Feamster & Balakrishnan’s ADU
1 ADU = 1 Frame NUS.SOC.CS5248 OOI WEI TSANG

81 Loss Detection LEN: 50 ADU: 0 ADU Size: 100 ADU Off: 0 LEN: 20 ADU: 0
NUS.SOC.CS5248 OOI WEI TSANG

82 Retransmission Request
Based on priority Example: I-Frame: highest priority P-Frame: higher priority if closer to prev I B-Frame: no retransmition NUS.SOC.CS5248 OOI WEI TSANG

83 Error Concealment for Video
Repeat pixels from previous frame Interpolate pixels from neighbouring region Interpolate motion vectors from previous frame NUS.SOC.CS5248 OOI WEI TSANG

84 Inferred MV for P Frame I P NUS.SOC.CS5248 OOI WEI TSANG

85 Inferred MV for I Frame P P I NUS.SOC.CS5248 OOI WEI TSANG

86 Evaluation Peak Signal to Noise Ratio (PSNR)
2552 over average square of differences in pixel values Calculated in dB (10 log 10) NUS.SOC.CS5248 OOI WEI TSANG

87 Performance of SR-RTP NUS.SOC.CS5248 OOI WEI TSANG

88 Today’s Summary

89 How to recover packet loss
Retransmission FEC Error Concealment NUS.SOC.CS5248 OOI WEI TSANG

90 How to limit the damage of error
Interleaving Key frame selection Change reference frame NUS.SOC.CS5248 OOI WEI TSANG

91 Demo

92 Relate to CS5248 Really bursty audio loss Error concealment with noise
Really bursty video loss, or long video propagation Need to protect important content (content-based unequal error protection) NUS.SOC.CS5248 OOI WEI TSANG

Download ppt "Project Proposal Due Next Mon. Submit by"

Similar presentations

Streaming Video over the Internet

Streaming Video over the Internet
NUS.SOC.CS5248 Ooi Wei Tsang 1 Adaptive Playout. NUS.SOC.CS5248 Ooi Wei Tsang 2 You are Here Network Encoder Sender Middlebox Receiver Decoder.

NUS.SOC.CS5248 Ooi Wei Tsang 1 Adaptive Playout. NUS.SOC.CS5248 Ooi Wei Tsang 2 You are Here Network Encoder Sender Middlebox Receiver Decoder.
1 Wireless Sensor Networks Akyildiz/Vuran Administration Issues  Take home Mid-term Exam  Assign April 2, Due April 7  Individual work is required 

1 Wireless Sensor Networks Akyildiz/Vuran Administration Issues  Take home Mid-term Exam  Assign April 2, Due April 7  Individual work is required 
NUS.SOC.CS5248-2007 Roger Zimmermann (based on slides by Ooi Wei Tsang) MPEG + RTP.

NUS.SOC.CS Roger Zimmermann (based on slides by Ooi Wei Tsang) MPEG + RTP.
MMCN 19 Jan 2005 Ooi Wei Tsang Peer-to-Peer Streaming.

MMCN 19 Jan 2005 Ooi Wei Tsang Peer-to-Peer Streaming.
L-21 Multicast. L -15; 10-31-02© Srinivasan Seshan, 20022 Overview What/Why Multicast IP Multicast Service Basics Multicast Routing Basics DVMRP Overlay.

L-21 Multicast. L -15; © Srinivasan Seshan, Overview What/Why Multicast IP Multicast Service Basics Multicast Routing Basics DVMRP Overlay.
A Survey of Packet-Loss Recovery Techniques Colin Perkins, Orion Hodson and Vicky Hardman Department of Computer Science University College London (UCL)

A Survey of Packet-Loss Recovery Techniques Colin Perkins, Orion Hodson and Vicky Hardman Department of Computer Science University College London (UCL)
1 NUS.SOC.CS5248 OOI WEI TSANG Playout Buffer Management.

1 NUS.SOC.CS5248 OOI WEI TSANG Playout Buffer Management.
NUS.SOC.CS5248-2014 Roger Zimmermann (based in part on slides by Ooi Wei Tsang) 1 Adaptive Playout.

NUS.SOC.CS Roger Zimmermann (based in part on slides by Ooi Wei Tsang) 1 Adaptive Playout.
Yi Liang Department of Electrical Engineering Stanford University April 19, 2000 Loss Recovery and Adaptive Playout Control for Packet Voice Communications.

Yi Liang Department of Electrical Engineering Stanford University April 19, 2000 Loss Recovery and Adaptive Playout Control for Packet Voice Communications.
A Layered Hybrid ARQ Scheme for Scalable Video Multicast over Wireless Networks Zhengye Liu, Joint work with Zhenyu Wu.

A Layered Hybrid ARQ Scheme for Scalable Video Multicast over Wireless Networks Zhengye Liu, Joint work with Zhenyu Wu.
Packet Loss Recovery for Streaming Video N. Feamster and H. Balakrishnan Massachusetts Institute of Technology In Workshop on Packet Video (PV) Pittsburg,

Packet Loss Recovery for Streaming Video N. Feamster and H. Balakrishnan Massachusetts Institute of Technology In Workshop on Packet Video (PV) Pittsburg,
CS525z Multimedia Networking Review. Analog to Digital What is the relationship between –Fidelity and Sample Size –Fidelity and Sample Rate.

CS525z Multimedia Networking Review. Analog to Digital What is the relationship between –Fidelity and Sample Size –Fidelity and Sample Rate.
Measurement Study of Low- bitrate Internet Video Streaming Dmitri Loguinov and Hayder Radha CS Dept at CUNY NY and EE/ECE at MSU. In Proceedings of ACM.

Measurement Study of Low- bitrate Internet Video Streaming Dmitri Loguinov and Hayder Radha CS Dept at CUNY NY and EE/ECE at MSU. In Proceedings of ACM.
Video Streaming: An FEC-Based Novel Approach Jianfei Cai, Chang Wen Chen Electrical and Computer Engineering, 2001. Canadian Conference on.

Video Streaming: An FEC-Based Novel Approach Jianfei Cai, Chang Wen Chen Electrical and Computer Engineering, Canadian Conference on.
A Survey of Packet-Loss Recovery Techniques Colin Perkins, Orion Hodson and Vicky Hardman Department of Computer Science University College London (UCL)

A Survey of Packet-Loss Recovery Techniques Colin Perkins, Orion Hodson and Vicky Hardman Department of Computer Science University College London (UCL)
Using Redundancy and Interleaving to Ameliorate the Effects of Packet Loss in a Video Stream Yali Zhu, Mark Claypool and Yanlin Liu Department of Computer.

Using Redundancy and Interleaving to Ameliorate the Effects of Packet Loss in a Video Stream Yali Zhu, Mark Claypool and Yanlin Liu Department of Computer.
A Survey of Packet Loss Recovery Techniques for Streaming Audio Colin Perkins, Orion Hodson, and Vicky Hardman University College London IEEE Network.

A Survey of Packet Loss Recovery Techniques for Streaming Audio Colin Perkins, Orion Hodson, and Vicky Hardman University College London IEEE Network.
CS 294-9 :: Fall 2003 Layered Coding and Networking Ketan Mayer-Patel.

CS :: Fall 2003 Layered Coding and Networking Ketan Mayer-Patel.
Using Interleaving to Ameliorate the Effects of Packet Loss in a Video Stream Mark Claypool and Yali Zhu Computer Science Department Worcester Polytechnic.

Using Interleaving to Ameliorate the Effects of Packet Loss in a Video Stream Mark Claypool and Yali Zhu Computer Science Department Worcester Polytechnic.

Similar presentations

Ads by Google