1 A Suite of Schemes for User-level Network Diagnosis without Infrastructure Yao Zhao, Yan Chen Lab for Internet and Security Technology, Northwestern University

2 Motivation How do end users, with no special privileges, identify packet loss inside the network with one or two computers?

3 Motivation How do end users, with no special privileges, identify packet loss inside the network with one or two computers? Take-home –We propose three user-level loss rate diagnosis approaches –The combo of our approaches and Tulip [SOSP03] is much better than any single approach

4 Outline Motivation Related Works Lossy Link Diagnosis –Fragmentation Aided Diagnosis (FAD) Algebraic FAD Opportunistic FAD –Striped Probe Analysis (SPA) Evaluations Conclusions

5 Related Work I Internet Tomography –Multicast based (not practical) –Unicast based Mimic multicast L1L1 L2L2 L3L3 L4L4 S Virtual link The more cooperating end hosts, the shorter the virtual links

6 Related Work II Tulip [SOSP03] –Leverage on consecutive IPID –Tend to underestimate forward loss rates Suffer from the packet loss correlation x id id+1 Forward Loss SD x id id+2 Reverse Loss SD x id SD x ?

7 Outline Motivation Related Works Lossy Link Diagnosis –Fragmentation Aided Diagnosis (FAD) Algebraic FAD Opportunistic FAD –Striped Probe Analysis (SPA) Evaluations Conclusions

8 Link Diagnosis=> Forward Path Diagnosis If we can infer the loss rates of forward path F 1 and F 2, we can infer the link loss rate of l 3 F1F1 D SR1R1 R2R2 F2F2 l3l3 l2l2 l1l1 The more diagnosable forward path segments, the better the diagnosis granularity

9 Basic Idea of FAD SN PR P R SN P1P1 RP2P2 R P1P1 P2P2

10 Algebraic FAD Let p f and p r be the loss rate of the forward and reverse path respectively P R R P1P1 P2P2 (1 - p f ) × (1 - p r )=1 – p (1) (1 - p f ) 2 × (1 - p r )=1 – p’ (2) p and p’ are measurable. Solve p f and p r using (1) and (2)

11 How to Achieve FAD IP Fragmentation –Fragment a packet longer than MTU –Required to be supported in IPv4 –Some routers disable it for security reason Support of IP Fragmentation –64,320 router IP addresses probed by using Traceroute –About 80% of routers support IP fragmentation Degree of Rate Limiting on Responses –99% of routers allow a rate of 100 probes/s for ICMP Echo, ICMP Timestamp and TCP probes –Response to UDP probe is severely rate- limited

12 Opportunistic FAD F1F1 F2F2 +P F’ 2 F1F1 +P’ aaaaaaaa bbbbbbbb aaaaaaaabbbbbb aaaaaaaa cccccccccaaaaaaaacccccccc

13 Opportunistic FAD R’ Forward Loss F1F1 x F2F2 F’ 2 R No Loss SN F1F1 F2F2 F’ 2 F 1 +F 2 F 1 +F’ 2 SN Similar to Tulip, but OFAD allows large gap between fragments

14 Striped Probe Analysis (SPA) S sends a probe to D and we get the path p 1 -> p 2 S sends UDP packet with a certain TTL so that R returns an ICMP TTL-Exceeded response. Hence we get path p 1 -> p 3 S p1p1 p3p3 p2p2 DR S R D S p1p1 p2p2 p3p3

15 Striped Probe Analysis (SPA) S R S p1p1 p2p2 p3p3 P1P1 P2P2 (1) Loss on shared link D

16 Striped Probe Analysis (SPA) Success rate of p 1 ≈ n 1 × n 2 / ( n × n 12 ) –n : number of striped probes sent, –n 1 : number of P 1 received by D, –n 2 : number of P2 received by S, –n 12 : number of cases that both P 1 and P 2 are received Unbiased if packet loss has perfect correlation and loss rates of different links are independent S R S p1p1 p2p2 p3p3 P1P1 P2P2 (2) Loss on non-shared link D S R S p1p1 p2p2 p3p3 (1) Loss on shared link D

17 Summary RequirementAccuracy Tulip [SOSP03] Consecutive IPID (70%) Inaccurate w/ strong loss correlation FAD (AFAD & OFAD) IP fragmentation (80%) Accurate w/ weak or short loss correlation SPA ICMP TTL-Exceeded. Access from both end hosts Accurate w/ strong loss correlation The current Internet usually has strong but short loss correlation.

18 Outline Motivation Related Works Lossy Link Diagnosis –FAD –SPA Evaluations Conclusions

19 Evaluation Metrics Diagnosis Granularity –Weighted average of the lengths of the path’s diagnosable segments –For example, an 8-hop path has two diagnosable segments of length 3 and 5, and then the granularity of the path is ( )/8 = 4.25 Accuracy –Estimation error: –Relative error:

20 Diagnosis Granularity SPA is best FAD ≈Tulip Combo of FAD and Tulip is better

21 Path-Level Accuracy Evaluation FAD > Tulip > SPA OFAD, Tulip and SPA tends to underestimate loss rates

22 More Evaluations Consistency Check Packet Probe Size Selection Lossy Link Distribution More in the technical report

23 Conclusions and Recommendations We propose AFAD, OFAD and SPA which can conduct loss rate diagnosis without infrastructure Tulip, FAD and SPA have different working scenarios –The combination of them can achieve low diagnosis granularity and high accuracy Recommendations –OFAD+SPA, if we can control the two ends of an end-to-end path –OFAD+Tulip, if we can only control the source

24

25 Thanks! Questions?

26 Path-Level Accuracy of Combined Schemes

27

28 Path-Level Accuracy Evaluation

29 Path-Level Accuracy of Combined Schemes

30 IP Fragmentation Is Widely Supported Router Collection –64,320 router IP addresses probed by using traceroute from a machine Support of Different Probes Support of IP Fragmentation –90.3% of responsive routers support IP fragmentation –Altogether about 80% of routers support FAD. Degree of Rate Limiting on Responses –99% of routers allow a rate of 100 probes/s for ICMP Echo, ICMP Timestamp and TCP probes –UDP probe is severely rate-limited EchoTimestampUDPTCPAny 1 source85.3%69.2%64.5%71.7%88.2% 10 sources87.3%72.3%70.7%73.3%90.1%

31 Packet Transmission Correlation Choose 100 PlanetLab hosts and randomly measure 5000 paths Little loss correlation with enough gap

32 Forward Path Diagnosis => Link Diagnosis If we can infer the loss rates of forwarding path l 1 and P 1, we can infer the link loss rate of l 2 too. D

33 Opportunistic FAD n: number of R 12 received, n’: number of R’ 12 received X i = 0 when forward packet i is lost and X i =1 otherwise P(X 2 =1)≈P(X 2 =1|X 1 =1)≈n/(n+n’) R 12 P1P1 P2P2 P’ 2 R’ 12 P1P1 P2P2 P’ 2 x (1)(2)

34 Striped Probe Analysis (SPA) No fragmented packets needed ! S sends a probe to D and we get the path l 1 -> l 2 S sends UDP packet with a certain TTL so that R returns an ICMP TTL-Exceeded response. Hence we get path l 1 -> l 3 SR l1l1 l3l3 l2l2 S R D S l1l1 l2l2 l3l3 D

35 Striped Probe Analysis (SPA) S R S l1l1 l2l2 l3l3 P1P1 P2P2 D

36 Striped Probe Analysis (SPA) S R S l1l1 l2l2 l3l3 P1P1 P2P2 (1) No loss(2) Loss on shared link S R S l1l1 l2l2 l3l3 P1P1 P2P2 D D

37 Striped Probe Analysis (SPA) Success rate of l 1 ≈ n 1 × n 2 / ( n × n 12 ) –n : number of striped probes sent, –n 1 : number of P 1 received by D, –n 2 : number of P2 received by S, –n 12 : number of cases that both P 1 and P 2 are received Unbiased if packet loss has perfect correlation and loss rates of different links are independent S R S l1l1 l2l2 l3l3 S R S l1l1 l2l2 l3l3 P1P1 P2P2 (1) No loss(2) Loss on shared link(3) Loss on non-shared link S R DS l1l1 l2l2 l3l3 P1P1 P2P2 DD