TUNDRA The Ultimate Netflow Data Realtime Analysis Jeffrey Papen Yahoo! Inc.

Slides:



Advertisements
Similar presentations
Fall VoN 2000 SIP Servers SIP Servers: A Buyers Guide Jonathan Rosenberg Chief Scientist.
Advertisements

Network Monitoring System In CSTNET Long Chun China Science & Technology Network.
Release 5.1, Revision 0 Copyright © 2001, Juniper Networks, Inc. Advanced Juniper Networks Routing Module 9: Static Routes & Routing Table Groups.
© 2006 Cisco Systems, Inc. All rights reserved. MPLS v MPLS VPN Technology Introducing the MPLS VPN Routing Model.
Static Routing Exercise AFNOG 2003/ Track 2 # 1 Static Routing Exercise u Unix network interface configuration u Cisco network interface configuration.
CCNP Network Route BGP Part -I BGP : Border Gateway Protocol. It is a distance vector protocol It is an External Gateway Protocol and basically used for.
Copyright © sFlow.org All Rights Reserved sFlow & Benefits Complete Network Visibility and Control You cannot control what you cannot see.
© 2007 Cisco Systems, Inc. All rights reserved.Cisco Public 1 Version 4.0 Introduction to Dynamic Routing Protocol Routing Protocols and Concepts – Chapter.
© 2007 Cisco Systems, Inc. All rights reserved.Cisco Public 1 Version 4.1 Routing Working at a Small-to-Medium Business or ISP – Chapter 6.
Implementing a Highly Available Network
QoS Solutions Confidential 2010 NetQuality Analyzer and QPerf.
Routing and Routing Protocols Introduction to Static Routing.
Network Monitoring for Internet Traffic Engineering Jennifer Rexford AT&T Labs – Research Florham Park, NJ 07932
NetFlow Analyzer Drilldown to the root-QoS Product Overview.
ROUTING PROTOCOL IGRP. REVIEW 4 Purpose of Router –determine best path to destination –pass the frames to the destination 4 Protocols –routed - used by.
© 2009 Cisco Systems, Inc. All rights reserved.ROUTE v1.0—6-1 Connecting an Enterprise Network to an ISP Network Configuring and Verifying Basic BGP Operations.
© 2009 Cisco Systems, Inc. All rights reserved. ROUTE v1.0—6-1 Connecting an Enterprise Network to an ISP Network Considering the Advantages of Using BGP.
COEN 252: Computer Forensics Router Investigation.
Fundamentals of Networking Discovery 2, Chapter 6 Routing.
S305 – Network Infrastructure Chapter 5 Network and Transport Layers.
Coarse-Grained Traffic Analysis in ISP Networks A Router-Based Approach Christian Martin Verizon.
Net Optics Confidential and Proprietary Net Optics appTap Intelligent Access and Monitoring Architecture Solutions.
Introduction to Routing and Routing Protocols By Ashar Anwar.
6: Routing Working at a Small to Medium Business.
1 © 2003, Cisco Systems, Inc. All rights reserved. CCNA 2 Module 6 Routing and Routing Protocols.
Introduction to Dynamic Routing Protocol
Session 2 Security Monitoring Identify Device Status Traffic Analysis Routing Protocol Status Configuration & Log Classification.
1 © 2004, Cisco Systems, Inc. All rights reserved. CCNA 2 v3.1 Module 8 TCP/IP Suite Error and Control Messages.
EMEA Partners XTM Network Training
1. 2 Anatomy of an IP Packet IP packets consist of the data from upper layers plus an IP header. The IP header consists of the following:
POSTECH DP&NM Lab. Internet Traffic Monitoring and Analysis: Methods and Applications (1) 4. Active Monitoring Techniques.
1 © 2003, Cisco Systems, Inc. All rights reserved. CCNA 2 Module 9 Basic Router Troubleshooting.
© 2007 Cisco Systems, Inc. All rights reserved.Cisco Public ITE PC v4.0 Chapter 1 1 Introduction to Routing and Packet Forwarding Routing Protocols and.
Page 1 Intro to Cisco Routers and RIP & IGRP Lecture 6 Hassan Shuja 04/18/2006.
© 2004 AARNet Pty Ltd Measurement in aarnet3 4 July 2004.
T. S. Eugene Ngeugeneng at cs.rice.edu Rice University1 COMP/ELEC 429/556 Introduction to Computer Networks Inter-domain routing Some slides used with.
Verify that timestamps for debugging and logging messages has been enabled. Verify the severity level of events that are being captured. Verify that the.
CCNA 2 Week 6 Routing Protocols. Copyright © 2005 University of Bolton Topics Static Routing Dynamic Routing Routing Protocols Overview.
6: Routing Working at a Small to Medium Business.
Routing and Routing Protocols
1 © 2003, Cisco Systems, Inc. All rights reserved. CCNA 2 v3.0 Module 9 Basic Router Troubleshooting.
1 © 2004, Cisco Systems, Inc. All rights reserved. CCNA 2 v3.1 Module 8 TCP/IP Suite Error and Control Messages.
1 Version 3.1 Module 6 Routed & Routing Protocols.
1 © 2004, Cisco Systems, Inc. All rights reserved. CCNA 2 v3.1 Module 9 Basic Router Troubleshooting.
Cisco Systems Networking Academy S2 C 12 Routing Protocols.
ERICSON BRANDON M. BASCUG Alternate - REGIONAL NETWORK ADMINISTRATOR HOW TO TROUBLESHOOT TCP/IP CONNECTIVITY.
The New Policy for Enterprise Networking Robert Bays Chief Scientist June 2002.
© 2005 Cisco Systems, Inc. All rights reserved. BGP v3.2—6-1 Scaling Service Provider Networks Scaling IGP and BGP in Service Provider Networks.
+ Routing Concepts 1 st semester Objectives  Describe the primary functions and features of a router.  Explain how routers use information.
© 2005 Cisco Systems, Inc. All rights reserved. BGP v3.2—5-1 Customer-to-Provider Connectivity with BGP Connecting a Multihomed Customer to a Single Service.
© 2005 Cisco Systems, Inc. All rights reserved. BGP v3.2—2-1 BGP Transit Autonomous Systems Forwarding Packets in a Transit AS.
1 © 2003, Cisco Systems, Inc. All rights reserved. CCNA 2 v3.0 Module 9 Basic Router Troubleshooting.
Internet Traffic Engineering Motivation: –The Fish problem, congested links. –Two properties of IP routing Destination based Local optimization TE: optimizing.
Cisco Routers Routers collectively provide the main feature of the network layer—the capability to forward packets end-to-end through a network. routers.
© 2007 Cisco Systems, Inc. All rights reserved.Cisco Public 1 Version 4.1 Routing Working at a Small-to-Medium Business or ISP – Chapter 6.
Introduction to Dynamic Routing Protocol
Working at a Small-to-Medium Business or ISP – Chapter 6
IP Routing using Packet Tracer Simulator
Connecting an Enterprise Network to an ISP Network
BGP 1. BGP Overview 2. Multihoming 3. Configuring BGP.
Planning and Troubleshooting Routing and Switching
Routing and Routing Protocols: Routing Static
Chapter 4: Routing Concepts
Introduction to Networking
Introduction To Networking
CCNA 2 v3.1 Module 6 Routing and Routing Protocols
Module Summary BGP is a path-vector routing protocol that allows routing policy decisions at the AS level to be enforced. BGP is a policy-based routing.
BGP Overview BGP concepts and operation.
Routing and Routing Protocols: Routing Static
Working at a Small-to-Medium Business or ISP – Chapter 6
Presentation transcript:

TUNDRA The Ultimate Netflow Data Realtime Analysis Jeffrey Papen Yahoo! Inc.

TUNDRA Features 1.Source and Destination AS bandwidth analysis 2.Transit AS bandwidth analysis 3.Custom AS macros: Bandwidth forecasting, peering merit analysis 4.Billing Formulas for cost/ benefit budget analysis 5.Analyze usage for local servers or services - Charge Back Billing 6.Symmetric Network Performance Analysis: latency and packet loss 7.AS path hop count stats 8.DOS attack detection 9.All in Real Time

Why should you care about TUNDRA? 1.Empirical Data Prove that network performance increases Prove that network reliability increases as AS hops decrease Cost/Savings analysis for new peer or transit 2.Know how much bandwidth a peer will use before (or after) you turn link up – determine private vs. public peering need 3.Focus and Order peer hit list – who should you go after? 4.Business case to document support for peers that say No.

Why Call It TUNDRA?

Router Collector/ Processor SNMP Poller Zebra Server MySQL Database Continuously exporting flows Polls Interfaces. Stores to local DB 49,000 subnets processed in 2 – 3 minutes Flow % * SNMP stored in central DB 500Mb/sec in + out in 15 minutes generates approx 5,244,216 flows (288 MB). Processed in ,724 flows/sec

Flow Data TUNDRA Displays InboundOutboundTransit AS BandwidthXXX PortXX ProtocolXX Server (IP)XX AS PathX

Port Out

Protocol Out

Bandwidth Out

Transit Data All outbound flows have destination IP Each Destination Subnet learns AS path from Zebra BGP table - AS padding removed Zebra BGP table is identical to actual routes used on local router(s) Local BGP data reflects immediate policy changes with no performance impact or security threat to production routers

Destination vs. Transit Traffic – UUNet

AS Hop Count Table AS Path Hop CountRouter #1Router #2 0 (Yahoo!)0% 1 (Peering ISP) % % % % % % % % % % % % % % % % % %

Performance Analysis ICMP Ping vs. TCP packet with bogus SYN/ACK Testing is done from your network’s perspective Route-Maps on collector interface Simultaneous testing of multiple paths to same target AS No continuous IBGP flapping from /32 updates No adding and removing /32 static routes No 3 rd party remote applications logging onto routers Looking Glass server (www) for troubleshooting

TUNDRA Next Steps 1.White Paper – No, I really mean it! 2.I’m looking for help – this is a hobby, not my job 3.Maintainers to finish baking code and configuration 4.Release to Internet community 5.Licensing is GPL + please peer with Yahoo!

Questions? Jeffrey Papen