PCAP BGP Parser RIPE 73, Madrid Christoph Dietzel, Tobias Hannaske

Slides:



Advertisements
Similar presentations
© 2008 Cisco Systems, Inc. All rights reserved.Cisco ConfidentialPresentation_ID 1 Chapter 8: Monitoring the Network Connecting Networks.
Advertisements

Technical Aspects of Peering Session 4. Overview Peering checklist/requirements Peering step by step Peering arrangements and options Exercises.
Entire Routes Reflecting capability draft-zhang-idr-bgp-entire-routes-reflect-00.txt Zhang Renhai :
BGP.
Part IV: BGP Routing Instability. March 8, BGP routing updates  Route updates at prefix level  No activity in “steady state”  Routing messages.
Border Gateway Protocol Ankit Agarwal Dashang Trivedi Kirti Tiwari.
Network Layer: Internet-Wide Routing & BGP Dina Katabi & Sam Madden.
© J. Liebeherr, All rights reserved 1 Border Gateway Protocol This lecture is largely based on a BGP tutorial by T. Griffin from AT&T Research.
Border Gateway Protocol Autonomous Systems and Interdomain Routing (Exterior Gateway Protocol EGP)
© 2005 Cisco Systems, Inc. All rights reserved. BGP v3.2—1-1 Module Summary BGP has reliable transport provided by TCP, a rich set of metrics called BGP.
1 Interdomain Routing Protocols. 2 Autonomous Systems An autonomous system (AS) is a region of the Internet that is administered by a single entity and.
1 Towards Secure Interdomain Routing For Dr. Aggarwal Win 2004.
CS Summer 2003 Lecture 3. CS Summer 2003 What is a BGP Path Attribute? BGP uses a set of parameters known as path attributes to characterize.
Analysis of BGP Routing Tables
Internet Routing Instability Labovitz et al. Sigcomm 1997 Largely adopted from Ion Stoica’s slide at UCB.
Bgpmon real-time collection and distribution of BGP updates Dave Matthews, Yan Chen, Dan Massey Department of Computer Science Colorado State University.
More on BGP Check out the links on politics: ICANN and net neutrality To read for next time Path selection big example Scaling of BGP.
Network Monitoring for Internet Traffic Engineering Jennifer Rexford AT&T Labs – Research Florham Park, NJ 07932
© 2009 Cisco Systems, Inc. All rights reserved. ROUTE v1.0—3-1 Implementing a Scalable Multiarea Network OSPF- Based Solution Configuring and Verifying.
Guide to TCP/IP Fourth Edition
IP-UDP-RTP Computer Networking (In Chap 3, 4, 7) 건국대학교 인터넷미디어공학부 임 창 훈.
Computer Networks Layering and Routing Dina Katabi
Yaping Zhu with: Jennifer Rexford (Princeton University) Subhabrata Sen and Aman Shaikh (AT&T Labs-Research) Impact of Prefix-Match.
Real-Time BGP Data Access 1 Mikhail Strizhov Colorado State University.
CS 3700 Networks and Distributed Systems Inter Domain Routing (It’s all about the Money) Revised 8/20/15.
Chapter 9. Implementing Scalability Features in Your Internetwork.
Border Gateway Protocol
Xuan Zheng (modified by M. Veeraraghavan) 1 BGP overview BGP operations BGP messages BGP decision algorithm BGP states.
BGP Man in the Middle Attack Jason Froehlich December 10, 2008.
© 2006 Cisco Systems, Inc. All rights reserved.Cisco PublicITE I Chapter 6 1 Filtering Traffic Using Access Control Lists Introducing Routing and Switching.
Border Gateway Protocol (BGP) W.lilakiatsakun. BGP Basics (1) BGP is the protocol which is used to make core routing decisions on the Internet It involves.
More on Internet Routing A large portion of this lecture material comes from BGP tutorial given by Philip Smith from Cisco (ftp://ftp- eng.cisco.com/pfs/seminars/APRICOT2004.
IP Security.  In CERTs 2001 annual report it listed 52,000 security incidents  the most serious involving:  IP spoofing intruders creating packets.
Detecting Selective Dropping Attacks in BGP Mooi Chuah Kun Huang November 2006.
Internet Protocols. ICMP ICMP – Internet Control Message Protocol Each ICMP message is encapsulated in an IP packet – Treated like any other datagram,
CSCI-1680 Network Layer: Inter-domain Routing Based partly on lecture notes by Rob Sherwood, David Mazières, Phil Levis, Rodrigo Fonseca John Jannotti.
Yaping Zhu with: Jennifer Rexford (Princeton University) Aman Shaikh and Subhabrata Sen (ATT Research) Route Oracle: Where Have.
An internet is a combination of networks connected by routers. When a datagram goes from a source to a destination, it will probably pass through many.
03/26/2009draft-cheng-grow-bgp-xml-00.txt 1 An XML Format for BGP Data Collection draft-cheng-grow-bgp-xml-00.txt Dan Massey Kevin BurnettPayne Cheng He.
JAtlasX Sascha Bleidner Junior Researcher, DE-CIX R&D Access RIPE Atlas through Java.
Routing in the Inernet Outcomes: –What are routing protocols used for Intra-ASs Routing in the Internet? –The Working Principle of RIP and OSPF –What is.
© 2006 Cisco Systems, Inc. All rights reserved.Cisco Public 1 Version 4.0 Filtering Traffic Using Access Control Lists Introducing Routing and Switching.
© 2005 Cisco Systems, Inc. All rights reserved. BGP v3.2—3-1 Route Selection Using Policy Controls Using Outbound Route Filtering.
© 2005 Cisco Systems, Inc. All rights reserved. BGP v3.2—3-1 Route Selection Using Policy Controls Applying Route-Maps as BGP Filters.
Routing Protocols COSC 541 Data Commun. System & Networks Yue Dou.
RIP Routing Protocol. 2 Routing Recall: There are two parts to routing IP packets: 1. How to pass a packet from an input interface to the output interface.
BGP Basics BGP uses TCP (port 179) BGP Established unicast-based connection to each of its BGP- speaking peers. BGP allowing the TCP layer to handle such.
EE 122: Integrated Services Ion Stoica November 13, 2002.
Border Gateway Protocol BGP-4 BGP environment How BGP works BGP information BGP administration.
ROUTING ON THE INTERNET COSC Jun-16. Routing Protocols  routers receive and forward packets  make decisions based on knowledge of topology.
UNIT 7- IP Security 1.IP SEC 2.IP Security Architecture
CS 3700 Networks and Distributed Systems
Connecting an Enterprise Network to an ISP Network
Border Gateway Protocol
CS 3700 Networks and Distributed Systems
Featured Enhancements to the IDE & Debugger
PCAP BGP Parser RIPE 73, Madrid Christoph Dietzel, Tobias Hannaske
A Quick Guide to Ethereal/Wireshark
Border Gateway Protocol
ICMP ICMP – Internet Control Message Protocol
BGP supplement Abhigyan Sharma.
Streaming Network Analytics System
IP Forwarding Relates to Lab 3.
Juniper Networks IPv6 Implementation
CSCI-1680 Network Layer: Inter-domain Routing
Chapter 8: Monitoring the Network
Netscope: Traffic Engineering for IP Networks
IP Forwarding Relates to Lab 3.
Network Analyzer :- Introduction to Wireshark
CSCI-1680 Network Layer: Inter-domain Routing
Presentation transcript:

PCAP BGP Parser RIPE 73, Madrid Christoph Dietzel, Tobias Hannaske Research and Development, DE-CIX

IXPs’ Route Servers They exist (yees!) Process a significant amount of data Crucial information for IXPs

Route Server as BGP Speaker at IXPs Customer debugging assistance Historic analysis (new routes, new peaks) Incidents (route hijacks, route leaks)

BIRD’s Information Export Limitations Limited long term export of BGP information No continuous export of MRT for BIRD No simple filtering before MRT exports No insights into incoming BGP advertisements

Solution? - tcpdump & tshark!(?) Complex / cumbersome Output hard to process in automated fashion Not build for BGP

PCAP BGP Parser Python 2.7 and 3.x Open Source (github.com/de-cix/pbgp-parser) License Apache 2.0

Features - Input Reads PCAP files (not PCAPng yet - would be easy to implement) BGP parser can read from stdin (PCAP format) Live reading from network interface not fully implemented yet Extending is possible, as long as it relies on raw packet data

Features - Filtering IP/MAC/port src/dst other filters Filtering before and after parsing IP/MAC/port src/dst other filters

Features – Filtering Filter field Values; Description Message type OPEN, UPDATE, NOTIFICATION, ROUTE-REFRESH, KEEPALIVE NLRI Prefix, e.g., 80.81.82.0/24 Withdrawn route Next hop IP, e.g., 80.81.82.1 ASN in AS path ASN, e.g., 6339 Last ASN in AS path ASN of the neighbor AS Community ASN BGP Community, e.g., 6993:666 Source IP Neighbor router’s IP Destination IP Source MAC Neighbor router’s MAC Destination MAC …

Features - Filtering Filtering to display specific BGP messages – only messages that apply are displayed Combine any filters as desired Different values for same filter are chained with a logical OR Different filters are chained with a logical AND NLRI must contain either 127.0.0.0/8 OR 192.168.1.0/32 AND next hop must be 1.1.1.1

Features - Output Human readable JSON Basic information about BGP msgs Easy to read Includes all important fields such as NEXT_HOP, AS_PATH, NLRI and/or WITHDRAWALS, etc. JSON All BGP msgs + meta information (capture specific data such as timestamp, source/dest ip/mac/port) RFC 7159 (see Python internal json-package) One JSON string per line Line based User can specify fields to be displayed Not all fields supported, yet Available fields for line based output are: NLRI, AS_PATH, NEXT_HOP, Communities, Source/Destination IP, Timestamp, Message Types

Evaluation Correctness Compared results of PBGP and tshark E.g., no. of packets after filtering, timestamps DE-CIX RS dump of several hours Correct, but we keep looking

Limitations Kafka support with Python 2.7 Packet reordering issue Not all features implemented yet

Evaluation Performance

Conclusion / Contribution Open source PCAP BGP Parser Apache 2.0 license Wide range of flexible input/output parameters Strong filtering capabilities Nice to integrate in shell/bash/python toolchain Fast enough perform “live” parsing for RS dump from large IXP

github.com/de-cix/pbgp-parser