Slide 1 Experiences with PerfSONAR and a Control Plane for Software Defined Measurement Yan Luo Department of Electrical and Computer Engineering University.

Slides:

Advertisements

Similar presentations

Network Resource Broker for IPTV in Cloud Computing Lei Liang, Dan He University of Surrey, UK OGF 27, G2C Workshop 15 Oct 2009 Banff,

Advertisements

Presented by: Julio Ibarra, Eric Johnson, David Rotella, Key Components: Science DMZ at FIU FlowSurge.

University of Kentucky Brent Salisbury Partnership between IT, CS, CCS, and Researchers. Liberation of research traffic from.

Supercharging PlanetLab : a high performance, Multi-Application, Overlay Network Platform Written by Jon Turner and 11 fellows. Presented by Benjamin Chervet.

Title or Title Event/Date Presenter, PresenterTitle, Internet2 SDX’s & the Internet2 Innovation Platform To keep our community at the “tip of the spear”,

Internet2 and AL2S Eric Boyd Senior Director of Strategic Projects

Title or Title Event/Date Presenter, PresenterTitle, Internet2 Network Virtualization & the Internet2 Innovation Platform To keep our community at the.

Kansei Connectivity Requirements: Campus Deployment Case Study Anish Arora/Wenjie Zeng, GENI Kansei Project Prasad Calyam, Ohio Supercomputer Center/OARnet.

Internet2 Network: Convergence of Innovation, SDN, and Cloud Computing Eric Boyd Senior Director of Strategic Projects.

Towards Virtual Routers as a Service 6th GI/ITG KuVS Workshop on “Future Internet” November 22, 2010 Hannover Zdravko Bozakov.

Network Innovation using OpenFlow: A Survey

Integrating Network and Transfer Metrics to Optimize Transfer Efficiency and Experiment Workflows Shawn McKee, Marian Babik for the WLCG Network and Transfer.

1 In VINI Veritas: Realistic and Controlled Network Experimentation Jennifer Rexford with Andy Bavier, Nick Feamster, Mark Huang, and Larry Peterson

1 GENI: Global Environment for Network Innovations Jennifer Rexford Princeton University

1 GENI: Global Environment for Network Innovations Jennifer Rexford On behalf of Allison Mankin (NSF)

The Future of Internet Research Scott Shenker (on behalf of many networking collaborators)

NATIONAL & KAPODISTRIAN UNIVERSITY OF ATHENS INTERDEPARTMENTAL GRADUATE PROGRAM IN MANAGEMENT AND ECONOMICS OF TELECOMMUNICATION NETWORKS Master Thesis.

NGNS Program Managers Richard Carlson Thomas Ndousse ASCAC meeting 11/21/2014 Next Generation Networking for Science Program Update.

1 GENI: Global Environment for Network Innovations Jennifer Rexford Princeton University See for.

Building a Strong Foundation for a Future Internet Jennifer Rexford ’91 Computer Science Department (and Electrical Engineering and the Center for IT Policy)

Experimenting with Persistent Live Video Streaming Service Kuang-Ching (KC) Wang Clemson University joint project with Parmesh Ramanathan University of.

Agenda Network Infrastructures LCG Architecture Management

Edge Based Cloud Computing as a Feasible Network Paradigm(1/27) Edge-Based Cloud Computing as a Feasible Network Paradigm Joe Elizondo and Sam Palmer.

Network Performance Measurement Atlas Tier 2 Meeting at BNL December Joe Metzger

1 ESnet Network Measurements ESCC Feb Joe Metzger

SDN Research Roy Hockett - Network Architect January 14, 2014 Common Solutions Group workshop.

Sponsored by the National Science Foundation Research & Experiments on GENI GENI CC-NIE Workshop NSF Mark Berman, Mike Zink January 7,

Sponsored by the National Science Foundation GENI and Cloud Computing Niky RIga GENI Project Office

INTERNATIONAL NETWORKS At Indiana University Hans Addleman TransPAC Engineer, International Networks University Information Technology Services Indiana.

The Singapore Advanced Research & Education Network.

HOPI Update Rick Summerhill Director Network Research, Architecture, and Technologies Jerry Sobieski MAX GigaPoP and TSC Program Manager Mark Johnson MCNC.

High-speed IDS The search for the Holy Grail….. Agenda The Problem Types of IDS’ The Problem Drawbacks Testing Assumptions Conclusions.

1 Measuring Circuit Based Networks Joint Techs Feb Joe Metzger

Delivering Circuit Services to Researchers: The HOPI Testbed Rick Summerhill Director, Network Research, Architecture, and Technologies, Internet2 Joint.

PiPEs Server Discovery – Adding NDT testing to the piPEs architecture Rich Carlson Internet2 April 20, 2004.

UNH network currently supports a 2.5 gbps network on campus. This network services thousands of users a day, and must be secure. These security measures.

Connect communicate collaborate GÉANT3 Services Connectivity and Monitoring Services by and for NRENs Ann Harding, SWITCH TNC 2010.

Innovations to Transition a Campus Core Cyberinfrastructure to Serve Diverse and Emerging Researcher Needs Prasad Calyam (Presenter), Jay Young, Paul Schopis.

ASCR/ESnet Network Requirements an Internet2 Perspective 2009 ASCR/ESnet Network Requirements Workshop April 15/16, 2009 Richard Carlson -- Internet2.

1 Network Measurement Summary ESCC, Feb Joe Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.

Slide 1 9/29/15 End-to-End Performance Tuning and Best Practices Moderator: Charlie McMahon, Tulane University Jan Cheetham, University of Wisconsin-Madison.

Connect. Communicate. Collaborate perfSONAR MDM Service for LHC OPN Loukik Kudarimoti DANTE.

UW Madison Campus Network Security Strategy Campus Firewall Service Rick Keir DoIT Network Services

Cyberinfrastructure: An investment worth making Joe Breen University of Utah Center for High Performance Computing.

1 | © 2015 Infinera Open SDN in Metro P-OTS Networks Sten Nordell CTO Metro Business Group

IHEP(Beijing LCG2) Site Report Fazhi.Qi, Gang Chen Computing Center,IHEP.

Slide 1 Simple, Flexible Programming of Data Movement Paths using Algorithmic Policies PIs: Y. Richard Yang, Robert Bjornson, Andrew Sherman Architect:

ANSE: Advanced Network Services for Experiments Institutes: –Caltech (PI: H. Newman, Co-PI: A. Barczyk) –University of Michigan (Co-PI: S. McKee) –Vanderbilt.

BEIJING-LCG Network Yan Xiaofei

CERN Campus Network Infrastructure Specificities Jean-Michel Jouanigot Campus Network Leader CERN EUROPEAN ORGANIZATION FOR NUCLEAR RESEARCH EUROPEAN LABORATORY.

LHCONE Monitoring Thoughts June 14 th, LHCOPN/LHCONE Meeting Jason Zurawski – Research Liaison.

Internet Traffic Engineering Motivation: –The Fish problem, congested links. –Two properties of IP routing Destination based Local optimization TE: optimizing.

Connect communicate collaborate perfSONAR MDM News Domenico Vicinanza DANTE (UK)

Slide 1 E-Science: The Impact of Science DMZs on Research Presenter: Alex Berryman Performance Engineer, OARnet Paul Schopis, Marcio Faerman.

ORNL Site Report ESCC Feb 25, 2014 Susan Hicks. 2 Optical Upgrades.

With the recent rise in cloud computing, applications are routinely accessing and interacting with data on remote resources. As data sizes become increasingly.

1 Deploying Measurement Systems in ESnet Joint Techs, Feb Joseph Metzger ESnet Engineering Group Lawrence Berkeley National Laboratory.

1 Network Measurement Challenges LHC E2E Network Research Meeting October 25 th 2006 Joe Metzger Version 1.1.

Instructor Materials Chapter 7: Network Evolution

15-744: Computer Networking

Dynamic Network Services In Internet2

Christos Markou Institute of Nuclear Physics NCSR ‘Demokritos’

Big-Data around the world

2018/12/10 Energy Efficient SDN Commodity Switch based Practical Flow Forwarding Method Author: Amer AlGhadhban and Basem Shihada Publisher: 2016 IEEE/IFIP.

V. Arun College of Information and Computer Sciences

Network Performance Measurement

“Detective”: Integrating NDT and E2E piPEs

Next-generation Internet architecture

In-network computation

Presentation transcript:

Slide 1 Experiences with PerfSONAR and a Control Plane for Software Defined Measurement Yan Luo Department of Electrical and Computer Engineering University of Massachusetts Lowell

Slide 2 FLowell Project at a Glance

Slide 3 FLowell Project Status UML Campus SDN Network –In-lab Testbed Completed: Six OpenFlow switches (Extreme Networks) + OpenDayLight Controller –Campus-wide Deployment In Progress (two buildings completed, other two buildings by Oct’15) Layer-2 10Gbps Link (UML MGHPCC) in progress (new Ciena optics pack in order) Layer-2 10Gbps Link (UML Internet2) in progress (new Cisco switch ordered) Science DMZ in progress (architectural design and verification, vendor selection) GENI Rack in progress (vendor selection)

Slide 4 Performance Tests DTN –CPU: Intel Core 2 cores –Hard Disk: Read/Write Speed: 125MB/s –1Gbps edge link (production net) PerfSONAR Test server: anl-diskpt1.es.net Inside firewallOutside firewall

Slide 5 PerfSONAR Today Over 1400 public perfSONAR nodes

Slide 6 PerfSONAR’s Scaling Challenges Challenges –Control, coordination and execution of network measurements –Monitor healthiness of networks besides major networks –Network issues caused by multiple problematic links Our Research –Using measurement archives (MA) to build a traceroute graph –Propose a control plane on top of perfSONAR to support software defined measurement and troubleshooting –A joint work with ESnet (Brian Tierney) and AMPATH/FIU (Jeronimo Bezerra)

Slide 7 Motivation of PerfSONAR Control Plane Typical Workflow Finding the Longest Clean Path

Slide 8 Objectives of PerfSONAR Control Plane Measurement Archive Data Analysis –How were the measurement results? –What can we learn from them? Automatic perfSONAR Peer Selection –Quickly identify the best suitable PS node(s) on the routes in question Programmable Measurement and Troubleshooting –Define measurement task and conditions with software

Slide 9 The Design of PerfSONAR Control Plane PerfSONAR Node Discovery –Finding nearest perfSONAR node of a target router on the path Measurement Task Control –Initiating tests between (any) two chosen perfSONAR nodes –Monitoring the performance on the path –Locating the problematic link(s)

Slide 10 The Operation of PerfSONAR Control Plane Obtain traceroute information from MAs Build a traceroute graph based on the dataset Find a set of perfSONAR node pairs to start bandwidth tests and monitor the results Diagnostic analysis and troubleshooting network issues O f f l i n e O n l i n e

Slide 11 Evaluation of PerfSONAR Control Plane Traceroute Dataset –95 MA hosts in the central US and eastern US regions –1831 traceroute records Traceroute Graph –2377 perfSONAR hosts and routers in total

Slide 12 A Use Case of the New Control Plane pr20.uml.edu --- typhoon.pub.alcf.anl.gov ( ) A python program with less than 300 lines of code “Troubleshooting” procedure took about 15 minutes

Slide 13 Conclusion and Future Work FLowell project at UMass Lowell in good progress Gained experiences with DTN and PerfSONAR A Control Plane for PerfSONAR show promising results –Open source at: –Community feedback welcomed! Tasks in the Upcoming FY: –Science DMZ Deployment at UML –GENI Rack operational at MGHPCC –Campus wide outreach to researchers –PerfSONAR Control Plane Collaboration Contact info: Yan Luo,