Programmable HPC Network Fabrics for Adaptive Computing

Slides:



Advertisements
Similar presentations
Heng Pan , Hongtao Guan, Junjie Liu (ICT, CAS)
Advertisements

Why SDN and MPLS? Saurav Das, Ali Reza Sharafat, Guru Parulkar, Nick McKeown Clean Slate CTO Summit 9 th November, 2011.
Towards a Virtual European Supercomputing Infrastructure Vision & issues Sanzio Bassini
An OpenFlow based virtual network environment for Pragma Cloud virtual clusters Kohei Ichikawa, Taiki Tada, Susumu Date, Shinji Shimojo (Osaka U.), Yoshio.
SDN and Openflow.
Network Innovation using OpenFlow: A Survey
OpenDaylight Architecture ONF Member Work Day February 12 th, 2015 Colin TSC Chair, OpenDaylight Principal Engineer, Brocade.
Chapter 13 Embedded Systems
Traffic Management - OpenFlow Switch on the NetFPGA platform Chun-Jen Chung( ) SriramGopinath( )
Keith Wiles DPACC vNF Overview and Proposed methods Keith Wiles – v0.5.
Contiki A Lightweight and Flexible Operating System for Tiny Networked Sensors Presented by: Jeremy Schiff.
May 31, 2007PRESTO Workhop (Princeton, NJ) PRESTO workshop discussion notes Henning Schulzrinne Columbia University.
A Comparative Study of Network Protocols & Interconnect for Cluster Computing Performance Evaluation of Fast Ethernet, Gigabit Ethernet and Myrinet.
SEDCL: Stanford Experimental Data Center Laboratory.
1 Dong Lu, Peter A. Dinda Prescience Laboratory Department of Computer Science Northwestern University Evanston, IL GridG: Synthesizing Realistic.
Jharrod LaFon (HPC-3) Jim Williams (HPC-3) 2011 Computer System, Cluster, and Networking Summer Institute Russell Husted (MTU) Derek Walker (NCA&TSU) Povi.
Introduction Operating Systems’ Concepts and Structure Lecture 1 ~ Spring, 2008 ~ Spring, 2008TUCN. Operating Systems. Lecture 1.
Traffic shaping with OVS and SDN Ramiro Voicu Caltech LHCOPN/LHCONE, Berkeley, June
Chapter 1 An Overview of Database Management. 1-2 Topics in this Chapter What is a Database System? What is a Database? Why Database? Data Independence.
IEEE MEDIA INDEPENDENT SERVICES DCN: SAUC Title: Use cases of MIS framework to cooperate with SDN wireless access networks Date.
LIGHTNESS Introduction 10th Oct, 2012 Low latency and hIGH Throughput dynamic NEtwork infrastructureS for high performance datacentre interconnectS.
Introduction and Overview Questions answered in this lecture: What is an operating system? How have operating systems evolved? Why study operating systems?
Final Year Project Electronic & Computer Engineering Student: Andrew Sweeney Supervisor: Dr. Peter Corcoran Design and Realisation of Experiments for an.
So, Jung-ki Distributed Computing System LAB School of Computer Science and Engineering Seoul National University Implementation of Package Management.
Traffic Management - OpenFlow Switch on the NetFPGA platform Chun-Jen Chung( ) Sriram Gopinath( )
OFLOPS: An Open Framework for OpenFlow Switch Evaluation Haris Rotsos, Andrew W. Moore, University of Cambridge Nadi Sarrar, T-Labs/TU Berlin Steve Uhlig,
A Unified Framework for Software Defined Information-centric Network Wen Qi, Jinfan Wang, Yujia Luo, Rui Qin, Weigang Hou, Jing Ren Shucheng Liu, Jianping.
An Approach To Automate a Process of Detecting Unauthorised Accesses M. Chmielewski, A. Gowdiak, N. Meyer, T. Ostwald, M. Stroiński
Welcome Experiences in the Use of MDA and UML in Developing NATO Standards 16 July 2008 Chris Raistrick, Kennedy KC.COM.
A policy-based per-flow mobility management system design
SDN AND OPENFLOW SPECIFICATION SPEAKER: HSUAN-LING WENG DATE: 2014/11/18.
Windows OpenFabrics (WinOF) Update Gilad Shainer, Mellanox Technologies November 2007.
SDN Management Layer DESIGN REQUIREMENTS AND FUTURE DIRECTION NO OF SLIDES : 26 1.
EXPOSING OVS STATISTICS FOR Q UANTUM USERS Tomer Shani Advanced Topics in Storage Systems Spring 2013.
Arbitrary Packet Matching in Openflow
July 12th 1999Kits Workshop 1 Active Networking at Washington University Dan Decasper.
Copyright © 2015 Juniper Networks, Inc. 1 QFX5100 Line of Switches The World’s Most Nimble 10/40GbE Data Center Access Switches Speaker Name Title.
Simula Research Laboratory Lokaliteter & Forskning
Mellanox Connectivity Solutions for Scalable HPC Highest Performing, Most Efficient End-to-End Connectivity for Servers and Storage September 2010 Brandon.
Azher Mughal / Beraldo Leal Programming OpenFlow Flows for Scientific Profit 1 Azher Mughal / Beraldo Leal SuperComputing 2015.
3.6 Software-Defined Networks and OpenFlow
Programming Assignment 2 Zilong Ye. Traditional router Control plane and data plane embed in a blackbox designed by the vendor high-seed switching fabric.
Grant agreement no: TNC2014, Dublin. Why do we need Hardware Abstracion Layer (HAL)? What is HAL? How HAL is validated? Architecture of the HAL.
IEEE MEDIA INDEPENDENT SERVICES DCN: SAUC Title: Use cases of MIS framework to cooperate with SDN wireless access networks Date.
Atrium Router Project Proposal Subhas Mondal, Manoj Nair, Subhash Singh.
Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter,
SDN controllers App Network elements has two components: OpenFlow client, forwarding hardware with flow tables. The SDN controller must implement the network.
Developing an Implementation Framework for the Future Internet using the Y-Comm Architecture, SDN and NFV Glenford Mapp Associate Professor Middlesex University,
Instructor Materials Chapter 7: Network Evolution
University of Maryland College Park
Programming Assignment
OpenMosix, Open SSI, and LinuxPMI
Capgemini SAP Challenge 6: Party2AllParties
Heterogeneous Computation Team HybriLIT
Author: Daniel Guija Alcaraz
April 28, 2017 SUMIT MAHESHWARI INES UGALDE
Deep Learning Platform as a Service
© 2016 Global Market Insights, Inc. USA. All Rights Reserved Software Defined Networking Market to grow at 54% CAGR from 2017 to 2024:
Interface to Routing System (I2RS)
GGF15 – Grids and Network Virtualization
Chapter 9 Internetworking
Indigo Doyoung Lee Dept. of CSE, POSTECH
by Manuel Saldaña, Daniel Nunes, Emanuel Ramalho, and Paul Chow
Shadow: Scalable and Deterministic Network Experimentation
CLUSTER COMPUTING.
Architectures of distributed systems Fundamental Models
Architectures of distributed systems Fundamental Models
All or Nothing The Challenge of Hardware Offload
Architectures of distributed systems Fundamental Models
Designing a PC Farm to Simultaneously Process Separate Computations Through Different Network Topologies Patrick Dreher MIT.
Presentation transcript:

Programmable HPC Network Fabrics for Adaptive Computing Supercomputing 2017 Programmable HPC Network Fabrics for Adaptive Computing Dr. Venkat Dasari Army Research Laboratory Approved for public release

Approved for public release Motivation Rapid adoption of heterogeneous computing platforms require hardware independent abstraction layer to connect data to the computing platforms. Adaptive computing architectures are highly needed in tactical environment Network is also a computer. Approved for public release

Adaptive Computing Overview Heterogeneous computing platforms Hardware agnostic AIML abstractions Programmable Networks Approved for public release

Approved for public release Classical vs Programmable Networks Control plane is externally placed in programmable networks. Networks are application aware and vice versa Unified forwarding and Security Policy enforcement Software driven network intelligence and vendor agnostic Approved for public release

Approved for public release Design Overview Add more descriptive labels MPI/OpenFlow Interaction Schema extended from Takahashi, et al. model Global view of HPC programmable network fabric Approved for public release

Approved for public release Approach Modify OpenFlow switch and controller Modify Ryu, build and install with additional MPI fields Modify Open VSwitch Modify Loxigen, build OpenFlow Dissector Install kernel modules and binaries for testing with Mininet Approved for public release

Approved for public release Proposed MPI Data Structures for OpenFlow CPU load RAM load Bandwidth Latency Description Current total CPU load % on node Current total RAM load % on node Current % of total throughput available Round trip time between switch and node Field Name mpi_cload mpi_rload mpi_bwidth mpi_ping New data structures proposed to create interaction between OpenFlow and MPI Approved for public release

Approved for public release Code Snippet Programmable OpenFlow functions Approved for public release

Experimenter labels captured Approved for public release

Adaptive Computing Cluster Approved for public release Real-time visualization of programmable network fabric for adaptive computing Approved for public release

Approved for public release DEMO Approved for public release