A Grid Proxy Architecture for Network Resources Phil Wang, Inder Monga, Tal Lavian, Ramesh Durairaj, Franco Travostino Nortel Networks Labs {pywang, imonga,

Slides:



Advertisements
Similar presentations
Photonic TeraStream and ODIN By Jeremy Weinberger The iCAIR iGRID2002 Demonstration Shows How Global Applications Can Use Intelligent Signaling to Provision.
Advertisements

The Anatomy of the Grid: An Integrated View of Grid Architecture Carl Kesselman USC/Information Sciences Institute Ian Foster, Steve Tuecke Argonne National.
Lawrence Berkeley National LaboratoryU.S. Department of Energy | Office of Science Network Service Interface (NSI) Inder Monga Co-chair, Network Services.
Agreement-based Distributed Resource Management Alain Andrieux Karl Czajkowski.
Grant agreement n° SDN architectures for orchestration of mobile cloud services with converged control of wireless access and optical transport network.
Workflow Integrated Network Resource Orchestration.
An evolutionary approach to G-MPLS ensuring a smooth migration of legacy networks Ben Martens Alcatel USA.
USING THE GLOBUS TOOLKIT This summary by: Asad Samar / CALTECH/CMS Ben Segal / CERN-IT FULL INFO AT:
DWDM-RAM: DARPA-Sponsored Research for Data Intensive Service-on-Demand Advanced Optical Networks DWDM RAM DWDM RAM BUSINESS WITHOUT BOUNDARIES.
Asper School of Business University of Manitoba Systems Analysis & Design Instructor: Bob Travica System architectures Updated: November 2014.
Milos Kobliha Alejandro Cimadevilla Luis de Alba Parallel Computing Seminar GROUP 12.
Grids and Grid Technologies for Wide-Area Distributed Computing Mark Baker, Rajkumar Buyya and Domenico Laforenza.
1 Routing as a Service Karthik Lakshminarayanan (with Ion Stoica and Scott Shenker) Sahara/i3 retreat, January 2004.
1© Copyright 2015 EMC Corporation. All rights reserved. SDN INTELLIGENT NETWORKING IMPLICATIONS FOR END-TO-END INTERNETWORKING Simone Mangiante Senior.
Workflow Integrated Network Resource Orchestration Phil Wang, Inder Monga, Satish Raghunath, Franco Travostino, Tal Lavian {pywang, imonga, satishra, travos,
ESnet On-demand Secure Circuits and Advance Reservation System (OSCARS) Chin Guok Network Engineering Group Thomas Ndousse Visit February Energy.
Abstraction and Control of Transport Networks (ACTN) BoF
Resource Management Reading: “A Resource Management Architecture for Metacomputing Systems”
Project CO2: Technical Overview Inder Monga om} Advanced Technology CTO Office Billerica MA.
THE NEXT STEP IN WEB SERVICES By Francisco Curbera,… Memtimin MAHMUT 2012.
Distributed Real-Time Systems for the Intelligent Power Grid Prof. Vincenzo Liberatore.
National Science Foundation Arlington, Virginia January 7-8, 2013 Tom Lehman University of Maryland Mid-Atlantic Crossroads.
Connecting OurGrid & GridSAM A Short Overview. Content Goals OurGrid: architecture overview OurGrid: short overview GridSAM: short overview GridSAM: example.
Interoperable Intelligent Optical Networking: Key to future network services and applications OIF Carrier Group Interoperability: Key issue for carriers.
TeraPaths TeraPaths: establishing end-to-end QoS paths - the user perspective Presented by Presented by Dimitrios Katramatos, BNL Dimitrios Katramatos,
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
GEC 15 Houston, Texas October 23, 2012 Tom Lehman Xi Yang University of Maryland Mid-Atlantic Crossroads (MAX)
Rick Summerhill Chief Technology Officer, Internet2 Internet2 Fall Member Meeting 9 October 2007 San Diego, CA The Dynamic Circuit.
A Framework for Internetworking Heterogeneous High-Performance Networks via GMPLS and Web Services Xi Yang, Tom Lehman Information Sciences Institute (ISI)
Service Oriented Architectures Presentation By: Clifton Sweeney November 3 rd 2008.
Copyright © 2002 Intel Corporation. Intel Labs Towards Balanced Computing Weaving Peer-to-Peer Technologies into the Fabric of Computing over the Net Presented.
Copyright: NOMAD IST NOMAD Integrated Networks for Seamless and Transparent Service Discovery.
TeraPaths TeraPaths: Establishing End-to-End QoS Paths through L2 and L3 WAN Connections Presented by Presented by Dimitrios Katramatos, BNL Dimitrios.
Cracow Grid Workshop ‘06 17 October 2006 Execution Management and SLA Enforcement in Akogrimo Antonios Litke Antonios Litke, Kleopatra Konstanteli, Vassiliki.
Lucy Yong Young Lee IETF CCAMP WG GMPLS Extension for Reservation and Time based Bandwidth Service.
SDN AND OPENFLOW SPECIFICATION SPEAKER: HSUAN-LING WENG DATE: 2014/11/18.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
7. Grid Computing Systems and Resource Management
Internet of Things. IoT Novel paradigm – Rapidly gaining ground in the wireless scenario Basic idea – Pervasive presence around us a variety of things.
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
Aneka Cloud ApplicationPlatform. Introduction Aneka consists of a scalable cloud middleware that can be deployed on top of heterogeneous computing resources.
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
GRID ANATOMY Advanced Computing Concepts – Dr. Emmanuel Pilli.
Data Grid Plane Network Grid Plane Dynamic Optical Network Lambda OGSI-ification Network Resource Service Data Transfer Service Generic Data-Intensive.
INFSO-RI Enabling Grids for E-sciencE Grid Services for Resource Reservation and Allocation Tiziana Ferrari Istituto Nazionale di.
DICE: Authorizing Dynamic Networks for VOs Jeff W. Boote Senior Network Software Engineer, Internet2 Cándido Rodríguez Montes RedIRIS TNC2009 Malaga, Spain.
CSF. © Platform Computing Inc CSF – Community Scheduler Framework Not a Platform product Contributed enhancement to The Globus Toolkit Standards.
Supporting Advanced Scientific Computing Research Basic Energy Sciences Biological and Environmental Research Fusion Energy Sciences High Energy Physics.
Admela Jukan jukan at uiuc.edu March 15, 2005 GGF 13, Seoul Issues of Network Control Plane Interactions with Grid Applications.
Franco Travostino and Admela Jukan jukan at uiuc.edu June 30, 2005 GGF 14, Chicago Grid Network Services Architecture (GNSA) draft-ggf-ghpn-netserv-2.
© 2006 Open Grid Forum George Zervas, Reza Nejabati, Dimitra Simeonidou University of Essex Update on Grid User Network Interface (GUNI) Draft.
GGF11 - Honolulu draft-ggf-ghpn-opticalnets-1 Grid High-Performance Networking Research Group Optical Network Infrastructure for Grid Dimitra Simeonidou.
AMSA TO 4 Advanced Technology for Sensor Clouds 09 May 2012 Anabas Inc. Indiana University.
Enabling Grids for E-sciencE Agreement-based Workload and Resource Management Tiziana Ferrari, Elisabetta Ronchieri Mar 30-31, 2006.
The Internet2 Network and LHC Rick Summerhill Director Network Research, Architecture, and Technologies Internet2 LHC Meeting 23 October 2006 FERMI Lab,
Towards a High Performance Extensible Grid Architecture Klaus Krauter Muthucumaru Maheswaran {krauter,
An evolutionary approach to G-MPLS ensuring a smooth migration of legacy networks Ben Martens Alcatel USA.
Instructor Materials Chapter 7: Network Evolution
Implementation Considerations in an On-Demand Switched Lightpath Network Adapting the Network to the Application Rob Keates Optical Architecture and PLM.
Grid Resource Allocation Agreement Protocol Working Group
Grid Network Services: Lessons from SC04 draft-ggf-bas-sc04demo-0.doc
Grid Computing.
University of Technology
GGF15 – Grids and Network Virtualization
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Resource and Service Management on the Grid
The Anatomy and The Physiology of the Grid
The Anatomy and The Physiology of the Grid
Presentation transcript:

A Grid Proxy Architecture for Network Resources Phil Wang, Inder Monga, Tal Lavian, Ramesh Durairaj, Franco Travostino Nortel Networks Labs {pywang, imonga, tlavian, radurai,

GlobusWorld 2004 GPAN - 1 Agenda Challenges Grid Proxy Architecture for Networks (GPAN) Demo Summary

GlobusWorld 2004 GPAN - 2 Grids and Networks Network is an integral part to Grids –Network resources guarantee Grid resource sharing –Networks resource allocation needed to effectively enable distributed virtual organizations (VOs) Networks are heterogeneous in nature –Different kinds of devices and vendors –Domain-specific clouds in separate administrative domains –Unknown number of network layers and elements in a p2p connection Networks have their own standards and evolution curve, not necessarily grid savvy –Standards and architectures defined in IEEE, IETF, ITU and others –Data plane, control plane, and management plane protocols –Network services provided for management and control For Grids to be successfully deployed across LAN/MAN/WAN, we need a rich 2-way interaction between Grid and Nets Networks are unaware of Grid concepts and services

GlobusWorld 2004 GPAN - 3 Challenge: Grid Management of Network Resources Current network services do not match Grid Resource requirements –E.g., reporting resource status into MDS/Index –E.g., allocating resources based on GRAM/RSL request Network elements individually may not be able to offer Grid compatible resource services –Limited CPU, memory, embedded system environment –Ineffective allocations of element resources when shared by multiple VO’s Grid deployment over legacy and varied networks –Optical, Ethernet, IP, FR, ATM networks do not all offer same resources –Legacy network elements cannot be grid enabled

GlobusWorld 2004 GPAN - 4 Agenda Challenges Grid Proxy Architecture for Networks (GPAN) Demo Summary

GlobusWorld 2004 GPAN - 5 Grid Proxy Architecture for Network Resources (GPAN) Enables Grid Resource Services to take advantage of existing network services The GPAN Grid middleware functionality includes: –Proxy for accepting Grid resource requirements –Provider of information regarding network resource availability/status –Co-existence and integration with GRAM2, MDS –Support for RSL2 extensions featuring network resource allocation capabilities –OGSI-services providing network resource info & dynamic allocation capabilities –Abstract view and access to base network services Grid Applications Network Elements Grid Services Network Services GPAN

GlobusWorld 2004 GPAN - 6 Grid Resources: general setup B D E A Grid Domain: Virtual Organization MDS Index C A A Grid VO utilizes grid resources in Campus A-E Service Providers (xSP) on MAN/WAN access networks peer together to provide required network services to the Grid VO. Index services collects resource information from computing, storage resources in Campus A-E and xSP Broker/metascheduler performs resource lookups and allocations of all grid resources for applications Grid Overlay Computing GRAM2 MMJFS MFJS RIPS MFJS RIPS MJS RIPS Storage MFJS RIPS MFJS RIPS RM Info GRAM2 RM Computing GRAM2 MMJFS MFJS RIPS MFJS RIPS MJS RIPS Access Network Service Overlay Access Broker/Metascheduler Core Network xSP GPAN Proxy NIP Hosting Environment application

GlobusWorld 2004 GPAN - 7 Proxy architecture implements scalable resource services for networks Computer Network device GPAN Grid Service Network Services GPAN Grid Service –Provides a GRAM-2 instance in a network –Extends RSL2 for network resources –Supports resource discovery and info updates on the Grid –Supports resource dynamic provisioning, optimization –Resource Services such as GRAM talks to GPAN for network resource requests –Grid clients and services use GPAN WSDL interface

GlobusWorld 2004 GPAN - 8 GRAM2 Computing RM GRAM2 GPAN GRAM2 Visual. RM GRAM2 Storage RM Broker/Metascheduler Application Resource Management Flow Network Service overlay Network RM MDS Feeds not shown Derived from © ANL Material

GlobusWorld 2004 GPAN - 9 Network Resource Information using GPAN B D E A Grid Domain: Virtual Organization MDS Index C A Grid Overlay Computing GRAM2 MMJFS MFJS RIPS MFJS RIPS MJS RIPS Storage MFJS RIPS MFJS RIPS RM Info GRAM2 RM Computing GRAM2 MMJFS MFJS RIPS MFJS RIPS MJS RIPS Access Network Service Overlay Access Core Network xSP GPAN Proxy NIP GPAN provides network info to MDS/Index –Proxy for network resource allocation status and updates Network Info Provider (NIP) aggregates resource discovery and status updates −Based on virtual network topology related to the VO Hosting Environment application Broker/Metascheduler

GlobusWorld 2004 GPAN - 10 Network Resource Allocation using GPAN B D E A Grid Domain: Virtual Organization MDS Index C A Grid Overlay Computing GRAM2 MMJFS MFJS RIPS MFJS RIPS MJS RIPS Storage MFJS RIPS MFJS RIPS RM Info GRAM2 RM Computing GRAM2 MMJFS MFJS RIPS MFJS RIPS MJS RIPS Access Network Service Overlay Access Core Network xSP GPAN Proxy NIP 1)Application requests broker/metascheduler for job services and resources 2)Broker/metascheduler generates RSL2 for resource allocation requests after consulting MDS/Index 3)xSPs co-ordinate to allocate requested resources RSL2 3 Hosting Environment application Broker/Metascheduler

GlobusWorld 2004 GPAN - 11 GPAN Programming Model Two service infrastructures involved –OGSI: Grid services –NS: network services GPAN Service Components –GPS: GPAN proxy –NIP: GPAN network info provider –GDS: GPAN delegation –Smart: NS intelligence –NPS: NS network provisioning –RIS: NS network discovery and info update Other Service Components –BM: Broker/Metascheduler –MJS: Managed Job Service NIP Index BM Network End Client Grid Security GPAN GPS GDS Network Service Infrastructure OGSI 1.0 RSL-2 GRAM-2 Interface Common OGSI block Common NS block New GPAN block Legends MJS Smart NPSRIS

GlobusWorld 2004 GPAN - 12 GPAN RSL2 extension GPAN RSL2 RSL Index Response Resource Info Resource ID CLIENT TYPE TITLE ACTION STARTTIME ENDTIME BANDWIDTH profile TRAFFICROUTE profile [Extensions] Discovery Refresh Query Resource ID CLIENT TYPE ACTION STATUS [Extensions] Allocation request info request feedback ID CLIENT TYPE [Extensions] all resources update all resources specify GPAN RSL2 is defined in terms of XML and schemas GPAN RSL2 is used for resource allocation, info and feedback GPAN RSL2 is fully extensible

GlobusWorld 2004 GPAN - 13 Agenda Challenges Grid Proxy Architecture for Networks (GPAN) Demo Summary

GlobusWorld 2004 GPAN - 14 Bandwidth Boost Notional Picture 1. I’m in San Francisco. I need this application of mine to munch on a 200 GB data set. Elapsed time is a known function of Ω/N, with Ω a manifest constant and N the number of processors <= 100. I need the result (estimated ~100 GB) to be shipped to Chicago, Eindhoven, and back here within the next 12 hrs. San Francisco [X] Chicago <=100 cpus, 300 GB RAID A B C β δ 3. Infrastructure decides [A,B,C] vs. [A,B,δ] vs. [A,β,δ] vs.[others] according to which Location [X]s complies and which optical by- passes [A,B,C,β,δ] can be set at times t 0 and t 0 +f(Ω /N). Proceed to reserve Location [X] with the chosen optical by-passes (all or none). 2. That is, I anycast everything but the final destination(s) Eindhoven

GlobusWorld 2004 GPAN - 15 App. A Resources Ethernet Switch Ethernet Switch Photonic switch Ethernet Switch Optical Control Plane Network Provisioning Services GPAN Proxy App. B Resources App. A Resources App. B Resources “A Globus-based Grid Infrastructure Negotiates Ephemeral Optical Bandwidth Boost” Internet Optical bypass RSL2 Two applications use Grid FTP for communicating large sets of data Grid FTP provides data movement requirements and constraints to GPAN GPAN Proxy module translates Grid requirements to appropriate network resource allocation GPAN Proxy module works with Network provisioning services to allocate optical by-pass as shown.

GlobusWorld 2004 GPAN - 16 Agenda Challenges Grid Proxy Architecture for Networks (GPAN) Demo Summary

GlobusWorld 2004 GPAN - 17 Related Work GARA, DUROC –Concept of Resource co-allocation, scheduler, advanced reservations leveraged in our work –GPAN extends the reach of GARA/DUROC concepts –Job Manager in GPAN refers to GRAM2 and its instances WS-Agreement –Services and resource lifetime-management and policy-based negotiations between network domains GRAM/RSL/JSDL –Extend RSL2 to work with GPAN for network resources –JSDL is new standard being for job submissions

GlobusWorld 2004 GPAN - 18 Relevant Standards Activities Global Grid Forum DMTF –CIM schemas for network devices and end-to-end services OIF –New UNIs IETF/IRTF –Policy, AAAs ITU –VPNs, (E)NNIs, GMPLS OASIS, W3C –Evolution of WS technologies

GlobusWorld 2004 GPAN - 19 Summary GPAN leverages existing network service facilities for Grid resource provisioning –Grid applications needs not to use or know about network services –Current network services need not to be modified for Grids –GPAN exploits network smart services for Grid applications –No Grid service is deployed on any particular network element GPAN Achievement –Support of OGSI 1.0, GT3 implementation –Extensions to RSL2 for network resource info and allocation –GT3 integration with MDS/Index –Built on Nortel’s extensible network service platform –Can run over hybrid optical + IP networks –Live demo at GW04!