ORCA Overview LEARN Workshop Ilia Baldine, Anirban Mandal Renaissance Computing Institute, UNC-CH

Overview Cloud technologies (IaaS) ORCA overview Putting it all together Demo 2

Open source and supported Runs at 1000s of sites w/ Xen, KVM, etc. Amazon/EC2 compatible (“standard”)

XCat (Extreme Cloud Administration toolkit) Open-Source with support from IBM Highly-scalable (up to 30,000 nodes) Flexible Support for bare metal provisioning and virtualization Non standard highly extensible remote interface 4

Using clouds for network experiments Advantages: –Published remotable interfaces –Multi-use infrastructure Utility computing Cloud applications IaaS Experimentation –Makes easier to convince substrate owners to contribute resources to GENI Key requirement –Ability to embed a topology into one or more cloud sites Possible with XCat Not possible with stock Eucalyptus 5

Eucalyptus Network Extensions NEuca (pronounced nyoo-kah) - extensions to Eucalyptus that permit –Creating and configuring virtual machines with multiple network interfaces attaches to VLANs or physical interfaces on the host node –Perform arbitrary post-boot actions on guest VMs Implemented as a set of patches for Eucalyptus 2.0.[02] and guest-side tools pre-loaded on the image (Linux derivatives supported) Permits using Eucalyptus-manage interface for management, while using high-performance separate backplane for data communications Developed as part of the larger initiative in enabling science applications on clouds –NSF SDCI award # Does not affect the normal functionality of a private Eucalyptus cloud –In GENI context network experiments can coexist with computational work in a private cloud 6

Overview 7

Usage Create an.INI-formatted configuration file Pass to the instance using –user-data-file option File contains –Global definitions –Guest interface configuration –Shell script to be executed post-boot –Other extensions in near future (SSH proxy options) NEuca-py tools installed on the image can help retrieve the information for use by applications Presentation title goes here8

9 [global] slice_id=6D3DE7CC B2-AF48-F D84 ; optional slice identifier [interfaces] ; Interface specification has the form of either ; eth1=vlan:[host ethX]:[vlan tag on ethX]{:guest ip address} or ; eth1=phys:[host ethX]{:guest ip address} ; interfaces must start at eth1 and can be named in any order, however numbering gaps are not allowed ; e.g. if configuration file specified eth1, eth2 and eth4 only eth1 and eth2 will be processed eth1=vlan:eth0:20: /24 ; eth1 attaches to eth0.20 on host and has IP /24 eth2=vlan:eth0:19: /24 ; eth2 attaches to eth0.19 on host and has IP /24 [instanceConfig] ; The script must not have any blank lines ; use tab or spaces in the beginning of the line to indicate the continuation ; of the script script=#!/bin/sh # Test script yum install make

What it is good for 10 Institutional general purpose cloud infrastructure Well-established APIs Overflow capacity from Amazon EC2 Using well-established Amazon EC2 API for network experiments

Network resources BEN – Breakable Experimental Network –Optical metro testbed connecting RENCI, UNC-CH, Duke and NCSU –Equipped with optical switches, DWDM, switches and routers –Several Xcat/Eucalyptus clusters (departmental or RENCI-owned) –Deeply programmable, reconfigurable NLR –Sherpa dynamic VLAN API Internet2 –ION MPLS-based VLAN service ESNet –OSCARS VLAN service 11

BEN BEN: Breakable Experimental Network –Dark fiber interconnecting RENCI, UNC, Duke and NCSU campuses –Unique testbed for developing disruptive distributed technologies –Managed by RENCI for Triangle Universities Multi-layered, high-performance (multiple 10Gbps), dedicated to research –L2 switches, routers –OpenFlow switches Connection to FrameNet –Working on connection to ION PerfSONAR MPs for optical layer properties –GEC10 Controlled by ORCA software –A framework for distributed computational, network substrate orchestration 12

Network Where does ORCA fit? 13 Application Resource Provisioning Middleware Compute Storage ORCA OSCARS Sherpa GENI experiment control tool BEN SA ORCA BEN Multi-layered provisioning ORCA BEN Multi-layered provisioning XCat Eucalyptus Middleware API Substrate APIsGENI AM APIs Walrus

14

The Demo Slice

Operators ORCA Actors Broker (CH) ticket redeem lease Authority/AM delegate Slice Manager (SM) request XML – RPC ORCA Server (Actor) Roles Java Web portal Web portal Web portal Users and tools Substrate owners

ORCA Key facts Lease-based transactions between actors –Traceable, verifiable Inherently distributed, without centralized control –Multiple configurations possible Using Semantic Web tools and mechanisms for resource descriptions Extensible –New resource management policies –New drivers Recently developed Cisco3400 (UofH), OpenFlow –New controllers GENI-compliant controller based on XMLRPC 18

ORCA Tools Actor registry Resource description format converter Client-side XMLRPC tools 19

ORCA near-term feature roadmap Image Proxy (by GEC10) GENI AM API Interoperability (by GEC10) Shibboleth + ABAC (by GEC11) ION support (GEC11) Full protoGENI interoperability (GEC11) Multi-site embedding L3 slice peering Advanced scheduling 20

ORCA Demo Embedding a topology into a cloud at a single site Giving researcher access to instantiated VMs Presentation title goes here21

Embedding Triangle Topology 22 vlan 2 vlan 4 vlan 3 eth1: eth2: eth1: eth2: eth1: eth2: