1. Eucalyptus: A Middleware for the NEP Bruce Spencer, Sandy Liu, Yong Liang National Research Council June 26, 2007

2. 2 The community I am talking to Scientists (natural, technical, social) who see an opportunity to accelerate their research by reaching out to a larger community –Researchers with similar interests, problems, approaches –To reach their subjects, data sources Sharing their computing environment and resources –Multiplatform, multisite, access reusable components Synchronous and Asynchronous –Access to people and resources for participatory sessions –Access to computing and storage devices

3. 3 CyberInfrastructure While hardware performance has been growing exponentially – with gate density doubling every 18 months, storage capacity every 12 months, and network capability every 9 months – it has become clear that increasingly capable hardware is not the only requirement for computation-enabled [scientific] discovery. –Cyberinfrastructure Vision for 21st Century Discovery Networks of resources –High performance computers, communication systems Data sources –Data collection methods, sensor networks Data analysis methods –Data mining Service-based computing –Stateless/stateful, standards Virtual organizations –Having impact on society –Social networking

4. 4 More from Cyberinfrastructure Vision for 21 st Century Discovery In facilitating the creation and support of effective virtual organizations, NSF will focus on three essential elements: the creation of a common technological framework that promotes seamless, secure integration across a wide range of shared, geographically-distributed resources; the establishment of an operational framework built on productive and accountable partnerships developed among system architects, developers, providers, operators, and end users who span multiple communities;…

5. 5 More of NSF’s vision Together, Web Services and service-oriented architectures are emerging as a standard framework for interoperability among various software applications on different platforms. They provide important characteristics such as standardized and well-defined interfaces and protocols, ease of development, and reuse of services and components, making them potential central facets of the cyberinfrastructure software ecosystem.

6. 6 More of NSF’s vision NSF will also support projects that study how ongoing and future cyberinfrastructure efforts might be informed by lessons learned and by the identification of promising practices. Among other things, NSF seeks to build a stronger foundation in our understanding of how individuals, teams and communities most effectively interact with cyberinfrastructure;

7. 7 Service Oriented Architectures Model of distributed, shared computing –Evolution: Objects/Messages, Client/Server –Simplified model: Stateless services that complete some function –Platform and language independent, sharable components XML Standards –WSDL: Description, SOAP: Packaging –WS Triangle –Development environments: Eclipse WSToolKit –Repositories XMethods Workflows –BPEL: Ties services together –Relevant for business models Semantics of Services –OWL-S, WSMO: descriptions in logic of purpose and interface Broker ProviderClient 1:Publish 4:Invoke 5:Respond 2:Search 3:Bind

8. 8 Semantic Service Computing Priority Project

9. 9 What is Eucalyptus? Eucalyptus: UCLP PDS –User Controlled Light Path-enabled Participatory Design Studio –Canarie: funding, Carleton: lead, visions applications, facilities, NRC: middleware, CRC: lightpaths, hosting –Associated partners: Pleora, IBM, Autodesk (Alias): applications –For the architecture and industrial design community Eucalyptus manages participatory sessions –Users, resources brought together at once Resources are single-session (e.g. videoconference) or multi-session (e.g. computing resources) Users in multiple location –In the clip we show two locations: Ottawa then Montreal Sharing Maya application over a lightpath Pleora Videoconferencing OpenSceneGraph, UltraGrid HD over lightpath –XML messages used for configuration only, not for high bandwidth signals

10. 10 Eucalyptus in action

11. 11 Eucalyptus Layers Client Client PDSC Resource JNLP Application Eucalyptus Website Client JNLP Application SessionManager User Manager Resource Manager Framework PDSF Management Services WS (Tomcat) Client JNLP Application

12. 12 Management Web Services ResourceMgmtWebService User Mgmt WebService Session Management Web Service

13. 13

14. 14 Eucalyptus Client A Java Desktop Application Integrated Web Services Clients A dashboard that controls and configures sessions Implemented as a floating dock Use Java Web Start to simplify deployment and maintenance

15. 15 Management Web Services Manages the resources and users Users interact with the system by engaging in sessions Selecting people s/he wants to interact with and the resource that supports the interaction (e.g. High-Def VideoConference) Status of sessions, resources, and users can be acquired through these management services

16. 16 Resource Hosts Web Services platform (HTTP + Servlet Container + SOAP engine) installed All Resources (e.g. videoconference) are wrapped as Web Services Hides configuration complexity for each resource

17. 17 APN - Articulated Private Network This Web Service allows a Eucalyptus admin user to configure an APN using UCLPv2. Eucalyptus users can then use this configured APN as a resource for connectivity.

18. 18 Eucalyptus Resources used by Architect / Industrial Design Community: CIMS Pleora videoconferencing –Pleora’s devices for converting digital media signal into IP –Standard Definition: 270 Mbps uncompressed –Signal can be easily accommodated by 1Gbps CANET4 Ultragrid HD Videoconference –A Sweet Spot: $8K and a lightpath gives you point to point HD Isabel multi-site videoconferencing Autodesk Maya –Qube: rendering from Maya OpenSceneGraph for visualization DCV: graphics acceleration from IBM –RVN for two-way graphics application sharing –SVN for display over multiple monitors UCLPv2 Lightpath configuration CD++ Simulation system Jabber Chat

19. 19 How might you use Eucalyptus? Set up a session with a number of people accessing a number of resources for a certain period of time –Schedule a session with colleagues every Monday morning at 9:00 using Maya and lightpaths for an hour Files –File transfer over lightpaths (can be tricky) Desktop applications (standalone) –Use tool to share desktop with colleagues: VNC Both can move mouse, keyboard, etc. –E.g Suppose an application licence costs $100,000 per desktop, you can share it across your network, saving you cost of more licences Networked applications (that already run in multiple locations) –Set up lightpath between locations –Bring them into the session

20. 20 Adding your own resource You have a custom application –allows you to visualize a virtual phenomenon (weather maps in real time, connected to many observation points) –You want to incorporate it to Eucalyptus to show your colleague You build a hosted Web Service that invokes your application You provide the WSDL URL –our software builds the stubs in Java –compiles them and deploys to our management service. We generate a generic client interface –Similar to xMethods –Probably want to customize for end-user client Now any Eucalyptus user can use your resource

21. 21 Eucalyptus Workflow

22. 22 Workflow for High Definition Tool

23. 23 2-step Conference First step Two sub groups Second step One big group If a resources is not available (fault) We invoke backup

24. 24 Open Eucalyptus Networks: P2P We plan to allow different management servers to share information about their resources –Descriptions of resources –Configuation parameters –Permissions –Availability (for single session resources) Load (for multi-session resource) P2P Network

25. 25 Working with the NRC team We are looking for NEP partners –Want to incorporate Eucalyptus –Interested in doing own development, customization with our support –We provide software for basic management services We plan to licence the software as OpenSource across the set of our NEP partners –No sublicencing –After the technology is more mature, and then will open source in the usual sense with sublicences, modifibility. –By then there will be a healthy Eucalyptus community

26. 26 Eucalyptus Facts Eucalyptus provisions resources to users in sessions –Client code is in Java, delivered by Java WebStart –Resources deployed, configured through Web Services Sessions can be scheduled –To start immediately –to start/stop at specific times New resources are easy to add –New resource deployed by a Web Service easily integrated –Services can be hosted on any platform Two sets of clients –End-user for start/stop resources –Admin user for configure resources Eucalyptus is simple, lightweight, adaptable

27. 27

28. 28

29. 29

30. 30

31. 31 Layer 1/2 and Layer3 Lightpaths require a computer with access to layer 1 –Direct connections through optical switches Access to Web Services usually requires access to layer 3 –Routed network, the usual internet We have one computer that can access two networks

32. 32

33. 33 Driver for User Controlled Networks More and more organizations are acquiring their own fiber networks Acquiring fiber in the long haul is very expensive to light and obtain –Alternative is to use “dim fiber” – point to point wavelengths –But want flexibility to do configuration and change management as with dark fiber e-Science needs dedicated networks for specific applications and disciplines for high data volume grids –Want to be able to manipulate the network in the same way they can manipulate the application SOA and networks − Can provide the same user control over networks as with applications

34. 34 What is UCLP? Stands for User-Controlled Lightpath Provisioning A configuration and provisioning tool: http://www.uclp.ca/http://www.uclp.ca/ Treats network resources as software objects Uses Service Oriented Architecture (SOA) and so network can be integrated with other Web Service applications Extends the network into the application Creates discipline or application-specific IP network Supports for high-end e-science and grid applications

35. 35 What is an APN – VPN enabled by UCLP Articulated Private Network is the Next generation VPN –normal VPNs but able to have any topology Network operators can make part of their resources available to end users The end users can then assemble these various Web Services into multiple network virtualizations, i.e. APNs, running their own protocols and services. Extending the Application into the Network: –users can make use of the network resources whenever they are required, effectively bringing the network into the application itself. –Not only can the end users control and manage their own private high speed networks, but so can their sensors, instruments and applications.

36. 36 CANARIE provides APN to NRC New York Chicago Seattle Vancouver Edmonton Calgary Regina Saskatoon Winnipeg Toronto Ottawa Montreal Fredericton Halifax CA*net 4 router 2G Lightpath WS GbE interface WS Source: Bill St Arnaud

37. 37 NRC partitions APN New York Chicago Seattle Edmonton Calgary Regina Saskatoon Winnipeg Toronto Ottawa Montreal Fredericton Halifax Source: Bill St Arnaud

38. 38 NRC logical view of APN New York Chicago Seattle Victoria Vancouver Edmonton Regina Saskatoon Winnipeg Toronto Ottawa Montreal Fredericton Halifax Source: Bill St Arnaud

39. 39 Tomorrow’s peer to peer IP network World University Region al Server World National DWDM Network NREN A NREN B NREN C NREN D Child Lightpaths Child Lightpaths Source: Bill St Arnaud