1. Using and Building Infrastructure Clouds for Science
Kate Keahey, John Bresnahan, David LaBissoniere, Patrick Armstrong, Paul Marshall
Argonne National Laboratory, University of Chicago, University of Colorado, University of Victoria
5/12/2019

2. Request a FutureGrid Account
Follow the instructions on the hand out
Fill out the form and submit
Use the sign up code: SC11 Cloud Tutorial
Once submitted instructions in will follow
5/12/2019

3. Meet the Presenters Dr. Kate Keahey Paul Marshall David LaBissoniere
Patrick Armstrong
John Bresnahan
5/12/2019

4. Introducing Nimbus Nimbus Platform Nimbus Infrastructure
High-quality, extensible, customizable,
open source implementation
Enable users to use IaaS clouds
Nimbus Platform
Context Broker
Cloudinit.d
Elastic Scaling Tools
Enable providers to build IaaS clouds
Nimbus Infrastructure
Workspace Service
Cumulus
Enable developers to extend,
experiment and customize
5/12/2019

5. Tutorial Goals Introduce infrastructure cloud computing
Get attendees to successfully use a real production cloud
Present the current state of the Cloud
Software, providers, tools, APIs, environments, limitations, possibilities
Highlight opportunities, and point out the challenges for science in the cloud
A hands on and working understanding of:
Cloud application tools
Platform as a service (PaaS)
Sky computing and multi-cloud applications
Introductory level knowledge of running your own cloud
Demonstrate what is under the hood
5/12/2019

6. Tutorial Outline Request a FutureGrid account
Introduction to cloud computing and science
Get on the Cloud
Advanced cloud usage
Virtual Clusters
scripting
Lunch
Run your own private cloud
Cloud application management
PaaS
Challenges
5/12/2019

7. Seattle Types of Clouds Infrastructure as a Service (IaaS)
AKA: Infrastructure Clouds
Seattle
Platform as a Service (PaaS)
Software as a Service (SaaS)
5/12/2019

8. Infrastructure Clouds
If only I had a 16 node Linux cluster….
…then I could easily get my research done.
Here is a high interest credit card with revolving debt!
Dedicated student in distress (she only has a laptop)
Captain Cloud!
POOF! A Virtual Cluster
5/12/2019 8

9. IaaSiaN (Infrastructure Clouds in a Nutshell)
Outsource your hardware
Machines become virtual machines
Economies of scale
Cheaper to let Amazon admins run one large machine room
Pay for what you use
Only “own” a lot of machines when you need a lot of machines
Supporting software
Storage, Firewalls, Cluster support, etc.
5/12/2019

10. FutureGrid Test bed for computer science research
Robust simulation environment
HPC, Grid, and Cloud Computing
Security, distributed networks, virtualization, etc
Several different types of IaaS clouds
Nimbus
Eucalyptus
OpenStack (evaluation stages)
Need an example of a CS project experimenting with clouds on FG—pierre?
5/12/2019

11. Nimbus Clouds hotel sierra alamo foxtrot (Chicago) (CA) (Texas)
(Florida)
5/12/2019

12. Nimbus on FutureGrid
Hotel (University of Chicago) -- Xen 41 nodes, 328 cores
Foxtrot (University of Florida) -- Xen 26 nodes, 208 cores
Sierra (SDSC) -- Xen 18 nodes, 144 cores
Alamo (TACC) -- KVM 15 nodes, 120 cores
5/12/2019

13. Using Nimbus Clouds AWS Interfaces Cloud-client
Protocol compliant with EC2 and S3
Many libraries and clients can be used
Cloud-client
Easy to user command line client for Nimbus
Remote access to any nimbus cloud
X509 security
5/12/2019

14. Access Levels Portal Account Project Membership Cloud Accounts
Access to the web portal
Project Membership
All use of resources must be in the context of a project
Cloud Accounts
All the Nimbus cloud accounts are synchronized
Sync up on account
5/12/2019

15. ssh Access
ssh access to hotel.futuregrid.org comes with a FutureGrid Nimbus account
It is only needed to acquire the Nimbus credentials
However, it also provides a well configured environment and tool set.
Nimbus Clouds can be controlled from any place with a IP address
5/12/2019

16. Join The SC11 Project Log into www.futuregrid.org
Go to:
Find project 150: “S11: Using and Building Infrastructure Clouds for Science”
Click “Join”
See handout for more information
5/12/2019

17. Add ssh keys Navigate to the ssh key entry page Add your public key
5/12/2019