Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant Agreement n Cloud Infrastructure Riccardo BRUNO, INFN Catania - Italy CHAIN-REDS School for Application Porting, June 2014, Catania - Italy

Outline 2  Introduction to the Cloud  Traditional computing  Cloud computing  Cloud on the CSGF  Summary and Conclusions

What is a Cloud 3  Any virtual service accessible via the network  store/compute/access  Users don’t have any hardware perception  Probably you are already using Clouds

Traditional Computing 4  Mainframes  One big server  Many little terminals  WorkGroups (P2Ps)  Different desktops interconnected  No centralized services: storage/computing/…  Client/Server  One or more servers hosting computing/data resources  Client computers exploiting server’ resources

Traditional Computing efforts 5  Software installation/patches/updates  Maintain/Purchase multiple software licenses  Maintain/Purchase hardware  Availability/Elasticity  Skilled man power for H24 support and maintenance  Electricity power consumption  Full control of the system  Costs  Eletricity power efficiency  Costly scalability

Traditional Computing working environment 6  Access  Office’ LAN  Dial Up  VPN (internet)  telnet/ftp  ssh/sftp  Other protocols …  File/Data transfer  USB sticks/CD/DVD/Floppies   Chat/Messaging  Office’ web site

Cloud Computing 7  Client/Server like architecture  One or more big servers  Many different ‘terminals’ connected  Difference?  Full networked Client/Server interaction (LAN/WAN/Internet)  Clients may exploit resources coming from different servers  Many different servers may provide a single ‘virtual service’ (Virtualization)  Terminology  ‘Cloud’ Marketing word which emphasizes internet/network  Software, Platforms and Infrastructures sold as Service

Cloud Computing Service classification 8 Vendor Client Traditional Computing Traditional Computing Cloud

Cloud Computing Service classification hierarchy 9  Not really a precise classification!

Cloud Pros/Cons 10  Cost efficiency  Pay per use: Only pay what you exactly use (CPU time, Storage, …)  Underlying HW virtualization offers a better energy use  Accessibility  Access services from anywhere and any device  Maintenance  No care of software maintenance and updates  Scalability  Easily grow or downsize accordingly to the business  Contracts (Unexpected high bills/lost of data/service)  QoS (Choose vendors with high standards of reliability)  Limited by the network connectivity (availability/bandwidth)  Privacy/Security (business hosted ‘somewhere’)  Legal Issues (Which country host your data/services?)

Who can use Clouds 11  Medium-Small research institutions/companies/individuals  No HW/SW maintenance costs  Short lived usage of services (Amount of cores, Data, …)  Access to expensive equipment (Servers,Sensors, Devices)  Typical cloud usage  Offsite backup (Dropbox)  hosting (Gmail)  Online sharing and collabotation (Google docs)  SaaS (pay as you go)  Flickr, SlideShare,

Inside the Clouds 12  OS virtualization (Less used)  Chroot  LXC (Linux containers), …  Hardware virtualization software  Hypervisors: VMWare, Xen, KVM, …  Virtual Machines  Virtual computers having virtual devices:  CPUs, RAM, Storage, Network, …  Easily managed  Clones  Changeable virtual resources  Cloud software

Cloud on CSGF IaaS/PaaS 13

CSGF Examples ‘agLRtool’ 14  The service operates as PaaS, since the VM template can be customized to work for other institutions  Another VM ‘template available: ‘Agrid-Drupal’  Restrictable to allowed users only

Cloud on CSGF SaaS 15 Application Survey Reject CSGF Maintainer VM App is available The user CSGF Developer agINFRA’ SG Portlet

CSGF Example WRF 16  The Weather Research and Forecasting (WRF) is a widely used weather prediction system designed to serve both atmospheric research and operational forecasting needs  2 implementations  Grid  Cloud  Both selectable from the portlet  Grid VM instantiated by the Cloud Engine This is just a PoC with static inputs. Under design a more generic GUI This is just a PoC with static inputs. Under design a more generic GUI

CSGF MyCloud interface 17 Available VMs Multi/Single instance Available VMs Multi/Single instance Instantiate/Drop VMs VMs are Moveable across Clouds Only for SG’ ‘Cloud Managers’ (Cloud tenants)

 MyCloud communicates with a system named CLEVER (UniME)  CLEVER is a Cloud middleware which simplifies the management of different and interconnected clouds  CLEVER exploits the xmpp and OCCI standard protocols to manage virtual resources (VMs,Storage,…)  OCCI (Open Cloud Computing Interface) OGF driven specifications to manage Cloud resources via API (REST) CSGF MyCloud Drag operation instantiate VMs

Inside MyCloud 1/4 Turn On/Off the VM VM Status (On/Off) VMs Single Instance Multiple Instances VMs Single Instance Multiple Instances Sinlge Instance VMs will disappear once deployed

Inside MyCloud 2/4 Press to interact with …

Inside MyCloud 3/4 Press to interact with …

Inside MyCloud 4/4

Summary and Conclusions 23  Resource virtualization (flexibility, scalability, elasticity)  Accessible from everywhere  Accessible from any device  Many OpenSource solutions available  Many Free/Pay per use services already available  Most of the Cloud success due to the Marketing:  Easiness to build business models  Many different service types (IaaS,PaaS,SaaS, NaaS,…, XaaS,)  CSGF simplifies the access to the Cloud resources  Run jobs on configured VM Templates (SaaS)  MyCloud helps to instantiate/manage VMs  Provide to Tenants a VM (IaaS)  Provide to Tenants a ‘templated VM’ (PaaS)

Co-ordination & Harmonisation of Advanced e-Infrastructures for Research and Education Data Sharing Grant Agreement n