Cloud Challenges C. Loomis (CNRS/LAL) EGI-TF (Amsterdam)

Slides:



Advertisements
Similar presentations
1/17/20141 Leveraging Cloudbursting To Drive Down IT Costs Eric Burgener Senior Vice President, Product Marketing March 9, 2010.
Advertisements

StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Management Overview StratusLab.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Enhancing grid.
An Approach to Secure Cloud Computing Architectures By Y. Serge Joseph FAU security Group February 24th, 2011.
Marketplace and Appliance Management Charles (Cal) Loomis & Mohammed Airaj LAL, Univ. Paris-Sud, CNRS/IN2P October 2013.
5205 – IT Service Delivery and Support
VAP What is a Virtual Application ? A virtual application is an application that has been optimized to run on virtual infrastructure. The application software.
1/8 Enhancing Grid Infrastructures with Virtualization and Cloud Technologies Ignacio M. Llorente Business Workshop EGEE’09 September 21st, 2009 Distributed.
StratusLab: Darn Simple Cloud Charles (Cal) Loomis & Mohammed Airaj LAL, Univ. Paris-Sud, CNRS/IN2P October 2013.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Cloud Computing and Challenges.
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
StratusLab Cloud Distribution Installation Charles Loomis (CNRS/LAL) 3 July 2014.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks C. Loomis (CNRS/LAL) M.-E. Bégin (SixSq.
Large Scale Sky Computing Applications with Nimbus Pierre Riteau Université de Rennes 1, IRISA INRIA Rennes – Bretagne Atlantique Rennes, France
StratusLab Roadmap StratusLab Tutorial (Orsay, France) 28 November 2012.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Virtual Machine Isolation.
Advanced Topics StratusLab Tutorial (Orsay, France) 28 November 2012.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks C. Loomis (CNRS/LAL) M.-E. Bégin (SixSq.
Virtual Workspaces Kate Keahey Argonne National Laboratory.
Trusted Virtual Machine Images a step towards Cloud Computing for HEP? Tony Cass on behalf of the HEPiX Virtualisation Working Group October 19 th 2010.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab Collaborations.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INSFO-RI Integrating Cloud Monitoring.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INSFO-RI Operating grid services on.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Enhancing Grid.
PLATFORM TO EASE THE DEPLOYMENT AND IMPROVE THE AVAILABILITY OF TRENCADIS INFRASTRUCTURE IberGrid 2013 Miguel Caballer GRyCAP – I3M - UPV.
StratusLab: Darn Simple Cloud Charles (Cal) Loomis & Mohammed Airaj LAL, Univ. Paris-Sud, CNRS/IN2P3 29 August 2013.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Demonstration StratusLab First.
WP5 – Infrastructure Operations Test and Production Infrastructures StratusLab kick-off meeting June 2010, Orsay, France GRNET.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Technical Overview StratusLab.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Enhancing Grid.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 2 Interactions.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Cloud Computing and Challenges.
Amazon Web Services. Amazon Web Services (AWS) - robust, scalable and affordable infrastructure for cloud computing. This session is about:
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Work Package 5 Infrastructure.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Exploitation and Sustainability.
The StratusLab Distribution and Its Evolution 4ème Journée Cloud (Bordeaux, France) 30 November 2012.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab: Overview & Collaboration.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab Sustainability.
Virtual Machines on BiG Grid INFN Annual Meeting May 2010 Sander Klous, Nikhef.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI Features, Use Cases, and Sustainability.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI DCI Collaborations Steven Newhouse 15/09/2010 DCI Vision1.
Unit 3 Virtualization.
Introduction to Cloud Technology
DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING
C Loomis (CNRS/LAL) and V. Floros (GRNET)
IT Services Katarzyna Dziedziniewicz-Wojcik IT-DB.
StratusLab First Periodic Review
StratusLab Roadmap C. Loomis (CNRS/LAL) EGI TCB (Amsterdam)
WP3 - Dissemination.
StratusLab Tutorial (Bordeaux, France)
Real-time protection for web sites and web apps against ATTACKS
IGE Globus Appliances Dr. Ioan Lucian Muntean, Dr. Adrian Colesa
Real World Use of Agile Software Development Methods
Work Package 4 Software Integration and Distribution
Exploitation and Sustainability
StratusLab Final Periodic Review
StratusLab Final Periodic Review
StratusLab Tutorial (Bordeaux, France)
StratusLab Project Status
Work Package 2 Interactions with Targeted Communities
StratusLab Sustainability
Introduction to Cloud Computing
Management of Virtual Execution Environments 3 June 2008
20409A 7: Installing and Configuring System Center 2012 R2 Virtual Machine Manager Module 7 Installing and Configuring System Center 2012 R2 Virtual.
Data Security for Microsoft Azure
Technical Capabilities
Windows Azure Hybrid Architectures and Patterns
Day 2, Session 2 Connecting System Center to the Public Cloud
NFV and SD-WAN Multi vendor deployment
06 | SQL Server and the Cloud
Presentation transcript:

Cloud Challenges C. Loomis (CNRS/LAL) EGI-TF (Amsterdam) 16 September 2010

Contents StratusLab Project Early Results Challenges Conclusions Project Facts Vision and Benefits Early Results Cloud Infrastructures and Grid Services User and Administrator Surveys Challenges Meeting Expectations Sharing Trust Conclusions

Contents Facts Goal Contacts 1 June 2010—31 May 2012 (2 yrs.) Partners: 6 from 5 countries Budget: 3.3 M€ (2.3 M€ EC) Goal Provide coherent, open-source private cloud distribution Contacts Website: http://stratuslab.eu/ Twitter: @StratusLab CNRS (FR) UCM (ES) GRNET (GR) SIXSQ (CH) TID (ES) TCD (IE)

Grid Services Over Cloud Resources users Grid Resource Center Grid Services Cloud API StratusLab Distribution Private Cloud Public Clouds

Benefits Ease of Deployment Increased Reliability/Robustness Prepared virtual machine images for grid services Decouple OS on physical systems from grid requirements Increased Reliability/Robustness Migration for load balancing or for avoid hardware failures Better isolate user jobs/machines from others Customized Environments Responsibility of environments rests with VOs Flexible environments appeals to more diverse scientific community

Early Results Appliance Repository at TCD Complete Grid Sites at GRNET Based on standard Apache web server Contains stock images for supported operating systems Will contain grid service images (“appliances”) Complete Grid Sites at GRNET Two StratusLab clouds deployed: Ubuntu 10.04 and CentOS 5.5 Functional (pre-production) grid site on each cloud Worker Node Tests at LAL Worker nodes deployed via Quattor in StratusLab cloud Run in production for >1 month without problems

User and Administrator Surveys Surveys for Users and Administrators Collect use cases and requirements from target communities 248 and 608 unique views, 22 and 56 completed Analysis: D2.1 (http://stratuslab.eu/doku.php?id=deliverables) User Feedback 33% of users are regular cloud users Most respondents from CS/eng., bioinformatics, and physics Most planned for “real” use within 2 years Administrator Feedback 68% of administrators will deploy virtualization/cloud technologies Half have already deployed; remainder within 1 year Reluctance for administrators to trust user-generated VMs

Meeting Expectations Bare Metal Performance Virtualization tax near zero from technological improvements IO still issue, but also on physical resources as well! Instantaneous (~10s) Availability of Machines Fast copies, caching of machine images Client site preparation of contextualization image, … Optimization of OS boot sequence Fully Elastic Clouds Users expect infinite resources, machine room reality is different! How to prevent users from seeing a queue? Allow resource searching/matchmaking like the grid? Site-level, automated bartering through hybrid clouds?

Sharing Resources Possible to bring grid’s collaborative spirit into the fundamentally “selfish” cloud paradigm? Authentication/Authorization Mechanisms Reuse worldwide trust network and its technologies Machine Images and Appliances Great way to share algorithms, software, packaged data, … Issues of transport, caching, and access control Data Management Like grid, issues of access, persistency, versioning, … Additional issue of service state, logging, accounting, …

Building (More) Trust Reluctance to Run User-Defined Images Realizing full potential of cloud infrastructures will require building more trust between users, VOs, and system administrators Trust will vary with actors involved  sliding scale that balances level of trust with allowed capabilities Requirements Define security requirements for images (HEPiX) Matchmaking: appliance metadata vs. site requirements Enhanced monitoring (e.g. ports and connections) Additional trust between firewall “controllers” and site administrators

Conclusions Combining Grid and Cloud Technologies Easier deployment, maintenance of sites for administrators More flexible, capable, and dynamic infrastructure for users StratusLab Early Results Feedback from both users and administrators Complete functioning grid sites over clouds Deployment of application repository Challenges for Cloud Community Meeting expectations of users and administrators Sharing easily the diversity of resources in communities Building more trust between actors