ECEE  Enabling Clouds for eScience The open collaboration spot for cloud projects in Europe www. Scientific-cloud.org Åke Edlund, PhD KTH-SICS Cloud Innovation Center Vilnius

Åke Edlund  Coordinator KTH-SICS Cloud Innovation Center (C!C)[1]  Managing Partner SICS Seed Accelerator[2]  Leading VENUS-C Scientific and International Cooperation[3]  Coordinating ECEE (see this presentation)[4]  December 2010: completed the NEON project (Northern Europe Cloud Computing) [1] [2] [3] [4]

Why “ECEE”?  Many initiatives with similar goals  Accelerate the learning process  Share the load  Cross border and cross project services www. Scientific-cloud.org Vilnius

Who’s “in”? So far. VENUS-CItaly, Germany, UK, Spain, Sweden, Greece, Israel StratusLabFrance, Greece, Switzerland, Spain, Ireland NGSUnited Kingdom GRNET cloudGreece SARA cloudThe Netherlands UCMSpain – as part of the OpenNebula Project SEECCISlovenia, Croatia, Serbia, Bosnia and Herzegovina, Montenegro, Kosova, FYRo Macedonia, Albania, Romania, Bulgaria CESGASpain – as part of the Open Cirrus project NEONSweden, Norway, Denmark, Finland, Iceland BalticCloudEstonia, Latvia, Lithuania, Belarus, Poland Participated in workshops: VISION project Vilnius

Collaboration cross European projects  Initiated in September 2009 – at EGEE’09  Meet twice a year  1 st workshop – OGF28, Munich, March 2010  2 nd workshop – EGI TF, Amsterdam, Sept 2010  3 rd workshop – EGI UF, Vilnius, April 2011 www. Scientific-cloud.org Vilnius

Workshops – example  1 hr Industry presentations  2 hr Detailed findings - project-by-project, sharing specific findings, and respective roadmap  1 hrDiscussion, pointing at common challenges and how to share the load, to update common high-level roadmap www. Scientific-cloud.org Vilnius

Sharing experiences – examples  Sharing experiences from using different cloud solutions – private and public  Security issues, issues with network topologies  Sharing experiences from management of private and hybrid clouds  Sharing user experiences  Users - hard to find good representatives that have the time to participate  Open source vs closed source - pros and cons  Pricing - how to compete, how to estimate, what are the risks www. Scientific-cloud.org Vilnius

Looking at common challenges - examples  Investigate how to build a cloud storage infrastructure that supports the use of clouds for scientific applications.  Investigate if a machine provisioning interface like that of Amazon's EC2 coupled with a library of scientific appliances is of value to European academic research communities. www. Scientific-cloud.org Vilnius

Looking at common challenges  Identify the economic value of cloud computing  Understand the economic implications of moving parts of HPC onto cloud infrastructures. -Estimate the fraction of current HPC compute jobs that could realistically be executed on clouds -Estimate the cost of building and operating a cloud facility of the same capacity as the above percentage of the total current resources -Estimate possible cost reductions achievable by scaling out peak loads to commercial clouds -Compare cost of a private cloud facility with a commercial cloud -Estimate savings in scenarios with -Commercial clouds when aiming at direct peering (data transfer cost) -Allocating their spare capacity at a reduced price www. Scientific-cloud.org Vilnius

Big variety among ECEE projects: NEON www. Scientific-cloud.org

Supporting Multiple Basic Research Disciplines Biomedicine (3): Integrating widely used tools for Bioinformatics, System Biology and Drug Discovery into the VENUS-C infrastructure. Civil Protection & Emergencies (1): Early fire risk detection, through an application that will run models on the VENUS-C infrastructure, based on multiple data sources. Civil Engineering (2): Support complex computing tasks on Building Information Management for green constructions and dynamic building structure analysis. Data for Science (1): Integrating computing through VENUS-C on data repositories. In particular focus will be on Marine Biodiversity through Aquamaps. 7even User Scenarios Extending eScience Applications through Open Call: €20,000 funding each, in addition to Azure Compute, Storage and Network Resources porting applications to the cloud - education and training - scalability tests Extending eScience Applications through Open Call: €20,000 funding each, in addition to Azure Compute, Storage and Network Resources porting applications to the cloud - education and training - scalability tests Big variety among ECEE projects: VENUS-C

HPC Cloud HPC System –Fast & Large RAM, CPU, Storage, Network IAAS, PAAS, SAAS Graphic User Interface –Standards: OCCI, CDMI Portal for user collaboration –Documentation, Fora & Wiki –User Projects –Ticket system –VM repository Usergroups –Life Sciences & Humanities (Ecology, Geography, Bioinformatics, psychology, Linguistics) –Sciences (Physics, CS, Chemistry) –More every day…

HPC Cloud Open Cloud Standards for System Interoperability Laptop Workstation HPC Systems – Sara – Neon – “Blue” – … Open Standards – OCCI (OGF) – CDMI (SNIA) – … Open Standards provide interoperability between all available systems to ensure maximal freedom of choice

Big variety among ECEE projects: StratusLab Provides complete, open-source IaaS cloud distribution. Focus on grid resource centers: Allow collaborative science with dynamic cloud resources Use of grid authn/authz mechanisms Demonstrate: Certified grid site over a StratusLab cloud InfrastructuresCertified EGI grid site running at GRNET. Reference cloud infrastructure for user feedback. Support at for help and Release (v0.3)Logging and security enhancements. Prototype Marketplace for shared images. Use of VOMS proxies. Inclusion of OpenNebula

Big variety among ECEE projects… www. Scientific-cloud.org Public Private IaaS SaaS ?

SUMMARY - ECEE  An open collaboration between cloud projects  All contributing projects are welcome to join.  Meet twice a year (as ECEE) to share experiences and roadmaps – initiated September 2009  ECEE is a complement to the project-to-project collaborations – bringing in many – often very different - projects to the same meeting  ECEE is in contact with the SIENA Roadmap Advisory Board to act as ‘interoperability-now’ feedback group to the SIENA Roadmap work. www. Scientific-cloud.org Vilnius

www. Scientific-cloud.org Vilnius FutureGrid: An Experimental Computing Grid and Cloud Test-Bed Karolina Sarnowska-Upton, University of Virgina BiG Grid HPC Cloud Floris Sluiter, SARA Venus-C Architecture Hakan Soncu, Venus-C/EMIC StratusLab - Current Status and Plans Cal Loomis, StratusLab/IN2P3 ECEE Agenda (after lunch)

Thank you! Åke Edlund www. Scientific-cloud.org Vilnius