EGEE and gLite: an opportunity for industries Federico Rossi Sales and Business Development Vice-President Elsag Datamat spa – a Finmeccanica Company Grid Open Days (Università di Messina) 17-18 June 2008

Contents EGEE in short: EGEE Evolution: EGI EGEE and business The project The infrastructure The Middleware -> gLite Application and User Communities International Cooperation EGEE Evolution: EGI EGEE and business Technology transfer Sample of business applications EGEE Business Forum EGEE Business Associates Conclusions EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE in short

EGEE Flagship Grid infrastructure project co-funded by the European Commission Main Objectives Expand/optimise existing EGEE infrastructure, Operate a large-scale, production quality Grid infrastructure for e-Science Attract new resources and users from sciences as well as business Prepare migration from a project-based model to a sustainable federated infrastructure based on National Grid Initiatives EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 4

EGEE-III EGEE-III Consortium Third phase of the EGEE programme: EGEE: April 2004 – March 2006 EGEE-II: April 2006 – April 2008 Co-funded under European Commission under call INFRA-2007-1.2.3 EC Requested Contribution : 32M€ - represents less than 1/3 of total project costs 9010 person months/375 FTEs 2 year period – 1 May 2008 to 30 April 2010 Consortium Structured on a national basis (National Grid Initiatives/Joint Research Units) 42 beneficiaries (+ 100 JRU members) EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE-III activities and leaders NA1: Management of the project Bob Jones, CERN NA2: Dissemination, Communication and Outreach Catherine Gater, CERN SA1: Grid Operations Maite Barroso Lopez, CERN NA3: User Training and support Robin McConnell, UEDIN SA2: Networking Support Xavier Jeannin, CNRS NA4: User Community Support and Expansion Cal Loomis, CNRS SA3: Integration, testing & certification Oliver Keeble, CERN NA5: International Cooperation & Policy Panos Louridas, GRNET JRA1: Middleware engineering Francesco Giacomini, INFN EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE-III activities share EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE – Results Infrastructure operation Middleware Sites distributed across many countries Large quantity of CPUs and storage Continuous monitoring of Grid services & automated site configuration/management Support multiple Virtual Organisations from diverse research disciplines Middleware Production quality middleware distributed under business friendly open source licence Implements a service-oriented architecture that virtualises resources Adheres to recommendations on web service inter- operability and evolving towards emerging standards User Support - Managed process from first contact through to production usage Training Expertise in Grid-enabling applications Online helpdesk Networking events (User Forum, Conferences etc.) EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE – Infrastructure http://gridportal.hep.ph.ic.ac.uk/rtm/ Archeology Astronomy Astrophysics Civil Protection Comp. Chemistry Earth Sciences Finance Fusion Geophysics High Energy Physics Life Sciences Multimedia Material Sciences … >250 sites 48 countries >68,000 CPUs >20 PetaBytes >10,000 users >150 VOs >150,000 jobs/day EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE - Users and resources distribution EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE - gLite Grid Middleware Services Access CLI API Security Information & Monitoring Authorization Auditing Information & Monitoring Application Monitoring Authentication Data Management Workload Management Metadata Catalog File & Replica Catalog Accounting Job Provenance Package Manager Storage Element Data Movement Site Proxy Computing Element Workload Management Overview paper http://doc.cern.ch//archive/electronic/egee/tr/egee-tr-2006-001.pdf EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE – VO: Disciplines and users All user communities are required to contribute resources to the infrastructure ~8500 users listed in registered VOs Digital libraries, disaster recovery, computational sciences, etc. http://cic.gridops.org/index.php?section=home&page=volist EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

Estimated cost if performed with Amazon’s EC2 and S3: $58,688,679.08 EGEE workload in 2007 Data: 25Pb stored 11Pb transferred CPU: 114 Million hours Estimated cost if performed with Amazon’s EC2 and S3: $58,688,679.08 http://gridview.cern.ch/GRIDVIEW/same_index.php http://calculator.s3.amazonaws.com/calc5.html? 17/05/08 EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

Why users like the EGEE Grid Share more than information Efficient use of resources at many institutes Leverage other sources of funding Data, computing power, applications Join local communities Challenges: share data between thousands of scientists with multiple interests link major and minor computer centres ensure all data accessible anywhere, anytime grow rapidly, yet remain reliable for more than a decade cope with different management policies of different centres ensure data security Continuous, production service EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 14

Collaborating e-Infrastructures EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE Evolution

European e-Infrastructure Evolution National European e-Infrastructure Global Testbeds Utility Service Routine Usage EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

European Grid Initiative Need to prepare permanent, common Grid infrastructure Ensure the long-term sustainability of the European e-Infrastructure independent of short project funding cycles Coordinate the integration and interaction between National Grid Infrastructures (NGIs) Operate the production Grid infrastructure on a European level for a wide range of user communities Must be no gap in the support of the production Grid EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE and business

EGEE and business Technology Transfer and potential commercial exploitation The Business Forum as a means of dialog with business actors Specific attention to SMEs start-ups (innovative applications and portals) collaborative projects (partner grids) Develop a network of companies to prepare the future commercial exploitation of EGEE technology Business Forum; EGEE Business Associates; ISVs; Software integrators and IT Services providers Provide solutions to challenges for Business adoption MoU’s signed with related projects and interested partners to develop identified higher-level services and solutions (e.g. SLA; Windows porting, ...) Further develop EGEE technology to simplify the interaction between grids and commercial cloud services Explain the advantages and limitations of grids & cloud computing to businesses EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

Sample of Business Applications BEinGRID Earth Sciences – seismic imaging & reservoir simulation Earth Observation – atmospheric retrieval parameters Finance and Insurance – Risk Management SMEs OpenPlast project - Develop and deploy Grid platform for plastics industry Imense Ltd - Ported gLite application and GridPP sites Health Health-e-Child – Biomedical information platform for Paediatrics WISDOM – using EGEE infrastructure for drug discovery Energy TOTAL, UK - Ported application using GILDA testbed CERN Openlab Collaboration between CERN and industrial partners to develop data-intensive Grid solutions EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

Expanding Geosciences-On-Demand (EGEODE) services to SMEs Modern seismic data processing and geophysical simulations require greater amounts of computing power, data storage and sophisticated software Difficult for Oil & Gas Small & Medium size Enterprises (SMEs) to exploit innovative algorithms SME Market: small O&G structures 1035 O&G companies in EU 93% are SMEs; 63% < 10 employees Research labs Very small projects of large firms Conventional High Tech. SMEs market CGGVeritas market EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

Geocluster© Geocluster© - Seismic processing platform First industrial application successfully running on the EGEE Grid Production Service Developed by CGGVeritas Leading supplier of geophysical products and services to the worldwide Oil and Gas, Mining and Environmental Industries Enables researchers to process seismic data and to explore the composition of the Earth’s layers Thanks to EGEE, providing the geosciences research community with easy access to comprehensive and commercial seismic processing software is now a reality EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 23

EGEE Business Forum EGEE's Business Forum reaches out to private & public sector organisations that are looking at Grid for their innovation. The Forum interacts with current and new users, highlighting the benefits of Grid through user case studies and evaluating adoption potential across diverse vertical markets. http://business.eu-egee.org/ EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 24

EGEE Business Forum EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 25

EGEE Business Associates Provides opportunities for companies to engage in technical work in collaboration with EGEE, such as: Coordinated technical developments Market surveys Exploitation strategies General transfer of know-how and services to industry 6 EGEE Business Associates (EBAs) Avanade Excelian GridwiseTech Hitachi - Sophia Antipolis Laboratory Nice Platform EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 26

EGEE Business Associates Avanade leverage expertise on .Net technologies to fully support gLite on Windows machines Excelian Shape EGEE infrastructure by bringing the problems facing businesses today to EGEE Make EGEE technologies more relevant to current business needs GridwiseTech Developing Grid tutorials to Industrial Mgt. Outreach to Business EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 27

EGEE Business Associates Hitachi – Sophia Antipolis Laboratory Integrating their data Grid solution with the EGEE framework NICE Developing EGEE compatible GENIUS Grid portal and EnginFrame Framework Platform Computing Making gLite middleware better in exploiting the LSF local resources management system EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 28

Summary www.eu-egee.org EGEE operates the world’s largest multi-disciplinary Grid infrastructure for scientific research In constant and significant production use, constantly growing in scale of resources and breadth of user communities supported A third phase of EGEE has now started EGEE-III 2008-2010 Need to prepare the long-term EGEE, collaborating projects, National Grid Initiatives and user communities are working to define a model for a sustainable Grid infrastructure that is independent of short project cycles Business applications are now on the spotlight then… … we invite industries to get to us, tell us their needs and try our solutions! www.eu-egee.org EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008

EGEE’08 Conference 3rd Dedicated Business Track Business Task Force and Business Forum - Programme Committee Presented results of last 12 months EBAs and Business Applications Sessions on specific topics (licensing, clouds, modelling, virtualisation…) EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 30

Thank you! Thank you! Federico Rossi federico.rossi@elsagdatamat.com Grid Open Days (Università di Messina, Italy) 17-18 June 2008 EGEE and gLite: an opportunity for industries -Grid Open Days -17-18 June 2008 31