1.  Prospective Nationale sur les Grilles de Production, Paris, 06.10.08 L'état d'avancement des grilles en Allemagne Klaus-Peter Mickel Karlsruhe Institute of Technology mickel@kit.edu D-Grid – The German Grid Initiative

2.  K.-P. Mickel: Grilles en Allemagne 2 My Academic Environment University of Karlsruhe + Research Centre Karlsruhe Karlsruhe Institute of Technology – KIT Computer Centre of + Computer Centre of University of Karlsruhe Research Centre Karlsruhe Steinbuch Centre for Computing – SCC SCC is a leading German IT and Grid institution (GridKa, D-Grid, EGEE, and others)

3.  K.-P. Mickel: Grilles en Allemagne 3 Outline The roots of D-Grid 1 st stage of D-Grid – Basics 2 nd stage of D-Grid – Improvements 3 rd stage of D-Grid – Looking for Sustainability Organization Summary and Outlook

4.  K.-P. Mickel: Grilles en Allemagne 4 Outline The roots of D-Grid 1 st stage of D-Grid – Basics 2 nd stage of D-Grid – Improvements 3 rd stage of D-Grid – Looking for Sustainability Organization Summary and Outlook

5.  K.-P. Mickel: Grilles en Allemagne 5 The CERN Project "LHC" (Large Hadron Collider)

6.  K.-P. Mickel: Grilles en Allemagne 6 Aber LHC Computing Grid – LCG

7.  K.-P. Mickel: Grilles en Allemagne 7 Outline The roots of D-Grid 1 st stage of D-Grid – Basics 2 nd stage of D-Grid – Improvements 3 rd stage of D-Grid – Looking for Sustainability Organization Summary and Outlook

8.  K.-P. Mickel: Grilles en Allemagne 8 National Grid Initiatives in Europe Since ~ 2000 large Grid funding activities in some countries (USA, Japan) After that also Grid funding in Europe: –Austrian Grid Initiative –DutchGrid –France: e-Toile; ACI Grid –Germany: D-Grid; Unicore –Greece: HellasGrid –Grid Ireland –Italy: INFNGrid; GRID.IT –NorduGrid –UK e-Science: National Grid Service; OMII; GridPP

9.  K.-P. Mickel: Grilles en Allemagne 9 D-Grid – 2001 to 2004 Some Grid activities in Germany: – 2001: In the Research Centre Karlsruhe begins the planning and setting up GridKa as Tier-1- Centre for the global Grid infrastructure for High Energy Physics www.gridka.de – 2002: The German Ministry for Education and Research is publishing a programme "IT-2006", for improving information technology in Germany www.it2006.de – 2003: The German Grid Initiative is invented and founded (from Research Centre Karlsruhe). After a few weeks lot of institutions became partners of D-Grid www.d-grid.de – 2004: The Ministry is publishing the first call for proposals for Grid projects in Germany – based on D-Grid

10.  K.-P. Mickel: Grilles en Allemagne 10 Ziele der ersten D-Grid- Ausschreibung Goal: Building and establishing a flexible, national Grid infrastructure as a technical basis for the realization of an environment for scientific work Main goals: –Development of e-science services for scientific communities –Possibility of a commercial use of these grid services later on –Robustness and flexibility of this grid infrastructure –In the beginning the grid infrastructure has to be built for the scientific communities and for their needs –  The needs and wishes of the scientific communities are law –The grid infrastructure must be able to improve the scientific capabilities of the communities D-Grid – First call for proposals (2004)

11.  K.-P. Mickel: Grilles en Allemagne 11 Results of the first call for proposals (2005) One large "Integration Project" (DGI = D-Grid Integration Project), consisting of 4 partial projects –Goal: To establish a distributed and largely usable grid infrastructure in Germany ("Core D-Grid") Seven Community Projects: –High Energy Physics, Astro Physics, Medicine, Climatology, Engineering, Humanities, Energy Research About 100 partners, funding from Sept. 2005 to August 2008 Community projects Integration project Grid Resources, Grid Middleware, Grid Services Projekt- spezifische Entwicklun- gen HEP-Grid … Community Grid Middleware Projekt- spezifische Entwicklun- gen AstroGrid-D Community Grid Middleware Projekt- spezifische Entwicklun- gen Projekt- spezifische Entwicklun- gen Projekt- spezifische Entwicklun- gen Projekt- spezifische Entwicklun- gen Community Grid Middleware Community Grid Middleware Community Grid Middleware MediGRIDC3-GridInGridTextGrid Community Grid Middleware Projekt- spezifische Entwicklun- gen Community Grid Middleware WISENT

12.  K.-P. Mickel: Grilles en Allemagne 12 DGI's duty: to establish a grid environment (1) March 2007: 2.200 CPUs, 800 TB Disk, 1.400 TB Tape (22 locations, linked via German research network)

13.  K.-P. Mickel: Grilles en Allemagne 13 DGI's duty: to establish a grid environment (2) VO and User services Resource Mgmt. Backup Support Firewall AAI/VO Early security warnings Sustainability Accounting Meta data Data Mgmt. Monitoring Legal aspects Training

14.  K.-P. Mickel: Grilles en Allemagne 14 DGI and Community Projects AstroGridHEP-Grid In-Grid MediGridWISENT KlimaGridTextGrid

15.  K.-P. Mickel: Grilles en Allemagne 15 DGI and Community Projects AstroGridHEP-Grid In-Grid MediGridWISENT KlimaGridTextGrid

16.  K.-P. Mickel: Grilles en Allemagne 16 The DGI Infrastructure (Dec. 2006) 2.200 CPU-Cores, 0,8 PB Disk, 1,4 PB Tape Web Portal for User and Provider: www.d-grid.de

17.  K.-P. Mickel: Grilles en Allemagne 17 Status of D-Grid at the end of the 1 st stage The ministry has funded DGI and seven community projects with 25 million Euro Additionally the ministry has funded the German grid infrastructure with 20 million Euro At the end of 2006 we had a nationwide grid infrastructure in Germany More than 100 scientific institutions and more than 250 people were partners of D-Grid-1

18.  K.-P. Mickel: Grilles en Allemagne 18 Outline The roots of D-Grid 1 st stage of D-Grid – Basics 2 nd stage of D-Grid – Improvements 3 rd stage of D-Grid – Looking for Sustainability Organization Summary and Outlook

19.  K.-P. Mickel: Grilles en Allemagne 19 Ziele der ersten D-Grid- Ausschreibung Goals: – To attract more scientific communities to the Grid – To attract commercial communities to the Grid, as many as possible – To expand and improve the German Grid Infrastructure D-Grid – Second call for proposals (2007)

20.  K.-P. Mickel: Grilles en Allemagne 20 Results of the second call for proposals (2005) Again funded: One large "Integration Project" (DGI), consisting now of six partial projects: –Support –Operations –Security –Data Management –Monitoring, Accounting, Billing –Sustainability Many new Community Projects mainly from commercial industry are funded: –Civil engineering –Car production –Airplane production –Banking and financing –Assurances

21.  K.-P. Mickel: Grilles en Allemagne 21 Status of D-Grid at the end of the 2 nd stage (now) The ministry has funded DGI and 20 community projects in total with 45 million Euro Additionally the ministry has funded the German grid infrastructure in total with 40 million Euro (2006 and 2007: 20 M€ each) At the end of 2008 we have a very large and well established nationwide Grid infrastructure in Germany More than 150 scientific institutions, 45 commercial companies, and more than 450 people are partners of the German Grid Initiative D-Grid

22.  K.-P. Mickel: Grilles en Allemagne 22 The DGI Infrastructure (Oct. 2008) 10.000 CPU-Cores, 3,3 PB Disk, 5,5 PB Tape

23.  K.-P. Mickel: Grilles en Allemagne 23 Outline The roots of D-Grid 1 st stage of D-Grid – Basics 2 nd stage of D-Grid – Improvements 3 rd stage of D-Grid – Looking for Sustainability Organization Summary and Outlook

24.  K.-P. Mickel: Grilles en Allemagne 24 Looking for Sustainability (1) The German government is funding scientific and commercial projects only in their early phases The ministry expects and demands, that funded projects can live without any funding after some years of funding The German Research Network ("the German RENATER") is a good example: –Large funding in the first ~ 10 years –Since that time self financing, also in the future –Method: The more you use, the more you pay. The funding for D-Grid will end soon  We have to find soon a sustainable organization for D-Grid This organization must: –Provide strong, distributed, and reliable Grid resources –Provide extended and reliable Grid services –Arrange and overview Service Level Agreements between resource providers and Grid users

25.  K.-P. Mickel: Grilles en Allemagne 25 Looking for Sustainability (2) Early this year the German Grid Initiative became a legal entity (the German version of a "S.A.R.L.") This company can sign contracts, e. g. with EGI It is planned, that the Grid resource providers become partners of this company It is planned, that the Grid users sign contracts with this company concerning the (reliable) use of Grid resources But: At present it is absolutely not clear, who will pay in the future the resources, the use of the resources, and the operation of the German Grid Two possible models are under discussion: –The German association of large German Research Centres (Helmholtz Association) could it pay –The Grid users could pay Grid services corresponding to their use of resources and services

26.  K.-P. Mickel: Grilles en Allemagne 26 Outline The roots of D-Grid 1 st stage of D-Grid – Basics 2 nd stage of D-Grid – Improvements 3 rd stage of D-Grid – Looking for Sustainability Organization Summary and Outlook

27.  K.-P. Mickel: Grilles en Allemagne 27 Organization of D-Grid (1)  Funding agency Calls for proposals National and international advisors Integration projectCP1CPn CP2 CP3.. 20 Community Projects One large Integration Project

28.  K.-P. Mickel: Grilles en Allemagne 28 Organization of D-Grid (2) Integration projectCP1CPn CP2 CP3.. D-Grid Advisory Board Speaker: The manager of the D-Grid S.A.R.L. company Members: The Speakers of all D-Grid projects The Speaker of the D-Grid Advisory Board has to report to the funding agency

29.  K.-P. Mickel: Grilles en Allemagne 29 Outline The roots of D-Grid 1 st stage of D-Grid – Basics 2 nd stage of D-Grid – Improvements 3 rd stage of D-Grid – Looking for Sustainability Organization Summary and Outlook

30.  K.-P. Mickel: Grilles en Allemagne 30 Summary and Outlook Until 2003 we had nearly no Grid activities in Germany As the result of the generous funding by our government we have today in Germany a large, strong, and reliable Grid infrastructure This Grid infrastructure is extensively used by science (more) and industry (less) At present nearly all Grid resources in Germany are funded by the federal government At present it is completely uncertain, who will pay the German Grid resources in the future

31.  K.-P. Mickel: Grilles en Allemagne 31 M e r c i