1. CoreGRID: The Unique European NoE for Grid and P2P Technologies European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies Pierre Kuonen Ecole d’Ingénieurs et d’architectes de Fribourg (HES-SO/EIA-FR) E-mail: pierre.kuonen@eif.chpierre.kuonen@eif.ch www.eif.ch/gridgroup

2. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 2 Network of Excellence (NoE) Definition –A Network of Excellence is an instrument for strengthening excellence by tackling the fragmentation of European research, where the main deliverable is a durable structuring and shaping of the way that research is carried out on the topic of the network. Aims and Objectives –NoE are designed to strengthen scientific and technological excellence on a particular research topic through the durable integration of the research capacities of the participants. They aim to overcome the fragmentation of European research by: gathering the critical mass of resources gathering the expertise needed to provide European leadership –NoE also have to spread excellence beyond the boundaries of its partnership.

3. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 3 Network of Excellence (NoE) cont. Project components –Projects must include a training component in the frame of their “spreading of excellence “ activities. Number of participants –Minimum of three partners from three different countries. However, the achievement of the “durable integration objective” usually implies a rather limited partnership. Duration –Typically up to 5 years with a maximum of 7 years. Projects Management –An overall management framework will have to be into place. Type of funding –Funding will be in form of a grant for integration. A fixed amount which will be distributed in annual instalments.

4. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 4 CoreGRID NoE objectives To build a European-wide research laboratory –To avoid fragmentation of Grid research activities in Europe –Create the European “Grid Lighthouse” and be seen as such worldwide –To achieve integration and sustainability To build solid foundations for GRID and Peer-to-Peer (P2P) technologies –Both on a methodological basis and a technological basis. –Support medium and long term research activities Achieve and promote scientific and technological excellence within & beyond the Grid research community Gather and disseminate European research A think-tank for spin-off projects –EC funded, bilateral projects, international cooperations, …

5. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 5 Network priorities Excellence –CoreGRID brings together a European critical mass of well-known experts in GRID and P2P research allowing to compete with research and development in North America and Asia –An ambitious joint program of activities to deal with well identified challenges Long-term integration & structuring –Set-up a sustainable European research laboratory with an associated management With several Institutes With research groups assigned to Institutes

6. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 6 Operating the Network Administrative & Financial Management –ERCIM Bruno Le Dantec (Administrative & Financial Coordinator) Celine Bitoune (Assistant to the AFC) Scientific & Technical Management –INRIA Thierry Priol (Scientific Coordinator) Päivi Palosaari (Assistant to the SCO)

7. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 7 CoreGRID Membership 40 partners from 18 Countries (1 from S. America) CoreGRID researchers –Sep 2004: 118 researchers –Aug 2005: 145 researchers –7 researchers left the Network, 34 new ones were included CoreGRID PhD students –Sep 2004: 163 PhD students –Aug 2005: 169 PhD students –22 left the Network, 28 new ones were included U. Cyprus INRIA CNRS ERCIM CETIC UCL CNR-ISTI INFN U. Calabria U. Pisa CLPP-BAS Delft U. Vrije U. EPFL HES-SO FhG FZJ USTUTT U. Muenster UNI DO U. Passau ZIB ICS-FORTH IC RAL-CCLRC U. Belfast U. Cardiff U. Manchester U. Newcastle U. Wesminster KTH SICS SZTAKI VTT U. Coimbra UPC Masaryk U. U. Chile PSC CYFRONET

8. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 8 Organizational map Executive Committee Scientific Advisory BoardIndustrial Advisory Board Specific Task Forces - NPTF: New Participants Integration Monitoring Committee Chair: R. Perrott (U. Belfast) Head of the “Collaboration Gateway” Administrative & Financial Co-ordinator Scientific Co-ordinator Members General Assembly Head of the “Integrated Activities” Head of the “Spreading Excellence” Heads of CoreGRID Institutes Chair: D. Laforenza (CNR-ISTI)

9. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 9 Organizational map Members General Assembly Knowledge & Data Management D. Talia (U. Calabria) Scheduling R. Yahyapour (U. Dortmund) System Architecture A. Andrzejak (ZIB) CoreGRID Institutes Executive Committee Scientific Advisory BoardIndustrial Advisory BoardSpecific Task Forces Integration Monitoring Committee Chair: R. Perrott (U. Belfast) Integrated Activities S. Gorlatch (U. Munster) Spreading Excellence P. Guisset (CETIC) Collaboration Gateway W. Ziegler (FhG) Programming Model M. Danelutto (U. Pisa) Grid Information & Monitoring L. Matyska (U. Masaryk) PSE, tools and GRID systems V. Getov (U. Wesminster) Administrative & Financial Co-ordinator B. Le Dantec (ERCIM) Scientific Co-ordinator T. Priol (INRIA) Chair: D. Laforenza (CNR-ISTI)

10. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 10 Joint Program of Activities Joint Programme of Activities Integrated Activities Jointly Executed Research Spreading of Excellence Excellence Spreading of Excellence Excellence Knowledge & Data Management Knowledge & Data Management Programming Model System Architecture Grid Information and Monitoring Service Grid Information and Monitoring Service Resource Management And Scheduling Resource Management And Scheduling Coordinated Programming of Partners’ activities Coordinated Programming of Partners’ activities Coordinated approach to prepare project proposals Internal Collaboration and Dissemination Internal Collaboration and Dissemination Annual Integration Workshop Systems tools and Environments Public Website Technical reports Workshops & conferences NewsletterNewsletter IndustryIndustry GRID User community ConferencesConferences Common Understanding Trust & Security Common Understanding Trust & Security Grid Testbed Mobility of researchers Sergei Gorlatch Domenico Talia Marco Danelutto Vivi Fragopoulou Norbert Meyer Ramin Yahyapour Vladimir Getov Pierre Guisset BrochuresBrochures Training & Education CoreGRID Institutes

11. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 11 Collaboration with other EU Grid projects CoreGRID is participating to the EU Concertation Activities of FP6 Grid Projects through its Collaboration Gateway and leads two activities : Roadmaps Trainings Collaboration Gateway Exploitation of synergies / technical concertation Exploitation of synergies / technical concertation Joint fora for exchange and dissemination Joint fora for exchange and dissemination Co-ordination of standardisation efforts Co-ordination of standardisation efforts Repository of reference Implementations and Grid middleware Repository of reference Implementations and Grid middleware Collaboration on research Inventories and roadmaps Collaboration on research Inventories and roadmaps Indicators and impact assessment assessment Wolfgang Ziegler Training activities Leadership

12. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 12 A set of well identified research challenges Knowledge & Data Management –Handling information/data that are required/produced by a wide range of diverse processing power Programming Model –Making the programming of Grid infrastructures as simple and transparent as possible System Architecture –Designing the next generation Grid middleware Grid Information, Resource and Monitoring Services –Scalable information service to implement a service view of the Grid Resource Management & Scheduling –Scheduling jobs/applications/tasks/computation within a Grid environment Systems, Tools and Environments –Integrating various middleware, tools and applications for problem solving

13. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 13 CoreGRID Integration Workshop Annual workshop to discuss... –possible overlappings and synergies between partners within every Institute, and between Institutes, –interdisciplinary topics within the NoE, –future collaboration activities. Workshop schedule –Workshop 2004: Future Generation Grids 1.-5.November 2004, Dagstuhl/Germany 45 invited participants, about 40 from CoreGRID Selected papers after reviewing --> second book in the CoreGRID Series by Springer-Verlag –Workshop 2005: To present and discuss the results of integration in Year 1 (held 28-30.11.05 in Pisa) –Workshop 2006: To be held in Krakow on October 19-20, 2006

14. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 14 Durable mobility of researchers Internal mobility is essential for integration and to ensure stronger co-operation among partners, promote career development and mobility 2 activities : –Fellowship Programme - Young researchers hosted by two institutes for two distinct periods ~ 600 k€ CALL 1, JANUARY 2005 (12 applications and 3 candidates selected) CALL 2, MAY 2005 (28 applications and 4 candidates selected) CALL 3, DECEMBER 2005 (5 positions offered) –Research Exchange Programme - Researcher or student from 1 member to another, two weeks to six months~ 480 k€ Exchange visit in Dortmund (8 weeks) Exchange visit in Cyprus (20 weeks) Search for external sources of funding is also needed, e.g. the Marie-Curie-Programme Mobility web portal available at the CoreGRID web site +

15. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 15 Public Website www.coregrid.net Internal and External Communication Regularly updated Visitors counted since mid April 05 –Apr 14: 90,508 visits –May 31: 123,000 visits –Aug 26: 227,701 visits –Dec 2: 337,631 visits Visibility: score of 8/10 in the Google PageRank 36% from non-european countries

16. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 16 CoreGRID Publications Objectives –To gather information on publications in journals, edited books, proceedings of conferences and workshops from CoreGRID researchers –To disseminate the results of the network by publishing Technical Reports –To publish white papers related to Grid technologies Results –Many joint scientific publications in proceedings, journals and edited books during the first year –40 CoreGRID Technical Reports available –3 planned White Papers –A publication database with more than 400 entries …

17. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 17 CoreGRID Springer series CoreGRID negotiated a series of books with Springer 1.Vol 1: Component Models and Systems for Grid Applications (2005) 2.Vol 2: Future Generation Grids (2005) 3.Vol 3: Proceedings on the 1st CoreGRID Workshop on Knowledge and Data Management in Grids (to appear) 4.Vol 4: Proceedings on the CoreGRID Integration Workshop 2005 (to appear) Knowledge and Data Management in Grids Integration Workshop 2005 2005

18. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 18 Grid User Community & Newsletter Grid User Community –Electronic mailing list –Scientific – Industry – Public –Expanded through other Newsletter mailing lists Quarterly Newsletter –6 newsletters already published –Editorial board: Berengère Fally, Rosa Badia, Ron Perrott, Vladimir Getov, Thierry Priol, Domenico Laforenza and Per Brand –Sent to the GUC –Infos relayed by other Newsletters

19. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 19 Training & Education activities Training and Education Website Annual CoreGRID Summer Schools In 2005, 42 participants of 13 nationalities came to Lausanne and in 2006, 55 participants of 12 nationalities came to Bonn

20. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 20 Swiss institutions involved in CoreGRID Two Swiss institutions are involved in CoreGRID –Ecole Polytechnique Fédérale de Lausanne (EPFL) Dr Ralf Gruber  Computational Engineering Laboratory –Ecole d’ingénieurs et d’architectes de Fribourg (HES-SO) Prof. Pierre Kuonen  Communication and Information Technologies Dept.  Leader of the GRID & Ubiquitous Computing Group

21. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 21 Swiss involvement in CoreGRID WP1: Integrated activities –HES-SO is member of the Integration Monitoring Committee WP6: Resource Management and Scheduling – EPFL and HES-SO –ISS project : SwissGRID initiative WP3: Programming Model – HES-SO –HES-SO is leader of task 3.1: Basic programming models WP8: Spreading Excellence – EPFL and HES-SO –HES-SO is leader of task 8.9: Training and Education –EPFL was the local organizer of the 2005 CoreGRID Summer School WP9: Collaboration Gateway – HES-SO –HES-SO is the contact person for collaboration with EGEE P.Kuonen is member of the external reviewers panel of the EGEE NA3 Training Activity

22. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 22 Forthcoming CoreGRID events –Integration Workshop 2006 in Krakow on –October 19-20, 2006 –1st CoreGRID Industrial Conference Sophia Antipolis, November 30th, December 1st 2006 –FP7 GRID-Day & Swiss GRID Crunching Test, HES-SO, Fribourg, December 7th 2006, organized by Euresearch, in collaboration with CSCS and EGEE Attention !!! Not the 6 th as indicated in the document

23. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 23 Contacts At HES-SO Prof. Pierre Kuonen Ecole d’ingénieurs et d’architectes de Fribourg Bd de Pérolles, 80 1705 Fribourg +41 26 429 65 65 pierre.kuonen@eif.ch www.eif.ch/gridgroup At EPFL Dr. Ralf Gruber Computational Engineering Laboratory 1015 Lausanne +41 21 693 59 06 ralf.gruber@epfl.ch

24. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 24 Knowledge & Data Management Research challenge: Handling information/data that are required/produced by a wide range of diverse processing power Integration of data management and knowledge discovery with GRID technologies for providing knowledge-based GRID services Define a unified vision of the data and knowledge management in Grids through a layered approach Research activities –Distributed data management Based on commodity storage devices and interconnects –Information and knowledge management Semantic modeling through metadata –Data mining and knowledge discovery Semantic description for service discovery

25. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 25 Programming Model Research challenge: Making the programming of Grid infrastructures assimple and transparent as possible Raise the level of abstraction to make the programming of grids easier –OGSA and WSRF are just the instruction set of grid computing infrastructures Definition of a lightweight component model for grid applications –A clear illustration of the research fragmentation At least 9 partners are working on component programming –Specific requirements: heterogeneity, dynamicity, scalability –Targeted applications: grid middleware & scientific computing Research activities –Application requirements –Communication between components –Component model definition and hierarchical composition –Advanced programming models based on components framework

26. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 26 System Architecture Research challenge: Designing the next generation Grid middleware Next Generation Grid System Architecture –Implement the “invisible Grid” vision of the NGG report Focus on specific deficiencies of present day Grid systems –Today Grid middleware centralized or semi-centralized Short-term prediction models and tools Fault tolerance mechanisms only for small/medium scale systems –Specific requirements: scalability, adaptability and dependability Research activities –Definition of capabilities and architectural components of Grids –Scalable Grid Services follow a P2P approach instead of a client/server approach –Mechanism for adaptive Grids tools and models for long-term prediction –Dependability in Grids Fault tolerant middleware and runtime

27. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 27 Grid Information & Monitoring Service Research challenge: Scalable information service to implement a service view of the Grid Improve various services such as monitoring, information and user/accounting management –Avoid centralized management as much as possible Research activities –Checkpointing services –Workflow services –Accounting and user management services in large scale system

28. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 28 Resource Management & Scheduling Research challenge: Scheduling jobs/applications/tasks/computation within a Grid environment Develop generic solution for Grid scheduling and management –Not only able to manage computational resources Definition of a pervasive RMS middleware for different application scenarios –Consider different kind of resources –Common interface and models –Support business models Research activities –Grid scheduling architecture –Multi-level scheduling strategies –Workflow scheduling strategies for jobs with temporal dependencies –Fault-tolerance and reliability in scheduling –Coordinating scheduling with data management –Performance prediction for advanced scheduling

29. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 29 Problem Solving Environment, tools and applications for problem solving Research challenge: Integrating various middleware, tools and applications for problem solving Develop a novel software environments and tools for Grid systems –Today Grid middleware systems are not component-based although their high-degree of complexity Definition of a generic component system to integrate applications, tools and system components –Based on the CoreGRID components model Research activities –Definition of a generic platform –Mediator components –Integrated toolkit –Advanced tools and environments

30. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 30 Scientific Advisory Board (SAB) Objectives: –Annual external assessment of the scientific quality of the work –Provide guidance to the strategic orientations –Formulate recommendations  guard the excellence of the Network Three senior Network scientists and three external advisors Internal members: Jarek Nabrzyzki (PSNC - Poland) Henri Bal (Vrije U. - The Netherlands) Uwe Schwiegelshohn (Dortmund U. - Germany) External members: Dennis Gannon (Indiana U. - USA) Michel Cosnard (Nice U. - France) Sato Sekiguchi (AIST - Japan)

31. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 31 Industrial Advisory Board (IAB) IAB has four primary objectives: –To communicate to the Network European Industry’s long-term Grid-related technology needs and challenges –To provide the Network with Grid validation cases –To help identify the market sector(s) to be addressed within the Grid User Community, in order to ensure a quick adoption of next generation Grid technologies within European industry –To report to the Scientific Advisory Board its recommendation with respect to future strategic GRID-related research objectives IAB is composed of 15 members from the European industrial sector Confirmed members: Federico Rossi, DATAMAT (Italy) Yannis Perros, Algosystems (Greece) Bernd Kosch, FUJITSU SIEMENS COMPUTER (Germany) Mark Gilbert, European Microsoft Innovation Center (Germany) John Easton, IBM Grid Computing (UK) Anssi Karhinen, Nokia Research Center (Finland) Igor Klapka, SAMTECH (Belgium)

32. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 32 Dissemination http://www.coregrid.net NewsletterTechnical Report European Grid Technology Days 2005 (Brussels, Belgium, 30-31 May 2005) Information available at the CoreGRID web site Announcement

33. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 33 Forum Engelberg

34. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 34 The First CoreGRID summer school EPFL: 5-9 September 2005 –Local organizer: Ralf Gruber EPFL –More than 20 sessions of theorical courses and practical work –Theme: Introduction to GRID technologies Mainly targeted to young computer scientists (PhD) –Information and registration at: www.coregrid.net/summerschool

35. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 35 Conclusion CoreGRID started in September 1st, 2004 –A very active project although it is in its early stage –Involvement of the main European Key players in Grid computing (both institutions and researchers) –The only one Network of Excellence in Grid funded by the EU http://www.ercim.org/publication/Ercim_News/enw59/ www.coregrid.net

36. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 36 Some «SWISS» considerations Switzerland was inside top countries in HPC –SOS workshops: S andia- O ak Ridge- S wiss Annual workshop series: www.eif.ch/sos GRID is certainly a matter of hardware and software –But today it is mainly a matter of « knowware » ! GRID « knowware » exists in Switzerland : CoreGRID –Switzerland needs a strong political willpower A steady long term national wide initiative: SwissGRID ? If we want to avoid that this « knowware » just goes NOWHERE !!

37. European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 37 GRID - Computing Virtual Supercomputing –An association of several supercomputers geographically distributed (10-1000) –Each node is a parallel machine managed through a scheduling system (batch) –To provide a virtual supercomputer Internet computing –A combination of a large number of PCs (10000 - 1000000) –To exploit unused computing Metacomputing –An association of several servers providing a set of applications