CoreGRID: European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies Thierry PRIOL Scientific Coordinator INRIA Bruno Le Dantec Administrative & Financial Coordinator ERCIM Evangelos Markatos FORTH-ICS Based on a talk prepared by:

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 2 DCS Lab Distributed Computing Systems Lab –People 4 faculty and researchers 5 staff members (M.S.) 10 graduate students 5 undergraduate students –Research Areas Security GRIDs and P2P systems Network Monitoring

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 3 Mission Statement Driving Force: Study planet-wide distributed systems –to understand the forces that drive their day-to-day operation –as well as the dimensions that sustain their long-term evolution It is probably the first time in the history of Comp. Science that we have build something so complex that it deserves to be studied on its own Example Questions: –Why do they work at all? –How do they break? –What kind of traffic is that which flows through the “veins” of such systems? –What holds these systems together? –How do they respond to various types of attacks? –Under what circumstances would they collapse? –How can we make them more robust? –How can we trust them? –How can we be safe in them?

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 4 Internet Epidemics Cyberattacks –Worms, viruses, backdoors Background: –CodeRED Worm infected 350,000 computers in 24 hours –The Sapphire/Slammer worm infected 70,000 computers in 30 minutes Research areas: –Detection and mitigation of cyber-attacks

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 5 GRID Computing Large Scale Distributed Computing Research Areas: –Scalability to millions (billions?) of end nodes –Monitoring and Measurements

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 6 Network Monitoring Research Questions: –How can we develop Scalable Monitoring Systems? For Gbps? –What kind of traffic flows in the Internet today? –How can we use it to detect performance bottlenecks? –How can we use it to detect security compromises?

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 7 Network Monitoring – Achievements Successful Completion of SCAMPI –EU-funded project to develop a 10Gbps passive monitoring system Project Coordination of the follow-up LOBSTER project –LOBSTER: Large Scale Monitoring of Broadband Internet Infrastructure A European network of monitors Secured Funding –SCAMPI, LOBSTER EU projects Enstablished Collaborations –NRNs: National Research Networks CESNET, UNINETT (100 monitoring nodes in 2008) –TERENA The Association of European NRNs Invited to give Keynote talk –At 4th Concertation Meeting of IST-FP6 Communication and Network Technologies projects and associated clusters, Brussels, Belgium, March 2005.

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 8 Peer-to-Peer Systems Research Areas: –Scalability in p2p systems Caching, prefetching, reduction of duplicate messages, etc. –Reliability How can we develop reliable p2p systems out of unreliable components? –Security Attackers exploit peers into communicating with a single victim computer How can we detect and mitigate such attacks?

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 9 CoreGRID objectives To build a European-wide research center –To avoid fragmentation of Grid research activities in Europe –Create the European “Grid Lighthouse” and be seen as such worldwide –To achieve integration and sustainability To build solid foundations for GRID and P2P technologies –Both on a methodological basis and a technological basis –Support medium and long term research activities Achieve and promote scientific and technological excellence within & beyond the Grid research community Gather and disseminate European research A think-tank for spin-off projects –EC funded, bilateral projects, international cooperations, …

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 10 CoreGRID Membership 42 partners from 18 Countries (1 from S. America) CoreGRID researchers –Sep 2004: 118 researchers –Aug 2005: 145 researchers –7 researchers left the Network, 34 new ones were included CoreGRID PhD students –Sep 2004: 163 PhD students –Aug 2005: 169 PhD students –22 left the Network, 28 new ones were included U. Cyprus INRIA CNRS ERCIM CETIC UCL CNR-ISTI INFN U. Calabria U. Lecce U. Pisa CLPP-BAS Delft U. Vrije U. EPFL UASF FhG FZJ USTUTT U. Muenster UNI DO U. Passau ZIB ICS-FORTH IC RAL-CCLRC U. Belfast U. Cambridge U. Cardiff U. Manchester U. Newcastle U. Wesminster KTH SICS SZTAKI VTT U. Coimbra UPC Masaryk U. U. Chile PSC CYFRONET

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 11 Vision: Integrated Research CenterBuild an Integrated Research Center –on GRID and P2P systems Research Institutes A IRC consists of Research Institutes –on specific topics such as –Data management, Programming Models –Scheduling, Monitoring –Architecture, etc. Research LabsA RI consists of Research Labs –2-10 researchers from different organizations closely working on the same subject

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 12 Operating the Network Administrative & Financial Management –ERCIM Bruno Le Dantec (Administrative & Financial Coordinator) Celine Bitoune (Assistant to the AFC) Scientific & Technical Management –INRIA Thierry Priol (Scientific Coordinator) Päivi Palosaari (Assistant to the SCO)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 13 A brief description of ERCIM ERCIM is a consortium of leading research institutions from 18 European countries committed to information technology and applied mathematics.

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 14 Organizational map Executive Committee Scientific Advisory BoardIndustrial Advisory Board Specific Task Forces - NPTF: New Participants Integration Monitoring Committee Chair: R. Perrott (U. Belfast) Head of the “Collaboration Gateway” Administrative & Financial Co-ordinator Scientific Co-ordinator Members General Assembly Head of the “Integrated Activities” Head of the “Spreading Excellence” Heads of CoreGRID Institutes Chair: D. Laforenza (CNR-ISTI)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 15 Scientific Advisory Board (SAB) Objectives: –Deliberate on science-related matters of the Network –Annual external assessment of the scientific quality of the work –Provide guidance to the strategic orientations –Formulate recommendations to the Executive Committee  on content, planning and execution of the Joint Programme of Activities Three senior Network scientists and three external advisors + SCO Internal members: Jarek Nabrzyzki (PSNC - Poland) Henri Bal (Vrije U. - The Netherlands) Uwe Schwiegelshohn (Dortmund U. - Germany) External members: Dennis Gannon (Indiana U. - USA) Michel Cosnard (Nice U. - France) Sato Sekiguchi (AIST - Japan)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 16 Industrial Advisory Board First IAB meeting: June 15, 2005, at UPC, Barcelona Report written by Monica Marinucci-Lopez, Oracle, CoreGRID IAB secretary

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 17 A set of well identified research challenges Knowledge & Data Management –Handling information/data that are required/produced by a wide range of diverse processing power Programming Model –Making the programming of Grid infrastructures as simple and transparent as possible System Architecture –Designing the next generation Grid middleware Grid Information, Resource and Monitoring Services –Scalable information service to implement a service view of the Grid Resource Management & Scheduling –Scheduling jobs/applications/tasks/computation within a Grid environment Systems, Tools and Environments –Integrating various middleware, tools and applications for problem solving

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 18 Integration Workshop CoreGRID Integration Workshop 2005 Summarized the integration work of Year November in Pisa 124 attendees: All partners, SAB and IAB. 50 reviewed presentations, incl. 46 cooperation papers: –23 full (20 min) –27 short (10 min) 179 authors 2 keynote speeches (SAB and IAB) 2 general discussions (Trust & Security, Panel) Preliminary Proceedings: both printed and electronic versions Selected papers  Book by Springer-Verlag (early 2006)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 19 Durable mobility of researchers Internal mobility is essential for integration and to ensure stronger co-operation among partners, promote career development and mobility 2 activities : –Fellowship Programme –Fellowship Programme - Young researchers hosted by two institutes for two distinct periods ~ 600 k€ CALL 1, JANUARY 2005 (12 applications and 3 candidates selected) CALL 2, MAY 2005 (28 applications and 4 candidates selected) CALL 3, DECEMBER 2005 (5 positions offered) –Research Exchange Programme –Research Exchange Programme - Researcher or student from 1 member to another, two weeks to six months~ 480 k€

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 20 Public Website Internal and External Communication Regularly updated Visitors counted since mid April 05 –Apr 14: 90,508 visits –May 31: 123,000 visits –Aug 26: 227,701 visits –Dec 2: 337,631 visits Visibility: score of 8/10 in the Google PageRank 36% from non-european countries

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 21 « CoreGRID Publications » joint scientific publications –Authors from two or more labs –Tech Reports –Conferences –Journals

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 22 CoreGRID Springer series CoreGRID negotiated a series of books with Springer 1.Vol 1: Component Models and Systems for Grid Applications (2005) 2.Vol 2: Future Generation Grids (2005) 3.Vol 3: Proceedings on the 1st CoreGRID Workshop on Knowledge and Data Management in Grids (to appear) 4.Vol 4: Proceedings on the CoreGRID Integration Workshop 2005 (to appear)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 23 Grid User Community & Newsletter Grid User Community –Electronic mailing list –Scientific – Industry – Public –Expanded through other Newsletter mailing lists Quarterly Newsletter –Nr. 1: February 2005 –Nr. 2: May 2005 –Nr. 3: September 2005 –Nr. 4: January 2006 –Editorial board: Anne Falier, Rosa Badia, Ron Perrott, Vladimir Getov, Thierry Priol, Domenico Laforenza and Per Brand –Sent to the GUC –Infos relayed by other Newsletters

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 24 CoreGRID Brochure Electronic & Paper (4,000 copies) Set-up CoreGRID visual identity

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 25 Training & Education activities Training and Education Website Summer Schools Annual CoreGRID Summer Schools In 2005 : –EPFL, Lausanne, Switzerland, 5-9 September –Targeted to young computer science PhD students –40 participants (fully booked)

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 26 Our work in CoreGRID Architecture –Large Scale Systems Monitoring –Use passive monitoring to infer performance of individual connections Security –Threat Models for GRID systems –Cyberattacks Exploit p2p and GRID protocols to attack a victim –HoneyLab How to use the GRID as a distributed Honeypot

European Research Network on Foundations, Software Infrastructures and Applications for large scale distributed, GRID and Peer-to-Peer Technologies 27 Conclusion CoreGRID started in September 1st, 2004 completed successfully its first year –A very active project that has completed successfully its first year main European Key players –Involvement of the main European Key players in Grid computing (both institutions and researchers) only one Network of Excellence in Grid –The only one Network of Excellence in Grid funded by the EU