DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 DataGrid Project Status Fabrizio Gagliardi – Project Manager
DataGrid Project Status - n° 2 Outline u Introduction to the review u General project status n Middleware, Testbed, Networking, Applications, Dissemination, Project management u Project deliverables u Project budget u Summary u Conclusions
DataGrid Project Status - n° 3 Introduction to the Review u Review structure n Today (AM): 2003 Overview and current status n Today (PM): Application assessment, dissemination and quality, Application demos n Tomorrow (AM): Middleware development, security, summary u Details are provided in the deliverables and periodic reports u Need to follow the agenda firmly so please hold questions till the end of presentations
DataGrid Project Status - n° 4 DataGrid Summary u Leading vehicle for Grid Research and deployment over the last three years n Europe’s flagship Grid Project u 2001 n Established organisational structures n Gathered/analysed requirements and surveyed software toolkits n Assembled large scale grid testbed and defined middleware architecture u 2002 n Improved services provided to application groups (quality issues in software, creation of documentation, tutorial programme) u 2003 n Built on solid technical base to provide advanced functionality to application groups and Grid related projects around the world. The results will form the basis of EGEE
DataGrid Project Status - n° 5 Themes of 3 rd year of the project u Complete the work as described in the technical annex u Delivery and support the grid software for various national and international production grid programmes u Define migration plan for future projects u Elaborate exploitation plans
DataGrid Project Status - n° 6 DataGrid Achievements in Brief u Successful deployment of middleware for use by applications n Sept. 03: third major release of EDG middleware made available n Important improvements included in final EDG version 2.1 deployed end Nov. 03 u Successful delivery of middleware to the LCG production infrastructure: n EDG software installed on more than 40 sites throughout the world. Next generation LCG-2 deployed January 2004 u Datagrid Middleware being exploited by other projects and production facilities: n LCG, EU Crossgrid Project, EU Grace Project, Italian INFN grid/grid.it, Dutch Dutchgrid, UK eScience programme, DataTAG, etc. n openlab: Involvement of industrial partners in Grid-related activities n EDG middleware being ported to different platforms such as IA64 as part of the CERN openlab project. (Enterasys Networks, HP, IBM, Intel Corporation, Oracle) n WP4 Quattor computing management tool now deployed at the CERN computing centre (approx nodes). Other sites have expressed interest
DataGrid Project Status - n° 7 DataGrid Achievements II u Re-launched Application Working Group (AWG) has delivered important cross-application outputs n Re-launched March Chaired by Vincent Breton (WP10) n Interactions with GridLab Project n Valuable recommendations and requirements n Excellent forum for discussions u Europe-wide network activity n Upgrade of numerous National research and Education networks n National networks inter-connected with GEANT n Grid data transport at GBit/s speed anticipated confidently n Close collaboration maintained with DataTAG and DANTE u Active participation in international standards bodies n Providing contributions to different GGF Working and Research groups
DataGrid Project Status - n° 8 DataGrid Achievements III u Coordination and cooperation with related Grid Projects n DataTAG, CrossGrid, GRIDSTART, GRACE, GridLab… u Open-style Software license established n Used throughout 2003 and submitted for approval as an OSI compliant license; model for CrossGrid and Globus license. u Tutorials n “Education & Outreach Manager” assigned to coordinate and lead tutorial activities. n More than 600 people trained in over 25 events
DataGrid Project Status - n° 9 DataGrid Third Year Deliverables D1.6, D2.5, D3.5, D4.5, D5.5, D6.7: Components and documentation for the third project release D1.7, D2.6, D3.6, D4.6, D5.6: Final Evaluation report D6.8: Final evaluation of testbed operation D7.4: Final report on network infrastructure and services D7.7: Final security report D8.4: Report on the results of HEP applications at run #2 and final application report D9.4: EO application platform interface D9.5: EP application processing testbed demonstration and final report D10.4: Final report including report on the 2nd bio-testbed release D11.6: Second annual conference and grid forum D11.7: Final conference D11.9: Contribution to international standards D : Third year quarterly reports D12.19: Third year annual report D6.6, D8.3, D9.3 and D10.3 which had been rescheduled for the first quarter of the third year were also delivered
DataGrid Project Status - n° 10 Mware stuff… u Level 1 n Level 2 s Level 3 n Level 4 Level 5
DataGrid Project Status - n° 11 WP12 Project Management u Project Office u Second Project Review successfully passed and followed-up u Third Project Review organized u Project conferences held (Barcelona and Heidelberg) u Architecture group (ATF) u Globus support contract activated with Argonne (ANL) and being processed with Univ. S. California's Info Sciences Inst. (ISI) u Software license established
DataGrid Project Status - n° 12 Project Major Issues u State that it was a wise decision (stated at the 2 nd review) to not produce an OGSA-based EDG release u Relations with other Grid projects, LCG in particular (real production use with LCG, keeping track of new technology standards (OGSA/OGSI/WSRF…) u Persistency of project results (exploitation of project results including EGEE) u Globus and other tools support (migration to OGSA) u Project Office resources (maternity leave) u Third year funding marginal with some partners
DataGrid Project Status - n° 13 Project Budget Table shows status at 31 st December 2003
DataGrid Project Status - n° 14 Project Effort
DataGrid Project Status - n° 15 Summary u Project completed within budget and on schedule u All partners actively participated and made it to the end u DataGrid has gone the extra mile to produce output beyond the original contracted programme of work u Successful deployment of M/W for use by real applications: n LCG + others projects such as CrossGrid, DataTAG, GRACE, others (South Korea, Chili, Russia, etc.) u Applications heavily involved in all phases of the project n Joint Application Working Group produced important outputs. u International network activity established (via DataTAG, RN Geant) n Many upgrades within the NREN area n Good collaboration with Geant in defining EGEE networking plans u Active participation in international standard bodies (GGF etc.) u High-level coordination with related Grid projects (CrossGrid, GRIDSTART, DataTAG, GRACE, etc.) u Open source license established u Major dissemination success with tutorial and road-shows
DataGrid Project Status - n° 16 Conclusions u Project completed within budget and on schedule u All partners actively participated and made it to the end u Difficulties arise from finding balance between support of the current s/w and effort devoted towards advance solutions and migration to new emerging standards u Functionality and performance of software and testbed(s) completed according to the original plans. u Confirmed the value of EDG technology as adopted by many projects including LCG for one of the largest scientific enterprises to date u Follow on project successfully proposed and being launched (EGEE)