DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 DataGrid Project Status Fabrizio Gagliardi – Project Manager

DataGrid Project Status - n° 2 Outline u Introduction to the review u Achievements of the project u Project deliverables u Project budget u Summary

DataGrid Project Status - n° 3 Introduction to the Review u Review structure n Today (AM): 2003 Overview and current status n Today (PM): Application assessment, dissemination and quality, Application demos n Tomorrow (AM): Middleware development, security, summary and future exploitation u Details are provided in the deliverables and periodic reports u Need to follow the agenda firmly so please hold questions till the end of presentations

DataGrid Project Status - n° 4 DataGrid Summary u Leading vehicle for Grid Research and deployment over the last three years n Europe’s flagship Grid Project u 2001 n Established organisational structures n Gathered/analysed requirements and surveyed software toolkits n Assembled large scale grid testbed and defined middleware architecture u 2002 n Improved services provided to application groups (quality issues in software, creation of documentation, tutorial programme) u 2003 n Built on solid technical base to provide advanced functionality to application groups and Grid related projects around the world. The results will form the basis of EGEE

DataGrid Project Status - n° 5 Themes of 3 rd year of the project u Complete the work as described in the technical annex u Deliver and support the grid software for various national and international production grid programmes u Define migration plan for future projects u Elaborate exploitation plans

DataGrid Project Status - n° 6 Relationship with LCG u LCG is a grid deployment project n Provides the computing infrastructure for the LHC experiments n World-wide coverage n Production requirements with strict deadlines u LCG has worked closely with DataGrid over the last two years n Has adopted software products from all DataGrid middleware WPs n Has adopted many DataGrid procedures and templates n Established joint testing-team with software certification and scalability tests n Rapid feedback has helped improve the quality of DataGrid software

DataGrid Project Status - n° 7 DataGrid Achievements in Brief u Complete the work as described in the technical annex n Major enhancements for functionality and stability in all middleware areas s VOMS based security model integrated in job-submission chain s Replica Location Service (RLS) deployed s Re-factorization of WMS, edg-replica-catalog s Support for MPI, interactive, and checkpointable jobs s Unified access to storage (SE) s R-GMA replaced MDS as basis for the information system s New automated fabric tools developed s Many more (details in the individual WP presentations) n Successful deployment of middleware for use by applications s Sept. 03: third major release of EDG middleware made available s Important improvements included in final EDG version 2.1 deployed end Nov. 03 s Testbed focused on geographic distribution (more than 20 sites), not on computing power (many sites moved CPUs to production Grids)

DataGrid Project Status - n° 8 DataGrid Achievements II u Applications assessed middleware on application testbed n Many scientific results achieved exploiting DataGrid testbed in all three application areas n New applications ported to Grid (WP10) n Earth Observation sites joined the testbed (WP9) n Grid environments (e.g. LCG) already in production use for HEP (WP8) u Re-launched Application Working Group (AWG) has delivered important cross-application outputs n Re-launched March Chaired by Vincent Breton (WP10) n Interactions with EU GridLab Project n Valuable recommendations and requirements n Excellent forum for discussions

DataGrid Project Status - n° 9 DataGrid Achievements III u Delivery and support the grid software for various national and international production grid programmes n Successful delivery of middleware to the LCG production infrastructure: s EDG software installed on more than 40 sites throughout the world. Next generation LCG-2 deployed January 2004 n Datagrid Middleware being exploited by other projects and production facilities: s LCG, EU CrossGrid Project, EU Grace Project, Italian INFN grid/grid.it, Dutch Dutchgrid, UK eScience programme, DataTAG, etc. s openlab: Involvement of industrial partners in Grid-related activities s EDG middleware being ported to different platforms such as IA64 as part of the CERN openlab project. (Enterasys Networks, HP, IBM, Intel Corporation, Oracle) s WP4 Quattor computing management tool now deployed at the CERN computing centre (approx nodes). Other sites have expressed interest

DataGrid Project Status - n° 10 DataGrid Achievements IV u Further important achievements n Europe-wide network activity s Upgrade of numerous National research and Education networks s National networks inter-connected with GEANT s Grid data transport at GBit/s speed anticipated confidently s Close collaboration maintained with DataTAG and DANTE n Active participation in international standards bodies s Providing contributions to different GGF Working and Research groups n Coordination and cooperation with related Grid Projects s DataTAG, CrossGrid, GRIDSTART, GRACE, GridLab, etc.

DataGrid Project Status - n° 11 DataGrid Achievements V u Further important achievements n Tutorials s “Education & Outreach Manager” assigned to coordinate and lead tutorial activities. s More than 600 people trained in over 25 events n Two Project conferences organized s May 2003 in Barcelona, September 2003 in Heidelberg

DataGrid Project Status - n° 12 DataGrid Achievements VI u Open source software license established Used throughout 2003 ; model for CrossGrid and Globus license and recommended for approval as an OSI ( compliant license Original Message----- From: Russell Nelson Sent: Wednesday, February 18, :21 AM To: Cc: Subject: License Committee report I'm the chair of the license approval committee. This is my report for the current set of licenses under discussion. If anybody disagrees with my assessment of the committee's conclusions, say so promptly. -- We've sat on this license submission for far too long. It's a clever and innovative license which we should approve. Title: EU DataGrid Software License Submission: License: Comments: …. Recommend: approval.

DataGrid Project Status - n° 13 DataGrid Third Year Deliverables D1.6, D2.5, D3.5, D4.5, D5.5, D6.7: Components and documentation for the third project release D1.7, D2.6, D3.6, D4.6, D5.6: Final Evaluation report D6.8: Final evaluation of testbed operation D7.4: Final report on network infrastructure and services D7.7: Final security report D8.4: Report on the results of HEP applications at run #2 and final application report D9.4: EO application platform interface D9.5: EO application processing testbed demonstration and final report D10.4: Final report including report on the 2nd bio-testbed release D11.6: Second annual conference and grid forum D11.7: Final conference D11.9: Contribution to international standards D : Third year quarterly reports D12.19: Third year annual report D6.6, D7.6, D8.3, D9.3 and D10.3 which had been rescheduled for the first quarter of the third year were also delivered

DataGrid Project Status - n° 14 Project Major Issues u Build on fast moving technology n GT2 -> GT3 (OGSI) -> GT4 (WSRF) n Decision at the beginning of year 3 to stay with GT2 and only prepare a few components for OGSI by building on plain web- services was a sensible choice u Relations with other Grid projects, LCG in particular n True production use with LCG required the adoption of more strict procedures u Globus and other tools support n Now based on VDT; together with LCG an excellent relationship and support structure could be established u Persistency of project results n Exploitation of project results (in particular through EGEE) n More details will be given at the presentation at the end of the review

DataGrid Project Status - n° 15 Project Budget Table shows status at 31 st December 2003

DataGrid Project Status - n° 16 Project Effort Table shows status at 31 st December 2003

DataGrid Project Status - n° 17 Summary u Project completed within budget and on schedule u All partners actively participated and made it to the end u DataGrid has gone the extra mile to produce output beyond the original contracted programme of work u Functionality and performance of software and testbed(s) completed according to the original plans u The value of EDG technology has been confirmed through its adoption by many projects including LCG for one of the largest scientific enterprises to-date u Follow-on project successfully proposed and being launched (EGEE)