28 March 2001F Harris LHCb Software Week1 Overview of GGF1 (Global Grid Forum) and Datagrid meeting, NIKHEF, Mar F Harris(Oxford)

28 March 2001F Harris LHCb Software Week2 Overview of presentation Programme and purpose of meetings Summary of WP8 (HEP applications) reaction Some specific LHCb reaction Actions arising out of meeting - the LHCb programme of work

28 March 2001F Harris LHCb Software Week3 Programme and Purpose of meetings GGF1 (Mar 5-7) –First in sequence of ‘global’ meetings -US and Europe coming together. Origins in US. –Attendance ~ 400 –Working groups to develope GRID Services and Applications –Tutorials (Globus, Advanced XML etc.) Datagrid (Mar 7-9) –First meeting since contract start Jan 1,2001 –Attendance ~200; LHCb~12 - Nikhef,UK,Fr, It,CERN –Working groups on middleware,testbeds, networking,applications

28 March 2001F Harris LHCb Software Week4 The Grid from a Services View : : E.g., Applications Resource-specific implementations of basic services E.g., Transport protocols, name servers, differentiated services, CPU schedulers, public key infrastructure, site accounting, directory service, OS bypass Resource-independent and application-independent services authentication, authorization, resource location, resource allocation, events, accounting, remote data access, information, policy, fault detection Distributed Computing Toolkit Grid Fabric (Resources) Grid Services (Middleware) Application Toolkits Data- Intensive Applications Toolkit Collaborative Applications Toolkit Remote Visualization Applications Toolkit Problem Solving Applications Toolkit Remote Instrumentation Applications Toolkit Applications Chemistry Biology Cosmology High Energy Physics Environment

28 March 2001F Harris LHCb Software Week5 Five Emerging Models of Networked Computing From The Grid Distributed supercomputing – synchronous processing High-Throughput Computing – large scale asynchronous processing On-Demand Computing (and interactive) – dynamic resources Data-Intensive Computing – databases Collaborative Computing (sharing) – scientists Last 4 models apply to HEP

28 March 2001F Harris LHCb Software Week6 Reminder of WP8 aims, and the LHCb role Interfacing HEP applications to GRID, and developing the applications to take advantage of GRID Year 1 milestones –end June Planning doc ‘ Requirements for GRID services ’ –end Dec Report on Run 0 with M9 release Activity in several institutes (e.g interfacing MC production to GRID; thinking about analysis model and data management)

28 March 2001F Harris LHCb Software Week7 Relationship of applications to GRID Architecture Group HEP applications EO applications Biology applications TWG I.Augustin(Chair, CERN) C.Charlot(CNRS) A.Tricomi(INFN) K.Bos(NIKHEF) D.Newbold(PPARC) P.Cerello(ALICE) C.Tull(ATLAS) A.Sciabà(CMS) E.VanHerwijnen(LHCb) D.Brugnoni(WP9) R.Medina(WP10) ATF

28 March 2001F Harris LHCb Software Week8 The multi-layer hourglass OS & Net services Bag of Services (GLOBUS) DataGRID middleware PPDG, GriPhyn, EuroGRID HEP VO common application layer Earth Obs.Biology ALICEATLASCMSLHCb Specific application layer WP9WP 10 GLOBU S team DataGRI D ATF WP TWG

28 March 2001F Harris LHCb Software Week9 Status of WP 8-10 use case and requirements documents ‘User cases and urgent requirements for Test Bed 0 & 1’ (meet with ATF 26 Mar and security Mar 29) –Available for WP8 –Available for WP9(ESA) User cases for Test Bed 2 & 3 (analysis etc..) –Draft in one month for WP8 –There will be discussions next week in WP8 Common user requirements (Specifications) –Together with WP9 and WP10 –First draft in one month –First release at PM6 (EU reqt)

28 March 2001F Harris LHCb Software Week10 Strategy for Test Beds Need test beds to –Validate existing software (applications & DataGRID) –Develop our long-term vision (not only use cases) Move to at least one site per ‘active’ country - but carefully, otherwise chaos! –Start first serious tests for CERN and RAL. Move to others (Liverpool,Lyon,Nikhef,Bologna...) according to success Usable environment for test –High-availability stable release of GLOBUS –Separation from development and production

28 March 2001F Harris LHCb Software Week11 Minimal Requirements for Testbed 0 (NOW!) Working release of GLOBUS –Plus support for it! Uniform, dependable ( ) certification / authentication mechanism –One single login good for all test bed sites –Possibility to add users from experiments

28 March 2001F Harris LHCb Software Week12 Test bed installation kits Products requiring root(system privileges) access –OS, compilers, Objectivity… –To be installed by WP6 CERN products installation kits –CLHEP, GEANT4, CERNLIB… –Kits provided by CERN / IT and installed by WP6 Experiment environment installation kits –Kits provided by experiment and installed by WP8 funded effort

28 March 2001F Harris LHCb Software Week13 Some Reactions to ATF (preliminary) Do we really want to use files? – ??Higher level data handling concept needed –We may want to use objects when interacting with DataGRID middleware –We may need UML/IDL models Is interactive use taken into account in the design? –We need to talk more here –We will propose interactive use cases

28 March 2001F Harris LHCb Software Week14 Reactions to ATF (preliminary) MPI and CORBA will be needed (Biology) There will be read/write databases! –Database update has to be taken into account Concerns on portability –Running on Linux and Solaris is not enough –The code should be written to run on any machine with a reasonable cc/java Worries about the use of CONDOR –Will we all have to install CONDOR? –Is the code Open Source?

28 March 2001F Harris LHCb Software Week15 Reactions to ATF (preliminary) Security is a concern for the M9 release –All implementations should go via some secure mechanism (globus init?) We met with ATF Mar 26 to discuss our reaction to M9 deliverables draft –‘Decided’ to decouple M9 deliverables and long term architecture planning

28 March 2001F Harris LHCb Software Week16 Specific LHCb reactions (post Amsterdam) We should broaden the GRID involvement of LHCb sites ( but maybe not make all of them part of first Datagrid Testbed?) –installation of Globus and LHCb s/w at our sites In parallel broaden our production but separate from GRID tests to start with We must develop our data and analysis models and map them to the GRID –Atlas are looking at mapping Athena/GAUDI to GRID –?our physics application layer running above GAUDI

28 March 2001F Harris LHCb Software Week17 Execution Control/Location (some thoughts from C Tull(Atlas) Execution in a fully grid-enabled manner involves locating, authenticating, brokering, and scheduling the use of appropriate grid resources (Security Services should be included here). The Athena/Gaudi Application Manager as the entity responsible for execution control in the framework might interface to appropriate grid services.

28 March 2001F Harris LHCb Software Week18 More on actions arising out of meeting - the LHCb programme of work Setting up LHCb GRID testbed (see Eric’s and Martin’s talks) Developing our analysis model (see Glenn’s talk) Interfacing our OO software to the GRID (see Pere’s talk) Hoping to organise brainstorming workshop ( ? Bologna late May/early June)