EGEE is a project funded by the European Union under contract IST-2003-508833 “The ARDA project” Massimo Lamanna / CERN on behalf of the LCG-ARDA project.

Slides:



Advertisements
Similar presentations
INFSO-RI Enabling Grids for E-sciencE Application Demonstrations C. Loomis, J. Moscicki, J. Montagnat EGEE European Review (CERN)
Advertisements

EGEE is a project funded by the European Union under contract IST NA2 Dissemination John DYER Activity Leader All Activity Meeting, CERN 18.
EGEE is a project funded by the European Union under contract IST “The ARDA project: Grid analysis prototypes of the LHC experiments” Massimo.
EGEE is a project funded by the European Union under contract IST JRA1 Testing Activity: Status and Plans Leanne Guy EGEE Middleware Testing.
EGEE is a project funded by the European Union under contract IST The ARDA Project Between Grid middleware and LHC experiments Juha Herrala.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
EGEE is a project funded by the European Union under contract IST Testing processes Leanne Guy Testing activity manager JRA1 All hands meeting,
EGEE is a project funded by the European Union under contract IST “ARDA status” Dietrich Liko / CERN XXVII HTASC, 10 September
DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.
EGEE is a project funded by the European Union under contract IST Project Technical Forum C. Loomis (LAL-Orsay) GAG (CERN) July 6,
INFSO-RI Enabling Grids for E-sciencE EGEE and Industry Bob Jones EGEE-II Project Director Final EGEE Review CERN, May 2006.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PPS All sites Meeting: Introduction & Agenda.
David Adams ATLAS ADA, ARDA and PPDG David Adams BNL June 28, 2004 PPDG Collaboration Meeting Williams Bay, Wisconsin.
SA1/SA2 meeting 28 November The status of EGEE project and next steps Bob Jones EGEE Technical Director EGEE is proposed as.
INFSO-RI Enabling Grids for E-sciencE SA1 and gLite: Test, Certification and Pre-production Nick Thackray SA1, CERN.
EGEE is a project funded by the European Union under contract IST Middleware Planning for LCG/EGEE Bob Jones EGEE Technical Director e-Science.
GLite – An Outsider’s View Stephen Burke RAL. January 31 st 2005gLite overview Introduction A personal view of the current situation –Asked to be provocative!
JRA Execution Plan 13 January JRA1 Execution Plan Frédéric Hemmer EGEE Middleware Manager EGEE is proposed as a project funded by the European.
ARDA Prototypes Andrew Maier CERN. ARDA WorkshopAndrew Maier, CERN2 Overview ARDA in a nutshell –Experiments –Middleware Experiment prototypes (basic.
EGEE is a project funded by the European Union under contract IST EGEE Services Ian Bird SA1 Manager Cork Meeting, April
LCG ARDA status Massimo Lamanna 1 ARDA in a nutshell ARDA is an LCG project whose main activity is to enable LHC analysis on the grid ARDA is coherently.
INFSO-RI Enabling Grids for E-sciencE Experience of using gLite for analysis of ATLAS combined test beam data A. Zalite / PNPI.
INFSO-RI Enabling Grids for E-sciencE EGEE SA1 in EGEE-II – Overview Ian Bird IT Department CERN, Switzerland EGEE.
EGEE is a project funded by the European Union under contract IST “Interfacing to the gLite Prototype” Andrew Maier / CERN LCG-SC2, 13 August.
15 December 2015M. Lamanna “The ARDA project”1 The ARDA Project (meeting with the LCG referees) Massimo Lamanna CERN.
WP3 Information and Monitoring Rob Byrom / WP3
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
LCG CERN David Foster LCG WP4 Meeting 20 th June 2002 LCG Project Status WP4 Meeting Presentation David Foster IT/LCG 20 June 2002.
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
EGEE is a project funded by the European Union under contract IST Roles & Responsibilities Ian Bird SA1 Manager Cork Meeting, April 2004.
EGEE is a project funded by the European Union under contract IST “ARDA input for the testing coordination meeting” Massimo Lamanna CERN, 7.
EGEE Project Review Fabrizio Gagliardi EDG-7 30 September 2003 EGEE is proposed as a project funded by the European Union under contract IST
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Operations Automation Team Kickoff Meeting.
EGEE is a project funded by the European Union under contract IST ARDA Project Status Massimo Lamanna ARDA Project Leader NA4/HEP Cork, 19.
ATLAS Distributed Analysis Dietrich Liko IT/GD. Overview  Some problems trying to analyze Rome data on the grid Basics Metadata Data  Activities AMI.
Enabling Grids for E-sciencE CMS/ARDA activity within the CMS distributed system Julia Andreeva, CERN On behalf of ARDA group CHEP06.
EGEE is a project funded by the European Union under contract IST “The LCG ARDA prototypes” Workshop summary Organised by ARDA and the gLite.
INFSO-RI Enabling Grids for E-sciencE gLite Test and Certification Effort Nick Thackray CERN.
Organisation of HEP Applications within NA4 F Harris (Oxford/CERN) EGEE is proposed as a project funded by the European Union under contract IST
WLCG Status Report Ian Bird Austrian Tier 2 Workshop 22 nd June, 2010.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks EGEE Operations: Evolution of the Role of.
Ian Bird LCG Project Leader Status of EGEE  EGI transition WLCG LHCC Referees’ meeting 21 st September 2009.
ARDA Massimo Lamanna / CERN Massimo Lamanna 2 TOC ARDA Workshop Post-workshop activities Milestones (already shown in December)
EGEE is a project funded by the European Union under contract IST Issues from current Experience SA1 Feedback to JRA1 A. Pacheco PIC Barcelona.
EGEE is a project funded by the European Union under contract IST “ARDA status” Massimo Lamanna / CERN LCG-SC2, 13 August
EGEE is a project funded by the European Union under contract IST “The ARDA project: status report” Massimo Lamanna LCG PEB, 1 June
INFSO-RI Enabling Grids for E-sciencE EGEE is a project funded by the European Union under contract IST Report from.
Ian Bird, CERN WLCG Project Leader Amsterdam, 24 th January 2012.
GridPP2 Workshop – 5 March 2004 – Data Management DataGrid is a project funded by the European Union GridPP is funded by PPARC GridPP2: Metadata Management.
JRA1 Middleware re-engineering
Bob Jones EGEE Technical Director
INFNGRID Technical Board, Feb
James Casey, CERN IT-GD WLCG Workshop 1st September, 2007
(Prague, March 2009) Andrey Y Shevel
Regional Operations Centres Core infrastructure Centres
EGEE Middleware Activities Overview
JRA3 Introduction Åke Edlund EGEE Security Head
SA1 Execution Plan Status and Issues
Ian Bird GDB Meeting CERN 9 September 2003
Joint JRA1/JRA3/NA4 session
EGEE Review: Application Assessment of gLite
INFN-GRID Workshop Bari, October, 26, 2004
EGEE support for HEP and other applications
Readiness of ATLAS Computing - A personal view
Savannah to Jira Migration
Thoughts on Applications Area Involvement in ARDA
The ARDA Project status report
LCG middleware and LHC experiments ARDA project
LCG Operations Workshop, e-IRG Workshop
Monitoring of the infrastructure from the VO perspective
Presentation transcript:

EGEE is a project funded by the European Union under contract IST “The ARDA project” Massimo Lamanna / CERN on behalf of the LCG-ARDA project EGEE NA4 Meeting, July cern.ch/lcg

EGEE NA4 meeting: The ARDA project Massimo Lamanna 2 Contents “Historical” remarks The project in a nutshell ARDA-related workshops Highlights from the 4 experiment prototypes Conclusion

EGEE NA4 meeting: The ARDA project Massimo Lamanna 3 LCG ARDA working group recommendations circa end 2003 New service decomposition for a grid system  Strong influence of Alien system the Grid system developed by the ALICE experiments and used by a wide scientific community (not only HEP) Role of experience, existing technology…  Web service framework Interfacing to existing middleware to enable their use in the experiment frameworks Early deployment of (a series of) end-to-end prototypes to ensure functionality and coherence gLite Middleware ARDA project

EGEE NA4 meeting: The ARDA project Massimo Lamanna 4 End-to-end prototypes: why? Provide a fast feedback to the EGEE MW development team  Hit the road running! Avoid uncoordinated evolution of the middleware Coherence between users expectations and final product Experiments ready to benefit from the new MW as soon as possible  Hit the road running!! Frequent snapshots of the middleware available Expose the experiments (and the community in charge of the deployment) to the current evolution of the whole system Experiments system are very complex and still evolving Move forward towards new-generation real systems (analysis!)  Hit the road running!!! Prototypes should be exercised with realistic workload and conditions –No academic exercises or synthetic demonstrations –LHC experiments users absolutely required here!!! A lot of work (and useful software) is involved in current experiments data challenges: this will be used as a starting point –Adapt/complete/refactorise the existing: we do not need another system!

EGEE NA4 meeting: The ARDA project Massimo Lamanna 5 ARDA project in a nutshell ARDA is an LCG project whose main activity is to enable LHC analysis on the grid ARDA is coherently contributing to EGEE NA4 (using the entire CERN NA4-HEP resource) Use the grid software as it matures (EGEE project)  ARDA should be the key player in the evolution from LCG2 to the EGEE infrastructure  Complementary information to the LCG2 experience (e.g. Data challenges)  Provide early and continuous feedback (guarantee the software is what experiments expect/need)  Exposed to gLite since May 18 th Use the last years experience/components both from Grid projects (LCG, VDT, EDG) and experiments middleware/tools (Alien, Dirac, GAE, Octopus, Ganga, Dial,…)  Help in adapting/interfacing (direct help within the experiments)  Every experiment has different implementations of the standard services, but: Used mainly in production environments (Few expert users, coordinated activities)  ARDA Interface with the gLite middleware Verify (help to evolve to) such components to analysis environments –Many users (Robustness might be an issue) –Concurrent “read” actions (Performance will be more and more an issue) One prototype per experiment A Common Application Layer might emerge in future The emphasis is to enable each experiment to be ready to benefit from the new EGEE infrastructure! Provide a forum for discussion  Comparison on results/experience/ideas  Interaction with other projects  Organise ARDA workshops  Contribute to EGEE events Experiment interfaces Piergiorgio Cerello (ALICE) David Adams (ATLAS) Lucia Silvestris (CMS) Ulrik Egede (LHCb)

EGEE NA4 meeting: The ARDA project Massimo Lamanna 6 (ARDA) workshops  1 st ARDA workshop (January 2004 at CERN; open)  2 nd ARDA workshop (June at CERN; by invitation) “The first 30 days of EGEE middleware”  NA4 meeting mid July NA4/JRA1 and NA4/SA1 joint sessions organised by M. Lamanna and F. Harris  3 rd ARDA workshop (beginning of October 2004; open) 2-day meeting Cross fertilisation between ARDA workshops (HEP focused) and NA4 events (broader scope and larger community) New: Operations Emphasis: gLite

EGEE NA4 meeting: The ARDA project Massimo Lamanna 7 “The first 30 days of the EGEE middleware” ARDA workshop CERN: of June 2004 Monday, June 21  ARDA team / JRA1 team  ATLAS (Metadata database services for HEP experiments) Tuesday, June 22  LHCb (Experience in building Web Services for the Grid)  CMS (Data management) Wednesday, June 23  ALICE (Interactivity on the Grid)  Close out

EGEE NA4 meeting: The ARDA project Massimo Lamanna 8 “The first 30 days of the EGEE middleware” ARDA workshop Effectively, this is the 2 nd workshop (January ’04 workshop) Given the new situation:  Glite middleware becoming available  LCG ARDA project started  Experience + need of technical discussions New format:  “Small” (30-35 participants vs 150+ in January) To have it small, by invitation only…  ARDA team + experiments interfaces  EGEE Glite team (selected persons)  Experiments technical key persons  Technology experts  NA4/EGEE links (4 persons)  EGEE PTF chair Info on the web:  URL:

EGEE NA4 meeting: The ARDA project Massimo Lamanna 9 Activity with the experiments ALICE  Interactive access to the gLite grid services  Good progress (also shown as a demo in the ARDA workshop) ATLAS  High level analysis services for the experiments (DIAL) on top of the gLite infrastructure  Collaboration on the AMI metadata catalogue CMS  Detailed plan still being sorted out  Preliminary activity on metadata/provenance system (refDB) and exercising analysis software on gLite prototype (job execution + catalogues) LHCb  Adapt their “user interface” (GANGA) to interact with gLite (and support the evolution of the tool itself)  Collaboration on the LHCb metadata catalogue See D. Feichtinger talk in the JRA1/NA4 session

EGEE NA4 meeting: The ARDA project Massimo Lamanna 10 Present status Usable software made available as promised  We understand (and strongly support) the prototype model (“release early, release often” paradigm) We understand that “early” might imply “incomplete”  What the pre-production system should look like? See next slide Responsiveness of the JRA1 team  “High level” Prototype access is an extra load –we believe it pays off for the common goal (i.e. high quality gLite software)  Bug fixes / workarounds / discussions Good relationship, trust (developers working around the clock, positive reactions to input, constructive attitude!)

EGEE NA4 meeting: The ARDA project Massimo Lamanna 11 Where do we want to go from here (in the next ~ 3 months)? Present critical issues:  Stability of the gLite prototype  Availability of significant resources (o(100) CPU sites, at least 3 sites connected) to attract serious users  Effective data access to significant fraction of the experiments data store CASTOR storage element not yet available “Key” ROCs must join (some LCG Tier1s)  Coherent software distribution mechanism for the experiment software JRA1 session JRA1 and SA1 sessions SA1 session JRA1 session Look forward to useful discussions in Catania!

EGEE NA4 meeting: The ARDA project Massimo Lamanna 12 Conclusions Up and running Main tool: end-to-end prototype  Definition of the detailed programme of work  Contributions in the experiment-specific domain Playing with the Glite middleware Experience discussed (and augmented) within the workshop activity Catania workshop  Discussions NA4/JRA1  Discussions NA4/SA1 Stay tuned