InterGrid Meeting 7 Oct 2001 Tony Doyle. Tony Doyle - University of Glasgow GridPP Status  Financial Background  Deliverables  Recruitment  Regional.

Slides:



Advertisements
Similar presentations
S.L.LloydATSE e-Science Visit April 2004Slide 1 GridPP – A UK Computing Grid for Particle Physics GridPP 19 UK Universities, CCLRC (RAL & Daresbury) and.
Advertisements

S.L.LloydGridPP Collaboration Meeting Introduction Slide 1 GridPP - Introduction Welcome to the First GridPP Collaboration Meeting Introduction A brief.
Fabric and Storage Management GridPP Fabric and Storage Management GridPP 24/24 May 2001.
GridPP Funding Model(s) D. Britton Imperial College 24/5/01 £21m + £5m.
Tony Doyle GridPP2 Specification Process Grid Steering Committee Meeting, MRC, London, 18 February 2004.
Particle physics – the computing challenge CERN Large Hadron Collider –2007 –the worlds most powerful particle accelerator –10 petabytes (10 million billion.
S.L.LloydGridPP9 IntroductionSlide 1 Introduction Welcome to the 9 th GridPP Collaboration Meeting Dissemination Officer GridPP2 Posts Tier-2 Centres Steve.
GridPP Presentation to PPARC Grid Steering Committee 26 July 2001 Steve Lloyd Tony Doyle John Gordon.
Tony Doyle GridPP2 Proposal, BT Meeting, Imperial, 23 July 2003.
Steve Lloyd Tony Doyle GridPP Presentation to PPARC e-Science Committee 31 May 2001.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
16 th Oct’02Nick Brook – University of Bristol1 News Nick Brook University of Bristol PMB News Feedback from “review” LCG News.
S.L.LloydGridPP CB 4 December 2003Slide 1 Agenda 1.Minutes of Previous Meeting (19 Feb 2003) 2.Matters Arising 3.Announcements (Steve) 4.GridPP2 Proposal.
S.L.LloydGridPP CB Meeting 23 October 2001Slide 1 AGENDA 1.Minutes of meeting held on 25 July GridPP Management 3.GridPP Status 4.GridPP Finances.
15 May 2006Collaboration Board GridPP3 Planning Executive Summary Steve Lloyd.
Reporting of the Experiments Follow procedures set up for technical WP of EDG Spreadsheet report man month effort Pro-forma reply sheet Pro-forma sheet.
Andrew McNab - Manchester HEP - 2 May 2002 Testbed and Authorisation EU DataGrid Testbed 1 Job Lifecycle Software releases Authorisation at your site Grid/Web.
Andrew McNab - Manchester HEP - 22 April 2002 EU DataGrid Testbed EU DataGrid Software releases Testbed 1 Job Lifecycle Authorisation at your site More.
Nick Brook University of Bristol The LHC Experiments & Lattice EB News Brief overview of the expts  ATLAS  CMS  LHCb  Lattice.
Deployment Board Introduction David Kelsey 29 Oct 2004
EGEE statement EU and EU member states major investment in Grid Technology Several good prototype results Next Step: –Leverage current and planned national.
S.L.LloydGridPP CB 29 Oct 2002Slide 1 Agenda 1.Introduction – Steve Lloyd 2.Minutes of Previous Meeting (23 Oct 2001) 3.Matters Arising 4.Project Leader's.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
1st Project Management Board Meeting 3 Sep 2001 Tony Doyle.
GridPP Steve Lloyd, Chair of the GridPP Collaboration Board.
October 24, 2000Milestones, Funding of USCMS S&C Matthias Kasemann1 US CMS Software and Computing Milestones and Funding Profiles Matthias Kasemann Fermilab.
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
GridPP9 – 5 February 2004 – Data Management DataGrid is a project funded by the European Union GridPP is funded by PPARC WP2+5: Data and Storage Management.
CMS Report – GridPP Collaboration Meeting VI Peter Hobson, Brunel University30/1/2003 CMS Status and Plans Progress towards GridPP milestones Workload.
S.L.LloydGridPP CB 19 February 2003Slide 1 Agenda 1.Minutes of Previous Meeting (29 Oct 2002) 2.Matters Arising 3.GridPP2 Planning 4.EGEE 5.Any Other Business.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Tony Doyle - University of Glasgow 12 January 2005Collaboration Board Beyond GridPP2 Tony Doyle.
Tony Doyle GridPP – From Prototype To Production, GridPP10 Meeting, CERN, 2 June 2004.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
DataGrid Applications Federico Carminati WP6 WorkShop December 11, 2000.
Robin Middleton RAL/PPD DG Co-ordination Rome, 23rd June 2001.
Nick Brook Current status Future Collaboration Plans Future UK plans.
GRID IIII D UK Particle Physics GridPP Collaboration meeting - R.P.Middleton (RAL/PPD) 23-25th May Grid Monitoring Services Robin Middleton RAL/PPD24-May-01.
The Technical Side John Gordon. John Gordon - RAL Outline  How will we manage the techncal side of the project?  Formal Structure  Pragmatic Structure.
3 June 2004GridPP10Slide 1 GridPP Dissemination Sarah Pearce Dissemination Officer
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
7April 2000F Harris LHCb Software Workshop 1 LHCb planning on EU GRID activities (for discussion) F Harris.
GridPP Collaboration meeting Manchester 9/10 May 2002 P.Clarke Resource Management: Instruments and Procedures Testbed Rollout: Development of Plan Education.
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
LCG LHC Computing Grid Project – LCG CERN – European Organisation for Nuclear Research Geneva, Switzerland LCG LHCC Comprehensive.
GridPP Presentation to AstroGrid 13 December 2001 Steve Lloyd Queen Mary University of London.
GridPP Building a UK Computing Grid for Particle Physics Professor Steve Lloyd, Queen Mary, University of London Chair of the GridPP Collaboration Board.
GRID IIII D UK Particle Physics Tony Doyle - University of Glasgow GridPP Status Report  Executive Summary  News  “Unfunded” EU DataGrid Posts  Shadow.
October 30, 2001ATLAS PCAP1 LHC Computing at CERN and elsewhere The LHC Computing Grid Project as approved by Council, on September 20, 2001 M Kasemann,
…building the next IT revolution From Web to Grid…
Tony Doyle - University of Glasgow 8 July 2005Collaboration Board Meeting GridPP Report Tony Doyle.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
GridPP Collaboration Meeting 5 Nov 2001 Tony Doyle.
1CHEP2000 February 2000F. Gagliardi EU HEP GRID Project Fabrizio Gagliardi
November 27, 2001DOE/NSF review of US LHC S&C projects1 The Software and Computing Committee (SC2) in the LHC Computing Grid Project M Kasemann, FNAL.
LHC Computing, SPC-FC-CC-C; H F Hoffmann1 CERN/2379/Rev: Proposal for building the LHC computing environment at CERN (Phase 1) Goals of Phase.
CERN 1 DataGrid Architecture Group Bob Jones CERN.
Dave Newbold, University of Bristol14/8/2001 Testbed 1 What is it? First deployment of DataGrid middleware tools The place where we find out if it all.
12 March, 2002 LCG Applications Area - Introduction slide 1 LCG Applications Session LCG Launch Workshop March 12, 2002 John Harvey, CERN LHCb Computing.
14 June 2001LHCb workshop at Bologna1 LHCb and Datagrid - Status and Planning F Harris(Oxford)
10-Feb-00 CERN HepCCC Grid Initiative ATLAS meeting – 16 February 2000 Les Robertson CERN/IT.
Bob Jones EGEE Technical Director
Ian Bird GDB Meeting CERN 9 September 2003
Grid related projects CERN openlab LCG EDG F.Fluckiger
UK GridPP Tier-1/A Centre at CLRC
Fabric and Storage Management
UK Testbed Status Testbed 0 GridPP project Experiments’ tests started
Collaboration Board Meeting
LHC Computing, RRB; H F Hoffmann
Presentation transcript:

InterGrid Meeting 7 Oct 2001 Tony Doyle

Tony Doyle - University of Glasgow GridPP Status  Financial Background  Deliverables  Recruitment  Regional Centres  Information Flow  Technical Structure  Project management Board

Tony Doyle - University of Glasgow £17m 3-Year Project I: £2.49m  £1.2m Experiment Objectives H*: 5.4% H: 3.2% Software Support G: Prototype Grid 9.7% F* 1.5% F 1.9% CERN J 2.6% E 1.7% D* 1.5% D 2.7% C* 0.6% C 1.1% B* 1.9% B 1.5% A* 0.4% A 1.4% UK Managers 1.9% UK Capital Work Groups A - F £7.1m  £6.7m  £6.0m £3.2  £2.9  £2.45m 90.0%

Tony Doyle - University of Glasgow Major Deliverables  Prototype IMar 2002  Performance and scalability testing of components of the computing fabric (clusters, disk storage, mass storage system, system installation, system monitoring) using straightforward physics applications. Testing of the job scheduling and data replication software from the first DataGrid release (M9).  Prototype IIMar 2003  Prototyping of the integrated local computing fabric, with emphasis on scaling, reliability and resilience to errors. Performance testing of LHC applications. Distributed HEP and other science application models using the second DataGrid release (M21).  Prototype IIIMar 2004  Full scale testing of the LHC computing model with fabric management and Grid management software for Tier-0 and Tier-1 centres, with some Tier-2 components. This will use the software from the final DataGrid release (M33). M9 important: working demonstrators (public spending review) need to ensure key areas are visible

Tony Doyle - University of Glasgow First Year Finances  Funding of PPARC's EU DataGrid staff commitment  Staff to implement initial Grid Testbed in UK  Hardware to satisfy BaBar requirements and EU DataGrid testbed commitment  Staff for CERN LHC computing  Contribution to CERN Tier-0  15 EU DataGrid 3 year posts (already committed) £0.4M  15 GridPP 3 year posts £0.4M  Hardware for BaBar Tier-A/LHC Tier-1 £0.9M  15 CERN 3 year posts £0.5M  Hardware for CERN Tier-0 £0.3M Total £2.5M (Staff costs assume only 6 months of salary in first year) Sets a short-term agenda… complete allocation by December

Tony Doyle - University of Glasgow First Year Deliverables Each Workgroup has detailed deliverables. These will be refined each year and build on the successes of the previous year. The Global Objectives for the first year are:  Deliver EU DataGrid Middleware (First prototype [M9])  Running experiments to integrate their data management systems into existing facilities (e.g. mass storage)  Assessment of technological and sociological Grid analysis needs  Experiments refine data models for analyses  Develop tools to allow bulk data transfer  Assess and implement metadata definitions  Develop relationships across multi-Tier structures and countries  Integrate Monte Carlo production tools  Provide experimental software installation kits  LHC experiments start Data Challenges  Feedback assessment of middleware tools

Tony Doyle - University of Glasgow “two legs good three legs better?” UK ++ Build on Existing Structures. Identify Common Requirements. Establish Group Identity. Reach Out.

Tony Doyle - University of Glasgow Recruitment Timetable  8th October - EB input deadline (just after GGF3).  19th October - TAG assessment document  26th October - PMB definition of tasks inc. allocation of posts to Working Groups  - first review of CERN posts  2nd November - Tender document  5-6th November - Collaboration Meeting  30th November- Deadline for submission  7th December - PRSC mtg.  14th December- summary document submitted to PPARC  outcomes communicated to groups  - second review of CERN posts

Tony Doyle - University of Glasgow Regional Centres SRIF Infrastructure Local Perspective: Consolidate Research Computing Optimisation of Number of Nodes? 4 Relative size dependent on funding dynamics Global Perspective: V. Basic Grid Skeleton

Tony Doyle - University of Glasgow Information Flow

Tony Doyle - University of Glasgow GridPP Team Dissemination/ Collaborations (Roger Jones) Software ExperimentsTestbed Support (Nick Brook)(Dave Newbold) (Andrew McNab) Workload Information ServicesMonitoring Mass Storage Managementand Services and (Dave Colling) Data Management (Steve Fisher) Fabric Management (Alex Martin) (John Gordon) SecurityNetworking (Dave Kelsey) (Pete Clarke) CERN (Les Robertson) = Basis for Technical Information Flow?...Technical Task Force

Tony Doyle - University of Glasgow Technical Board Structure? Experiments Networking Security, Networking “Site Management” Fabric Management Mass Storage “Grid Management” Workload Management Data Management Information Services Monitoring Services “Testbed” Prototype Grid, Software Support KEY: Build on DataGrid - merge groups naturally... Expand experiments’ role via Pilot developments KEY: Build on DataGrid - merge groups naturally... Expand experiments’ role via Pilot developments Optimisation of Number of Groups?

Tony Doyle - University of Glasgow Demonstrators real world... …simulated world We need both.. M9 + web-based interfaces… We need both.. M9 + web-based interfaces…

Tony Doyle - University of Glasgow GridPP Year Book

Tony Doyle - University of Glasgow Technical Planning …next collab meeting (M11) Need to monitor progress… 3-month report = requirement of all GridPP posts

Tony Doyle - University of Glasgow Project Management Board  Project Leader Tony Doyle  Deputy Project Leader John Gordon  Chair of the CB Steve Lloyd  Technical Board Pete Clarke  EU DataGrid-UK Leader Robin Middleton  Resource Manager Dave Britton  Experiments Chair Nick Brook  Experiments Deputy Roger Barlow  CERN Liaison Les Robertson  e-Science Director (in Att) Neil Geddes  Final PMB structure determined by appointment...  Working methods determined quickly via 1 day meeting in Sept...

Tony Doyle - University of Glasgow PMB Meetings  Frequency - once per week (fixed weekly slot, e.g. 1pm)  Agenda circulated 3 hours before (10am) - web page with links  Duration - 1 hour, via multi-site VC, guillotined  Chair - Project Leader  Agenda items sent to PL = heading + proposed outcome  Order of business determined by Chair  Draft minutes later that day  Minutes of all meetings available via web 2 days later  Actions listed as e.g.  No.DescriptionInitiated WhoTargetCompleted  1.1 meeting web site Aug 20 TBDAug 26Aug 26  Actions ordered by completed, short-term, long-term (requiring periodic updates)  Review meeting methods formally after 3 months - external CB report?

Tony Doyle - University of Glasgow Summary  Learning to crawl…  … quickly  First Priority: EU DataGrid  Next Priority: Integration with experiments  Need to respond rapidly to external input  Implementation of final GridPP structure  Definition of scope of Collaboration…  Medium Term (M9):  Importance of Demonstrators  First steps…  Proposal (2/4/01)  DataGrid posts (25/5/01)  1st Collab. Mtg. (23-24/5/01)  Addendum (13/7/01)  Expts. Board (NB, 24/7/01)  Collab. Board (SL, 25/7/01)  PMB (TD, 1/9/01)  Technical Board  CERN posts (11/01..)  2nd Collab. Mtg. (5-6/11/01)  GridPP posts (1/02..)