LCG CCRC’08 Status WLCG Management Board November 27 th 2007

Slides:



Advertisements
Similar presentations
Data Management TEG Status Dirk Duellmann & Brian Bockelman WLCG GDB, 9. Nov 2011.
Advertisements

Ian Bird LCG Project Leader LHCC + C-RSG review. 2 Review of WLCG  To be held Feb 16 at CERN  LHCC Reviewers:  Amber Boehnlein  Chris.
CCRC’08 Jeff Templon NIKHEF JRA1 All-Hands Meeting Amsterdam, 20 feb 2008.
Risk Analysis & Management. Phases Initial Risk Assessment Risk Analysis Risk Management and Mitigation.
COMPGZ07 Project Management Presentations Graham Collins, UCL
LCG Milestones for Deployment, Fabric, & Grid Technology Ian Bird LCG Deployment Area Manager PEB 3-Dec-2002.
© L.A.C.E. Research Group, 2003 University of Cadiz Eudoxos Project Teaching Science with a Robotic Telescope EVALUATION OF THE EUDOXOS PROJECT The evaluation.
Atlanta Public Schools Project Management Framework Proposed to the Atlanta Board of Education to Complete AdvancED/SACS “Required Actions” January 24,
LHCC Comprehensive Review – September WLCG Commissioning Schedule Still an ambitious programme ahead Still an ambitious programme ahead Timely testing.
CCRC’08 Common Computing Readiness Challenge
SC4 Workshop Outline (Strong overlap with POW!) 1.Get data rates at all Tier1s up to MoU Values Recent re-run shows the way! (More on next slides…) 2.Re-deploy.
Integration Program Update Rob Gardner US ATLAS Tier 3 Workshop OSG All LIGO.
ATLAS Metrics for CCRC’08 Database Milestones WLCG CCRC'08 Post-Mortem Workshop CERN, Geneva, Switzerland June 12-13, 2008 Alexandre Vaniachine.
LCG Introduction John Gordon, SFTC GDB December 2 nd 2009.
DCIPS Implementation Project Plan Update Army G2 Intelligence Personnel Management Office (IPMO) April 6, 2009.
LCG Introduction John Gordon, STFC-RAL GDB September 9 th, 2008.
DATE POWER 2 INCOME JANUARY 100member X 25.00P2, FEBRUARY 200member X 25.00P5, MARCH 400member X 25.00P10, APRIL 800member.
WLCG Grid Deployment Board, CERN 11 June 2008 Storage Update Flavia Donno CERN/IT.
SC4 Planning Planning for the Initial LCG Service September 2005.
WLCG Tier1 [ Performance ] Metrics ~~~ Points for Discussion ~~~ WLCG GDB, 8 th July 2009.
LCG Introduction John Gordon, STFC GDB December14 th 2011.
Site Manageability & Monitoring Issues for LCG Ian Bird IT Department, CERN LCG MB 24 th October 2006.
CCRC’08 Monthly Update ~~~ WLCG Grid Deployment Board, 14 th May 2008 Are we having fun yet?
2011 Calendar Important Dates/Events/Homework. SunSatFriThursWedTuesMon January
SunSatFriThursWedTuesMon January
WLCG Planning Issues GDB June Harry Renshall, Jamie Shiers.
CERN IT Department CH-1211 Genève 23 Switzerland t Streams Service Review Distributed Database Workshop CERN, 27 th November 2009 Eva Dafonte.
Data Transfer Service Challenge Infrastructure Ian Bird GDB 12 th January 2005.
DJ: WLCG CB – 25 January WLCG Overview Board Activities in the first year Full details (reports/overheads/minutes) are at:
Report from GSSD Storage Workshop Flavia Donno CERN WLCG GDB 4 July 2007.
LCG Accounting Update John Gordon, CCLRC-RAL WLCG Workshop, CERN 24/1/2007 LCG.
Data management demonstrators Ian Bird; WLCG MB 18 th January 2011.
Storage Interfaces and Access pre-GDB Wahid Bhimji University of Edinburgh On behalf of all those who participated.
CCRC – Conclusions from February and update on planning for May Jamie Shiers ~~~ WLCG Overview Board, 31 March 2008.
FTS monitoring work WLCG service reliability workshop November 2007 Alexander Uzhinskiy Andrey Nechaevskiy.
LCG Service Challenges SC2 Goals Jamie Shiers, CERN-IT-GD 24 February 2005.
CLIC - CDR Status (Volume 2) Hermann Schmickler, ILCW2010.
Handling of T1D0 in CCRC’08 Tier-0 data handling Tier-1 data handling Experiment data handling Reprocessing Recalling files from tape Tier-0 data handling,
Victoria, Sept WLCG Collaboration Workshop1 ATLAS Dress Rehersals Kors Bos NIKHEF, Amsterdam.
Last update: 03/03/ :37 LCG Grid Technology Area Quarterly Status & Progress Report SC2 February 6, 2004.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Ian Bird All Activity Meeting, Sofia
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
Enabling Grids for E-sciencE INFSO-RI Enabling Grids for E-sciencE Gavin McCance GDB – 6 June 2007 FTS 2.0 deployment and testing.
SRM v2.2 Production Deployment SRM v2.2 production deployment at CERN now underway. – One ‘endpoint’ per LHC experiment, plus a public one (as for CASTOR2).
1 Proposal for a technical discussion group  Because...  We do not have a forum where all of the technical people discuss the critical.
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
WLCG Collaboration Workshop 21 – 25 April 2008, CERN Remaining preparations GDB, 2 nd April 2008.
CIIMS Proposal for TOP-003 Approach Stacen Tyskiewicz WECC CIIMS Chair March 22, 2016.
SLIDE 1 Power Of Choice Metering Competition Pre-Final Rule Determination Workshop #2 24 th September 2015 FINAL.
Supervised teaching experience (STE) – an introduction and overview.
LCG Introduction John Gordon, STFC-RAL GDB June 11 th, 2008.
Dario Barberis: ATLAS DB S&C Week – 3 December Oracle/Frontier and CondDB Consolidation Dario Barberis Genoa University/INFN.
LCG Introduction John Gordon, STFC-RAL GDB November 7th, 2007.
Study of WLCG Incidents – A Proposal
Operations Coordination Team Maria Girone, CERN IT-ES GDB, 11 July 2012.
Jeremy Coles, STFC-RAL GDB April 4, 2007
David Kelsey CCLRC/RAL, UK
Database Readiness Workshop Intro & Goals
CIIMS Proposal for TOP-003 Approach
The CREAM CE: When can the LCG-CE be replaced?
WLCG Service Interventions
CCRC’08: Follow-up Actions
John Gordon, STFC-RAL GDB March 11, 2009
John Gordon, STFC-RAL GDB April 8th 2009
Key Information Summary (KIS)
Computing Overview Topics here: CSA lessons (briefly) PADA
13-block rotation schedule
2015 January February March April May June July August September
Presentation transcript:

LCG CCRC’08 Status WLCG Management Board November 27 th 2007

CHEP 2007 LCG Overview Conclude on scaling factors – done Conclusions on scope / scale of February challenge (resource limited)  We have feedback from the sites and can now work this out: (partial) reprocessing at sites with sufficient resources; read pass over data files including calibration DB lookup for those without  Conclude on SRM v2.2 storage setup details  Experiments to come with details on storage classes by Tier at December F2F  This will defined what is available for pre-challenge testing in January and the February challenge itself – iteration possible prior to May – practical experience certainly needed  ‘Walk-throughs’ by experiments of ‘blocks’, emphasising “Critical Services” involved and appropriate scaling factors  Details on next slide (hidden) – this is perhaps best combined with the above?  Essential for sites to understand which are the services involved and the necessary parameters for sizing / configuring the services appropriately  Also needed to understand how well we do wrt the 2008 requirements  Monitoring, logging and reporting the (progress of the) challenge  First discussion during this week’s WLCG Service Reliability workshop, conclude during F2F and GDB (possible iteration in January?)  CDR challenge in December – splitting out ‘temporary’ (challenge) and permanent data CDR challenge in December  Other tests that can be done prior to February??  De-scoping? How do we negotiate this if required?

October 9, 2007 M.Kasemann CCRC f2f planning meeting 4/10 CCRC’08 – Proposed Schedule Phase 1 - February 2008: –Possible scenario: blocks of functional tests, Try to reach 2008 scale for tests at… 1.CERN: data recording, processing, CAF, data export 2.Tier-1’s: data handling (import, mass-storage, export), processing, analysis 3.Tier-2’s: Data Analysis, Monte Carlo, data import and export  Experiments have been asked to present these ‘blocks’ in detail at December CCRC’08 planning meeting, including services (WLCG, experiment) involved as well as corresponding ‘scaling factors’  Resource availability at sites expected to limit scope / scale of challenge (e.g. not all sites will have full 2008 resources in production by then – no / reduced re-processing pass at these – e.g. read each event in the file including a conditions DB lookup?) Phase 2: Duration of challenge: 1 week setup, 4 weeks challenge Ideas: Use January (pre-)GDB to review metric, tools to drive tests and monitoring tools –This means that we must preview the metric etc already in December meeting – more later!  Use March GDB to analysis CCRC phase 1  Launch the challenge at the WLCG workshop (April 21-25, 2008)  Schedule a mini-workshop after the challenge to summarize and extract lessons learned (June 12/13 in IT amphitheatre or Council Chamber)  Document performance and lessons learned within 4 weeks. Recent CSA07 experience ‘suggests’ doing these things concurrently is indeed harder than separately, e.g. load on storage due to transfers + production

CHEP 2007 LCG So What Happens When There Are Problems?  We know well that a challenge of this scale is most unlikely to proceed without any incident / problem whatsoever  But this is a Common Challenge – by all of us, for all of us – together!  When problems arise we must report them openly and work on them systematically, using the mechanisms that have been shown to work  We have already agreed and scheduled meetings / workshops to analyze the results of the challenges – and to write up the results – but this is a somewhat longer term view…

CHEP 2007 LCG Summary  We are on track with planning / preparations  It is important that we make good progress during the December F2F  Start asap regular calls with A-P to ensure they are up to speed with status of planning and their own preparations  Thursday December 6th is the proposed date for 1 st call Thursday December 6th  Problems are inevitable – if we cannot go over them or through them, then we need to go around them