Cosener’s House – 30 th Jan’031 LHCb Progress & Plans Nick Brook University of Bristol News & User Plans Technical Progress Review of deliverables.

Slides:



Advertisements
Similar presentations
Andrew McNab - Manchester HEP - 17 September 2002 Putting Existing Farms on the Testbed Manchester DZero/Atlas and BaBar farms are available via the Testbed.
Advertisements

ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
LHCb Computing Activities in UK Current activities UK GRID activities RICH s/w activities.
Reporting of the Experiments Follow procedures set up for technical WP of EDG Spreadsheet report man month effort Pro-forma reply sheet Pro-forma sheet.
NIKHEF Testbed 1 Plans for the coming three months.
GRID DATA MANAGEMENT PILOT (GDMP) Asad Samar (Caltech) ACAT 2000, Fermilab October , 2000.
Production Planning Eric van Herwijnen Thursday, 20 june 2002.
K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.
Magda – Manager for grid-based data Wensheng Deng Physics Applications Software group Brookhaven National Laboratory.
1 Bridging Clouds with CernVM: ATLAS/PanDA example Wenjing Wu
11 Dec 2000F Harris Datagrid Testbed meeting at Milan 1 LHCb ‘use-case’ - distributed MC production
Exploiting the Grid to Simulate and Design the LHCb Experiment K Harrison 1, N Brook 2, G Patrick 3, E van Herwijnen 4, on behalf of the LHCb Grid Group.
Bookkeeping data Monitoring info Get jobs Site A Site B Site C Site D Agent Production service Monitoring service Bookkeeping service Agent © Andrei Tsaregorodtsev.
K. Harrison CERN, 15th May 2003 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Development strategy - Ganga prototype - Release plans - Conclusions.
CMS Report – GridPP Collaboration Meeting VI Peter Hobson, Brunel University30/1/2003 CMS Status and Plans Progress towards GridPP milestones Workload.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
K.Harrison CERN, 21st November 2002 GANGA: GAUDI/ATHENA AND GRID ALLIANCE - Background and scope - Project organisation - Technology survey - Design -
LCG-France, 22 July 2004, CERN1 LHCb Data Challenge 2004 A.Tsaregorodtsev, CPPM, Marseille LCG-France Meeting, 22 July 2004, CERN.
3 Sept 2001F HARRIS CHEP, Beijing 1 Moving the LHCb Monte Carlo production system to the GRID D.Galli,U.Marconi,V.Vagnoni INFN Bologna N Brook Bristol.
LHCb Applications and GRID Integration Domenico Galli Catania, April 9, st INFN-GRID Workshop.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
SLICE Simulation for LHCb and Integrated Control Environment Gennady Kuznetsov & Glenn Patrick (RAL) Cosener’s House Workshop 23 rd May 2002.
12th November 2003LHCb Software Week1 UK Computing Glenn Patrick Rutherford Appleton Laboratory.
Nick Brook Current status Future Collaboration Plans Future UK plans.
1 DIRAC – LHCb MC production system A.Tsaregorodtsev, CPPM, Marseille For the LHCb Data Management team CHEP, La Jolla 25 March 2003.
LHCb and DataGRID - the workplan for 2001 Eric van Herwijnen Wednesday, 28 march 2001.
4th February 2004GRIDPP91 LHCb Development Glenn Patrick Rutherford Appleton Laboratory.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
MAGDA Roger Jones UCL 16 th December RWL Jones, Lancaster University MAGDA  Main authors: Wensheng Deng, Torre Wenaus Wensheng DengTorre WenausWensheng.
Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
LHCb planning for DataGRID testbed0 Eric van Herwijnen Thursday, 10 may 2001.
29 May 2002Joint EDG/WP8-EDT/WP4 MeetingClaudio Grandi INFN Bologna LHC Experiments Grid Integration Plans C.Grandi INFN - Bologna.
RAL Site Report John Gordon IT Department, CLRC/RAL HEPiX Meeting, JLAB, October 2000.
WP8 Meeting Glenn Patrick1 LHCb Grid Activities in UK Grid WP8 Meeting, 16th November 2000 Glenn Patrick (RAL)
1 LCG-France sites contribution to the LHC activities in 2007 A.Tsaregorodtsev, CPPM, Marseille 14 January 2008, LCG-France Direction.
The Experiments – progress and status Roger Barlow GridPP7 Oxford 2 nd July 2003.
…building the next IT revolution From Web to Grid…
T3 analysis Facility V. Bucard, F.Furano, A.Maier, R.Santana, R. Santinelli T3 Analysis Facility The LHCb Computing Model divides collaboration affiliated.
Author: Andrew C. Smith Abstract: LHCb's participation in LCG's Service Challenge 3 involves testing the bulk data transfer infrastructure developed to.
Grid User Interface for ATLAS & LHCb A more recent UK mini production used input data stored on RAL’s tape server, the requirements in JDL and the IC Resource.
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Presenter Name Facility Name UK Testbed Status and EDG Testbed Two. Steve Traylen GridPP 7, Oxford.
UK Grid Meeting Glenn Patrick1 LHCb Grid Activities in UK Grid Prototype and Globus Technical Meeting QMW, 22nd November 2000 Glenn Patrick (RAL)
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
Bookkeeping Tutorial. 2 Bookkeeping content  Contains records of all “jobs” and all “files” that are produced by production jobs  Job:  In fact technically.
K. Harrison CERN, 3rd March 2004 GANGA CONTRIBUTIONS TO ADA RELEASE IN MAY - Outline of Ganga project - Python support for AJDL - LCG analysis service.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
LHCb Data Challenge in 2002 A.Tsaregorodtsev, CPPM, Marseille DataGRID France meeting, Lyon, 18 April 2002.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
LHCb GRID Meeting 11/12 Sept Sept LHCb-GRID T. Bowcock 2 AGENDA 9:30 LHCb MC Production –Points SICB Processing Req. Data Storage Data Transfer.
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL DOE/NSF Review of US LHC Software and Computing Fermilab Nov 29, 2001.
Distributed Analysis Tutorial Dietrich Liko. Overview  Three grid flavors in ATLAS EGEE OSG Nordugrid  Distributed Analysis Activities GANGA/LCG PANDA/OSG.
GAG meeting, 5 July 2004, CERN1 LHCb Data Challenge 2004 A.Tsaregorodtsev, Marseille N. Brook, Bristol/CERN GAG Meeting, 5 July 2004, CERN.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
Moving the LHCb Monte Carlo production system to the GRID
DIRAC Production Manager Tools
Gridifying the LHCb Monte Carlo simulation system
Job workflow Pre production operations:
D. Galli, U. Marconi, V. Vagnoni INFN Bologna N. Brook Bristol
The Ganga User Interface for Physics Analysis on Distributed Resources
LHCb Distributed Computing and the Grid V. Vagnoni (INFN Bologna)
R. Graciani for LHCb Mumbay, Feb 2006
Gridifying the LHCb Monte Carlo production system
Status and plans for bookkeeping system and production tools
Short to middle term GRID deployment plan for LHCb
Production Manager Tools (New Architecture)
Production client status
The LHCb Computing Data Challenge DC06
Presentation transcript:

Cosener’s House – 30 th Jan’031 LHCb Progress & Plans Nick Brook University of Bristol News & User Plans Technical Progress Review of deliverables

Cosener’s House – 30 th Jan’032 Xmas MC production 4.4M event produced over Xmas All 8 UK institutes participated UK produced ~1/3 of the events UK produced ~40% of events produced outside of CERN All DST data copied back to CERN Data currently stored at some production sites (Cambridge, RAL & ScotGrid) DataGrid just another “site”

Cosener’s House – 30 th Jan’033 Xmas Production 4.4M event produced over Xmas correspond to < 1Tb of DSTs If required the whole of the DSTs produced can reside on disk at RAL Data transfer tools have been (and still are) being developed at CERN – production centre manager tool New book-keeping database available that allows replica dataset also to be stored Should be able to generate files that need to be replicated to local site from DB Should be able to generate file i/p “opt” files from DB for each site

Cosener’s House – 30 th Jan’034 Data Challenge & Summer analysis Data Challenge due to commence Feb (for 3 months)  10-20M events Unlikely all DSTs will be available on disk at RAL (but might.) Need to use MSS at RAL ?? LHCb UK investigating “namespce” convention to allow long name (i.e. disk file type name) access to data. Investigation of tools from BaBar – ATLAS involvement as well

Cosener’s House – 30 th Jan’035 Production Server New LHCb Monte Carlo production system (DIRAC) Local Temp Storage Batch/GRID Front End Node Batch/GRID Front End Node Remote Grid Storage Production Manager via Monitoring Client Production Server Gennady Kuznetsov

Cosener’s House – 30 th Jan’036 MC production architecture Edit Prod.Mgr Work flow Editor Production Editor Instantiate Workflow Job request Status updates Production Agent Production data Scripts Production DB Production Server Bookkeeping info Bookkeeping Updates

Cosener’s House – 30 th Jan’037 Production agent n Job Batch farm Production Agent bbftp Storage Castor Job request Job status update Bookkeeping info Production center Submit job Log files Histo files Data files Transfer data BK files Check data Software installation Job status update

Cosener’s House – 30 th Jan’038 GRID GRID or local Batch Job Agent Job Job Agent Job Job Agent Job Monitoring Client JB Container Java Bean Production Server Object DBase Site service JAR (Static) Agent service JAR (Dynamic) Job service JAR (Dynamic) Application service JAR (Static) Statefull session via JRMI / CORBA Stateless session via JRMI / CORBA Database persistence via JDBC JMS or SOAP messaging service LHCb Monitoring and control tools

Cosener’s House – 30 th Jan’039 Production with DataGrid Edit Prod.Mgr Work flow Editor Production Editor Instantiate Workflow Job request Status updates DataGRID CE Production data Scripts Production DB Production Server Bookkeeping info Bookkeeping Updates Input sandbox: Job+ProdAge nt DataGRID Agent

Cosener’s House – 30 th Jan’0310 Agent on DG worker node Job Production Agent bbftp Storage (SE) Castor Job request Job status update Bookkeeping info DataGRID worker Activate job Log files Histo files Data files Transfer data BK files Check data Software installation Job status update

Cosener’s House – 30 th Jan’0311 POOL activities Catalog & Grid work package Provided file catalog browser (PYTHON) Code submitted to CVS repository Carmine Cioffi

Cosener’s House – 30 th Jan’0312 GANGA - activities Karl Harrison & Alexander Soroko Demonstration later today – see Alexander’s talk Fortnightly telephone meetings – CERN/UK/LBL Web site exists – Close working relationship with LCG PI project & US Grappa project

Cosener’s House – 30 th Jan’0313 Deliverable Review LHC experiments will be an integral part of the CERN LCG project LCG currently defined “middleware” to appear on their testbed LHCb UK hope to re-align deliverables with LCG Will review the situation ~March First “public” release of LCG facilities – July’03