Sep 6 2006Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova.

Slides:



Advertisements
Similar presentations
GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
Advertisements

B A B AR and the GRID Roger Barlow for Fergus Wilson GridPP 13 5 th July 2005, Durham.
Introduction to CMS computing CMS for summer students 7/7/09 Oliver Gutsche, Fermilab.
Amber Boehnlein, FNAL D0 Computing Model and Plans Amber Boehnlein D0 Financial Committee November 18, 2002.
Proposal for dCache based Analysis Disk Pool for CDF presented by Doug Benjamin Duke University on behalf of the CDF Offline Group.
Workload Management Massimo Sgaravatto INFN Padova.
22/04/2005Donatella Lucchesi1 CDFII Computing Status OUTLINE:  New CDF-Italy computing group organization  Usage status at FNAL and CNAF  Towards GRID:
Alexandre A. P. Suaide VI DOSAR workshop, São Paulo, 2005 STAR grid activities and São Paulo experience.
LcgCAF:CDF submission portal to LCG Federica Fanzago for CDF-Italian Computing Group Gabriele Compostella, Francesco Delli Paoli, Donatella Lucchesi, Daniel.
Remote Production and Regional Analysis Centers Iain Bertram 24 May 2002 Draft 1 Lancaster University.
CDF data production models 1 Data production models for the CDF experiment S. Hou for the CDF data production team.
Building a distributed software environment for CDF within the ESLEA framework V. Bartsch, M. Lancaster University College London.
BINP/GCF Status Report BINP LCG Site Registration Oct 2009
F.Fanzago – INFN Padova ; S.Lacaprara – LNL; D.Spiga – Universita’ Perugia M.Corvo - CERN; N.DeFilippis - Universita' Bari; A.Fanfani – Universita’ Bologna;
INTRODUCTION The GRID Data Center at INFN Pisa hosts a big Tier2 for the CMS experiment, together with local usage from other HEP related/not related activities.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
Nick Brook Current status Future Collaboration Plans Future UK plans.
LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
A Design for KCAF for CDF Experiment Kihyeon Cho (CHEP, Kyungpook National University) and Jysoo Lee (KISTI, Supercomputing Center) The International Workshop.
Interactive Job Monitor: CafMon kill CafMon tail CafMon dir CafMon log CafMon top CafMon ps LcgCAF: CDF submission portal to LCG resources Francesco Delli.
SAMGrid as a Stakeholder of FermiGrid Valeria Bartsch Computing Division Fermilab.
CDF Grid at KISTI 정민호, 조기현 *, 김현우, 김동희 1, 양유철 1, 서준석 1, 공대정 1, 김지은 1, 장성현 1, 칸 아딜 1, 김수봉 2, 이재승 2, 이영장 2, 문창성 2, 정지은 2, 유인태 3, 임 규빈 3, 주경광 4, 김현수 5, 오영도.
11 December 2000 Paolo Capiluppi - DataGrid Testbed Workshop CMS Applications Requirements DataGrid Testbed Workshop Milano, 11 December 2000 Paolo Capiluppi,
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
Instrumentation of the SAM-Grid Gabriele Garzoglio CSC 426 Research Proposal.
GridPP18 Glasgow Mar 07 DØ – SAMGrid Where’ve we come from, and where are we going? Evolution of a ‘long’ established plan Gavin Davies Imperial College.
International Workshop on HEP Data Grid Nov 9, 2002, KNU Data Storage, Network, Handling, and Clustering in CDF Korea group Intae Yu*, Junghyun Kim, Ilsung.
Movement of MC Data using SAM & SRM Interface Manoj K. Jha (INFN- Bologna) Gabriele Compostella, Antonio Cuomo, Donatella Lucchesi,, Simone Pagan (INFN.
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
Tier-2  Data Analysis  MC simulation  Import data from Tier-1 and export MC data CMS GRID COMPUTING AT THE SPANISH TIER-1 AND TIER-2 SITES P. Garcia-Abia.
1 LCG-France sites contribution to the LHC activities in 2007 A.Tsaregorodtsev, CPPM, Marseille 14 January 2008, LCG-France Direction.
16 September GridPP 5 th Collaboration Meeting D0&CDF SAM and The Grid Act I: Grid, Sam and Run II Rick St. Denis – Glasgow University Act II: Sam4CDF.
A Test Framework for Movement of MC Data using SAM & SRM Interface Manoj K. Jha (INFN- Bologna) Antonio Cuomo, Donatella Lucchesi, Gabriele Compostella,
Outline: Tasks and Goals The analysis (physics) Resources Needed (Tier1) A. Sidoti INFN Pisa.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
May Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova.
Outline: Status: Report after one month of Plans for the future (Preparing Summer -Fall 2003) (CNAF): Update A. Sidoti, INFN Pisa and.
SAM Overview (training session) for CDF Users Doug Benjamin Duke University Krzysztof Genser Fermilab/CD.
US-CMS T2 Centers US-CMS Tier 2 Report Patricia McBride Fermilab GDB Meeting August 31, 2007 Triumf - Vancouver.
Status report of the KLOE offline G. Venanzoni – LNF LNF Scientific Committee Frascati, 9 November 2004.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks CRAB: the CMS tool to allow data analysis.
INFSO-RI Enabling Grids for E-sciencE CRAB: a tool for CMS distributed analysis in grid environment Federica Fanzago INFN PADOVA.
MC Production in Canada Pierre Savard University of Toronto and TRIUMF IFC Meeting October 2003.
1 Andrea Sciabà CERN The commissioning of CMS computing centres in the WLCG Grid ACAT November 2008 Erice, Italy Andrea Sciabà S. Belforte, A.
Distributed Physics Analysis Past, Present, and Future Kaushik De University of Texas at Arlington (ATLAS & D0 Collaborations) ICHEP’06, Moscow July 29,
CMS: T1 Disk/Tape separation Nicolò Magini, CERN IT/SDC Oliver Gutsche, FNAL November 11 th 2013.
ATLAS Distributed Analysis DISTRIBUTED ANALYSIS JOBS WITH THE ATLAS PRODUCTION SYSTEM S. González D. Liko
LHCb Current Understanding of Italian Tier-n Centres Domenico Galli, Umberto Marconi Roma, January 23, 2001.
July 26, 2007Parag Mhashilkar, Fermilab1 DZero On OSG: Site And Application Validation Parag Mhashilkar, Fermi National Accelerator Laboratory.
Belle II Computing Fabrizio Bianchi INFN and University of Torino Meeting Belle2 Italia 17/12/2014.
Jianming Qian, UM/DØ Software & Computing Where we are now Where we want to go Overview Director’s Review, June 5, 2002.
CDF SAM Deployment Status Doug Benjamin Duke University (for the CDF Data Handling Group)
April 18, 2006FermiGrid Project1 FermiGrid Project Status April 18, 2006 Keith Chadwick.
CDF ICRB Meeting January 24, 2002 Italy Analysis Plans Stefano Belforte - INFN Trieste1 Strategy and present hardware Combine scattered Italian institutions.
DØ Computing Model and Operational Status Gavin Davies Imperial College London Run II Computing Review, September 2005.
DØ Grid Computing Gavin Davies, Frédéric Villeneuve-Séguier Imperial College London On behalf of the DØ Collaboration and the SAMGrid team The 2007 Europhysics.
BaBar & Grid Eleonora Luppi for the BaBarGrid Group TB GRID Bologna 15 febbraio 2005.
5/12/06T.Kurca - D0 Meeting FNAL1 p20 Reprocessing Introduction Computing Resources Architecture Operational Model Technical Issues Operational Issues.
1 P. Murat, Mini-review of the CDF Computing Plan 2006, 2005/10/18 An Update to the CDF Offline Plan and FY2006 Budget ● Outline: – CDF computing model.
CDF Monte Carlo Production on LCG GRID via LcgCAF Authors: Gabriele Compostella Donatella Lucchesi Simone Pagan Griso Igor SFiligoi 3 rd IEEE International.
Claudio Grandi INFN Bologna Workshop congiunto CCR e INFNGrid 13 maggio 2009 Le strategie per l’analisi nell’esperimento CMS Claudio Grandi (INFN Bologna)
IFAE Apr CDF Computing Experience - Gabriele Compostella1 IFAE Apr CDF Computing Experience Gabriele Compostella, University.
Workload Management Workpackage
LcgCAF:CDF submission portal to LCG
LCG Service Challenge: Planning and Milestones
Philippe Charpentier CERN – LHCb On behalf of the LHCb Computing Group
Universita’ di Torino and INFN – Torino
DØ MC and Data Processing on the Grid
The LHCb Computing Data Challenge DC06
Presentation transcript:

Sep Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova

Donatella Lucchesi2 Sep Introduction  Status and Plans for data and Monte Carlo  Status and Plan Monte Carlo  Data outside FNAL  CDF-Italy needs  Remote shift control room (Fabrizio Scuri)

Donatella Lucchesi3 Sep Data Production Status  Offline reconstruction algorithms frozen in fall 06  Data reconstruction performed for 1 fb -1  Post shutdown: Dataset cut-off: Sep 01 ~ 200 pb-1 Start producing new data Oct 01 Done by end of November  Calibration process will be improved for the next step User level:  Many analysis use st-ntuples produced by the production Farm (not standard yet for B physics)  Diskpool in use for user (st-)ntuple, not production yet  (st-)ntuples stored also at CNAF

Donatella Lucchesi4 Sep CDF Resources Needs as IFC Proportional Model: scale FY2005 resources FY200x demand = (FY2005 resources)x(FY200x/FY2005)data vol. Input parameters: Results:

Donatella Lucchesi5 Sep Where CDF can find new Resources Working on strategies to improve resources utilization:  One-pass production  Centralized ntuple production  Run dependent Monte Carlo production  Access GRID Resources  Merge several GlideCAF into one:NAmCAF Born as Fermilab-San Diego CMS group project Now include: FermiGrid, San Diego, MIT, Florida  lcgcaf: CAF reimplementation to access LCG middleware use gLite resource broker CDF-Italy and INFNGrid project developed by: F. Delli Paoli, D. Jeans, S. Sarkar, I. Sfiligoi and D.L.

Donatella Lucchesi6 Sep NamCAF It start being used

Donatella Lucchesi7 Sep Resources available to LcgCAF Italy: INFN-GRID: 2MspecInt2K, extra CNAF ~700KspecInt2K Already included: Barcelona, Lyon, Glasgow, Karlsruhe will be presented Joint Physics meeting and very soon in production!

Donatella Lucchesi8 Sep Monte Carlo Production Plans cdf-UI … cdf-cnaf-1 GRID Storage Element job Robotic Tape Storage output data output data output data EU GRID Buffer area storage area validation SAM station LcgCAF Need to be developed for CDF in GRID

Donatella Lucchesi9 Sep LcgCAF Characteristic & Performances  CDF code distribution: AFS was a limitation, now Parrot access to all sites  GRID failures due: sites misconfiguration, temporary authentication problems and services overloading in Resource Broker  Use GRID retry and the CDF internal resubmission mechanism SamplesEvents on tape   with 1 Recovery B->D s  D s ->  ~92%~100% B->D s  D s ->K*K ~98%~100% B->D s  D s ->K s K ~92%~100%

Donatella Lucchesi10 Sep Data  An automatic (almost) procedure to store at CNAF: o B data in any form: BCHARM dataset and/or skimmed datasets and/or Bs-ntuple o st-ntuples (any format) for high-pt analysis  Provide users running on data at CNAF with standard CAF (icaf) area, access via CAF tools and rootd  Keep use GlideCAF until LcgCAF has same performances  Use LcgCAF to access data:  SAM-SRM interface First SRM installation (F. Delli Paoli)  Test of native GPFS (D. Jeans)  Lot of effort now in understanding which SRM

Donatella Lucchesi11 Sep CDF share respect to other experiments Total cpu time August 2006Total cpu time since April `05 Need to agree with Tier 1 and Tier2 a minimum guarantee for CDF when LHC will start

Donatella Lucchesi12 Sep CDF needs: disk space CDF has some disk space assigned at CNAF. We ask for a little more to do data analysis Currently: 75 TB Physics needs

Donatella Lucchesi13 Sep CDF needs: cpu’s CDF is not asking more than what already discussed and approved. Tier 1 seems happy!

Donatella Lucchesi14 Sep Manpower Fermilab: I. Sfiligoi + San Diego group: “CAF +GRID transition” Replaced by D. Benjamin + R. Borgatti K. Genser T. Kuhr: “Data Handling and SAM” G. Compostella: Jul.-Sept. 2006, “CAF +NAmCAF” Italy: D. Lucchesi ( coordination, SAM in Italy, data import-export ) F. Delli Paoli ( LcgCAF resp., CDF code, SRM development ) ends in September 06 D. Jeans (GlideCaf-disk-user interface) new job Oct. 06 S. Sarkar (GlideCAF, LcgCAF, SRM) July 06 L. Brigliadori (support CNAF management) end January 07 New Assegno di (Bando 10 settembre) F. Scuri +D. Fabiani Remote CO shift (Pisa) Interest express by colleagues for MC production coord.

Donatella Lucchesi15 Sep BACKUP

Donatella Lucchesi16 Sep Lcgcaf design Developers: F. Delli Paoli, D. Jeans, S. Sarkar and I. Sfiligoi advices

Donatella Lucchesi17 Sep Need for Physics Center Disk space: - BCHARM dataset and skimmed data are on disk - size of these datasets is scaled using luminosity, logging rate and event size What we need for B Data