22/04/2005Donatella Lucchesi1 CDFII Computing Status OUTLINE:  New CDF-Italy computing group organization  Usage status at FNAL and CNAF  Towards GRID:

Slides:



Advertisements
Similar presentations
B A B AR and the GRID Roger Barlow for Fergus Wilson GridPP 13 5 th July 2005, Durham.
Advertisements

Exporting Raw/ESD data from Tier-0 Tier-1s Wrap-up.
LNL CMS M.Biasotto, Bologna, 29 aprile LNL Analysis Farm Massimo Biasotto - LNL.
4/2/2002HEP Globus Testing Request - Jae Yu x Participating in Globus Test-bed Activity for DØGrid UTA HEP group is playing a leading role in establishing.
SLUO LHC Workshop, SLACJuly 16-17, Analysis Model, Resources, and Commissioning J. Cochran, ISU Caveat: for the purpose of estimating the needed.
Duke Atlas Tier 3 Site Doug Benjamin (Duke University)
10 May 2002Report & Plans on computers1 Status Report for CDF Italy computing fcdfsgi2 disks Budget report CAF: now, next year GRID etc. CDF – Italy meeting.
ATLAS computing in Geneva Szymon Gadomski, NDGF meeting, September 2009 S. Gadomski, ”ATLAS computing in Geneva", NDGF, Sept 091 the Geneva ATLAS Tier-3.
Sep Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova.
INFN Testbed status report L. Gaido WP6 meeting CERN - October 30th, 2002.
Large scale data flow in local and GRID environment V.Kolosov, I.Korolko, S.Makarychev ITEP Moscow.
F Run II Experiments and the Grid Amber Boehnlein Fermilab September 16, 2005.
PROOF: the Parallel ROOT Facility Scheduling and Load-balancing ACAT 2007 Jan Iwaszkiewicz ¹ ² Gerardo Ganis ¹ Fons Rademakers ¹ ¹ CERN PH/SFT ² University.
US ATLAS Western Tier 2 Status and Plan Wei Yang ATLAS Physics Analysis Retreat SLAC March 5, 2007.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
Computing for ILC experiment Computing Research Center, KEK Hiroyuki Matsunaga.
LcgCAF:CDF submission portal to LCG Federica Fanzago for CDF-Italian Computing Group Gabriele Compostella, Francesco Delli Paoli, Donatella Lucchesi, Daniel.
David Hutchcroft on behalf of John Bland Rob Fay Steve Jones And Mike Houlden [ret.] * /.\ /..‘\ /'.‘\ /.''.'\ /.'.'.\ /'.''.'.\ ^^^[_]^^^ * /.\ /..‘\
Building a distributed software environment for CDF within the ESLEA framework V. Bartsch, M. Lancaster University College London.
BINP/GCF Status Report BINP LCG Site Registration Oct 2009
INTRODUCTION The GRID Data Center at INFN Pisa hosts a big Tier2 for the CMS experiment, together with local usage from other HEP related/not related activities.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
Federico Ruggieri INFN-CNAF GDB Meeting 10 February 2004 INFN TIER1 Status.
LCG Service Challenge Phase 4: Piano di attività e impatto sulla infrastruttura di rete 1 Service Challenge Phase 4: Piano di attività e impatto sulla.
A Design for KCAF for CDF Experiment Kihyeon Cho (CHEP, Kyungpook National University) and Jysoo Lee (KISTI, Supercomputing Center) The International Workshop.
Interactive Job Monitor: CafMon kill CafMon tail CafMon dir CafMon log CafMon top CafMon ps LcgCAF: CDF submission portal to LCG resources Francesco Delli.
Your university or experiment logo here Caitriana Nicholson University of Glasgow Dynamic Data Replication in LCG 2008.
CDF Grid at KISTI 정민호, 조기현 *, 김현우, 김동희 1, 양유철 1, 서준석 1, 공대정 1, 김지은 1, 장성현 1, 칸 아딜 1, 김수봉 2, 이재승 2, 이영장 2, 문창성 2, 정지은 2, 유인태 3, 임 규빈 3, 주경광 4, 김현수 5, 오영도.
Grid Workload Management Massimo Sgaravatto INFN Padova.
International Workshop on HEP Data Grid Nov 9, 2002, KNU Data Storage, Network, Handling, and Clustering in CDF Korea group Intae Yu*, Junghyun Kim, Ilsung.
November SC06 Tampa F.Fanzago CRAB a user-friendly tool for CMS distributed analysis Federica Fanzago INFN-PADOVA for CRAB team.
Tier-2  Data Analysis  MC simulation  Import data from Tier-1 and export MC data CMS GRID COMPUTING AT THE SPANISH TIER-1 AND TIER-2 SITES P. Garcia-Abia.
3 Apr 2002Stefano Belforte – INFN Trieste Necessita’ CDF al Tier11 CDF needs at Tier 1 Many details in slides for (your) future reference Will move faster.
CERN Physics Database Services and Plans Maria Girone, CERN-IT
Architecture and ATLAS Western Tier 2 Wei Yang ATLAS Western Tier 2 User Forum meeting SLAC April
JLAB Computing Facilities Development Ian Bird Jefferson Lab 2 November 2001.
CSCS Status Peter Kunszt Manager Swiss Grid Initiative CHIPP, 21 April, 2006.
25th October 2006Tim Adye1 RAL Tier A Tim Adye Rutherford Appleton Laboratory BaBar UK Physics Meeting Queen Mary, University of London 25 th October 2006.
The Experiments – progress and status Roger Barlow GridPP7 Oxford 2 nd July 2003.
The LHCb Italian Tier-2 Domenico Galli, Bologna INFN CSN1 Roma,
Stefano Belforte INFN Trieste 1 Middleware February 14, 2007 Resource Broker, gLite etc. CMS vs. middleware.
US ATLAS Tier 1 Facility Rich Baker Brookhaven National Laboratory Review of U.S. LHC Software and Computing Projects Fermi National Laboratory November.
Outline: Tasks and Goals The analysis (physics) Resources Needed (Tier1) A. Sidoti INFN Pisa.
18-sep-021 Computing for CDF Status and Requests for 2003 Stefano Belforte INFN – Trieste.
Evolution of a High Performance Computing and Monitoring system onto the GRID for High Energy Experiments T.L. Hsieh, S. Hou, P.K. Teng Academia Sinica,
GridPP11 Liverpool Sept04 SAMGrid GridPP11 Liverpool Sept 2004 Gavin Davies Imperial College London.
ATLAS Software Installation at UIUC “Mutability is immutable.” - Heraclitus ~400 B.C.E. D. Errede, M. Neubauer Goals: 1) ability to analyze data locally.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
May Donatella Lucchesi 1 CDF Status of Computing Donatella Lucchesi INFN and University of Padova.
The following is a collection of slides from a few recent talks on computing for ATLAS in Canada, plus a few new ones. I might refer to all of them, I.
Outline: Status: Report after one month of Plans for the future (Preparing Summer -Fall 2003) (CNAF): Update A. Sidoti, INFN Pisa and.
US-CMS T2 Centers US-CMS Tier 2 Report Patricia McBride Fermilab GDB Meeting August 31, 2007 Triumf - Vancouver.
RHIC/US ATLAS Tier 1 Computing Facility Site Report Christopher Hollowell Physics Department Brookhaven National Laboratory HEPiX Upton,
MC Production in Canada Pierre Savard University of Toronto and TRIUMF IFC Meeting October 2003.
Belle II Computing Fabrizio Bianchi INFN and University of Torino Meeting Belle2 Italia 17/12/2014.
Daniele Cesini - INFN CNAF. INFN-CNAF 20 maggio 2014 CNAF 2 CNAF hosts the Italian Tier1 computing centre for the LHC experiments ATLAS, CMS, ALICE and.
Dominique Boutigny December 12, 2006 CC-IN2P3 a Tier-1 for W-LCG 1 st Chinese – French Workshop on LHC Physics and associated Grid Computing IHEP - Beijing.
DGAS Distributed Grid Accounting System INFN Workshop /05/1009, Palau Giuseppe Patania Andrea Guarise 6/18/20161.
April 18, 2006FermiGrid Project1 FermiGrid Project Status April 18, 2006 Keith Chadwick.
CDF ICRB Meeting January 24, 2002 Italy Analysis Plans Stefano Belforte - INFN Trieste1 Strategy and present hardware Combine scattered Italian institutions.
BaBar & Grid Eleonora Luppi for the BaBarGrid Group TB GRID Bologna 15 febbraio 2005.
CDF Monte Carlo Production on LCG GRID via LcgCAF Authors: Gabriele Compostella Donatella Lucchesi Simone Pagan Griso Igor SFiligoi 3 rd IEEE International.
Condor Week 2006, University of Wisconsin 1 Matthew Norman Using Condor Glide-ins and GCB to run in a grid environment Elliot Lipeles, Matthew Norman,
Workload Management Workpackage
LcgCAF:CDF submission portal to LCG
LCG Service Challenge: Planning and Milestones
Luca dell’Agnello INFN-CNAF
The INFN Tier-1 Storage Implementation
Universita’ di Torino and INFN – Torino
Presentation transcript:

22/04/2005Donatella Lucchesi1 CDFII Computing Status OUTLINE:  New CDF-Italy computing group organization  Usage status at FNAL and CNAF  Towards GRID: where we are  Plans and requests

22/04/2005Donatella Lucchesi2 CDFII Computing group changes  S. Belforte keeps for the moment 20% (1 day/week) on CDF: necessary to guarantee the transition toward a new “responsabile nazionale”  The CDF-Italia projects for software and data handling are mature and well under control :  transition from “our machines at FNAL” to “our farm at CNAF” completed with success  our CNAF farm merging into the Tier1 common pool almost completed  new software infrastructure for CAF re-written by Igor Sfiligoi co-head “Computing and Grid” for CDF at FNAL Presented by Stefano for CMS

22/04/2005Donatella Lucchesi3 CDFII Computing group changes  Transition toward GRID started and very promising  Our budget ~0 Euro since two years  New people arrived in the latest 12 months and new very important role of Igor Sfiligoi:  Donatella Lucchesi (art. 23 – Padova)  Francesco Delli Paoli (borsa tecn. INFN – Padova)  Armando Fella (borsa tecn. INFN – Pisa)  Subir Sarkar (A.R. tecn. Tier1 – CNAF)  Daniel Jeans (A.R. tecn. INFNGRID – Roma)  New group organization Presented by Stefano for CMS

22/04/2005Donatella Lucchesi4 CDFII-Italy Computing before Stefano Belforte Factotum with helpers data replica, access, management in Italy Planning, management, committees, talks… Code distribution in Italy HW resources purchase and management in Italy and USA Supervision, management, operation of CNAF farm Large dataset management, split, skim, concatenation Armando Fella Subir Sarkar Francesco Delli Paoli Donatella Lucchesi Presented by Stefano for CMS

22/04/2005Donatella Lucchesi5 CDFII-Italy Computing group Stefano Belforte coordination data replica, access and management in Italy Needs assessment, interface with CSN1, Tier1 and GRID, HW resources management in Italy and USA Code distribution in Italy Management and operation of CNAF farm, migration to Tier1 common pool Large dataset management, split, skim, concatenation Armando Fella Subir Sarkar Donatella Lucchesi Francesco DelliPaoli Igor Sfiligoi Daniel Jeans Porting of CAF to LCG CAF and GRID for CDF Presented by Stefano

22/04/2005Donatella Lucchesi6 CAF status at Fnal (latest 6 months) Italian Users on CondorCaf All slots used, relative high demand before analysis approvals for conferences CAF reserved queue ~300 GHz

Stefano Belforte INFN Trieste 22/04/2005 Donatella Lucchesi 7 CDF al CNAF 2004: From 8 to 80 boxes. From FBSNG to Condor December: + 22TB disk data import ~200Mb/s Fair share: 800 users, 54 active last month  NFS stinks, GPFS ok  RFIO ok  Condor great  Glide-In in progress CPU Satura ! Xmas

22/04/2005Donatella Lucchesi8 Towards GRID: Glide-in Just a small change over the production Condor based CAF Use glide-ins to extend the Condor pool –A dedicated head node must be installed and maintained near the Computing Element –CDF user policy in our hands –Use dedicated storage In beta testing stage now at CNAF –Test users have access to 500KSI2K of CPU Work done by Subir Sarkar and Igor Sfiligoi Presented by Igor April 15

22/04/2005Donatella Lucchesi9 Towards GRID: Glide-in  CDF users are submitting jobs via GlideCaf to common (farm LSF)  We have access to 1.1 THz in principle  Need to define CDF dedicated resources when LHC Data Challenge will be in

22/04/2005Donatella Lucchesi10 Bottom Lines  Everything works:  FNAL and CNAF OK  CNAF OK, usage ~80%  CAF CNAF to “pool comune LSF” OK  LCG portal OK  Users happy, analysis not limited by resources  Impossible to define now if and when we will have crisis  Compare CDF 2008/9 with “Tier1”=resources pledged to INFN for as RRB of LCG of April  CDF cost is low  2005/2006 covered by what already approved  future  next slides

22/04/2005Donatella Lucchesi11 Disk Space  CDF produces ~100 TB of data per year  ~20% comes to CNAF  20TB per year  Same amount of disk space considered for Monte Carlo Ntuples and reduced datasets homemade  End of 2005 CDF has 90TB (80 from CNAF)  Small expansion: +40TB/year  CDF is a small fraction of CNAF/Tier1 program  Years of reference: 2008/9 CDF = 4~5% of Tier1 YearTB CDFTB T1%CDF % % % % % %

22/04/2005Donatella Lucchesi12 CPU: “Assisi” CDF requests  Scenario presented in 2004 (3 times) based on CDF official expectations presented by Rick Snider and not changed as today  CPU for CDF-Italy users: linear increase as 2004  2005  CPU for CDF: 15% of total needs as presented  In the reference year 2008/9 CDF ask for CPU as Atlas or CMS  Not crazy, but difficult to make now the case  Today proposal: we will ask so much when and if we need

22/04/2005Donatella Lucchesi13 CPU: “Assisi” CDF requests Year CDF (KSI2K) T1 (kSI2K) %CDF % % % % % %

22/04/2005Donatella Lucchesi14 CPU: exercise “crescita zero”  Assuming, as exercise, that starting from 2006 CDF does not buy any CPU we have 900 KSI2K  In the reference year 2008/9 CDF is 12% of Tier 1 a bit less of ~1/3 of Atlas o CMS  Not surprising, CDF will have ~10PB of data  CDF will not be “insignificant” in any case

22/04/2005Donatella Lucchesi15 CPU: exercise “crescita zero” Year CDF (KSI2K) T1 (kSI2K) %CDF % % % % % %

22/04/2005Donatella Lucchesi16 CPU: “in medio stat virtus”  But, CDF does not disappear  A small increase per year is needed:  luminosity will increase and data as well  to have something to count on in case GRID or FNAL are too loaded  give the possibility to redefine each year the increase (positive or negative)  Assumption: increase of 300 KSI2K/year after 2006  In the reference year 2008/9 CDF is 15% of Tier 1 to be compared with 12% if “a crescita zero”

22/04/2005Donatella Lucchesi17 CPU: “in medio stat virtus” Year CDF (KSI2K) T1 (KSI2K) %CDF % % % % % %

22/04/2005Donatella Lucchesi18 Summary  CDF-Italia has a group of people working on Computing and Data Handling which has been reorganized to cope with Stefano leave  is highly used  Several datasets and used for analysis  Big improvements towards GRID: o GlideCaf used to produce Monte Carlo o working hard to have LCG based CAF  Requests made in Assisi still valid for disks and CPU  Different scenario also presented to have possibility to discuss each year our needs based our and LCH usage

22/04/2005Donatella Lucchesi19 Backup

22/04/2005Donatella Lucchesi20 Backup

22/04/2005Donatella Lucchesi21

22/04/2005Donatella Lucchesi22 Assisi requests CDF Analysis hardware plan Roadmap for CNAF