Status of analysis & MC farms 30/08/2002 Concezio Bozzi INFN Ferrara.

Slides:

Advertisements

Similar presentations

Status of the Status of the MONARC Testbed in Padova Massimo Sgaravatto INFN Padova May Monarc Workshop.

Advertisements

BaBarGrid GridPP10 Meeting CERN June 3 rd 2004 Roger Barlow Manchester University 1: Simulation 2: Data Distribution: The SRB 3: Distributed Analysis.

Martin Bly RAL CSF Tier 1/A RAL Tier 1/A Status HEPiX-HEPNT NIKHEF, May 2003.

Southgrid Status Pete Gronbech: 27th June 2006 GridPP 16 QMUL.

MC requirements Concezio Bozzi Padova, Oct 16 th 2003.

Title US-CMS User Facilities Vivian O’Dell US CMS Physics Meeting May 18, 2001.

Analysis farm: past experience Concezio Bozzi Padova, Oct 16 th 2003.

Large scale data flow in local and GRID environment V.Kolosov, I.Korolko, S.Makarychev ITEP Moscow.

The Mass Storage System at JLAB - Today and Tomorrow Andy Kowalski.

ScotGrid: a Prototype Tier-2 Centre – Steve Thorn, Edinburgh University SCOTGRID: A PROTOTYPE TIER-2 CENTRE Steve Thorn Authors: A. Earl, P. Clark, S.

Remote Production and Regional Analysis Centers Iain Bertram 24 May 2002 Draft 1 Lancaster University.

Design & Management of the JLAB Farms Ian Bird, Jefferson Lab May 24, 2001 FNAL LCCWS.

Group Computing Strategy Introduction and BaBar Roger Barlow June 28 th 2005.

D0 Farms 1 D0 Run II Farms M. Diesburg, B.Alcorn, J.Bakken, T.Dawson, D.Fagan, J.Fromm, K.Genser, L.Giacchetti, D.Holmgren, T.Jones, T.Levshina, L.Lueking,

Farm Management D. Andreotti 1), A. Crescente 2), A. Dorigo 2), F. Galeazzi 2), M. Marzolla 3), M. Morandin 2), F.

3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.

Jean-Yves Nief CC-IN2P3, Lyon HEPiX-HEPNT, Fermilab October 22nd – 25th, 2002.

12th November 2003LHCb Software Week1 UK Computing Glenn Patrick Rutherford Appleton Laboratory.

23 Oct 2002HEPiX FNALJohn Gordon CLRC-RAL Site Report John Gordon CLRC eScience Centre.

CASPUR Site Report Andrei Maslennikov Lead - Systems Karlsruhe, May 2005.

Jefferson Lab Site Report Kelvin Edwards Thomas Jefferson National Accelerator Facility Newport News, Virginia USA

March 2003 CERN 1 EDG and AliEn in Prague Dagmar Adamova INP Rez near Prague.

Status of 2015 pledges 2016 requests RRB Report Concezio Bozzi INFN Ferrara LHCb NCB, November 3 rd 2014.

Fulvio Galeazzi, CHEP 2003, Mar 24— A Monitoring System for the BaBar INFN Computing Cluster Moreno Marzolla Università “Ca' Foscari” di Venezia.

Computing for LHCb-Italy Domenico Galli, Umberto Marconi and Vincenzo Vagnoni Genève, January 17, 2001.

International Workshop on HEP Data Grid Nov 9, 2002, KNU Data Storage, Network, Handling, and Clustering in CDF Korea group Intae Yu*, Junghyun Kim, Ilsung.

21 st October 2002BaBar Computing – Stephen J. Gowdy 1 Of 25 BaBar Computing Stephen J. Gowdy BaBar Computing Coordinator SLAC 21 st October 2002 Second.

SLAC Site Report Chuck Boeheim Assistant Director, SLAC Computing Services.

9 February 2000CHEP2000 Paper 3681 CDF Data Handling: Resource Management and Tests E.Buckley-Geer, S.Lammel, F.Ratnikov, T.Watts Hardware and Resources.

KLOE Computing Update Paolo Santangelo INFN LNF KLOE General Meeting University of Rome 2, Tor Vergata 2002, December

Manchester HEP Desktop/ Laptop 30 Desktop running RH Laptop Windows XP & RH OS X Home server AFS using openafs 3 DB servers Kerberos 4 we will move.

RAL Site Report John Gordon IT Department, CLRC/RAL HEPiX Meeting, JLAB, October 2000.

LHCb-Italy Farm Monitor Domenico Galli Bologna, June 13, 2001.

LCG Phase 2 Planning Meeting - Friday July 30th, 2004 Jean-Yves Nief CC-IN2P3, Lyon An example of a data access model in a Tier 1.

19th September 2003Tim Adye1 RAL Tier A Status Tim Adye Rutherford Appleton Laboratory BaBar UK Collaboration Meeting Royal Holloway 19 th September 2003.

London Tier 2 Status Report GridPP 11, Liverpool, 15 September 2004 Ben Waugh on behalf of Owen Maroney.

Tier2 Centre in Prague Jiří Chudoba FZU AV ČR - Institute of Physics of the Academy of Sciences of the Czech Republic.

Outline: Tasks and Goals The analysis (physics) Resources Needed (Tier1) A. Sidoti INFN Pisa.

CASPUR Site Report Andrei Maslennikov Lead - Systems Amsterdam, May 2003.

Nov. 8, 2000RIKEN CC-J RIKEN CC-J (PHENIX Computing Center in Japan) Report N.Hayashi / RIKEN November 8, 2000 PHENIX Computing

IDE disk servers at CERN Helge Meinhard / CERN-IT CERN OpenLab workshop 17 March 2003.

26 September 2000Tim Adye1 Data Distribution Tim Adye Rutherford Appleton Laboratory BaBar Collaboration Meeting 26 th September 2000.

PC clusters in KEK A.Manabe KEK(Japan). 22 May '01LSCC WS '012 PC clusters in KEK s Belle (in KEKB) PC clusters s Neutron Shielding Simulation cluster.

HEP Computing Status Sheffield University Matt Robinson Paul Hodgson Andrew Beresford.

Status of the Bologna Computing Farm and GRID related activities Vincenzo M. Vagnoni Thursday, 7 March 2002.

Outline: Status: Report after one month of Plans for the future (Preparing Summer -Fall 2003) (CNAF): Update A. Sidoti, INFN Pisa and.

Site Report: Prague Jiří Chudoba Institute of Physics, Prague WLCG GridKa+T2s Workshop.

11th April 2003Tim Adye1 RAL Tier A Status Tim Adye Rutherford Appleton Laboratory BaBar UK Collaboration Meeting Liverpool 11 th April 2003.

The 2001 Tier-1 prototype for LHCb-Italy Vincenzo Vagnoni Genève, November 2000.

BaBar and the GRID Tim Adye CLRC PP GRID Team Meeting 3rd May 2000.

Large scale data flow in local and GRID environment Viktor Kolosov (ITEP Moscow) Ivan Korolko (ITEP Moscow)

Materials for Report about Computing Jiří Chudoba x.y.2006 Institute of Physics, Prague.

Computing Issues for the ATLAS SWT2. What is SWT2? SWT2 is the U.S. ATLAS Southwestern Tier 2 Consortium UTA is lead institution, along with University.

Tier1A Status Martin Bly 28 April CPU Farm Older hardware: –108 dual processors (450, 600 and 1GHz) –156 dual processor 1400MHz PIII Recent delivery:

15-Feb-02Steve Traylen, RAL WP6 Test Bed Report1 RAL/UK WP6 Test Bed Report Steve Traylen, WP6 PPGRID/RAL, UK

Batch Software at JLAB Ian Bird Jefferson Lab CHEP February, 2000.

D0 Farms 1 D0 Run II Farms M. Diesburg, B.Alcorn, J.Bakken, R. Brock,T.Dawson, D.Fagan, J.Fromm, K.Genser, L.Giacchetti, D.Holmgren, T.Jones, T.Levshina,

Computer Performance. Hard Drive - HDD Stores your files, programs, and information. If it gets full, you can’t save any more. Measured in bytes (KB,

Oct. 6, 1999PHENIX Comp. Mtg.1 CC-J: Progress, Prospects and PBS Shin’ya Sawada (KEK) For CCJ-WG.

CDF SAM Deployment Status Doug Benjamin Duke University (for the CDF Data Handling Group)

Tier2 Centre in Prague Jiří Chudoba FZU AV ČR - Institute of Physics of the Academy of Sciences of the Czech Republic.

BaBar & Grid Eleonora Luppi for the BaBarGrid Group TB GRID Bologna 15 febbraio 2005.

12/19/01MODIS Science Team Meeting1 MODAPS Status and Plans Edward Masuoka, Code 922 MODIS Science Data Support Team NASA’s Goddard Space Flight Center.

BaBar-Grid Status and Prospects

GridPP10 Meeting CERN June 3 rd 2004

Xiaomei Zhang CMS IHEP Group Meeting December

SAM at CCIN2P3 configuration issues

The INFN TIER1 Regional Centre

Universita’ di Torino and INFN – Torino

Presentation transcript:

Status of analysis & MC farms 30/08/2002 Concezio Bozzi INFN Ferrara

30/08/02 Concezio Bozzi (Ferrara) The name of the game Three farms in Italy today: –“MC”: for official Simulation Production (formerly at Caspur, now at INFN Rome) –“Analysis”: a Tier B with Kanga data located at Caspur (Rome) –“Repro”: located in Padova, will reprocess all Babar Run1+Run2 data starting this summer

30/08/02 Concezio Bozzi (Ferrara) INFN Farms in Rome MonteCarlo Farm -Today -Upgrade Analysis Farm -Today - Upgrade MonteCarlo Farm has been moved June 15 th from Caspur to INFN (Rome) The Analysis Farm is still at Caspur

30/08/02 Concezio Bozzi (Ferrara) MonteCarlo Farm today - 1 server Linux, dual cpu, PIII 800 MHz, 512 MB (NFS and lock servers, batch queues, MocaEspresso) (NFS and lock servers, batch queues, MocaEspresso) - 14 Linux clients, dual cpu, PIII 800 MHz, 768 MB - 2 Array RAID EIDE : 2x0,5 = 1 TB Event rate: 3.5 M events/month 30 M events in 1 year

MonteCarlo Farm: jobs

30/08/02 Concezio Bozzi (Ferrara) Farm MonteCarlo: comparisons …

30/08/02 Concezio Bozzi (Ferrara) Farm MonteCarlo: comparisons … 19.4 M events from August 15 th 2001 to June 15 th 2002

Farm MonteCarlo: comparisons … we are here !

30/08/02 Concezio Bozzi (Ferrara) MonteCarlo Farm: CPU SCSI problems stop/start production re-validation

30/08/02 Concezio Bozzi (Ferrara) MonteCarlo Farm: disk & net

30/08/02 Concezio Bozzi (Ferrara) MonteCarlo Farm: Upgrades 2002: increase production to 6-8 Mevents/month - clone Linux farm CPUs, 1.26GHz, 1 GB RAM: installing now - Server and disk (1TB) ordered - use Analysis farm resources when available -Problems with a Sun disk (1TB), recovering… 2003: increase production to 20 M events/month - more CPUs (150*30SpecInt95 ~ GHz 2xCPUs) - use repro farm whenever possible

30/08/02 Concezio Bozzi (Ferrara) Analysis Farm: Today -5 Sun E450, 4x400 MHz, 2GB (NFS data server) -15 Linux clients, dual cpu, PIII 1 GHz, 1 GB: -1 Sun Ultra 10: lock server - 1 Sun Ultra 10: monitoring (to be dismissed soon) -Disk space: 9 TB for Kanga -Data: AllEvents + 8 streams. The complete (99-02) dataset is available -MC: ~650M events available -Private & Toy MC -SP MC production as “infn2” (lower priority wrt analysis)

30/08/02 Concezio Bozzi (Ferrara) Analysis Farm: users SUN Linux

30/08/02 Concezio Bozzi (Ferrara) Analysis Farm: jobs Linux CPU efficiency Running jobs Pending jobs

30/08/02 Concezio Bozzi (Ferrara) Analysis farm: Upgrade 2002: -17 Linux clients, dual cpu (in hand) -3TB disk space (ordered): 15TB total This will be enough until March : -cpu power x3: SpecInts95 (50 1.6GHz 2xCPUs) -Disk: from Padova (?) -maintain Kanga until end of reprocessing, (spring 03) -Next: Computing Model Working Group OBJY vs. non-OBJY Event Store, MINI vs. MICRO, etc…

30/08/02 Concezio Bozzi (Ferrara) Babar-Grid -Some activity going on in Italy -Define and implement a Grid-scheme for MC production -Installing/testing on the INFN-Grid Ferrara testbed

30/08/02 Concezio Bozzi (Ferrara) Farmers …. -Ferrara: D. Andreotti, V. Azzolini, C. Bozzi, E. Luppi + CS students -Padova: A. Ceseracciu, A. Crescente, A. Dorigo, F. Galeazzi, M. Marzolla, M. Morandin, R. Stroili, G. Tiozzo, G. Vedovato -Rome: C. Bulfon, F. Safai Tehrani -Trieste: G. Della Ricca