Status report NIKHEF Willem van Leeuwen February 11, 2002 DØRACE.

Slides:

Advertisements

Similar presentations

Upgrade D0 farm. Reasons for upgrade RedHat 7 needed for D0 software New versions of –ups/upd v4_6 –fbsng v1_3f+p2_1 –sam Use of farm for MC and analysis.

Advertisements

ICHEP visit to NIKHEF. D0 Monte Carlo farm hoeve (farm) MC request schuur (barn) SAM MHz 2-CPU nodes 50 * 40 GB 1.2 TB.

Installation mcc from minitar mc_runjob from upd –Copied from /d0dist to /d0/mcc/mc_runjob –Changes in /d0 –Undo mod of Rod Walker.

D0 NIKHEF. March 22, Nijmegen2 Amsterdam D0 farm (SAM station hoeve, node schuur) –2 servers, 50 dual cpu nodes –Used for MC production.

NIKHEF Testbed 1 Plans for the coming three months.

McFarm: first attempt to build a practical, large scale distributed HEP computing cluster using Globus technology Anand Balasubramanian Karthik Gopalratnam.

February 12, 2002 DØRACE 1 Grid activities in NIKHEF Willem van Leeuwen.

K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.

The D0 Monte Carlo Challenge Gregory E. Graham University of Maryland (for the D0 Collaboration) February 8, 2000 CHEP 2000.

Andrew McNab - Manchester HEP - 5 July 2001 WP6/Testbed Status Status by partner –CNRS, Czech R., INFN, NIKHEF, NorduGrid, LIP, Russia, UK Security Integration.

1 Data Management D0 Monte Carlo needs The NIKHEF D0 farm The data we produce The SAM data base The network Conclusions Kors Bos, NIKHEF, Amsterdam Fermilab,

The SAMGrid Data Handling System Outline:  What Is SAMGrid?  Use Cases for SAMGrid in Run II Experiments  Current Operational Load  Stress Testing.

Remote Production and Regional Analysis Centers Iain Bertram 24 May 2002 Draft 1 Lancaster University.

BaBar MC production BaBar MC production software VU (Amsterdam University) A lot of computers EDG testbed (NIKHEF) Jobs Results The simple question:

03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.

November 7, 2001Dutch Datagrid SARA 1 DØ Monte Carlo Challenge A HEP Application.

D0 Farms 1 D0 Run II Farms M. Diesburg, B.Alcorn, J.Bakken, T.Dawson, D.Fagan, J.Fromm, K.Genser, L.Giacchetti, D.Holmgren, T.Jones, T.Levshina, L.Lueking,

- Iain Bertram R-GMA and DØ Iain Bertram RAL 13 May 2004 Thanks to Jeff Templon at Nikhef.

A Design for KCAF for CDF Experiment Kihyeon Cho (CHEP, Kyungpook National University) and Jysoo Lee (KISTI, Supercomputing Center) The International Workshop.

1 DIRAC – LHCb MC production system A.Tsaregorodtsev, CPPM, Marseille For the LHCb Data Management team CHEP, La Jolla 25 March 2003.

Jan. 17, 2002DØRAM Proposal DØRACE Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) IntroductionIntroduction Remote Analysis Station ArchitectureRemote.

1 The D0 NIKHEF Farm Kors Bos Ton Damen Willem van Leeuwen Fermilab, May

Movement of MC Data using SAM & SRM Interface Manoj K. Jha (INFN- Bologna) Gabriele Compostella, Antonio Cuomo, Donatella Lucchesi,, Simone Pagan (INFN.

Status of the LHCb MC production system Andrei Tsaregorodtsev, CPPM, Marseille DataGRID France workshop, Marseille, 24 September 2002.

RAL Site Report John Gordon IT Department, CLRC/RAL HEPiX Meeting, JLAB, October 2000.

SAM Installation Lauri Loebel Carpenter and the SAM Team February

Dzero MC production on LCG How to live in two worlds (SAM and LCG)

A New CDF Model for Data Movement Based on SRM Manoj K. Jha INFN- Bologna 27 th Feb., 2009 University of Birmingham, U.K.

LFC Replication Tests LCG 3D Workshop Barbara Martelli.

Computing plans from UKDØ. Iain Bertram 8 November 2000.

Outline: Tasks and Goals The analysis (physics) Resources Needed (Tier1) A. Sidoti INFN Pisa.

From DØ To ATLAS Jae Yu ATLAS Grid Test-Bed Workshop Apr. 4-6, 2002, UTA Introduction DØ-Grid & DØRACE DØ Progress UTA DØGrid Activities Conclusions.

NIKHEF CT/ Status NIKHEF (NL). NIKHEFDataGrid/Oxford/July DutchGrid Participation of High-energy Physics Earth observation Computer.

Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.

UTA Site Report DØrace Workshop February 11, 2002.

UTA MC Production Farm & Grid Computing Activities Jae Yu UT Arlington DØRACE Workshop Feb. 12, 2002 UTA DØMC Farm MCFARM Job control and packaging software.

DCAF (DeCentralized Analysis Farm) Korea CHEP Fermilab (CDF) KorCAF (DCAF in Korea) Kihyeon Cho (CHEP, KNU) (On the behalf of HEP Data Grid Working Group)

Feb. 14, 2002DØRAM Proposal DØ IB Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) Introduction Partial Workshop Results DØRAM Architecture.

Re-Reconstruction Of Generated Monte Carlo In a McFarm Context 2003/09/26 Joel Snow, Langston U.

DCAF(DeCentralized Analysis Farm) for CDF experiments HAN DaeHee*, KWON Kihwan, OH Youngdo, CHO Kihyeon, KONG Dae Jung, KIM Minsuk, KIM Jieun, MIAN shabeer,

Feb. 13, 2002DØRAM Proposal DØCPB Meeting, Jae Yu 1 Proposal for a DØ Remote Analysis Model (DØRAM) IntroductionIntroduction Partial Workshop ResultsPartial.

Update on NIKHEF D0 farm June June 6, 2002D0RACE2 Outline Status of D0 farm –Upgrades –Move into grid network Use of EDG testbed and DAS-2 cluster.

D0 Farms 1 D0 Run II Farms M. Diesburg, B.Alcorn, J.Bakken, R. Brock,T.Dawson, D.Fagan, J.Fromm, K.Genser, L.Giacchetti, D.Holmgren, T.Jones, T.Levshina,

D0 File Replication PPDG SLAC File replication workshop 9/20/00 Vicky White.

Markus Frank (CERN) & Albert Puig (UB).  An opportunity (Motivation)  Adopted approach  Implementation specifics  Status  Conclusions 2.

Introduction to the SAM System at DØ Physics 5391 July 1, 2002 Mark Sosebee U.T. Arlington.

CCJ introduction RIKEN Nishina Center Kohei Shoji.

How to run MC on the D0 farm. Steps On hoeve (user fbsuser) –Get MC request –Create macro –Submit jobs On schuur (user willem) –Store files into SAM –Clear.

Apr. 25, 2002Why DØRAC? DØRAC FTFM, Jae Yu 1 What do we want DØ Regional Analysis Centers (DØRAC) do? Why do we need a DØRAC? What do we want a DØRAC do?

Scientific Data Processing Portal and Heterogeneous Computing Resources at NRC “Kurchatov Institute” V. Aulov, D. Drizhuk, A. Klimentov, R. Mashinistov,

Compute and Storage For the Farm at Jlab

WLCG IPv6 deployment strategy

Status report NIKHEF Willem van Leeuwen February 11, 2002 DØRACE.

Moving the LHCb Monte Carlo production system to the GRID

SAM at CCIN2P3 configuration issues

NGS Oracle Service.

Status of MC production on the grid

Bernd Panzer-Steindel CERN/IT

Grid Canada Testbed using HEP applications

Willem van Leeuwen SAM Users Meeting June 27, 2001

UM D0RACE STATION Status Report Chunhui Han June 20, 2002

DØRACE Workshop Summary

Lee Lueking D0RACE January 17, 2002

Grid activities in NIKHEF

DØ RAC Working Group Report

Proposal for a DØ Remote Analysis Model (DØRAM)

Status and plans for bookkeeping system and production tools

Short to middle term GRID deployment plan for LHCb

Production client status

The LHCb Computing Data Challenge DC06

Presentation transcript:

Status report NIKHEF Willem van Leeuwen February 11, 2002 DØRACE

Outline NIKHEF DØ farm SAM UPS/UPD Grid activities @ NIKHEF www.nikhef.nl/~bosk/farm/farm.htm www.nikhef.nl/~a03/farm/status.html SAM UPS/UPD Grid activities @ NIKHEF February 11, 2002 DØRACE

The NIKHEF DØ farm Batch server (hoeve [farm]) Boot/Software server Runs mc_runjob File server (schuur [barn]) Runs SAM 50 + dual cpu nodes Run MC jobs February 11, 2002 DØRACE

February 11, 2002 DØRACE

fbs job: 1 mcc 2 rcp [3 sam] 100+ cpu’s 1.2 TB mcc request fbs(rcp[,sam]) farm server file server SAM DB fbs job: 1 mcc 2 rcp [3 sam] fbs(mcc) datastore mcc input FNAL SARA mcc output node 100+ cpu’s control 40 GB data February 11, 2002 DØRACE metadata

SAM @ NIKHEF Stores metadata in database at FNAL Stores files sam declare import_<jobstep>.py scripts prepared by mc_runjob Stores files on tape at fnal via cache on d0mino on disk of teras.sara.nl and migrated to tape sam store --descrip=import_<jobstep>.py [--dest=teras.sara.nl:/sam/samdata/y01/w42] February 11, 2002 DØRACE

SAM @ SARA No need to install SAM or UPS/UPD  Declare teras directories in SAM as destination Access protocol May 2001 rcp October 2001 bbftp ??: gridftp February 11, 2002 DØRACE

SAM @ NIKHEF is full simplex Recommended action: Relax declare/store only Recommended action: Relax submit parallel streams of 50 reco and recoanalyze files eventually wait for 6 hours resubmit files which failed February 11, 2002 DØRACE

UPS/UPD was difficult to install dØrace prescription works fine for generic, not for DØ configuration do not forget to unalias setup still complicated many configuration options different directory structures still editing of database files necessary February 11, 2002 DØRACE

grid activities @ nikhef European Data Grid Testbed Alice farm LHCb farm Dutch Data Grid DAS cluster 200 Dual Pentium-III nodes, distributed over 5 universities http://www.dutchgrid.nl/ February 11, 2002 DØRACE

February 11, 2002 DØRACE

Conclusions NIKHEF DØ farm is need for sam input is growing easy to use (Antares, L3) easy to clone (Nijmegen) part of DØ data grid moving (slowly) to grid standards need for sam input is growing February 11, 2002 DØRACE