How to run MC on the D0 farm. Steps On hoeve (user fbsuser) –Get MC request –Create macro –Submit jobs On schuur (user willem) –Store files into SAM –Clear.

Slides:



Advertisements
Similar presentations
Voodoo D0 on EDG. Get certificate certificate.nikhef.nl Organization nikhef ? Open ssl necessary on dors?
Advertisements

Upgrade D0 farm. Reasons for upgrade RedHat 7 needed for D0 software New versions of –ups/upd v4_6 –fbsng v1_3f+p2_1 –sam Use of farm for MC and analysis.
ICHEP visit to NIKHEF. D0 Monte Carlo farm hoeve (farm) MC request schuur (barn) SAM MHz 2-CPU nodes 50 * 40 GB 1.2 TB.
Installation mcc from minitar mc_runjob from upd –Copied from /d0dist to /d0/mcc/mc_runjob –Changes in /d0 –Undo mod of Rod Walker.
D0 NIKHEF. March 22, Nijmegen2 Amsterdam D0 farm (SAM station hoeve, node schuur) –2 servers, 50 dual cpu nodes –Used for MC production.
11-May-15CSE 542: Operating Systems1 File system trace papers The Zebra striped network file system. Hartman, J. H. and Ousterhout, J. K. SOSP '93. (ACM.
Status of the new CRS software (update) Tomasz Wlodek June 22, 2003.
MultiJob PanDA Pilot Oleynik Danila 28/05/2015. Overview Initial PanDA pilot concept & HPC Motivation PanDA Pilot workflow at nutshell MultiJob Pilot.
Migrating to EPiServer CMS 5 Johan Björnfot -
State of Delaware Department of Natural Resources and Environmental Control.
A walkthrough of the SageQuest Mobile Control Online & ESC integration.
ALEPH version Services / Task Manager South Dakota Library Network 1200 University, Unit 9672 Spearfish, SD © South Dakota Library.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
1 Data Management D0 Monte Carlo needs The NIKHEF D0 farm The data we produce The SAM data base The network Conclusions Kors Bos, NIKHEF, Amsterdam Fermilab,
The SAMGrid Data Handling System Outline:  What Is SAMGrid?  Use Cases for SAMGrid in Run II Experiments  Current Operational Load  Stress Testing.
Remote Production and Regional Analysis Centers Iain Bertram 24 May 2002 Draft 1 Lancaster University.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
Central Reconstruction System on the RHIC Linux Farm in Brookhaven Laboratory HEPIX - BNL October 19, 2004 Tomasz Wlodek - BNL.
November 7, 2001Dutch Datagrid SARA 1 DØ Monte Carlo Challenge A HEP Application.
D0 Farms 1 D0 Run II Farms M. Diesburg, B.Alcorn, J.Bakken, T.Dawson, D.Fagan, J.Fromm, K.Genser, L.Giacchetti, D.Holmgren, T.Jones, T.Levshina, L.Lueking,
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
Unit R005: Understanding Computer Systems Introduction System Software Software (i.e., programs) used to control the hardware directly Used to run the.
- Iain Bertram R-GMA and DØ Iain Bertram RAL 13 May 2004 Thanks to Jeff Templon at Nikhef.
Jefferson Lab Site Report Kelvin Edwards Thomas Jefferson National Accelerator Facility Newport News, Virginia USA
CFS PO PRINT Navigation: My Fresno State > Reports Portfolio > Financials > CFS Purchase Order Print.
Practice and Evaluation. Practice Develop a java class called: SumCalculator.java which computes a sum of all integer from 1 to 100 and displays the result.
Write-through Cache System Policies discussion and A introduction to the system.
Module 1: Installing Microsoft Windows XP Professional.
Framework of Job Managing for MDC Reconstruction and Data Production Li Teng Zhang Yao Huang Xingtao SDU
SAM Installation Lauri Loebel Carpenter and the SAM Team February
SAM - Sequential Data Access via Metadata Schema Metadata Functionality Workshop Glasgow University April 26-28,2004.
SPW1 Database Architecture Networked (DAN) January 29, 2003 Stephen P. White – CEPA/DBS.
Lee Lueking 1 The Sequential Access Model for Run II Data Management and Delivery Lee Lueking, Frank Nagy, Heidi Schellman, Igor Terekhov, Julie Trumbo,
Unified scripts ● Currently they are composed of a main shell script and a few auxiliary ones that handle mostly the local differences. ● Local scripts.
New stager commands Details and anatomy CASTOR external operation meeting CERN - Geneva 14/06/2005 Sebastien Ponce, CERN-IT.
Proposal for a IS schema Massimo Sgaravatto INFN Padova.
1 Andrea Sciabà CERN Critical Services and Monitoring - CMS Andrea Sciabà WLCG Service Reliability Workshop 26 – 30 November, 2007.
STAR Collaboration, July 2004 Grid Collector Wei-Ming Zhang Kent State University John Wu, Alex Sim, Junmin Gu and Arie Shoshani Lawrence Berkeley National.
UTA MC Production Farm & Grid Computing Activities Jae Yu UT Arlington DØRACE Workshop Feb. 12, 2002 UTA DØMC Farm MCFARM Job control and packaging software.
Re-Reconstruction Of Generated Monte Carlo In a McFarm Context 2003/09/26 Joel Snow, Langston U.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
OSes: 2. Structs 1 Operating Systems v Objective –to give a (selective) overview of computer system architectures Certificate Program in Software Development.
Analysis Tools at D0 PPDG Analysis Grid Computing Project, CS 11 Caltech Meeting Lee Lueking Femilab Computing Division December 19, 2002.
December 07, 2006Parag Mhashilkar, Fermilab1 Samgrid – OSG Interoperability Parag Mhashilkar, Fermi National Accelerator Laboratory.
November 1, 2004 ElizabethGallas -- D0 Luminosity Db 1 D0 Luminosity Database: Checklist for Production Elizabeth Gallas Fermilab Computing Division /
Bringing your favorite analysis applications to iPlant using Docker containers Nirav Merchant
Update on NIKHEF D0 farm June June 6, 2002D0RACE2 Outline Status of D0 farm –Upgrades –Move into grid network Use of EDG testbed and DAS-2 cluster.
EGEE is a project funded by the European Union under contract IST Experiment Software Installation toolkit on LCG-2
DZero Monte Carlo Production Ideas for CMS Greg Graham Fermilab CD/CMS 1/16/01 CMS Production Meeting.
Alien and GSI Marian Ivanov. Outlook GSI experience Alien experience Proposals for further improvement.
Introduction to the SAM System at DØ Physics 5391 July 1, 2002 Mark Sosebee U.T. Arlington.
ATLAS TIER3 in Valencia Santiago González de la Hoz IFIC – Instituto de Física Corpuscular (Valencia)
SQL Advanced Monitoring Using DMV, Extended Events and Service Broker Javier Villegas – DBA | MCP | MCTS.
CDF SAM Deployment Status Doug Benjamin Duke University (for the CDF Data Handling Group)
Esri UC 2014 | Technical Workshop | Administering ArcGIS for Server with Python Jon Bodamer.
Tracking, Computing & other Stuff. Correlation of detector hits The track segments of inner and outer MDCs are matched on Cluster level The track segments.
Vendredi 27 avril 2007 Management of ATLAS CC-IN2P3 Specificities, issues and advice.
September 26, 2003K User's Meeting1 CCJ Usage for Belle Monte Carlo production and analysis –CPU time: 170K hours (Aug.1, 02 ~ Aug.22, 03)
Compute and Storage For the Farm at Jlab
Root I/O and the Gaudi Framework
Welcome to Indiana University Clusters
Status report NIKHEF Willem van Leeuwen February 11, 2002 DØRACE.
Welcome to Indiana University Clusters
SAM at CCIN2P3 configuration issues
Quicken File Password related Issues
Quicken File Password related Issues
Oracle HFM Implementation Boot Camp
UM D0RACE STATION Status Report Chunhui Han June 20, 2002
Configuration Of A Pull Network.
Status report NIKHEF Willem van Leeuwen February 11, 2002 DØRACE.
Presentation transcript:

How to run MC on the D0 farm

Steps On hoeve (user fbsuser) –Get MC request –Create macro –Submit jobs On schuur (user willem) –Store files into SAM –Clear sam cache and /d0/mcc/curr

Get MC request setup sam_admin python Queue.py The Next Request to be processed is Request ID = 1608 with events. setup sam sam modify request status --request-id= status=running

Create macro cd ~fbsuser/mcp11 setup sam sam get request details --request-id= dictfmt > Request_1608.py python translate.py Request_1608.py > Request_1608.macro vi Request_1608.macro %s/xxxx/1608/ /NumRecords/s/1/ :g/recoanalyze/d On hoeve Check cardfile version Check group

Submit job cd ~fbsuser/mcp11 submit Request_1608.macro

Store files in SAM cd /data/disk1/willem./make_tosam

Clean farm ~fbsuser/bin/empty_schuur

To Do Check –Disk space –Endless loops –schuur:/tmp/fbs_scratch –Disk errors on nodes and servers Filestream –Access from node to schuur

Problems fbs can not contact schuur –/etc/hosts ?