Neng XU University of Wisconsin-Madison X D.  This instruction is for beginners to setup and test an Xrootd/PROOF pool quickly.  Following up each step.

Slides:



Advertisements
Similar presentations
Imaging Genetics with Scientific Linux 6.4 Bennett Landman Mary Ellen Koran Tricia Thornton-Wells January 20, 2014 version
Advertisements

Copyright GeneGo CONFIDENTIAL »« MetaCore TM (System requirements and installation) Systems Biology for Drug Discovery.
GSIAF "CAF" experience at GSI Kilian Schwarz. GSIAF Present status Present status installation and configuration installation and configuration usage.
1.1 Installing Windows Server 2008 Windows Server 2008 Editions Windows Server 2008 Installation Requirements X64 Installation Considerations Preparing.
Lesson 5-Accessing Networks. Overview Introduction to Windows XP Professional. Introduction to Novell Client. Introduction to Red Hat Linux workstation.
MCITP: Microsoft Windows Vista Desktop Support - Enterprise Section 1: Prepare to Deploy.
Lesson 4-Installing Network Operating Systems. Overview Installing and configuring Novell NetWare 6.0. Installing and configuring Windows 2000 Server.
Installing and Setting up mongoDB replica set PREPARED BY SUDHEER KONDLA SOLUTIONS ARCHITECT.
Integrating HADOOP with Eclipse on a Virtual Machine Moheeb Alwarsh January 26, 2012 Kent State University.
CVMFS AT TIER2S Sarah Williams Indiana University.
Va-scanCopyright 2002, Marchany Unit 3 – Installing Solaris Randy Marchany VA Tech Computing Center.
Getting Connected to NGS while on the Road… Donna V. Shaw, NGS Convocation.
1 Web Server Administration Chapter 3 Installing the Server.
Operating Systems Review. 5 Purposes of an Operating System Provide User Interface Communicate with Hardware Create and Manage a File System Network Support.
Thrive Installation.
© 2005,2006 NeoAccel Inc. Partners Presentation SSL VPN-Plus 2.0 Quick Start Guide.
Introduction to Windows XP Professional Chapter 2 powered by dj.
Setup your environment : From Andy Hass: Set ATLCURRENT file to contain "none". You should then see, when you login: $ bash Doing hepix login.
Module 13: Maintaining Software by Using Windows Server Update Services.
 For Oracle Based Products  Windows XP Professional-SP3 / Window7-SP1 (32 Bit)  Min. Dual Processor or above  RAM 2GB or above  Internet explorer.
MSc. Miriel Martín Mesa, DIC, UCLV. The idea Installing a High Performance Cluster in the UCLV, using professional servers with open source operating.
1 Web Server Administration Chapter 3 Installing the Server.
Installing and Configuring IIS. Reliable IIS 6.0 uses a new request-processing architecture and application-isolation environment that enables individual.
Module 1: Installing and Configuring Servers. Module Overview Installing Windows Server 2008 Managing Server Roles and Features Overview of the Server.
Linux in a Virtual Environment Nagarajan Prabakar School of Computing and Information Sciences Florida International University.
 First, check if Windows Server 2008 minimum hardware requirements matches your computer hardware through link below
The Future of Windows ComNET 2002 DC David Strom
Xrootd, XrootdFS and BeStMan Wei Yang US ATALS Tier 3 meeting, ANL 1.
Cisco Confidential © 2010 Cisco and/or its affiliates. All rights reserved. 1 MSE Virtual Appliance Presenter Name: Patrick Nicholson.
PROOF Cluster Management in ALICE Jan Fiete Grosse-Oetringhaus, CERN PH/ALICE CAF / PROOF Workshop,
Support in setting up a non-grid Atlas Tier 3 Doug Benjamin Duke University.
Architecture and ATLAS Western Tier 2 Wei Yang ATLAS Western Tier 2 User Forum meeting SLAC April
MICROSOFT HYPER-V 2012 Presentation By:- Danish Khan.
MIPS Project -- Simics Yang Diyi Outline Introduction to Simics Simics Installation – Linux – Windows Guide to Labs – General idea Score Policy.
Linux Operations and Administration Chapter Two Installing OpenSUSE.
The DCS lab. Computer infrastructure Peter Chochula.
HEP Computing Status Sheffield University Matt Robinson Paul Hodgson Andrew Beresford.
Vista and halFILE. Vista Minimum Specs An 800 MHz processor 512 MB of RAM A 20 GB hard drive with 15 GB of free space.
Microsoft Windows XP Professional MCSE Exam
1 MSRBot Web Crawler Dennis Fetterly Microsoft Research Silicon Valley Lab © Microsoft Corporation.
UTA Site Report DØrace Workshop February 11, 2002.
VirtualBox: How to create a Linux Virtual Machine.
Linux Operations and Administration
Sydney Region Servers. Windows 2003 Standard Configuration Able to be supported remotely Antivirus updates managed from server.
The 2001 Tier-1 prototype for LHCb-Italy Vincenzo Vagnoni Genève, November 2000.
PROOF tests at BNL Sergey Panitkin, Robert Petkus, Ofer Rind BNL May 28, 2008 Ann Arbor, MI.
PROOF Benchmark on Different Hardware Configurations 1 11/29/2007 Neng Xu, University of Wisconsin-Madison Mengmeng Chen, Annabelle Leung, Bruce Mellado,
Computer Hardware & Processing Inside the Box CSC September 16, 2010.
Bestman & Xrootd Storage System at SLAC Wei Yang Andy Hanushevsky Alex Sim Junmin Gu.
Data Analysis w ith PROOF, PQ2, Condor Data Analysis w ith PROOF, PQ2, Condor Neng Xu, Wen Guan, Sau Lan Wu University of Wisconsin-Madison 30-October-09.
Xen on Pre- Production Service Marco Verlato INFN-Padova High Availability Group Meeting, 3 October EGEE-II INFSO-RI EGEE and.
ALICE Offline Tutorial PART 3: PROOF Alice Core Offline 5 th June, 2008.
Linux Introduction Linux was developed in the early 1990’s by Linus Torvald computer science student at the University of Helsinki Linux is distributed.
IPPP Grid Cluster Phil Roffe David Ambrose-Griffith.
Basharat Institute of Higher Education
bitcurator-access-webtools Quick Start Guide
DIT314 ~ Client Operating System & Administration
Installing Windows Server 2008
How to download, configure and run a mapReduce program In a cloudera VM Presented By: Mehakdeep Singh Amrit Singh Chaggar Ranjodh Singh.
UBUNTU INSTALLATION
Jean-Philippe Baud - Sophie Lemaitre IT-GD, CERN May 2005
StratusLab Tutorial (Bordeaux, France)
Machine Learning Workshop
The Linux Operating System
Manchester HEP group Network, Servers, Desktop, Laptops, and What Sabah Has Been Doing Sabah Salih.
Tivoli Common Reporting v1.2 Overview
Linux Operations and Administration
bitcurator-access-webtools Quick Start Guide
1.3 Given a scenario, apply appropriate Microsoft command line tools
Presentation transcript:

Neng XU University of Wisconsin-Madison X D

 This instruction is for beginners to setup and test an Xrootd/PROOF pool quickly.  Following up each step and you should be able to get it work. If not, the main problem may be the Firewall.  There is no explanation of configuration files. To understand more, please check:  If you have further questions, this forum can help you:  The text in those grey boxes are the commands you need to run.

 Xrootd Redirector(PROOF Master) Recommend hardware: Dual Core 2.0GHz, 2GB RAM, 80GB Hard driver.  Data Servers(PROOF Slaves) Recommend hardware: 4xCore 2.4GHz, 8GB RAM, 80GB system hard driver, 500GB data disk or RAID. pcuw101 pcuwsun01pcuwsun02

 Get ROOT binary package on EVERY machine: If you have 32bit SLC4: > su > cd /opt > wget ftp://root.cern.ch/root/root_v Linux.slc4.gcc3.4.tar.gz > tar zxvf root_v Linux.slc4.gcc3.4.tar.gz If you have 64bit SLC4: > su > cd /opt > wget ftp://root.cern.ch/root/root_v Linux.slc4_amd64.gcc3.4.tar.gz > tar root_v Linux.slc4_amd64.gcc3.4.tar.gz  Add user “xrootd” on EVERY machine: > su > /usr/sbin/adduser xrootd > mkdir /var/log/xrootd > chown xrootd /var/log/xrootd pcuw101 pcuwsun01pcuwsun02

 Mount your data disk on Data servers. (In this sample, the data disk (/dev/sdb1) always mount on /xrootd directory.) > su > mkdir /xrootd > chown xrootd /xrootd > mount /dev/sdb1 /xrootd > df /xrootd pcuw101 pcuwsun01pcuwsun02

 They are SAME on ALL the nodes.  The main configure files are: ◦ /etc/xrootd.cf ◦ /etc/proof.conf  The start scripts are: ◦ /etc/init.d/xrootd ◦ /etc/init.d/olbd pcuw101 pcuwsun01pcuwsun02

xrootd.fslib /opt/root/lib/libXrdOfs.so xrd.port 1094 olb.port 3121 if exec olbd xrd.sched mint 10 maxt 100 avlt 20 fi xrootd.export /xrootd/ if pcuw101.cern.ch ofs.redirect remote ofs.forward all else ofs.redirect target fi oss.path /xrootd/ r/w olb.path rw /xrootd/ if pcuw101.cern.ch olb.role manager else olb.role server fi olb.subscribe pcuw101.cern.ch 3121 odc.manager pcuw101.cern.ch 3121 olb.delay startup 30 olb.space 20g 1g if exec xrootd xrd.protocol xproofd:1093 /opt/root/lib/libXrdProofd.so fi xpd.rootsys /opt/root xpd.workdir /xrootd/ xpd.intwait 20 xpd.resource static /etc/proof.conf xpd.role worker xpd.role master if pcuw101.cern.ch xpd.allow pcuw101.cern.ch xpd.poolurl root://pcuw101.cern.ch xpd.namespace /home/xrootd/proofpool pcuw101 pcuwsun01pcuwsun02 Change “pcuw101” to your own Xrootd Redirector’s hostname.

master pcuw101.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd pcuw101 pcuwsun01pcuwsun02 Change “pcuw101” to your own Xrootd Redirector’s hostname. Change “pcuwsun01” and “pcuwsun02” to your own Xrootd data servers’ hostname. > su > cd /etc/init.d > wget > wget > chmod 755 xrootd > chmod 755 olbd

 Go to each machine and do : > su > cd /etc/init.d > xrootd start > olbd start pcuw101 pcuwsun01pcuwsun02

 Follow STEP 2 to install ROOT on your desktop or laptop.  After installation, you can start the test. > source /opt/root/bin/thisroot.sh > xrdcp anyfile.txt root://pcuw101.cern.ch//xrootd/test/anyfile.txt [xrootd] Total MB |====================| % [49.6 MB/s] > xrdcp root://pcuw101.cern.ch//xrootd/test/anyfile.txt anyfile_back.txt [xrootd] Total MB |====================| % [49.6 MB/s] pcuw101 pcuwsun01pcuwsun02 your laptop

 source /opt/root/bin/thisroot.sh  mkdir ~/proof_test  cd ~/proof_test  wget  tar zxvf PROOF_test.tgz  cd PROOF_test  xrdcp proof_test._00001.root root://your_redirector//xrootd/test/proof_test/proof_test._00001.root  xrdcp proof_test._00002.root root://your_redirector//xrootd/test/proof_test/proof_test._00002.root  Modify run.C, change to  Modify makechain.C, change chain->Add("root://pcuw101.cern.ch//xrootd/test/proof_test/"+filename) to chain->Add("root://your_redirector//xrootd/test/proof_test/"+filename)

 Start running the PROOF job :  Then, you should be able to see these windows. > source /opt/root/bin/thisroot.sh > root –l [root].x run.C Starting master: opening connection... Starting master: OK Opening connections to workers: 1 out of 8 (10 %) PROOF set to parallel mode (8 workers)