Neng XU University of Wisconsin-Madison X D
This instruction is for beginners to setup and test an Xrootd/PROOF pool quickly. Following up each step and you should be able to get it work. If not, the main problem may be the Firewall. There is no explanation of configuration files. To understand more, please check: If you have further questions, this forum can help you: The text in those grey boxes are the commands you need to run.
Xrootd Redirector(PROOF Master) Recommend hardware: Dual Core 2.0GHz, 2GB RAM, 80GB Hard driver. Data Servers(PROOF Slaves) Recommend hardware: 4xCore 2.4GHz, 8GB RAM, 80GB system hard driver, 500GB data disk or RAID. pcuw101 pcuwsun01pcuwsun02
Get ROOT binary package on EVERY machine: If you have 32bit SLC4: > su > cd /opt > wget ftp://root.cern.ch/root/root_v Linux.slc4.gcc3.4.tar.gz > tar zxvf root_v Linux.slc4.gcc3.4.tar.gz If you have 64bit SLC4: > su > cd /opt > wget ftp://root.cern.ch/root/root_v Linux.slc4_amd64.gcc3.4.tar.gz > tar root_v Linux.slc4_amd64.gcc3.4.tar.gz Add user “xrootd” on EVERY machine: > su > /usr/sbin/adduser xrootd > mkdir /var/log/xrootd > chown xrootd /var/log/xrootd pcuw101 pcuwsun01pcuwsun02
Mount your data disk on Data servers. (In this sample, the data disk (/dev/sdb1) always mount on /xrootd directory.) > su > mkdir /xrootd > chown xrootd /xrootd > mount /dev/sdb1 /xrootd > df /xrootd pcuw101 pcuwsun01pcuwsun02
They are SAME on ALL the nodes. The main configure files are: ◦ /etc/xrootd.cf ◦ /etc/proof.conf The start scripts are: ◦ /etc/init.d/xrootd ◦ /etc/init.d/olbd pcuw101 pcuwsun01pcuwsun02
xrootd.fslib /opt/root/lib/libXrdOfs.so xrd.port 1094 olb.port 3121 if exec olbd xrd.sched mint 10 maxt 100 avlt 20 fi xrootd.export /xrootd/ if pcuw101.cern.ch ofs.redirect remote ofs.forward all else ofs.redirect target fi oss.path /xrootd/ r/w olb.path rw /xrootd/ if pcuw101.cern.ch olb.role manager else olb.role server fi olb.subscribe pcuw101.cern.ch 3121 odc.manager pcuw101.cern.ch 3121 olb.delay startup 30 olb.space 20g 1g if exec xrootd xrd.protocol xproofd:1093 /opt/root/lib/libXrdProofd.so fi xpd.rootsys /opt/root xpd.workdir /xrootd/ xpd.intwait 20 xpd.resource static /etc/proof.conf xpd.role worker xpd.role master if pcuw101.cern.ch xpd.allow pcuw101.cern.ch xpd.poolurl root://pcuw101.cern.ch xpd.namespace /home/xrootd/proofpool pcuw101 pcuwsun01pcuwsun02 Change “pcuw101” to your own Xrootd Redirector’s hostname.
master pcuw101.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd worker pcuwsun01.cern.ch workdir=/xrootd worker pcuwsun02.cern.ch workdir=/xrootd pcuw101 pcuwsun01pcuwsun02 Change “pcuw101” to your own Xrootd Redirector’s hostname. Change “pcuwsun01” and “pcuwsun02” to your own Xrootd data servers’ hostname. > su > cd /etc/init.d > wget > wget > chmod 755 xrootd > chmod 755 olbd
Go to each machine and do : > su > cd /etc/init.d > xrootd start > olbd start pcuw101 pcuwsun01pcuwsun02
Follow STEP 2 to install ROOT on your desktop or laptop. After installation, you can start the test. > source /opt/root/bin/thisroot.sh > xrdcp anyfile.txt root://pcuw101.cern.ch//xrootd/test/anyfile.txt [xrootd] Total MB |====================| % [49.6 MB/s] > xrdcp root://pcuw101.cern.ch//xrootd/test/anyfile.txt anyfile_back.txt [xrootd] Total MB |====================| % [49.6 MB/s] pcuw101 pcuwsun01pcuwsun02 your laptop
source /opt/root/bin/thisroot.sh mkdir ~/proof_test cd ~/proof_test wget tar zxvf PROOF_test.tgz cd PROOF_test xrdcp proof_test._00001.root root://your_redirector//xrootd/test/proof_test/proof_test._00001.root xrdcp proof_test._00002.root root://your_redirector//xrootd/test/proof_test/proof_test._00002.root Modify run.C, change to Modify makechain.C, change chain->Add("root://pcuw101.cern.ch//xrootd/test/proof_test/"+filename) to chain->Add("root://your_redirector//xrootd/test/proof_test/"+filename)
Start running the PROOF job : Then, you should be able to see these windows. > source /opt/root/bin/thisroot.sh > root –l [root].x run.C Starting master: opening connection... Starting master: OK Opening connections to workers: 1 out of 8 (10 %) PROOF set to parallel mode (8 workers)