Weekly Work Dates:2010 8/20~8/25 Subject:Condor C.Y Hsieh
Introduction 1988, University of Wisconsin-Madison High Throughput Computing (HTC) High-Performance Computing(HPC),ex:MPI 。 High-Throughput Computing (HTC),ex:Condor 。 How to work?
Job1 Job2 Job3 Job4 :::::::::: Condor users upload jobs distribute CPU1 CPU2 CPU3 CPU4 :::::::::: Pool
The Architecture of Condor Step1Step2 Step3 Step4 Only one A. collector B. negotiator Any,more than one Submit Job Any,more than one Execute job
Setting Master: central manager submit machine execute machine. Node1 submit machine execute machine. Node2 submit machine execute machine. Master Central manager Submit machine Execute machine Node1 Submit machine Execute machine Node2 Submit machine Execute machine CPU1 CPU2
Install Condor #download file from websit to /etc/yum.repos.d cd /etc/yum.repos.d wge wget #install condor yum install condor # Edit Condor's configuration file vi /etc/condor/condor_config #Globle configuration vi /etc/condor/condor_config.local #Local configuration # Start Condor daemons service condor start
Name OpSys Arch State Activity LoadAv Mem ActvtyTime LINUX INTEL Unclaimed Idle :00:04 LINUX INTEL Unclaimed Idle :00:05 LINUX INTEL Unclaimed Idle :00:04 LINUX INTEL Unclaimed Idle :00:05 Total Owner Claimed Unclaimed Matched Preempting Backfill INTEL/LINUX Total # Check the number of CPU in the pool condor_status
#node condor :16 ? 00:00:00 /usr/sbin/condor_master -pidfile /var/run/condor/condor.pid condor :16 ? 00:00:00 condor_schedd -f condor :16 ? 00:00:04 condor_startd -f root :16 ? 00:00:00 condor_procd -A /var/run/condor/procd_pipe.SCHEDD -R S 60 -C 103 root :36 pts/2 00:00:00 grep condor # Check if Condor is running ps -ef | grep condor #master condor :12 ? 00:00:01 /usr/sbin/condor_master -pidfile /var/run/condor/condor.pid condor :12 ? 00:00:00 condor_collector -f condor :12 ? 00:00:01 condor_negotiator -f condor :12 ? 00:00:00 condor_schedd -f condor :12 ? 00:00:04 condor_startd -f root :12 ? 00:00:00 condor_procd -A /var/run/condor/procd_pipe.SCHEDD -R S 60 -C 103 root :32 pts/3 00:00:00 grep condor