Grid NERSC demo Shreyas Cholia Open Software and Programming NERSC User Group Meeting September 19, 2007

NERSC User Group Meeting, September 17, Overview Getting a certificate Initializing a certificate Registering certificate with NIM Submitting a fork job Submitting a serial job Submitting an MPI job Moving files with GridFTP Third party transfers with GridFTP Using myproxy to store your certificate

NERSC User Group Meeting, September 17, Getting a Certificate Instructions at: – Process: – –Click on Retrieval->New User. –Fill out form. –You will receive an once the certificate is ready. Click on the link. –Click on the import button in your browser. –Export/Backup certificate to local file –Convert file to usercert/key.pem using openssl Renew Annually - repeat above process

NERSC User Group Meeting, September 17, Initializing Your Cert Load the globus module. One of: module load globus module load osg. /usr/common/osg/0.6.0/setup.sh Your certificate is in: $HOME/.globus/usercert.pem $HOME/.globus/userkey.pem Initialize the cert: grid-proxy-init (Creates temporary “proxy” cert valid for 12 hours) View cert: grid-cert-info grid-proxy-info

NERSC User Group Meeting, September 17, Adding Cert Info to NIM Click on Grid certificates tab Click on Add Certificate Enter information from: grid-cert-info -subject grid-cert-info -issuer

NERSC User Group Meeting, September 17, For More Information NERSC Website –

NERSC User Group Meeting, September 17, Fork jobs Run a job for immediate execution: # globus-job-run davinci/jobmanager /bin/hostname davinci Submit a job # globus-job-submit davinci/jobmanager /bin/hostname Query submitted job # globus-job-status DONE Get output # globus-job-get-output davinci

NERSC User Group Meeting, September 17, Serial Jobs # globus-job-submit pdsfgrid/jobmanager-sge /bin/date 2/ # globus-job-get-output 2/ Tue Sep 18 14:47:06 PDT 2007

NERSC User Group Meeting, September 17, Parallel Jobs Create RSL script & (host_xcount=4) (xcount=2) (jobtype=mpi) (directory=/usr/common/homes/s/shreyas/sandbox) (executable=/usr/common/homes/s/shreyas/sandbox/cpi) (stdout=x-gass- cache://$(GLOBUS_GRAM_JOB_CONTACT)stdout anExtraTag) (stderr=x-gass- cache://$(GLOBUS_GRAM_JOB_CONTACT)stderr anExtraTag)

NERSC User Group Meeting, September 17, Parallel Jobs Submit Job # globusrun -r jacquardgrid.nersc.gov/jobmanager-pbs -f cpi.rsl -b Query Q # globus-job-run jacquardgrid/jobmanager /usr/common/nsg/torque/bin/qstat Get results # globus-job-get-output

NERSC User Group Meeting, September 17, Output PBS Leader node is jaccn203 Job setup time: Tue Sep 18 14:51:47 PDT 2007 Setting up security Job startup at Tue Sep 18 14:51:52 PDT pi is approximately , Error is wall clock time = Jobs exit status code is Job STDIN/ jacin03-m.nersc.gov completed Tue Sep 18 14:51:54 PDT 2007 Submitted by shreyas/shreyas using mpccc Job Limits: ncpus=1,nodes=4:ppn=2,walltime=00:30:00 Job Resources used: cput=00:00:00,mem=5340kb,vmem=33288kb,walltime=00:00:02 Nodes used: jaccn181 jaccn183 jaccn194 jaccn203 Killing any leftover processes...

NERSC User Group Meeting, September 17, File Transfer Get File from HPSS # globus-url-copy -nodcau \ gsiftp://garchive.nersc.gov//nersc/ccc/shreyas/Animals/gnu file:///home/shreyas/gnu file:///home/shreyas/gnu Third party copy # globus-url-copy gsiftp://pdsfgrid.nersc.gov//home/shreyas/Animals/gnu gsiftp://davinci.nersc.gov//u/s/shreyas/Animals/gnu Uberftp –Provides interactive access to gridftp server

NERSC User Group Meeting, September 17, MyProxy If you use several client systems Copying your.globus directory everywhere can be tedious Myproxy provides central certificate repository Storing cert # myproxy-init -s myproxy.nersc.gov (Valid for 1 week. Use -c for non-default lifetime) Getting cert # myproxy-logon -s myproxy.nersc.gov (Same effect as grid-proxy-init - you have a temporary proxy valid for 12 hours)