December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Grid Enabling Applications for the Grid: ENDYNE.

Slides:



Advertisements
Similar presentations
Copyright © 2008 SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
Advertisements

Utilizing the GDB debugger to analyze programs Background and application.
Chapter 6 Review System Software: Operating Systems and Utilities.
ISG We build general capability Job Submission on the Olympus Cluster J. DePasse; S. Brown, PhD; T. Maiden Pittsburgh Supercomputing Center Public Health.
GlueX Computing GlueX Collaboration Meeting – Glasgow Edward Brash – University of Regina August 4 th, 2003.
Sun Grid Engine Grid Computing Assignment – Fall 2005 James Ruff Senior Department of Mathematics and Computer Science Western Carolina University.
K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 8: Implementing and Managing Printers.
Guide To UNIX Using Linux Third Edition
Lecture 8 Configuring a Printer-using Magic Filter Introduction to IP Addressing.
Understanding the Basics of Computational Informatics Summer School, Hungary, Szeged Methos L. Müller.
DIRAC API DIRAC Project. Overview  DIRAC API  Why APIs are important?  Why advanced users prefer APIs?  How it is done?  What is local mode what.
ISG We build general capability Purpose After this tutorial, you should: Be comfortable submitting work to the batch queuing system of olympus and be familiar.
BaBar WEB job submission with Globus authentication and AFS access T. Adye, R. Barlow, A. Forti, A. McNab, S. Salih, D. H. Smith on behalf of the BaBar.
Recovery Manager Overview Target Database Recovery Catalog Database Enterprise Manager Recovery Manager (RMAN) Media Options Server Session.
December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Configuring Resources for the Grid Jerry Perez.
Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.2: Cluster and Grid Computing: Case studies Condor introduction August 9, 2006 Nadya.
December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Grid Technology: The Rough Guide Grid Building.
Dynamic Firewalls and Service Deployment Models for Grid Environments Gian Luca Volpato, Christian Grimm RRZN – Leibniz Universität Hannover Cracow Grid.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
VIPBG LINUX CLUSTER By Helen Wang March 29th, 2013.
Bigben Pittsburgh Supercomputing Center J. Ray Scott
Grid Computing I CONDOR.
(1) A Beginner’s Quick Start to SIMICS. (2) Disclaimer This is a quick start document to help users get set up quickly Does not replace the user guide.
Rochester Institute of Technology Job Submission Andrew Pangborn & Myles Maxfield 10/19/2015Service Oriented Cyberinfrastructure Lab,
Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 3: Operating-System Structures System Components Operating System Services.
UNIX Commands. Why UNIX Commands Are Noninteractive Command may take input from the output of another command (filters). May be scheduled to run at specific.
© Janice Regan, CMPT 300, May CMPT 300 Introduction to Operating Systems Operating Systems Overview Part 2: History (continued)
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
1 Sergio Maffioletti Grid Computing Competence Center GC3 University of Zurich Swiss Grid School 2012 Develop High Throughput.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.
December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide User Interfaces to Grids Patrick Hurley Texas.
July 11-15, 2005Lecture3: Grid Job Management1 Grid Compute Resources and Job Management.
Portal Update Plan Ashok Adiga (512)
INFSO-RI Enabling Grids for E-sciencE Running ECCE on EGEE clusters Olav Vahtras KTH.
CPSC 171 Introduction to Computer Science System Software and Virtual Machines.
Application Software System Software.
Cluster Computing Applications for Bioinformatics Thurs., Sept. 20, 2007 process management shell scripting Sun Grid Engine running parallel programs.
February 22-23, Washington D.C. SURA ENDyne Software for Dynamics of Electrons and Nuclei in Molecules. Developed by Dr. Yngve Öhrn and Dr. Erik Deumens,
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
ANR CIGC LEGO (ANR-CICG-05-11) Bordeaux, 2006, December 11 th Automatic Application Deployment on Grids Landry Breuil, Boris Daix, Sébastien Lacour, Christian.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Computational chemistry with ECCE on EGEE.
Project18 Communication Design + Parallelization Camilo A Silva BIOinformatics Summer 2008.
HUBbub 2013: Developing hub tools that submit HPC jobs Rob Campbell Purdue University Thursday, September 5, 2013.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
Large-scale accelerator simulations: Synergia on the Grid turn 1 turn 27 turn 19 turn 16 C++ Synergia Field solver (FFT, multigrid) Field solver (FFT,
Debugging Lab Antonio Gómez-Iglesias Texas Advanced Computing Center.
Wouter Verkerke, NIKHEF 1 Using ‘stoomboot’ for NIKHEF-ATLAS batch computing What is ‘stoomboot’ – Hardware –16 machines, each 2x quad-core Pentium = 128.
Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.
INTRODUCTION TO XSEDE. INTRODUCTION  Extreme Science and Engineering Discovery Environment (XSEDE)  “most advanced, powerful, and robust collection.
Grid Computing: An Overview and Tutorial Kenny Daily BIT Presentation 22/09/2016.
Advanced Computing Facility Introduction
GRID COMPUTING.
PARADOX Cluster job management
OpenPBS – Distributed Workload Management System
Prepared by: Eng. Maryam Adel Abdel-Hady
IW2D migration to HTCondor
Using Paraguin to Create Parallel Programs
Grid Application Support Group Case study Schrodinger equations on the Grid Status report 16. January, Created by Akos Balasko
Introduction to SimpleScalar
Practice #0: Introduction
NGS computation services: APIs and Parallel Jobs
Compiling and Job Submission
CCR Advanced Seminar: Running CPLEX Computations on the ISE Cluster
Exploring the Power of EPDM Tasks - Working with and Developing Tasks in EPDM By: Marc Young XLM Solutions
Good Testing Practices
gLite Job Management Christos Theodosiou
Working in The IITJ HPC System
Presentation transcript:

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Grid Enabling Applications for the Grid: ENDYNE Jerry Perez, Senior Administrator - Texas Tech University C 2 H 2 Target Carbon 1 Carbon 2 d=15 a.u. b p x z H + Projectile, Hydrogen 3   [  ] Orientation y Hydrogen 2 Hydrogen 1

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide ENDYNE Credits K. Tsereteli, S. Addepalli, J. Perez & J. A Morales

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide What is ENDYNE? With Coherent-States Theory, a Chemical Reaction Can Be Formulated As Reactants-to-Products Trajectories in a Quantum Phase Space As It Were Classical Mechanics The Several Trajectories Necessary to Simulate One Single Reaction Can Be Efficiently Run in Parallel on a Compute Grid.

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide How does ENDYNE run on a cluster? A batch file was written for the ENDYNE users and stored in an environment variable called DYNROOT$ The batch file that ran single processor jobs was called “endyne”. The batch file called “run” submits multiple ENDYNE jobs into the queue by reading multiple input files from the directory “run” is ran in.

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide How does ENDYNE run on a cluster? Before any jobs are submitted, the files must be prepared for running: 1. prepare the "endyne_H+HF_opt_pvdz in" 2. optimize the "endyne_H+HF_opt_pvdz in" by command "endyne endyne_H+HF_opt_pvdz in > inin" 3. collect the zoca parameters by using collect.pe program and command "./collect.pe >outout" 4. prepare the "endyne_H+HF_run_pvdz tmpl.in" and insert the zoca parameters from "outout" file 5. modify the "run" file to program path of input files 6. modify the endynejob file to handle output files 7. type "./run" to submit the job 8. type "qstat" to see the job

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Grid enabling ENDYNE on a Cycle Scavenging Grid Had to remove environment dependencies (DYNROOT$). Had to recompile ENDYNE for uniprocessor capabilities. TEST recompiled program locally before moving it onto the grid!!! Had to register libraries and necessary input files with the grid. Had to teach researchers how to use TechGrid campus-wide grid. Approx 3 hours of instruction with added documentation was necessary to get them on their feet.

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Grid enabling ENDYNE on a Globus Grid If all sites wish to use ENDYNE, one way is to create an environment variable called DYNROOT$. Another way to run ENDYNE is to do away with environmental dependencies and recompile for static execution. The following program is a Perl script written by TTU’s Srirangam Addepalli that allows users to create a GUI that runs ENDYNE and exports DYNROOT$.

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Grid enabling ENDYNE on a Globus Grid and a Data Grid #!/usr/bin/perl -w $run=1; while($run=="1") { system ("clear ;"); print(" Select one of the following options \n"); print(" Type of Job \n"); print(" 0. Hit Zero Any time to Quit \n"); print(" 1. Data, Executable on Data Grid \n"); print(" 2. Executable on Local Node \n"); print(" 3. Source on Data Grid \n"); print(" 4. Output on Data Grid \n"); print(" 5. View output file \n");

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide print("My Option:"); my $option = ; if ($option==0) { exit 0; } if ($option==1) { print(" Data Executable on Data Grid \n"); print("Name Executable: "); my $executable= "endyne"; print "\n"; print("Input File:"); my $input="endyne1.inp"; print"\n"; print("Output:"); my $output="endyne.out";

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide print "\n"; print (" Available Executables \n"); system ("find /mnt/avaki/data/rangam -name $executable > jobexec "); #open(executables, "/home/addepall/jobexec"); = executables; #foreach $line #{ # print "$line"; #} print ("1/0 for executable: \n"); $selection= ; if ($selection=="1") { print (" "); print ("\n Pushing Executable to Data Grid \n");

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide system("globus-url-copy -vb -p 20 -dbg gsiftp://antaeus.hpcc.ttu.edu:2811/home/addepall/GRI D/endyne gsiftp://buda.tacc.utexas.edu:2811/home/a ddepall/endyne &"); for ($wait=0;$wait < 15; $wait=$wait+1) { print ("*"); system("sleep 0.5;"); } print ("\n Pushing input on to remote Execute host \n"); for ($wait=0;$wait < 10; $wait=$wait+1) { print ("*"); system("sleep 0.5;");

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide } system ("cat /proc/net/tcp;"); #system("globus-url-copy -vb -p 20 -dbg gsiftp://antaeus.hpcc.ttu.edu:2811/home/addepall/GRI D/endyne gsiftp://buda.tacc.utexas.edu:2811/home/a ddepall/endyne ; system (" globus-url-copy -dbg gsiftp://antaeus.hpcc.ttu.edu:2811/home/addepall/GRI D/endyne.inp gsiftp://buda.tacc.utexas.edu:2811/home/addepall/end yne.inp; globus-job-submit buda.tacc.utexas.edu:2119 /home/addepall/DrEscobar/script2.sh"); system ("cd /home/addepall/GRID/; export DYNROOT=./;./endyne /mnt/avaki/data/rangam/$input > $input.out&; ");

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide } if ($option==2) { print(" Data Executable on Data Grid \n"); print("Name of Executable: "); my $executable="ENDYNE"; print "\n"; print("Input File:"); my $input="endyne.inp"; print"\n"; print("Output:"); my $output="endyne.output"; print "\n"; {

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide system ("cd /home/addepall/GRID/; export DYNROOT=./;./endyne endyne.inp | tee endyne.out "); } if ($option==3) { print(" Data,Executable,Outp ut Different Location \n"); print("Name of Executable: "); my $executable="endyne"; print "\n"; my $input="endyne.inp"; print"\n";

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide my $output="endyne.out"; $inputfile="$input"; $outputfile="$output"; print " \n Acquiring ENDYNE GRID IMAGE "; print "\n Running Endyne on Local Machine"; print ("\n Finished Endyne Job"); print ("\n Cleaning your tracks and Protecting your source" ); for ($wait=0;$wait < 13; $wait=$wait+1) { print ("*"); system("sleep 0.5;"); } print ("\n"); {

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide system ("cp /mnt/avaki/data/rangam/*tar /home/addepall; system ("echo $MESSAGE1; tar -xvf GRID-REAL.tar; cd GRID; export DYNROOT=./; echo $MESSAGE2;./endyne H4+-md.inp > H4+-md.out; echo $MESSAGE3; cp H4+-md.out../endyne.out; cd /home/addepall; echo $MESSAGE4;");

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide } if ($option==5) { print" View Output File \n"; print("Name of outputfile \n"); my $output="endyne.out"; system ("cat $output ;"); } print " Perform Another Operation \n"; $run=1; }

December 8 & 9, 2005, Austin, TX SURA Cyberinfrastructure Workshop Series: Grid Technology: The Rough Guide Questions?