UTAM REPRODUCIBLE RESEARCH AND C++ LIBRARIES Samuel Brown – February 6, 2009.

Slides:



Advertisements
Similar presentations
Working with pig Cloud computing lecture. Purpose  Get familiar with the pig environment  Advanced features  Walk though some examples.
Advertisements

1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
Using the Argo Cluster Paul Sexton CS 566 February 6, 2006.
Running Jobs on Jacquard An overview of interactive and batch computing, with comparsions to Seaborg David Turner NUG Meeting 3 Oct 2005.
New MPI Library on the cluster Since WSU’s Grid had an upgrade of its operating system recently, we need to use a new MPI Library to compile and run our.
Automated Tests in NICOS Nightly Control System Alexander Undrus Brookhaven National Laboratory, Upton, NY Software testing is a difficult, time-consuming.
ADLB Update Recent and Current Adventures with the Asynchronous Dynamic Load Balancing Library Rusty Lusk Mathematics and Computer Science Division Argonne.
Chapter-4 Windows 2000 Professional Win2K Professional provides a very usable interface and was designed for use in the desktop PC. Microsoft server system.
Parallel Processing LAB NO 1.
Introduction and simple using of Oracle Logistics Information System Yaxian Yao
Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.
Introduction to Hall-D Software February 27, 2009 David Lawrence - JLab.
DELTA TAU Data Systems, Inc. 1 UMAC TurboTurbo PMAC PCIGeo Drive Single Source Machine Control motion logic data Power PMAC Project Management November.
© 2011 Delmar, Cengage Learning Chapter 7 Managing a Web Server and Files.
Trilinos 101: Getting Started with Trilinos November 7, :30-9:30 a.m. Mike Heroux Jim Willenbring.
UNIX and Shell Programming (06CS36)
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
The Pipeline Processing Framework LSST Applications Meeting IPAC Feb. 19, 2008 Raymond Plante National Center for Supercomputing Applications.
VIPBG LINUX CLUSTER By Helen Wang March 29th, 2013.
Guideline: How to build AMSS source code? History: 01/02/ Make Draft 05/02/2010 – Release /02/2010 – Updated.
Parallel Interactive Computing with PyTrilinos and IPython Bill Spotz, SNL (Brian Granger, Tech-X Corporation) November 8, 2007 Trilinos Users Group Meeting.
:: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: ::::: :: GridKA School 2009 MPI on Grids 1 MPI On Grids September 3 rd, GridKA School 2009.
1 Automatic Processing Pipelines with XNAT and REDCap Vanderbilt University Benjamin Yvernault, Bennett Landman, Brian Boyd,
O.S.C.A.R. Cluster Installation. O.S.C.A.R O.S.C.A.R. Open Source Cluster Application Resource Latest Version: 2.2 ( March, 2003 )
MPI and High Performance Computing: Systems and Programming Barry Britt, Systems Administrator Department of Computer Science Iowa State University.
Installation and Development Tools National Center for Supercomputing Applications University of Illinois at Urbana-Champaign The SEASR project and its.
Using the BYU Supercomputers. Resources Basic Usage After your account is activated: – ssh You will be logged in to an interactive.
Soar Mazin Assanie, John Laird, Joseph Xu 1.
_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.
Apache Mahout Installation and Examples. Pre requisites Java ( jdk version ) Maven( version 3.0 or higher ) Mahout ( Download or svn repository ) Hadoop(
Software Overview Environment, libraries, debuggers, programming tools and applications Jonathan Carter NUG Training 3 Oct 2005.
UNIX and Shell Programming
Oracle Data Integrator Agents. 8-2 Understanding Agents.
Apr. 8, 2002Calibration Database Browser Workshop1 Database Access Using D0OM H. Greenlee Calibration Database Browser Workshop Apr. 8, 2002.
ATmospheric, Meteorological, and Environmental Technologies RAMS Parallel Processing Techniques.
How to for compiling and running MPI Programs. Prepared by Kiriti Venkat.
Towards large-scale parallel simulated packings of ellipsoids with OpenMP and HyperFlow Monika Bargieł 1, Łukasz Szczygłowski 1, Radosław Trzcionkowski.
Pipeline Introduction Sequential steps of –Plugin calls –Script calls –Cluster jobs Purpose –Codifies the process of creating the data set –Reduces human.
Running Parallel Jobs Cray XE6 Workshop February 7, 2011 David Turner NERSC User Services Group.
Getting Started with SIDL using the ANL SIDL Environment (ASE) ANL SIDL Team MCS Division, ANL April 2003 The ANL SIDL compilers are based on the Scientific.
UTAM Reproducible Research Package and C++ Seismic Library Samuel Brown November 5, 2008.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
1 Running MPI on “Gridfarm” Bryan Carpenter February, 2005.
Hyperion Artifact Life Cycle Management Agenda  Overview  Demo  Tips & Tricks  Takeaways  Queries.
Slide 1 Running NEMO at ECMWF Slide 1 NEMO under Perforce at ECMWF Kristian S. Mogensen Last revised:
HUBbub 2013: Developing hub tools that submit HPC jobs Rob Campbell Purdue University Thursday, September 5, 2013.
Portable Batch System – Definition and 3 Primary Roles Definition: PBS is a distributed workload management system. It handles the management and monitoring.
Jin Huang Ph.D. Candidate Massachusetts Institute of Technology.
Automatic Testing in Madagascar Jim Jennings Houston, Texas July, 2010.
Large-scale accelerator simulations: Synergia on the Grid turn 1 turn 27 turn 19 turn 16 C++ Synergia Field solver (FFT, multigrid) Field solver (FFT,
Debugging Lab Antonio Gómez-Iglesias Texas Advanced Computing Center.
Wouter Verkerke, NIKHEF 1 Using ‘stoomboot’ for NIKHEF-ATLAS batch computing What is ‘stoomboot’ – Hardware –16 machines, each 2x quad-core Pentium = 128.
CVS repositories, and how to set them up for using CCPN.
ORNL is managed by UT-Battelle for the US Department of Energy Spark On Demand Deploying on Rhea Dale Stansberry John Harney Advanced Data and Workflows.
Starting Analysis with Athena (Esteban Fullana Torregrosa) Rik Yoshida High Energy Physics Division Argonne National Laboratory.
Using ROSSMANN to Run GOSET Studies Omar Laldin ( using materials from Jonathan Crider, Harish Suryanarayana ) Feb. 3, 2014.
Compute and Storage For the Farm at Jlab
Hands on training session for core skills
Subversion Subversion is a brand of version control software that is frequently used to store the code and documentation of a project so as to permit.
PARADOX Cluster job management
CS5100 Advanced Computer Architecture
HPC usage and software packages
Welcome to our Nuclear Physics Computing System
Paul Sexton CS 566 February 6, 2006
Productivity Tools for Scientific Computing
Madagascar Installation
Welcome to our Nuclear Physics Computing System
Managing a Web Server and Files
Working in The IITJ HPC System
Black All good PowerPoint starts with black..
Presentation transcript:

UTAM REPRODUCIBLE RESEARCH AND C++ LIBRARIES Samuel Brown – February 6, 2009

Subversion Repository  svn co _research/trunk utam --username=utam2008  password: qUinoa80

Repository Snapshots   username: utam2008  password: qUinoa80  also contains images and intermediate data for student reports

Directory Structure

Prerequisites  Compiling C++ Library  scons version >= required  fftw3 - optional – need to set FFTWHOME  MPI C++ compiler/library – optional  C++ Library Documentation  Doxygen - optional

Environment Setup  Option 1:  cd utam  source utamvars.[c]sh  Option 2:  export UTAMHOME=/path/to/utam  source $UTAMHOME/utamvars.sh

Reproducibility  Report directories contain a latex file and uniform python script for generating results and compiling report  run.py: python only, does not use scons  generates and runs shell scripts interactively  simple mechanisms for downloading data and controlling computation with sources and targets

run.py Process( cmds=[ ], sources=[ ], targets=[ ], docmds=1, // check for targets or force/skip wdir=, // working directory bdir=, // batch directory sdir=, // source directory pbs=, // submit to cluster? nodes=, ppn=, walltime=, datapath=, scratchpath=, clean=, ktemps=, kbatch= )

C++ Compilation  Compilation must take place from $UTAMHOME/src/ucsl  Top-level SConstruct should be customized to your system  cd $UTAMHOME/src/ucsl  scons

SConstruct Customization USE_MPI=True BGP=False INTEL=False SANDDUNE=False HMM=False PS3D=False TEP=False if(BGP): UCPPFLAGS = ['-O5'] CC = 'bgxlc' CXX = 'bgxlc++' MPICC = 'mpixlc' MPICXX = 'mpixlcxx' BUILD_SERIAL = False USE_FFTW = True USE_THREAD = False

C++ Library Basic Objects  Parameter Initialization  Memory Abstractions  Traces  Axes  Planes  Volumes

C++ Library  Task-specific File I/O  Trace files  Volume files  Coordinate file

3D Modeling  3D domain decomposition object  ability to separate boundary and interior regions  load balancing  3D stencil overlap communication object