Holding slide prior to starting show. Applications WG Jonathan Giddy

Slides:



Advertisements
Similar presentations
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Advertisements

A Dynamic World, what can Grids do for Multi-Core computing? Daniel Goodman, Anne Trefethen and Douglas Creager
Greg Thain Computer Sciences Department University of Wisconsin-Madison Condor Parallel Universe.
M-grid Using Ubiquitous Web Technologies to create a Computational Grid R J Walters and S Crouch 21 January 2009.
Dr. David Wallom Use of Condor in our Campus Grid and the University September 2004.
RCAC Research Computing Presents: DiaGird Overview Tuesday, September 24, 2013.
GRID workload management system and CMS fall production Massimo Sgaravatto INFN Padova.
Contributing source code to CSDMS Albert Kettner.
Sun Grid Engine Grid Computing Assignment – Fall 2005 James Ruff Senior Department of Mathematics and Computer Science Western Carolina University.
GRID Workload Management System Massimo Sgaravatto INFN Padova.
UvA, Amsterdam June 2007WS-VLAM Introduction presentation WS-VLAM Requirements list known as the WS-VLAM wishlist System and Network Engineering group.
First steps implementing a High Throughput workload management system Massimo Sgaravatto INFN Padova
Southern Connecticut State University Exit Survey Eduardo Robalino Sponsor Klaus Peters.
Evaluation of the Globus GRAM Service Massimo Sgaravatto INFN Padova.
Enabling Grids for E-sciencE Medical image processing web portal : Requirements analysis. An almost end user point of view … H. Benoit-Cattin,
1 Integrated Development Environment Building Your First Project (A Step-By-Step Approach)
CONDOR DAGMan and Pegasus Selim Kalayci Florida International University 07/28/2009 Note: Slides are compiled from various TeraGrid Documentations.
DIANE Overview Germán Carrera, Alfredo Solano (CNB/CSIC) EMBRACE COURSE Monday 19th of February to Friday 23th. CNB-CSIC Madrid.
High Throughput Parallel Computing (HTPC) Dan Fraser, UChicago Greg Thain, Uwisc.
Research Computing with Newton Gerald Ragghianti Newton HPC workshop Sept. 3, 2010.
Christopher Jeffers August 2012
Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.2: Cluster and Grid Computing: Case studies Condor introduction August 9, 2006 Nadya.
What is Sure BDCs? BDC stands for Batch Data Communication and is also known as Batch Input. It is a technique for mass input of data into SAP by simulating.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
C HU H AI C OLLEGE O F H IGHER E DUCATION D EPARTMENT O F C OMPUTER S CIENCE Preparation of Final Year Project Report Bachelor of Science in Computer Science.
Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
High Throughput Parallel Computing (HTPC) Dan Fraser, UChicago Greg Thain, UWisc Condor Week April 13, 2010.
BLU-ICE and the Distributed Control System Constraints for Software Development Strategies Timothy M. McPhillips Stanford Synchrotron Radiation Laboratory.
Debugging and Profiling GMAO Models with Allinea’s DDT/MAP Georgios Britzolakis April 30, 2015.
3-2.1 Topics Grid Computing Meta-schedulers –Condor-G –Gridway Distributed Resource Management Application (DRMAA) © 2010 B. Wilkinson/Clayton Ferner.
2011 Computer Architecture Project #1 MIPS Programming: Merge Sort Ki Sup Hong Room 236, Engineering Building.
INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.
Condor Project Computer Sciences Department University of Wisconsin-Madison A Scientist’s Introduction.
Dr. Ahmed Abdeen Hamed, Ph.D. University of Vermont, EPSCoR Research on Adaptation to Climate Change (RACC) Burlington Vermont USA MODELING THE IMPACTS.
Practice and Evaluation. Practice Develop a java class called: SumCalculator.java which computes a sum of all integer from 1 to 100 and displays the result.
LHCb Software Week November 2003 Gennady Kuznetsov Production Manager Tools (New Architecture)
SEE-GRID-SCI The SEE-GRID-SCI initiative is co-funded by the European Commission under the FP7 Research Infrastructures contract no.
Interactive Workflows Branislav Šimo, Ondrej Habala, Ladislav Hluchý Institute of Informatics, Slovak Academy of Sciences.
Open Science Grid OSG Engagement Strategy and Status ETP Conference Call Oct ; 5:30PM EST Bringing additional non-physicists onto OSG John McGee.
CUDA Basics. Overview What is CUDA? Data Parallelism Host-Device model Thread execution Matrix-multiplication.
Architecture View Models A model is a complete, simplified description of a system from a particular perspective or viewpoint. There is no single view.
Getting Started with SIDL using the ANL SIDL Environment (ASE) ANL SIDL Team MCS Division, ANL April 2003 The ANL SIDL compilers are based on the Scientific.
MATRIX MULTIPLY WITH DRYAD B649 Course Project Introduction.
© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.
C HU H AI C OLLEGE O F H IGHER E DUCATION D EPARTMENT O F C OMPUTER S CIENCE Preparation of Final Year Project Report Bachelor of Science in Computer Science.
Application Programming in Cloud via Swift Swift Tutorial, CCGrid 2013, Hour 2 Ketan Maheshwari.
Jim Conboy / DPGTF-H 20-May Toric at JET – Status & Tools Work in Progress – See for latest.
INFSO-RI Enabling Grids for E-sciencE Using of GANGA interface for Athena applications A. Zalite / PNPI.
Purdue RP Highlights TeraGrid Round Table May 20, 2010 Preston Smith Manager - HPC Grid Systems Rosen Center for Advanced Computing Purdue University.
Large-scale accelerator simulations: Synergia on the Grid turn 1 turn 27 turn 19 turn 16 C++ Synergia Field solver (FFT, multigrid) Field solver (FFT,
Simulation of O2 offline processing – 02/2015 Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture Eugen Mudnić.
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
HPC University Requirements Analysis Team Training Analysis Summary Meeting at PSC September Mary Ann Leung, Ph.D.
Five todos when moving an application to distributed HTC.
Chapter 2 Build Your First Project A Step-by-Step Approach 2 Exploring Microsoft Visual Basic 6.0 Copyright © 1999 Prentice-Hall, Inc. By Carlotta Eaton.
GridWay Overview John-Paul Robinson University of Alabama at Birmingham SURAgrid All-Hands Meeting Washington, D.C. March 15, 2007.
GGF8 DRMAA State of C binding/implementation DRMAA implementation compliance test Andreas Haas Sun Microsystems GGF10 Berlin,
Software Analytics Platform
Grid Application Support Group Case study Schrodinger equations on the Grid Status report 16. January, Created by Akos Balasko
NGS computation services: APIs and Parallel Jobs
Building and Testing using Condor
Teaching Computing to GCSE
Teaching Computing to GCSE
Computer Programming.
Programming Languages
rvGAHP – Push-Based Job Submission Using Reverse SSH Connections
Contributing source code to CSDMS
Production Manager Tools (New Architecture)
Presentation transcript:

Holding slide prior to starting show

Applications WG Jonathan Giddy

Objectives Find out who’s here Gather case studies of applications –Basic details of applications & contacts –Select issues with using Condor –Discuss solutions, attempted and potential Create a section for the Condor Week document –Basic details of all applications & contacts –Real or potential solutions to problems –Requirements for Condor or 3 rd parties No new items on our To Do lists

Survey What field are you working in? –Bio, Chem, Phys, Earth Sci, Engin, Econ, Soc Sci, Humanities, Comp Sci, Grid,… Architecture –Single, Pleasantly Parallel, MW, Workflow What 3rd party codes do you use? –BLAST, Gaussian,… What libraries do you use? –MPI, OpenMP, pthreads, sockets,… What languages do you use? –Fortran, C, C++, Java, Perl, Python, VB,…

Report Description of problem area and application Issues with running the application using Condor, or “Condor is wonderful” Solutions –Attempted solutions that did not work –A solution that worked, and comments on how satisfactory the solution is –Other solutions that come to mind, but haven’t been tried, or that require modifications to Condor or other non-trivial effort

Example Long-running physics simulation written using OpenMP run on our 8x8 processor SGI Condor pool Issue: –Condor does not support OpenMP Our solution: –Use VIRTUAL_MACHINE_TYPE to partition machine into 3x8 processor VM’s and 40x1 processor VM’s. –Inflexible configuration and complex policy

Some More Examples Running a Matlab application on nodes that may not have Matlab installed File transfer under Condor-G Long running Windows applications Controlling Condor from applications Need application exit code to make decisions Licence control Application tries to display a window Code uses particular x86 extensions Watch output of program during execution Pool configuration was inappropriate

Layout Field, application summary, project, contact For one project: Description of –the problem solved by the application –the application characteristics: runtime, libraries, parameters,… –the experiment: no. of jobs, data source,… Issues with running the application using Condor, and optionally, for each issue: –Attempted solutions –Implemented solutions –Potential solutions

Potential solutions How would I submit 'perl foo.pl' to Condor in the submit file? RTFM Add to documentation / FAQ Create a perl universe… …and python, tcl, matlab… Create a capability to create arbitrary universes