Foundation API The Fast Version. Follow my examples Example: building App for GMAP on Stampede Materials are in the Data Store: – Community Data/iplantcollaborative/example_data/gmap.

Slides:

Advertisements

Similar presentations

MQ Series Cross Platform Dominant Messaging sw – 70% of market Messaging API same on all platforms Guaranteed one-time delivery Two-Phase Commit Wide EAI.

Advertisements

Slow Control LHCf Catania Meeting - July 04-06, 2009 Lorenzo Bonechi.

AMLAPI: Active Messages over Low-level Application Programming Interface Simon Yau, Tyson Condie,

NETW-240 Shells Last Update Copyright Kenneth M. Chipps Ph.D. 1.

Linux+ Guide to Linux Certification, Second Edition

Node-level Representation and System Support for Network Programming Jaein Jeong.

CCNA 2 v3.1 Module 2.

Building a Deployment The following screens demonstrate how to: 1. Create a new OpenHRE™ tailor-made deployment using a remote (sample) deployment Standard.

AR Invoices To Customers Presented by Chitra Kanakaraj.

MSF Testing Introduction Functional Testing Performance Testing.

HPCC Mid-Morning Break Interactive High Performance Computing Dirk Colbry, Ph.D. Research Specialist Institute for Cyber Enabled Discovery.

Deployment Management The following screens demonstrate how to: 1. Access and view deployments 2. Create a new local deployment 3. Create and modify a.

Snippet Management The following screens demonstrate how to: 1. Access and view snippets 2. Create a local standard snippet, or a local class snippet 3.

1 Introducing Windows Backup There are different methods for starting Windows 2000 Backup. Requirements for running Windows 2000 Backup All users can back.

Lecture 3 – Data Storage with XML+AJAX and MySQL+socket.io

TESTING STRATEGY Requires a focus because there are many possible test areas and different types of testing available for each one of those areas. Because.

The ATLAS Production System. The Architecture ATLAS Production Database Eowyn Lexor Lexor-CondorG Oracle SQL queries Dulcinea NorduGrid Panda OSGLCG The.

Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.

IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.

MARC 10.5 Update John Harvey. MARC 10.5 Changes  Backup Scripts restructured  Added a script to generate scripts outside of MARC  Generate Scripts.

Rsv-control Marco Mambelli – Site Coordination meeting October 1, 2009.

AUTOBUILD Build and Deployment Automation Solution.

ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.

The Pipeline Processing Framework LSST Applications Meeting IPAC Feb. 19, 2008 Raymond Plante National Center for Supercomputing Applications.

WEB API: WHY THEY MATTER ECOL 453/ Nirav Merchant

15 Copyright © 2007, Oracle. All rights reserved. Performing Database Backups.

Marianne BargiottiBK Workshop – CERN - 6/12/ Bookkeeping Meta Data catalogue: present status Marianne Bargiotti CERN.

1 Overview of the Application Hosting Environment Stefan Zasada University College London.

The Professional Open Source™ Company CLI Shell JBossNetwork Enterprise Manager Command Line Interface.

Training Guide for Inzalo SOP Users. This guide has been prepared to demonstrate the use of the Inzalo Intranet based SOP applications. The scope of this.

Siebel 8.0 Module 5: EIM Processing Integrating Siebel Applications.

Some Design Notes Iteration - 2 Method - 1 Extractor main program Runs from an external VM Listens for RabbitMQ messages Starts a light database engine.

Module 5: Upgrading to SQL Server 7.0. Overview Planning an Upgrade Preparing to Upgrade Verifying the Upgrade Setting a Compatibility Level.

New perfSonar Dashboard Andy Lake, Tom Wlodek. What is the dashboard? I assume that everybody is familiar with the “old dashboard”:

Managing SX.e and TWL with MARC and Scripts Jeremiah Curtis

Enabling Grids for E-sciencE EGEE-III INFSO-RI Using DIANE for astrophysics applications Ladislav Hluchy, Viet Tran Institute of Informatics Slovak.

Linux+ Guide to Linux Certification, Second Edition Chapter 10 Managing Linux Processes.

The Foundation API How does it work?. How It Runs... At the DE: The job is started, it runs the Foundation API App, with the information provided in json#1.

Nursery Job card holders engaged in nursery. Go to GP/Imp. Login from Home Page.

© 2006 Cisco Systems, Inc. All rights reserved.1.

Running Kuali: A Technical Perspective Ailish Byrne (Indiana University) Jonathan Keller (University of California, Davis)

Esri UC 2014 | Technical Workshop | Creating Geoprocessing Services Kevin Hibma.

Dynamic Batch Processing March 19 10:00 AM David Steger.

Managing SX.e and TWL with scripts and MARC 02/12/04 Jeremiah Curtis.

INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.

IPlant Discovery Environment An Overview. What is it? The Discovery Environment has been described in many ways… “It’s a virtual workbench…” “It’s where.

ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.

"Data sources index" a web application to list projects in Hadoop Luca Menichetti.

SharePoint Online Migration API and Improvements

OPTIMIZATION OF DIESEL INJECTION USING GRID COMPUTING Miguel Caballer Universidad Politécnica de Valencia.

Open Science Grid Build a Grid Session Siddhartha E.S University of Florida.

Debugging Lab Antonio Gómez-Iglesias Texas Advanced Computing Center.

Active-HDL Server Farm Course 11. All materials updated on: September 30, 2004 Outline 1.Introduction 2.Advantages 3.Requirements 4.Installation 5.Architecture.

Galaxy in Production Nate Coraor Galaxy Team Penn State University.

SCI-BUS is supported by the FP7 Capacities Programme under contract nr RI CloudBroker usage Zoltán Farkas MTA SZTAKI LPDS

ORNL is managed by UT-Battelle for the US Department of Energy Spark On Demand Deploying on Rhea Dale Stansberry John Harney Advanced Data and Workflows.

9 Copyright © 2004, Oracle. All rights reserved. Getting Started with Oracle Migration Workbench.

The Next Step Hudson Fare Files 102 – Import & upload Rev. 10/14.

CACI Proprietary Information | Date 1 Upgrading to webMethods Product Suite Name: Semarria Rosemond Title: Systems Analyst, Lead Date: December 8,

MCproduction on the grid

Work report Xianghu Zhao Nov 11, 2014.

Heapsort CSE 373 Data Structures.

Status of Storm+Lustre and Multi-VO Support

Operation System Program 4

TOSCA-Metadata (directory )

TOSCA-Metadata (directory )

Configuration Of A Pull Network.

Heapsort CSE 373 Data Structures.

3.1 Basic Concept of Directory and Sub-directory

Presentation transcript:

Foundation API The Fast Version

Follow my examples Example: building App for GMAP on Stampede Materials are in the Data Store: – Community Data/iplantcollaborative/example_data/gmap – /iplant/home/shared/iplantcollaborative/example _data/gmap

Key Steps 1.Binaries available on the target server? a.Is it the appropriate server? b.How many threads? MPI? 2.Make a test wrapper. 3.Modify the wrapper for the API 4.Make a json to match your wrapper. 5.Test the API application with the Test Application 6.Build a DE App to match the API application

Binaries 1.Binaries available on the target server? a.Is it the appropriate server? Does it require more than 24 hrs for typical use? b.Is there a module available? c.How many threads? MPI?

Test Wrapper Bash script Take data from the data store Pull binaries from the data store unless there is a module available Include all the options users may commonly need (target more for beginner than for expert) Test wrapper should be able to run on the queue for the chosen server in an empty directory (think of the exec node that will run your app, your data cold, no preparation)

Modified Wrapper (API-ready) The API will take care of some of the routine functions Remove queue configurations Remove test entries Remove icommands for loading in binaries Put finished wrapper in a data store directory for the application ( e.g. /iplant/rogerab/username/applications/gmap12 )

Make a json Enter in key API-needed entries (first section) Enter in your inputs, options, etc. Test the json for proper formatting Upload the json into the system – e.g. curl -sku "rogerab:XXXXXX" -X POST -F | python -mjson.tool

Test with the Test Application nt-test/ nt-test/ Log in, find your app, generate a job form (Apps Service) Monitor progress under Job Service

Build an App in the DE Use “foundational_api_adapter.pl” for application Input entries and options all need to match the json, the wrapper script Foundation API-specific entries are also needed – App id (--appid) – Run time (--requestedTime) – Max memory (--maxMemory) – Number of processors (--processorCount) For guidance, make copies of existing API apps and look at specific configurations