IPG2P Steering Committee January 25, 2011. CI Development Update Feb 2011 – next release – API function and Job Execution Paves way for user-led analysis.

Slides:

Advertisements

Similar presentations

Productivity Tools For SAS . SAS ® users today ASAP ™Enhancement complementSoft introduces ASAP ™ an innovative productivity tool for SAS ® Diagramming.

Advertisements

Foundation API: Today and Tomorrow Rion Dooley. Today v1 is in production 192 apps Creeping up on 200,000 requests/month About to hit 10,000th job Blowing.

IPlant Data Commons. iPlant Data Commons leverages all elements of our CI to enhance data management, discoverability, and reuse.

1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.

Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.

Mike Azocar Sr. Developer Technical Specialist Microsoft Corporation

Collaboration Suite Business Process Management

The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.

DIRAC API DIRAC Project. Overview  DIRAC API  Why APIs are important?  Why advanced users prefer APIs?  How it is done?  What is local mode what.

QA Automation Solution. Solution Architecture Test Management tool CI Tool Automation framework Testing Project BDD Tool Text of test to Testing Project.

Windows.Net Programming Series Preview. Course Schedule CourseDate Microsoft.Net Fundamentals 01/13/2014 Microsoft Windows/Web Fundamentals 01/20/2014.

Submitted by: Madeeha Khalid Sana Nisar Ambreen Tabassum.

6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.

Customized cloud platform for computing on your terms !

IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.

Extending the Discovery Environment: Tool Integration and Customization.

CDF Grid Status Stefan Stonjek 05-Jul th GridPP meeting / Durham.

Configuration Management (CM)

The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop iCommands and Other Data Store Resources.

National Center for Supercomputing Applications NCSA OPIE Presentation November 2000.

IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.

Created by Jan Medved Integration & Test Strategy for Lithium.

The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.

Ganga A quick tutorial Asterios Katsifodimos Trainer, University of Cyprus Nicosia, Feb 16, 2009.

Using Biological Cyberinfrastructure Scaling Science and People: Applications in Data Storage, HPC, Cloud Analysis, and Bioinformatics Training Scaling.

Created by Jan Medved Integration & Test Strategy for Lithium.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.

ModelPedia Model Driven Engineering Graphical User Interfaces for Web 2.0 Sites Centro de Informática – CIn/UFPe ORCAS Group Eclipse GMF Fábio M. Pereira.

Improving the world through engineeringhttp://nearyou.imeche.orgImproving the world through engineering 1 Near You enhancements 2014 Kevin Manning.

IPlant Collaborative Hands-on Cyberinfrastructure Workshop - Part 1 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 28, 2015,

6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.

Using the Open PHACTS API with KNIME Daniela Digles Open PHACTS Community Workshop.

Lightweight construction of rich scientific applications Daniel Harężlak(1), Marek Kasztelnik(1), Maciej Pawlik(1), Bartosz Wilk(1) and Marian Bubak(1,

FRErator – the Bridge between FRE and Curator DB.

John Porter Sheng Shan Lu M. Gastil Gastil-Buhl With special thanks to Chau-Chin Lin and Chi-Wen Hsaio.

 Automating the process of writing the automation code using Allay Test Tool.  Allay Test Tool generates test files in executable/running form.  Dev/Testers.

LQCD Workflow Project L. Piccoli October 02, 2006.

IPlant Discovery Environment An Overview. What is it? The Discovery Environment has been described in many ways… “It’s a virtual workbench…” “It’s where.

Postdoc Meeting 1/4/11. Round-Robin Introductions NameInstitutionRole Bindu JosephUC DavisPostdoc Lin WangCornellPostdoc Christos NoutsosCSHLPostdoc Lecong.

FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Grid2Win: Porting of gLite middleware to.

Welcome to Azure App Services! Amie Seisay

Automated tests CustomWare.Net. Goals Quality Finding problems before delivering Stability Upgrade projects Downgrade Refactoring Deacreasing of manual.

Research data management using Globus ESIP Summer Meeting 2015 Rachana Ananthakrishnan University of Chicago

Discovery Environment Tool Integration High Level Overview.

The GridPP DIRAC project DIRAC for non-LHC communities.

K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.

AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.

Enabling Plant Sciences Research with the iPlant Discovery Environment and Condor Juan Antonio Raygoza Garay, Sonya Lowry, John Wregglesworth.

CyVerse-enabled NCBI Sequence Read Archive (SRA) Submission Pipeline

Extending the Discovery Environment: Tool Integration and Customization.

Clarens Toolkit Building Blocks for a Simple TeraGrid Gateway Tutorial Conrad Steenberg Julian Bunn, Matthew Graham, Joseph Jacob, Craig Miller, Roy Williams.

D.Spiga, L.Servoli, L.Faina INFN & University of Perugia CRAB WorkFlow : CRAB: CMS Remote Analysis Builder A CMS specific tool written in python and developed.

© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.

The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.

CyVerse Workshop Discovery Environment Overview. Welcome to the Discovery Environment A Simple Interface to Hundreds of Bioinformatics Apps, Powerful.

The StratusLab Distribution and Its Evolution 4ème Journée Cloud (Bordeaux, France) 30 November 2012.

Jeremy Cowles, Eric Heien, Adam Kornafeld, Yusuke Takata, Kenichi Hagihara, Nicolás Alvarez.

PLG-Data and rimrock Services as Building

Introducing the Microsoft® .NET Framework

Build Automation with Gradle

CyVerse Discovery Environment

VI-SEEM Data Discovery Service

Job workflow Pre production operations:

Grid Metadata Management

SRA Submission Pipeline

OpenEMS: Automating the Data Center with Condor

Module 01 ETICS Overview ETICS Online Tutorials

UmbrellaDB v0.5 Project Report #3

Status and plans for bookkeeping system and production tools

Presentation transcript:

iPG2P Steering Committee January 25, 2011

CI Development Update Feb 2011 – next release – API function and Job Execution Paves way for user-led analysis authoring Foundational API – IO and DATA Tool Integration Tutorial Creating a new Analysis in the Discovery Environment Tutorial Creating a new Analysis in the Discovery Environment Tutorial

The (Current) iPlant Integration Model Programs installed on iPlant Linux nodes Job Execution Framework Job Submission Framework Tool and Analysis Metadata Manager Discovery Environment Analysis 1 Tool A Tool Z Analysis 2 Tool A Tool X JSON: JavaScript Object Notation

Programs installed on UA resources Job Execution Framework Job Submission Framework Tool and Analysis Metadata Manager Discovery Environment Analysis 1 Tool A Tool Z Analysis 2 Tool A Tool X Programs installed on TACC Resources Remote RESTful services Remote RESTful services GUI Editors

Example: BOWTIE

Roadmap Version 1 – Automate the creation of JSON for tool integration – Generate default Analysis for integrated tool – Write the resulting JSON to the screen to submit manually to iPlant

Roadmap Version 2 – Adds service that accepts generated JSON for manual review by iPlant staff – Real-time graphical feedback

Roadmap Version 3 – Adds ability to assemble existing Analyses (single or multi-step) into workflow with graphical feedback – Support for test runs

Version 1.0 All description JSON is hand-written No feedback No automated submission Version 1.2 Graphical editor for tool description Default analysis automatically built JSON written to file for submission to iPlant Version 1.4 JSON automatically submitted for review by iPlant staff Real-time graphical feedback in DE sandbox Version 1.6 Assemble multi-step analyses with graphical feedback Support for test runs of analyses NEAR TERM Tools are hand-deployed via iPlant staff JOBEX handles local execution only MEDIUM TERM Foundation.APPS and Foundation.JOB allow form-based tool upload and execution JOBEX handles remote, virtual, local jobs