Your name here SPA: Successes, Status, and Future Directions Terence Critchlow And many, many, others Scientific Process Automation PNNL.

Slides:



Advertisements
Similar presentations
OMII-UK Steven Newhouse, Director. © 2 OMII-UK aims to provide software and support to enable a sustained future for the UK e-Science community and its.
Advertisements

ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
Workflow automation for processing plasma fusion simulation data Norbert Podhorszki Bertram Ludäscher Scientific Computing Group Oak Ridge National Laboratory.
HP Quality Center Overview.
UCSD SAN DIEGO SUPERCOMPUTER CENTER Ilkay Altintas Scientific Workflow Automation Technologies Provenance Collection Support in the Kepler Scientific Workflow.
Using Kepler to Perform Parameter Studies in Subsurface Sciences Jared Chase Scientific Data Management CET All Hands Meeting 11/28/2007
© 2005 by Prentice Hall Appendix 2 Automated Tools for Systems Development Modern Systems Analysis and Design Fourth Edition Jeffrey A. Hoffer Joey F.
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
EXPERT DOCUMENT SOLUTIONS FOR YOUR BUSINESS EXPERT DOCUMENT SOLUTIONS FOR YOUR BUSINESS.
6th Biennial Ptolemy Miniconference Berkeley, CA May 12, 2005 Distributed Computing in Kepler Ilkay Altintas Lead, Scientific Workflow Automation Technologies.
Arc Hydro Geodatabase Inventory Tool SWQM Program FY06 Arc Hydro Customization Project.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
ISMT221 Information Systems Analysis and Design Project Management Tools Lab 1 Tony Tam.
Task Management System Client xx Team Member 1 Member 2 Member 3 This is not a real project, but a student project carried out for a system requirements.
Astrophysics, Biology, Climate, Combustion, Fusion, Nanoscience Working Group on Simulation-Driven Applications 10 CS, 10 Sim, 1 VR.
CASE Tools CIS 376 Bruce R. Maxim UM-Dearborn. Prerequisites to Software Tool Use Collection of useful tools that help in every step of building a product.
Chapter 2: Business Intelligence Capabilities
Do you know where your Assets are ? ScanAsset is a complete Asset Management System utilizing portable data collection to 1. Track inventory management.
SPAWAR HQ (General Fund) Navy ERP Implementation Lessons Learned – Comptroller View.
Professional Informatics & Quality Assurance Software Lifecycle Manager „Tools that are more a help than a hindrance”
Structure Commander Technical Presentation. Copyright (C) MCS 2013, All rights reserved. 2 STRUCTURE COMMANDER Introduction Product Overview.
Android Core Logging Application Keith Schneider Introduction The Core Logging application is part of a software suite that is designed to enable geologic.
LHC Experiment Dashboard Main areas covered by the Experiment Dashboard: Data processing monitoring (job monitoring) Data transfer monitoring Site/service.
CSCI ClearQuest 1 Rational ClearQuest Michel Izygon - Jim Helm.
GMD German National Research Center for Information Technology Innovation through Research Jörg M. Haake Applying Collaborative Open Hypermedia.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
Biology.sdsc.edu CIPRes in Kepler: An integrative workflow package for streamlining phylogenetic data analyses Zhijie Guan 1, Alex Borchers 1, Timothy.
January, 23, 2006 Ilkay Altintas
VirtualWorks.
The Design Discipline.
SDM Center A Quick Update on the TSI and PIW workflows SDM All Hands March 2-3, Terence Critchlow, Xiaowen Xin, Bertram.
An Extensible Python User Environment Jeff Daily Karen Schuchardt, PI Todd Elsethagen Jared Chase H41G-0956 Website Acknowledgements.
What is Workflow?  Workflow or Business Process Management (BPM) consists of Processes, States and Actions.  A Process (e.g. Customer Order fulfillment)
Testing Tools using Visual Studio Randy Pagels Sr. Developer Technology Specialist Microsoft Corporation.
50mm Telescope ACS Course Garching, 15 th to 19 th January 2007 January 2007Garching.
material assembled from the web pages at
David Abramson & Hoang Anh Nguyen Monash University.
NeSC Apps Workshop July 20 th, 2002 Customizable command line tools for Grids Ian Kelley + Gabrielle Allen Max Planck Institute for Gravitational Physics.
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
Accelerating Scientific Exploration Using Workflow Automation Systems Terence Critchlow (LLNL) Ilkay Altintas (SDSC) Scott Klasky(ORNL) Mladen Vouk (NCSU)
July 09, 2008 NIH Project Management Community Project Scope and Change Management Discussion This document is confidential and is intended solely for.
Software Engineering Prof. Ing. Ivo Vondrak, CSc. Dept. of Computer Science Technical University of Ostrava
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
A Collaborative Framework for Scientific Data Analysis and Visualization Jaliya Ekanayake, Shrideep Pallickara, and Geoffrey Fox Department of Computer.
Presented by Scientific Data Management Center Nagiza F. Samatova Network and Cluster Computing Computer Sciences and Mathematics Division.
ICCS WSES BOF Discussion. Possible Topics Scientific workflows and Grid infrastructure Utilization of computing resources in scientific workflows; Virtual.
ANKITHA CHOWDARY GARAPATI
Presented by Jens Schwidder Tara D. Gibson James D. Myers Computing & Computational Sciences Directorate Oak Ridge National Laboratory Scientific Annotation.
Selene Dalecky March 20, 2007 FDsys: GPO’s Digital Content System.
1 Limitations of BLAST Can only search for a single query (e.g. find all genes similar to TTGGACAGGATCGA) What about more complex queries? “Find all genes.
CASE (Computer-Aided Software Engineering) Tools Software that is used to support software process activities. Provides software process support by:- –
Software Engineering Chapter: Computer Aided Software Engineering 1 Chapter : Computer Aided Software Engineering.
Biomedical Informatics Research Network BIRN Workflow Portal.
Chapter 4 Automated Tools for Systems Development Modern Systems Analysis and Design Third Edition 4.1.
INFSO-RI Enabling Grids for E-sciencE ARDA Experiment Dashboard Ricardo Rocha (ARDA – CERN) on behalf of the Dashboard Team.
Thomas Kern | The system documentation as binding agent for and in between internal and external customers April 24th, 2009 | Page 1 The system documentation.
Supercomputing 2006 Scientific Data Management Center Lead Institution: LBNL; PI: Arie Shoshani Laboratories: ANL, ORNL, LBNL, LLNL, PNNL Universities:
SDM Center Experience with Fusion Workflows Norbert Podhorszki, Bertram Ludäscher Department of Computer Science University of California, Davis UC DAVIS.
Ocean Observatories Initiative OOI Cyberinfrastructure Life Cycle Objectives Review January 8-9, 2013 Scientific Workflows for OOI Ilkay Altintas Charles.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interfacing gLite services with the Kepler.
Workflow-Driven Science using Kepler Ilkay Altintas, PhD San Diego Supercomputer Center, UCSD words.sdsc.edu.
Keith Chadwick 1 Metric Analysis and Correlation Service. CD Seminar.
CyVerse Workshop Discovery Environment Overview. Welcome to the Discovery Environment A Simple Interface to Hundreds of Bioinformatics Apps, Powerful.
VisIt Project Overview
Introduction to Team Foundation Server 2010
API Documentation Guidelines
What is InPlace? InPlace is a web-based software system that provides RMIT staff and students a single interface for managing work integrated learning.
SDM workshop Strawman report History and Progress and Goal.
Laura Bright David Maier Portland State University
Scientific Workflows Lecture 15
Presentation transcript:

your name here SPA: Successes, Status, and Future Directions Terence Critchlow And many, many, others Scientific Process Automation PNNL

your name here Successes Actors Ssh Provenance recorder Generic actors File transfer Dashboard Movie generation Graphing Visualization Publications Tutorials SC 2006, 2007, 2008 …. SciDAC 2008 Founding members of the Kepler consortium

your name here Successes: Application Workflows Promoter Identification Workflow (2003-) Matt Coleman Genomics Low-dose cancer research

your name here Successes: Application Workflows TSI-1 workflow Doug Swesty Astrophysics Supernova simulations Images courtesy of Doug Swesty

your name here Successes: Application Workflows SALSSA Workflow Schiebe (Schuchardt) Groundwater Water flow through multi-scale substances Images courtesy of Karen Schuchardt

your name here Successes: Application Workflows CPES Workflow C.S. Chang (Klasky) Fusion Plasma edge simulation Images courtesy of Scott Klasky

your name here Ongoing thrusts: Dashboard User friendly interface for workflow monitoring Displays information from executing worflows in real time Linkage to provenance Improved visualization / interactive capabilities Portable dashboard Images courtesy of Roselyne Barreto

your name here Ongoing thrusts: Provenance Keeping track of where information came from Data stored in a database Collecting information from outside Kepler Query interface / capability Managing data volume

your name here Ongoing thrusts: Application Workflows S3D Jackie Chen Combustion Flame propagation Chimera Tony Mezzacappa Astrophysics GTC Fusion Particle simulations of ITER Images courtesy of Tony Mezzacappa Images courtesy of Jackie Chen Images courtesy of Scott Klasky

your name here Future directions: Dashboard Control over workflows Hardening code Multiple deployments

your name here Future directions: Templates New direction, replacing provenance effort starting in Q2 FY09 Customizable workflow descriptions Allow users more control over details of workflow definition Bridge gap between scientists and workflow developers

your name here Future directions: Distribution Package code for open source distribution Harden code Deposit actors and templates into Kepler repository Document code and actors User manuals Implementation documentation Disseminate tutorials Video?

your name here Conclusions Many successes so far Established open source community around Kepler Deployed multiple workflows across a variety of scientific domains Deployments have required extensive interaction between SPA team and external customers Working on models that provide scientists more control Dashboard Templates Goal is to enable scientists to customize workflows without direct involvement from a workflow developer