E-Science Workflow Support with Grid-Enabled Microsoft Project Gregor von Laszewski and Leor E. Dilmanian, Rochester Institute of Technology Abstract von.

Slides:



Advertisements
Similar presentations
A graphical user interface (GUI) is a human-computer interface (i.e., a way for humans to interact with computers) that uses windows, icons and menus.
Advertisements

Pegasus on the Virtual Grid: A Case Study of Workflow Planning over Captive Resources Yang-Suk Kee, Eun-Kyu Byun, Ewa Deelman, Kran Vahi, Jin-Soo Kim Oracle.
Grid Deployments and Cyberinfrastructure Andrew J. Younge 102 Lomb Memorial Drive Rochester, NY 14623
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Open Grid Computing Environments Marlon Pierce, Suresh Marru, Gregor von Laszewski, Mary Thomas, Maytal Dahan, Gopi Kandaswamy, and Wenjun Wu.
Jefferson Ridgeway 2, Ifeanyi Rowland Onyenweaku 3, Gregor von Laszewski 1*, Fugang Wang 1 1* Indiana University, Bloomington, IN 47408, U.S.A.,
Thermal Aware Resource Management Framework Xi He, Gregor von Laszewski, Lizhe Wang Golisano College of Computing and Information Sciences Rochester Institute.
Cyberaide Virtual Appliance: On-demand Deploying Middleware for Cyberinfrastructure Tobias Kurze, Lizhe Wang, Gregor von Laszewski, Jie Tao, Marcel Kunze,
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
Commodity Grid (CoG) Kits Keith Jackson, Lawrence Berkeley National Laboratory Gregor von Laszewski, Argonne National Laboratory.
A Web 2.0 Portal for Teragrid Fugang Wang Gregor von Laszewski May 2009.
Towards a Javascript CoG Kit Gregor von Laszewski Fugang Wang Marlon Pierce Gerald Guo
Andrew J. Younge Golisano College of Computing and Information Sciences Rochester Institute of Technology 102 Lomb Memorial Drive Rochester, New York
Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University
CoG Kit Overview Gregor von Laszewski Keith Jackson.
Job Submission Condor, Globus, Java CoG Kit Young Suk Moon.
23:48:11Service Oriented Cyberinfrastructure Lab, Grid Portals Fugang Wang April 29
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
GridFE: Web-accessible Grid System Front End Jared Yanovich, PSC Robert Budden, PSC.
Towards a unified Cyberaide architecture Fugang Wang May 29, 2009.
07:44:46Service Oriented Cyberinfrastructure Lab, Introduction to BOINC By: Andrew J Younge
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
Nadir Saghar, Tony Pan, Ashish Sharma REST for Data Services.
Experiment Management with Microsoft Project Gregor von Laszewski Leor E. Dilmanian Acknowledgement: NSF NMI, CMMI, DDDAS
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Composing workflows in the environmental sciences using Web Services and Inferno Jon Blower, Adit Santokhee, Keith Haines Reading e-Science Centre Roger.
Using Cyberaide JavaScript to develop Ajax based Grid Apps – A Tutorial for Grid App Developers Gregor von Laszewski Fugang Wang Jun 22, 2009.
Wrapping Scientific Applications As Web Services Using The Opal Toolkit Wrapping Scientific Applications As Web Services Using The Opal Toolkit Sriram.
Gregor von Laszewski Rochester Institute of Technology.
 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.
Rochester Institute of Technology Cyberaide Shell: Interactive Task Management for Grids and Cyberinfrastructure Gregor von Laszewski, Andrew J. Younge,
Commodity Grid Kits Gregor von Laszewski (ANL), Keith Jackson (LBL) Many state-of-the-art scientific applications, such as climate modeling, astrophysics,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
The Grid the united computing power Jian He Amit Karnik.
© Geodise Project, University of Southampton, Geodise Middleware & Optimisation Graeme Pound, Hakki Eres, Gang Xue & Matthew Fairman Summer 2003.
Grid Security: Authentication Most Grids rely on a Public Key Infrastructure system for issuing credentials. Users are issued long term public and private.
Bio Gregor von Laszewski is conducting state-of-the-art work in Cloud computing and GreenIT at Indiana University as part of the Future Grid project. During.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.
Cooperative experiments in VL-e: from scientific workflows to knowledge sharing Z.Zhao (1) V. Guevara( 1) A. Wibisono(1) A. Belloum(1) M. Bubak(1,2) B.
Green Computing Metrics: Power, Temperature, CO2, … Computing system: Many-cores, Clusters, Grids and Clouds Algorithm and model: task scheduling, CFD.
Experiment Management with Microsoft Project Gregor von Laszewski Leor E. Dilmanian Link to presentation on wiki 12:13:33Service Oriented Cyberinfrastructure.
10:47:46Service Oriented Cyberinfrastructure Lab, Grid Job Management with Microsoft Project Leor Dilmanian
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
VisPortal Project developer’s experience C.E.Siegerist, J. Shalf, E.W. Bethel NERSC/LBNL Visualization Group T.J. Jankun-Kelley, O. Kreylos, K.L. Ma CIPIC/UC.
Grid Interoperability Update on GridFTP tests Gregor von Laszewski
Chapter 1 Basic Concepts of Operating Systems Introduction Software A program is a sequence of instructions that enables the computer to carry.
OGCE Workflow and LEAD Overview Suresh Marru, Marlon Pierce September 2009.
The Earth System Grid (ESG) A Fault Monitoring System for ESG Components DOE SciDAC ESG Project Review Argonne National Laboratory, Illinois May 8-9, 2003.
Grappling Cloud Infrastructure Services with a Generic Image Repository Javier Diaz Andrew J. Younge, Gregor von Laszewski, Fugang.
MSF and MAGE: e-Science Middleware for BT Applications Sep 21, 2006 Jaeyoung Choi Soongsil University, Seoul Korea
An operating system (OS) is a collection of system programs that together control the operation of a computer system.
All Hands Meeting 2005 BIRN-CC: Building, Maintaining and Maturing a National Information Infrastructure to Enable and Advance Biomedical Research.
V7 Foundation Series Vignette Education Services.
CyberGIS Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
Petr Škoda, Jakub Koza Astronomical Institute Academy of Sciences
Lizhe Wang, Gregor von Laszewski, Jai Dayal, Thomas R. Furlani
Clouds , Grids and Clusters
Collaborations and Interactions with other Projects
Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5
Abstract Major Cloud computing companies have started to integrate frameworks for parallel data processing in their product portfolio, making it easy for.
Understand Windows Forms Applications and Console-based Applications
Chapter 2: Operating-System Structures
Versatile HPC: Comet Virtual Clusters for the Long Tail of Science SC17 Denver Colorado Comet Virtualization Team: Trevor Cooper, Dmitry Mishin, Christopher.
CIS16 Application Development – Programming with Visual Basic
Chapter-1 Computer is an advanced electronic device that takes raw data as an input from the user and processes it under the control of a set of instructions.
Overview Activities from additional UP disciplines are needed to bring a system into being Implementation Testing Deployment Configuration and change management.
Presentation transcript:

e-Science Workflow Support with Grid-Enabled Microsoft Project Gregor von Laszewski and Leor E. Dilmanian, Rochester Institute of Technology Abstract von Laszewski’s Meta Computer Workflow & resource utilization, fault tolerance CoG Kit Workflow Abstractions CoG Kit Grid Ant CoG Experiment CoG Karajan Cyberaide Shell Project Experiment Management Super-Gram The design, execution, and monitoring of challenging scientific applications is often a complex affair. To cope with the issue, several tools and frameworks have been designed and put into use. However, the entry barrier to using these tools productively is high, and may hinder the progress of many scientists or non-experts that develop workflows infrequently. As part of the Cyberaide framework we designed and developed an e-Science Workflow support tool with a Grid-Enabled Microsoft Project interface. Thus, Microsoft Project as a typical project management tool is being used in a new context for scheduling and coordinating Grid jobs. Furthermore, it is being used to design and monitor the execution of Grid based projects. The motivation for this choice is based on the fact that many scientists are already familiar with Microsoft Project. Hence, Cyberaide Project enables seamless access to computational Grids, such as the NSF sponsored TeraGrid. We test our hypothesis of usability while evaluating the tool as part of several graduate level courses taught in the field of Grid and Cloud computing. Cyberaide Framework Cyberaide is a framework used to simplify Cyber-infrastructure development, deployment, and integration through advanced mediated services. A Cyberaide Mediator provides a uniform interface and simplifies access to Grids, Clouds, and Social Networks. Cyberaide Grid-Enabled Microsoft Project Experiment Management The Cyberaide Grid-Enabled Microsoft Project allows users simple design, scheduling, execution and monitoring of workflows on the Grid. It provides the user a well known, familiar, easy to navigate user interface via a familiar interface. Console Proxy Initialization Task Table Gantt Chart Registers/Executes Console Application Launches Microsoft Project Accepts Commands Console Application Launches Microsoft Project Accepts Commands Command Interface Apache CLI Manipulate MSP Command Interface Apache CLI Manipulate MSP CommandDescriptionCommand Type taskAdd a Task.Workflow Manipulation mapMap Task/Resource.Workflow Execution delDelete a Task.Utility Function editEdit Task Information. depAdd a Task Dependency. rdepRemove a Task Dependency. resAdd a Resource. run-allRun a Workflow. saveSave a Workflow in JSON. loadLoad a Workflow in JSON. listList all Tasks with a valid name. findFind a Task by its name. Implementation References Our implementation is provided through a console application developed in C#. It starts a running instance of Microsoft Project and provides a command shell to the user. Objects implementing the command interface are registered with the shell. Each object implementing the command interface interacts with a running instance of Microsoft Project and uses Apache CLI to parse input parameters. Commands can be thought of as belonging to one of three categories. Workflow Manipulation commands are used to build, modify, and schedule a set of jobs on the Grid. Workflow Execution command is used to seamlessly run jobs on the Grid. Additional Utility Functions are used to import and export workflows, and query Microsoft Project in the command line interface. Technologies used: Visual Studio 2008 Professional, Microsoft Project 2007, Microsoft Project Primary Interoperability Assembly, Java CoG Kit, Cyberaide, Cyberaide Mediator, Apache CLI, WSI. 1.von Laszewski, G., & Dilmanian, L. E-Science Project and Experiment Management with Microsoft Project. Accepted for publication at GCE08 at SC08. 2.G. von Laszewski, A. J. Younge, X. He, and F. Wang, “GridShell: Interactive Task Management for Grid and Cluster Computing,” Sep. 2008, 3. G. von Laszewski, “Java CoG Kit Workflow Concepts,” Journal of Grid Computing, Jan. 2006, Scientist are often concerned about the management of a large number of experiments over a research environment supporting advanced data acquisition and information processing services over the internet. To support this experiment management challenge, our Cyberaide Grid-enabled Microsoft Project allows the coordination of such experiments in a structured fashion. The development of this experiment management tool has its origin in the Commodity Grid Kits (CoG) that have evolved over time. The early meta computer is created using a basic meta-computing framework for uniform access and orchestration over multiple compute resources. The latest generation of middleware technologies, called Cyberaide, includes sophisticated information services, shells and applications to simplify development for and interaction with Cyberinfrastructure. Overall, we lower entry barrier to and increase productivity in e-Science. Acknowledgements Work conducted by Gregor von Laszewski is supported (in part) by NSF CMMI and NSF SDCI NMI Contact Gregor von Laszewski Service Oriented Cyberinfrastructure Laboratory Rochester Institute of Technology Service Oriented Cyberinfrastructure Lab Building Lomb Memorial Drive Rochester, NY (585) * MS Project Ruby Python Java Mediator & Abstractions TeraGrid Amazon Cloud Amazon Cloud facebook iGoogle Social Networks Social Networks Globus GPIR, NWS, … Cloud Grid Client Services JavaScript C# Figure 2: Cyberaide Project consists of Microsoft Project, a console window, and proxy initialization capabilities from the Java CoG Kit. Figure 1: The Cyberaide EvolutionFigure 3: Cyberaide Mediator