Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University www.collab-ogce.org.

Slides:



Advertisements
Similar presentations
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Advertisements

Open Grid Computing Environments Marlon Pierce (IU) & Gopi Kandaswamy (RENCI)
Abstraction Layers Why do we need them? –Protection against change Where in the hourglass do we put them? –Computer Scientist perspective Expose low-level.
Gateway Transition Issues TeraGrid 10, August 2-5, 2010.
Building and Testing OGCE Software on the NMI Build and Test Facility Marlon Pierce Indiana University.
Wrapping Scientific Applications as Web Services Gopi Kandaswamy (RENCI) Marlon Pierce (IU)
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
SAN DIEGO SUPERCOMPUTER CENTER Choonhan Youn Viswanath Nandigam, Nancy Wilkins-Diehr, Chaitan Baru San Diego Supercomputer Center, University of California,
GridChem and ParamChem: Science Gateways for Computational Chemistry (and More) Marlon Pierce, Suresh Marru Indiana University Sudhakar Pamidighantam NCSA.
OGCE Overview: Portals, Services, Workflows, Gadgets, and Tags Marlon Pierce (IU), Suresh Marru (IU), Gregor von Laszewski (RIT), Mary Thomas (SDSU), Nancy.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
OGCE OVERVIEW: PORTALS, SERVICES, WORKFLOWS, GADGETS, AND TAGS Marlon Pierce (IU), Suresh Marru (IU), Raminder Singh (IU), Chathura Herath (IU), Gregor.
Science Gateway Advanced Support Activities in PTI Marlon Pierce Indiana University.
Open Grid Computing Environments Marlon Pierce, Suresh Marru, Gregor von Laszewski, Mary Thomas, Maytal Dahan, Gopi Kandaswamy, and Wenjun Wu.
TeraGrid’s Integrated Information Service “IIS” Grid Computing Environments 2009 Lee Liming, JP Navarro, Eric Blau, Jason Brechin, Charlie Catlett, Maytal.
The Open Gateway Computing Environment: Experiences Developing Tools for Scientific Communities in the Apache Software Foundation Marlon Pierce Indiana.
Grid Computing for Real World Applications Suresh Marru Indiana University 5th October 2005 OSCER OU.
Apache Airavata GSOC Knowledge and Expertise Computational Resources Scientific Instruments Algorithms and Models Archived Data and Metadata Advanced.
Grappa: Grid access portal for physics applications Shava Smallen Extreme! Computing Laboratory Department of Physics Indiana University.
XCAT Science Portal Status & Future Work July 15, 2002 Shava Smallen Extreme! Computing Laboratory Indiana University.
Distributed Web Security for Science Gateways Jim Basney In collaboration with: Rion Dooley Jeff Gaynor
Distributed Web Security for Science Gateways Jim Basney In collaboration with: Rion Dooley Jeff Gaynor
Future Grid Future Grid User Portal Marlon Pierce Indiana University.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
CloudCom Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University.
Developing Cyberinfrastructure to Support Computational Chemistry Workflows Marlon Pierce (IU), Suresh Marru (IU), Sudhakar Pamidighantam (NCSA) Sashikiran.
OGCE Workflow Suite GopiKandaswamy Suresh Marru SrinathPerera ChathuraHerath Marlon Pierce TeraGrid 2008.
SAN DIEGO SUPERCOMPUTER CENTER NUCRI Advisory Board Meeting November 9, 2006 Science Gateways on the TeraGrid Nancy Wilkins-Diehr TeraGrid Area Director.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
Open Grid Computing Environments: Advanced Gateway Support Activities RT Project Review October 7 th, 2010.
IU TeraGrid Gateway Support Marlon Pierce Community Grids Lab Indiana University.
The ACGT Workflow Editing & Enactment Environment Giorgos Zacharioudakis Institute of Computer Science, Foundation for Research & Technology – Hellas (ICS-FORTH)
UltraScan Gateway Advanced Support GIG Team: Suresh Marru, Raminder Singh, Marlon Pierce Pervasive Technology Institute Indiana University Gateway Personal:
Apache Airavata (Incubating) Gateway to Grids & Clouds Suresh Marru Nov 10 th 2011.
Experiment Management with Microsoft Project Gregor von Laszewski Leor E. Dilmanian Acknowledgement: NSF NMI, CMMI, DDDAS
FutureGrid Cyberinfrastructure for Computational Research.
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
Large Scale Nuclear Physics Calculations in a Workflow Environment and Data Provenance Capturing Fang Liu and Masha Sosonkina Scalable Computing Lab, USDOE.
1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.
 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.
Rochester Institute of Technology Cyberaide Shell: Interactive Task Management for Grids and Cyberinfrastructure Gregor von Laszewski, Andrew J. Younge,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
SAN DIEGO SUPERCOMPUTER CENTER Inca TeraGrid Status Kate Ericson November 2, 2006.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
OGCE Components for Enhancing UltraScan Job Management. Suresh Marru,Raminder Singh, Marlon Pierce.
The Open Grid Computing Environments Project Marlon Pierce Community Grids Laboratory Indiana University.
Biomedical and Bioscience Gateway to National Cyberinfrastructure John McGee Renaissance Computing Institute
Building Grid Portals with OGCE: Big Red Portal and GTLAB Mehmet A. Nacar, Jong Youl Choi, Marlon Pierce, Geoffrey Fox Community Grids Lab Indiana University.
Distributed Data for Science Workflows Data Architecture Progress Report December 2008.
Open Grid Computing Environments Tutorial Marlon Pierce, Suresh Marru, Gopi Kandaswamy, Gregor von Laszewski, and Tom Scavo.
GridChem Architecture Overview Rion Dooley. Presentation Outline Computational Chemistry Grid (CCG) Current Architectural Overview CCG Future Architectural.
BioVLAB-Microarray: Microarray Data Analysis in Virtual Environment Youngik Yang, Jong Youl Choi, Kwangmin Choi, Marlon Pierce, Dennis Gannon, and Sun.
The Gateway Computational Web Portal Marlon Pierce Indiana University March 15, 2002.
OGCE Workflow and LEAD Overview Suresh Marru, Marlon Pierce September 2009.
Lightweight OGCE Gadget Portal for Science Gateways Zhenhua Guo, Marlon Pierce Community Grids Laboratory, Pervasive Technology Institute, Indiana University,
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
Open Grid Computing Environment Summary
OGCE Short Summary Marlon Pierce Community Grids Lab
Marlon Pierce Indiana University February 14, 2012
Open Grid Computing Environments
Development of the Nanoconfinement Science Gateway
Building Science Gateways and Managing Workflows with the Open Grid Computing Environment Toolkit Marlon Pierce, Suresh Marru, Zhenhua Guo, Fugang Wang,
Standard Portlet Architecture Supports Reusable Components
OGCE Portal Applications for Grid Computing
OGCE Portal Applications for Grid Computing
OGCE Portal Software for Big Red and the TeraGrid
Open Grid Computing Environments
Gordon Erlebacher Florida State University
Status of Grids for HEP and HENP
Presentation transcript:

Software for Science Gateways: Open Grid Computing Environments Marlon Pierce, Suresh Marru Pervasive Technology Institute Indiana University

ogce.org/ogce/index.php/Tutoria ls Link to demonstration movies.

SoftwareDescription OGCE Gadget Container Google Gadget/Open Social compatible software for building Web- based user interfaces. XBayaA visual user interface for composing, launching and monitoring workflows GFACAn application factory service for wrapping command-line tools as Web services XRegistry; Registry Gadget A service and workflow registry and its user interface Experiment BuilderUser interface for creating online experiments with registered workflows

Compute Resources Resource Middleware Cloud Interfaces Grid Middleware SSH & Resource Managers Computational Clouds Computational Grids Gateway Services User Interfaces Web/Gadg et Container Web Enabled Desktop Applications User Management Auditing & Reporting Fault Tolerance Application Abstractions Workflow System Information Services Application Monitoring Registry Security Provenance & Metadata Management Local Resources Web/Gadge t Interfaces Gateway Abstraction Interfaces Science Gateways Layer Cake Color Coding Dependent resource provider components Complimentary Gateway Components OGCE Gateway Components

GFac Current & Future Features Input Handlers Scheduling Interface Auditing Monitoring Interface Data Management Abstraction Job Management Abstraction Job Management Abstraction Fault Tolerance Output Handlers Registry Interface Checkpoint Support XSUL/Apache Axis2 Globus Campus Resources Unicore Condor Amazon Eucalyptus Color Coding Planned/Requested Features Existing Features

OGCE Layered Workflow Architecture: Derived from LEAD Workflow System Workflow Execution & Control Engines Apache ODE Workflow Specification Workflow Interfaces (Design & Definition) PythonBPEL 2.0 BPEL 1.0 Java Code Pegasus DAG Scufl XBaya GUI (Composition, Deploying, Steering & Monitoring) Gadget Interface for Input Binding Condor DAGMan Taverna Dynamic Enactor Jython Interpreter GBPEL Flex/Web Composition

Putting It All Together

Software Strategy Focus on gadget container and tools for running science applications on grids and clouds. Provide a tool set that can be used in whole or in part. – If you just want GFac, then you can use it without buying an entire framework. Outsource security, information services, data and metadata, etc to other providers. – MyProxy, TG IIS, Globus, Condor, XMC Cat, iRods, etc.

More Information This is downloadable, packaged software. – Apache Maven build system provides everything you need to to build the gadget container, gadgets, workflow composer, and backing services. – Get code by anonymous SVN checkout. ogce- OGCE Web Site: Blog/News Feed: ogce.blogspot.com/ ogce.blogspot.com/

Acknowledgements and People Funding by TeraGrid GIG, RP and by OCI SDCI IU: Marlon Pierce, Suresh Marru, Raminder Singh, Archit Kulshrestha TACC: Maytal Dahan, Rion Dooley SDSC: Nancy Wilkins-Diehr SDSU: Mary Thomas

Demos Next

The OGCE Application Registry gadget allows users to interactively register hosts and applications that are dynamically wrapped as Web services.

The OGCE Gadget Container allows you to build portals out of public and private Google Open Social gadgets. Supports HTTPS. Downloadable, packaged software.

The OGCE Experiment Builder gadget allows users to create projects and experiments out of previously composed workflows.

The XBaya workflow composer allows you to build scientific workflows from services running across the TeraGrid. This is part of our workflow suite. OGCE Tools for Science Workflows

What Is a Science Gateway? Web and desktop user interfaces and user-centric Web services for accessing Grid and Cloud resources. – Clusters, supercomputers, mass storage – Applications, databases – Workflows Example Science Gateways from the NSF TeraGrid – GridChem: computational chemistry – UltraScan: biophysics computational analysis – LEAD: Atmospheric science – BioDrugScreen: drug docking, scoring, and discovery. Many others: see gateways/gateway_list gateways/gateway_list This demo is about software that powers gateways.

Google Gadget-Based Science Gateways LEAD PolarGrid