Grid Computing Environments GCE Discussion Meeting June 26 2003 Seattle GGF8 Geoffrey Fox Dennis Gannon Pervasive Technology Laboratories Computer Science.

Slides:



Advertisements
Similar presentations
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Advertisements

Using the Collaborative Tools in NEESgrid Charles Severance University of Michigan.
ASCR Data Science Centers Infrastructure Demonstration S. Canon, N. Desai, M. Ernst, K. Kleese-Van Dam, G. Shipman, B. Tierney.
Security Daniel Mallmann MWSG meeting Amsterdam December 2005.
Reusable Components for Grid Computing Portals Marlon Pierce Community Grids Lab Indiana University.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Open Library Environment Designing technology for the way libraries really work November 19, 2008 ~ ASERL, Atlanta Lynne O’Brien Director, Academic Technology.
6.1 Copyright © 2014 Pearson Education, Inc. publishing as Prentice Hall Building Information Systems Chapter 13 VIDEO CASES Video Case 1: IBM: Business.
Ischia, Italy 9th - 21st July Context & Linking Monday 18 th July David Fergusson & Malcolm Atkinson.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
UNICORE UNiform Interface to COmputing REsources Olga Alexandrova, TITE 3 Daniela Grudinschi, TITE 3.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Principles for Collaboration Systems Geoffrey Fox Community Grids Laboratory Indiana University Bloomington IN 47404
Grid Computing, B. Wilkinson, a.1 Grid Portals.
US NITRD LSN-MAGIC Coordinating Team – Organization and Goals Richard Carlson NGNS Program Manager, Research Division, Office of Advanced Scientific Computing.
© 2006 Open Grid Forum Geoffrey Fox GFSG Meeting CWI Amsterdam December OGF eScience Function.
GRID job tracking and monitoring Dmitry Rogozin Laboratory of Particle Physics, JINR 07/08/ /09/2006.
Application Web Service Toolkit Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University July
Possible Architectural Principles for OGSA-UK and other Grids UK e-Science Core Programme Town Meeting London Monday 31st January 2005 “Defining the next.
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
Database Taskforce and the OGSA-DAI Project Norman Paton University of Manchester.
revised CmpE 583 Fall 2006Discussion: OWL- 1 CmpE 583- Web Semantics: Theory and Practice DISCUSSION: OWL Atilla ELÇİ Computer Engineering.
HPC club presentation A proposal for a campus-wide research grid Barry Wilkinson Department of Computer Science UNC-Charlotte Dec. 2, 2005.
Grid Computing, B. Wilkinson, b.1 National Science Foundation Middleware Initiative (NMI) Started in 2001 initially over 3 years “to create and deploy.
© 2006 Open Grid Forum Geoffrey Fox September OGF eScience Function.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
© DATAMAT S.p.A. – Giuseppe Avellino, Stefano Beco, Barbara Cantalupo, Andrea Cavallini A Semantic Workflow Authoring Tool for Programming Grids.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
1 Advanced Software Architecture Muhammad Bilal Bashir PhD Scholar (Computer Science) Mohammad Ali Jinnah University.
Application portlets within the PROGRESS HPC Portal Michał Kosiedowski
IHE Profile – SOA Analysis: In Progress Update Brian McIndoe January 18, 2011.
Workflow in Grid Systems Workshop Dave Berry, Research Manager UK National e-Science Centre GGF10, Mar 2004.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
1 The Portal Expedition Beth Plale, Dennis Gannon Indiana University – Project Leads Jay Alameda NCSA – Project Coordinator The Alliance Portals Expedition.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
Applications and Requirements for Scientific Workflow Introduction May NSF Geoffrey Fox Indiana University.
Information Architecture WG: Report of the Spring 2004 Meeting May 13, 2004 Dan Crichton, NASA/JPL.
Enabling Grids for E-sciencE Astronomical data processing workflows on a service-oriented Grid architecture Valeria Manna INAF - SI The.
Grid Computing Environment Shell By Mehmet Nacar Las Vegas, June 2003.
Remarks on OGSA and OGSI e-Science All Hands Meeting September Geoffrey Fox, Indiana University.
16/11/ Semantic Web Services Language Requirements Presenter: Emilia Cimpian
CGL: Community Grids Laboratory Geoffrey Fox Director CGL Professor of Computer Science, Informatics, Physics.
GCE Shell? GGF6 Chicago October Geoffrey Fox Marlon Pierce Indiana University
Some comments on Portals and Grid Computing Environments PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics,
Overview of Grid Computing Environments Proposed GGF Information Document G.Fox, D. Gannon, M. Pierce, M. Thomas PTLIU Laboratory for Community Grids Geoffrey.
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
The Gateway Computational Web Portal Marlon Pierce Indiana University March 15, 2002.
GEOSS Common Infrastructure Initial Operating Capability Directions and Discussion Presented to GEO ADC Geneva May
Application Web Service Toolkit Allow users to quickly add new applications GGF5 Edinburgh Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University.
Grid Computing Environments Working Group (GCE) Grid Forum #5 Marlborough, MA
© 2006 Open Grid Forum Geoffrey Fox OGF Workshop eScience 2006 Royal Tropical Institute Amsterdam December OGF eScience Function.
Interacting Data Services for Distributed Earthquake Modeling Marlon Pierce, Choonhan Youn, and Geoffrey Fox Community Grids Lab Indiana University.
GGF5, Edinburgh, Jul GCE Research Group GGF5, Edinburgh, Scottland.
Advanced Higher Computing Science The Project. Introduction Worth 60% of the total marks for the course Must include: An appropriate interface using input.
GGF - © Birds of a Feather - Policy Architecture Working Group.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Advanced Higher Computing Science
OGSA Data Architecture Scenarios
iSERVOGrid Architecture Working Group Brisbane Australia June
Some remarks on Portals and Web Services
MANAGING KNOWLEDGE FOR THE DIGITAL FIRM
What is OGSA? GGF17 OGSA and Alternative Grid Architectures Panel
Middleware for Grid Portal Development
Grid Federation JXTA Jini etc.
Global Grid Forum (GGF) Orientation
Summary of Grid Portal Architecture Workshop March Tokyo GGF7
Gordon Erlebacher Florida State University
Status of Grids for HEP and HENP
GGF10 Workflow Workshop Summary
Presentation transcript:

Grid Computing Environments GCE Discussion Meeting June Seattle GGF8 Geoffrey Fox Dennis Gannon Pervasive Technology Laboratories Computer Science Indiana University, Bloomington IN

Themes for Next 18 Months ( 4-5 Meetings) Currently we are NOT involved in formal standards work – areas (job related metadata) we discussed in past are probably best done by OGSA (in collaboration with GCE) We are involved in identifying best practice, documenting this and collaborating to advance –In GGF documents –Journal Special issues (and book chapters) –Tutorials and other outreach Hold formal GGF Workshops as at GGF7 on Portal Architectures –Roughly one workshop per meeting? Meetings like this are for discussion and not (any longer) for technology presentations (change as of GG7)

Source of Overview of Grid Computing Environments GGF Information Document Last Half of 2001: Call from GCE RG for Papers for Journal special issues – 28 papers submitted and reviewed Published in Concurrency and Computation: Practice and Experience Vol. 14, Grid Computing Environments Special Issue 13-15, Fall Augmented by chapters (about 14) in Fran Berman, Geoffrey Fox and Tony Hey, ‘Grid Computing: Making the Global Infrastructure a Reality’, ISBN , John Wiley & Sons Ltd, Chichester, See Other key papers which we knew about

Three Major Themes Portal Architecture and Technology (continuation of work at GGF7) –GGF Information Document –Journal Special Issue Workflow or “Service Orchestration”, “Service or Process Coordination”, “Service Conversation”, “Web or Grid Scripting”, “Application Integration”, “Software Bus” or perhaps best –“Web or Grid Programming” –The GCE Shell topic of previous meetings can be included here (UNIX Shell simple “classic computing” workflow) Integration of Problem Solving Environments and GCE’s

Nugget1Nugget2 Nugget3Nugget4 Nugget > file6 a.out < file5 Nugget Data JDBC OGSA-DAI a) UNIX Shell Nugget b) Database Nugget c) Workflow linking Nuggets Two-level Grid Programming Model; Nuggets wrapped as Web Services

Components of Workflow Composition/Development: This is the top level and corresponds to the workflow IDE (Integrated Development Environment) and often has a graph editor to be able to visually form the graph of “linked” nuggets. –This editor allows one to choose from a palette of available services with ports that one can choose to link. –This paradigm is familiar from visualization and image processing where systems like AVS, Khoros and SCIRun Languages and Programming: There is usually an underlying formal language describing the workflow and the workflow is expressed as some sort of program in terms of it. Compiler/Interpreter: This part of the workflow system translates the result of the first two steps, composition and/or program, into the executable form. Enactment Engines (Runtime): This corresponds to the components of the execution environment supporting the execution of the workflow.

PSE’s and GCE’s Most PSE’s consists of a set of services or nuggets just like GCE’s PSE’s may or may not involve linking of distributed (Grid) resources GCE services are ALL message based for input and output between clients, resources and other services GCE’s should inherit PSE services wrapped as Grid Services PSE’s could use workflow technology as their software bus?

GGF7 Grid Portal Architecture Workshop Organized by Dennis Gannon, Geoffrey Fox and Mary Thomas These are co-chairs of GCE working group – this topic is a rather focused subset of GCE mandate –Grid Information document and C&C:P&E special issue of 28 papers describes “full” GCE activities 8 am to 1.50 pm Thursday March , 50 attendees 9 Presentations followed by discussion Talks were asked to address a set of questions prepared ahead of time –This differentiated workshop from earlier meetings with “project updates” –Appropriate because broad area reasonably well covered Final discussion agreed to produce a Grid Forum Information Document entitled Portal Component Architecture

Questions Addressed by Speakers Are the current portal frameworks, such as Jetspeed, sufficient for all our requirements? Is the portlet model the right one for Grid applications? When is the Web “pull” model insufficient for Grid applications? What Grid services are needed to make Grid portals useful? Are the proposed OGSA core Grid services appropriate and useable by Grid portals? What other Grid middleware implications are there for Grid portal interoperability? What are the requirements for a messaging and notification model to be used by Grid portals? How do we build a GridShell? How does one create a user’s Grid Context? How do we design a Grid portal architecture that best supports collaboration? Two important standard have emerged: WSIA (Web Services for Interactive Applications) and WSRP (Web Services for Remote Portals). Are these sufficient for the requirements of Grid Applications?

Typical Jetspeed Portal Each Tab displays multiple Portal Component Each user interface component maps to a Grid Service

Workshop Speakers Introduction and Workshop Charge Dennis Gannon Overview of GCE and Grid Portal Issues Geoffrey Fox Background: OGSA, WSIA and WSRP and Grid Contexts Dennis Gannon GridLab Portal Technology Michael Russell GridPort Technology Mary Thomas The CHEF Portal Charles Severance The Grid Portal Generator Toyotaro Suzumura GENIUS and EnginFrame: GRID Portal across Research and Industry –Roberto Barbera and Andrea Rodolico Mississippi Portal Tom Haupt

Portal Component Architecture Document GGF Information Document based on workshop 1 Overview/motivation 2 Portal Component Architecture (examples, general issues) 3 Using Component-based Portals Today 4 Futures of Portal Component Paradigms 4.1 New paradigms 4.2 Enhancing current paradigms 4.3 Portal Component Design issues 4.4 Security Considerations Appendix: Examples of use of current Component-based Portals Draft should be completed by GGF8 where it be discussed in a GCE meeting

GGF-GCE: GGF6 Summary Charter  Revised to reflect current GGF research group definitions and proposed activities  Volunteers: Secretary-- Jay Alameda; Webmaster-- Shawn Hampton, Brooke Carlson Proposed Activities for 2003  Planned Activities for GGF7: Workflow Specifications & Management (Piyush, Haupt)  Considering holding with Applications testbed  Others: Portal technologies (Marlon, Mike); GCE Shell (Fox, Cezary Mazurek)); Grid Applications & testbed (future considerations Informational Docs in progress  C&C:P&E Summary (Thomas, Fox, Gannon)  GCE Shell (Fox, Pierce)  Workflow/Metadata Current Practices, summary, survey (Mehrotra)  Previous external workshop activities (seeking volunteers) Done!!!

GGF5 Grid Computing Environments RG Sessions 1&2: Grid Jobs: Metadata and Management 10 presentations, 50-80/session “Best Practices” survey, produce GGF Info doc by GGF7 Session 2: Organizational issues/discussions (>40 attendees) Revised charter, plans to update website Defined current ‘targeted areas’ for RG and current activities: 28 publications on portals, Grid Job metadata survey, interoperable web services experiment with schemas needed for interoperable web services Identified new targeted activities to study portlets, OGSA- based Grid services, experiments technologies in a testbed fashion Topic to OGSA!