OGSA Rising Ian Foster Argonne National Laboratory

Slides:



Advertisements
Similar presentations
WS-Resource Framework: Globus Alliance Perspectives Ian Foster Argonne National Laboratory University of Chicago Globus Alliance
Advertisements

LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
© 2007 Open Grid Forum Data Management Challenge - The View from OGF OGF22 – February 28, 2008 Cambridge, MA, USA Erwin Laure David E. Martin Data Area.
Fujitsu Laboratories of Europe © 2004 What is a (Grid) Resource? Dr. David Snelling Fujitsu Laboratories of Europe W3C TAG - Edinburgh September 20, 2005.
The Next Generation Grid Kostas Tserpes, NTUA Beijing, 22 of June 2005.
The Open Grid Services Architecture, Version 1.0 I. Foster, H. Kishimoto, A. Savva, D. Berry, A. Djaoui, A. Grimshaw, B. Horn, F. Maciel, F. Siebenlist,
Internet Technologies (Grid Computing (OGSA, WSRF) )
The OGSA Vision for Service Oriented Architectures Dave Berry Research Manager, NeSC Co-chair, GGF OGSA Data WG European Grid Technology Days 2005 Concertation.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
4b.1 Grid Computing Software Components of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b.
1 Globus Developments Malcolm Atkinson for OMII SC 18 th January 2005.
Globus 4 Guy Warner NeSC Training.
Kate Keahey Argonne National Laboratory University of Chicago Globus Toolkit® 4: from common Grid protocols to virtualization.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
OGSA Hauptseminar: Data Grid Thema 2: Open Grid Service Architecture
Hiro Kishimoto OGSA-WG co-chairs OGSA Interested Party Chart -Very early draft - Incomplete draft for group review only.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
OASIS WSDM TC Face To Face Agenda January, 2005 IBM, Boulder, CO.
WS-Reliability Inter-op Now that we are done.. November 18, 2004.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
OGSA-Basic Services Prof S.Ramachandram. Outline  Introduction  Common Management Model  Policy Architecture  Security Architecture  Metering and.
© 2004 IBM Corporation ICSOC2004 Panel Discussion: Grid Systems: What is needed from web service standards? Jeffrey Frey IBM.
1 OGSA-WG Use Cases 06/25/2003 Hiro Kishimoto, Ph.D. Fujitsu GGF8 OGSA-WG.
© 2005 Global Grid Forum The information contained herein is subject to change without notice Leading the pervasive adoption of grid computing for research.
1 OGSA-WG Use Cases 10/1/2003 Jeffrin J. Von Reich Hewlett Packard GGF9 OGSA-WG.
© 2005 Global Grid Forum The information contained herein is subject to change without notice Leading the pervasive adoption of grid computing for research.
GGF - © Birds of a Feather - Policy Architecture Working Group.
OGSA-WG Program Execution Status Update GGF9 Chicago, USA October, 2003 GLOBALGRIDFORUM.ORG.
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
Exploring opportunities in the OGSA service model– realising Utility Computing Jeffrin J. Von Reich Chief architect Hewlett Packard Software Global Unit.
1 OGSA-WG Use Cases Editor: Jeffrin J. Von Reich Hewlett Packard.
OGSA HPC cluster usecase for reference Model v.02
GGF Intellectual Property Policy
Expected meeting output/goal proposal
OGSA-WG Basic Profile Session #1 Security
OGSA Session #1 Execution Management Services
OGSA-WG Information Services and Resource Management
Towards GLUE Schema 2.0 Sergio Andreozzi INFN-CNAF Bologna, Italy
Management and Manageability in OGSA
GGF OGSA-WG, Data Use Cases Peter Kunszt Middleware Activity, Data Management Cluster EGEE is a project funded by the European.
Globus —— Toolkits for Grid Computing
Grid Scheduling Architecture – Research Group
Some Basics of Globus Web Services
Hiro Kishimoto, OGSA-WG co-chair GGF16 in Athens February 13, 2006
Unicore and the EM Profile
Defining the Grid: A Roadmap for the Open Grid Services Architecture
UK e-Science OGSA-DAI November 2002 Malcolm Atkinson
OGSA Status and Future GGF13 March 14, 2005 in Seoul
CMM-WG: Updates and Gap Analysis Discussion
Naming service BoF #2 & report session
Grid Computing B.Ramamurthy 9/22/2018 B.Ramamurthy.
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Leigh Grundhoefer Indiana University
OGSA and Security Services GGF12 , September 20th, 2004 Hiro Kishimoto
WS-Resource Framework: Globus Alliance Perspectives
Report on GLUE activities 5th EU-DataGRID Conference
Grid Services B.Ramamurthy 12/28/2018 B.Ramamurthy.
What is OGSA? GGF17 OGSA and Alternative Grid Architectures Panel
Large Scale Distributed Computing
Wide Area Workload Management Work Package DATAGRID project
OGF19 – Chapel Hill, NC, USA 30 January 2007
Service Oriented Architecture (SOA)
Resource and Service Management on the Grid
The Anatomy and The Physiology of the Grid
The Anatomy and The Physiology of the Grid
Global Grid Forum (GGF) Orientation
Grid Systems: What do we need from web service standards?
Presentation transcript:

OGSA Rising Ian Foster Argonne National Laboratory University of Chicago Globus Alliance Hiro Kishimoto Research Fellow FUJITSU Business Grid Consortium All Rights Reserved, Copyright (C) 富士通株式会社 2002

What is OGSA Open service-oriented architecture based on Web services for addressing Grid scenarios Component-oriented architecture Interchangeable components Meta OS functionalities Distributed and heterogeneous environment A rendering of these functions, based on Web service architecture and specifications

OGSA History Announced at GGF4 (’02/2) WG created (’02/9) 6 interim F2F meetings OGSA Usecase document at GGF10 (’04/3) Declared as GGF’s flagship architecture at GGF10 (’04/3) OGSA document at GGF11 (’04/6) First version as informational document Companion OGSA Glossary document

OGSA Formation OGSA-WG OGSA-WG design teams Relation to other WG/RGs Designs overall architecture Integrates and adjust design-teams’ output OGSA-WG design teams Informal domain expert groups within OGSA-WG May include co-chairs of other WG/RGs Output is included in OGSA specification Relation to other WG/RGs Explain OGSA’s approach and get feedback Consign specification design work Two way street: OGSA-WG willing to receive innovative ideas and reflect in OGSA architecture

What’s completed Collection of requirements Based on the OGSA use cases Set design goals Representation of major capabilities Capability is interface, semantics, and behavior Built from multiple interacting services

OGSA-WG Use Case Drives the definition and prioritization of OGSA capabilities and services Gives the rationale for our choices We want to use this to To identify requirements To define OGSA capabilities Sets of OGSA services that meet specific set of requirements. To define relationships between GGF and other standard bodies

Reviewed Use Cases - I Science Grid Use Cases Severe Storm Modeling (Dennis Gannon) National Fusion Collaboratory ( Kate Keahey ) Commercial Grid Use Cases Commercial Data Center ( Hiro Kishimoto, Andreas Savva, David Snelling ) Online Media and Entertainment (Tan Lu, Boas Betzler ) Grid Resource Reseller ( Jon MacLaren, William Lee ) Inter Grid ( Jeffrin J. Von Reich )

Reviewed Use Cases – II Grid Technology Use Cases WG use cases Service-Based Distributed Query Processing ( Nedim Alpdemir, Norman Paton ) Grid Workflow ( Takuya Araki) Interactive Grids ( Jeffrin J. Von Reich) Grid Lite (Jeffrin J. Von Reich ) WG use cases Persistent archives (PA RG) Mutual Authorisation (SA3 RG ) Resource Usage Service (RUS WG )

What’s completed (cont) “The Open Grid Services Architecture, Ver. 1.0” The document is now on GridForge https://forge.gridforum.org/projects/ogsa-wg/document/draft-ggf-ogsa-spec/en Informational document, not recommendation Explains our current thinking on required capabilities, for discussion Depends on emerging specifications (e.g., WS-RF, WS-Notification) Insufficient to develop actual implementation To be reviewed, revised and sent to the GGF Editor within three weeks Your feedback is needed!

OGSA-WG Next Steps Create recommendation architecture document Version 2 of OGSA specification Create roadmap document Discuss in depth with related WG/RGs

Execution Mgmt Services OGSA Architecture II 12:30-2pm OGSA Architecture I 10-11:30am Cataloging Provisioning VO Mgmt Context Services Data Services Integration Policy Mgmt Access Information Services Context Services Data Services Info Services Execution Mgmt Services Trouble- shooting Event Mgmt Discovery Logging Execution Mgmt Services Infra Services Application Mgmt Workflow Mgmt Workload Mgmt Execution Planning Job Mgmt WSRF WSN WSDM Naming Infrastructure Services Rsrc Mgmt Services Self Mgmt Services Reservation Configuration Deployment Provisioning Security Services Resource Mgmt Services Heterogeneity Mgmt Authentication Self Mgmt Services Optimization OGSA Panel 2-3:30pm Authorization Security Services Service Level Attainment Integrity QoS Mgmt Boundary Traversal

Infrastructure Services Our assumptions about the underlying Web services infrastructure To make statements about OGSA services concrete To guarantee interoperability among implementations Web Service architecture and specifications XML, SOAP, WSDL v1.1 (WS-I basic profile) WS-Security, SAML, and XACML WS-Resource Framework, WS-Notification

Execution Mgmt Services Resources Modeling of processing, storage, executables Resource management and provisioning Resource selection Where to execute a service Job management Management and monitoring jobs

EMS Interaction Pattern App. Contents Service Candidate Set Generator (Work -Resource mapping) Provisioning Deployment Configuration Information Services Execution Planning Services Reservation Service Container Data Container Job Manager Accounting Services

EMS Interaction Pattern App. Contents Service Candidate Set Generator (Work -Resource mapping) Provisioning Deployment Configuration Information Services Execution Planning Services OGSA Architecture I 10-11:30am Reservation Service Container Data Container Job Manager Accounting Services

Resource Mgmt Services Domain-specific capabilities OGSA Capabilities OGSA functions level Execution Mgmt Data Service Security Service Infrastructure Level WSRF, WSDM Resources Resource level

Resource Mgmt Services Domain-specific capabilities OGSA Capabilities OGSA functions level Execution Mgmt Data Service Security Service OGSA Architecture I 10-11:30am Infrastructure Level WSRF, WSDM Resources Resource level

Information Services Information handling Models Applications Resources Services Models Information producer/consumer paradigm Data model / query language Meta data model Message schema Producer / consumer description

Information Services Information handling Models Applications Resources Services Models Information producer/consumer paradigm Data model / query language Meta data model Message schema Producer / consumer description OGSA Architecture I 10-11:30am

Data Services Objectives Data resource types Move data to where it is needed Manage replicated copies Run queries and updates Transform among formats Manage meta data Data resource types Flat file, streams, DBMS, catalogues, derivations

Data Services Objectives Data resource types Move data to where it is needed Manage replicated copies Run queries and updates Transform into new format Manage meta data Data resource types Flat file, streams, DBMS, catalogues, derivations OGSA Architecture II 12:30-2am

Security Services Facilitate the enforcement of security-related policy within virtual organizations that span multiple domains Each domain has its own business objectives Each domain translates in an enforced security policy

Security Services OGSA Architecture II 12:30-2am Facilitate the enforcement of security-related policy within virtual organizations that span multiple domains Each domain has its own business objectives Each domain translates in an enforced security policy OGSA Architecture II 12:30-2am

Self-Mgmt Services Reduce the cost and complexity of owning and operating an IT infrastructure System components are Self-configuring Self-healing Self-optimizing Policy- and model-based management Service level attainment

Service Level Attainment Monitoring, analysis and projection, provision, and execution Provisioning: deployment, configuration, and application contents service

Next Steps Version 1 (informational) Version 2 (recommendation) Solicit comments from related WG/RG Reflect them into the document Submit the document to GGF Editor within three weeks Version 2 (recommendation) More feedback and refinement Major revision Detailed enough to implement Roadmap document (version 1)

Goals for Version 2 Define specific interfaces (operations & behaviors) for capabilities identified in V1 Either in collaboration with existing WGs … Or as input to future WGs Refine statement of required capabilities Based on work of other WGs & other standards bodies Based on experience of early adopters Delivery in one year

Goals for Roadmap Define priorities for OGSA interfaces, based on community input Identify dependencies among interfaces Document community requirements for timing of various interfaces Delivery of first draft in 3 months, final in 6 months

GGF Collaboration Data Area WGs Security Execution Management Services Working well: a series of joint phone calls Security Frank Siebenlist provides connectivity Execution Management Services Communication needs to be improved Management Fred Maciel coordinates with CMM, WSDM

Other Standards Bodies OASIS WSRF and WS-Notification WS-Security, etc. WSDM DMTF Utility Computing CIM Server management W3C Various

Open Source Grids OGSA-DAI Several Grid projects are implementing OGSA components OGSA-DAI

Business Grid Project Next generation business application infrastructure Three years project: 2003 - 2005 Fujitsu, Hitachi, NEC, and AIST Jointly funded by the Ministry of Economy, Trade, and Industry (METI) To be available open-source

Business Grid Project (cont) Resource virtualization To handle distribution and heterogeneity Service level attainment Automatic and policy-based management Business application deployment Discover and allocate appropriate IT resources for the application Achieve site portability Standard Job Description Business Application AP Server DBMS Web Server Automatic Resource Allocation AP Server Standard Resource Description Business Applications Logical Resource Pool Virtualization Physical Resource Pool

GT Release Schedule 3.2 4.0 Note: We are not waiting for finalization Improved robustness, scalability, performance, usability 4.0 Q3 3.2 March 4.0 b Q2 4.2 b Q4 2004 2005 4.0 WSRF; some new functionality; further usability, performance enhancements 4.2 Q1 ‘05 New WSRF-based services Maintain pre-WS services 4.2 Note: We are not waiting for finalization of WSRF specs

Planned GT4.0 Components GSI WS-Security CAS (WSRF) SimpleCA RFT RLS OGSA-DAI New GridFTP XIO Pre-WS GRAM WS-GRAM (WSRF) CSF (contribution) MDS2 WS-Index (WSRF) JAVA WS Core (WSRF) C WS Core (WSRF) pyGlobus (contributed) Authz Framework Security Data Management Resource Management Information Services WS Core

NEESgrid Services Equipment Site Control System NEES-POP Control client NTCP Participants/ Observers CHEF NSDS Physical System Central Services NMDS GridFTP GridFTP DAQ System Ingestion tool Files NFMS Files Files MyProxy

What We Need from You Join OGSA sessions today! Architecture I & II (10-11:30am, 12:30-2pm) OGSA Panel (2-3:30pm) Review OGSA document and comment Input on priorities & requirements, ideally based on experiences with real implementations & deployments Interoperability experiences

Summary OGSA is an open service-oriented architecture based on Web services for addressing Grid scenarios Informational architectural document is ready for your review, defines OGSA capabilities Future priorities Version 2 & Roadmap Strengthen collaboration with related WG/RGs Join OGSA sessions today! Architecture I & II (10-11:30am, 12:30-2pm) OGSA Panel (2-3:30pm)