OGSA V1 Document (p19). Terminology What is a job? Job made of multiple tasks –Task: Single unit of work –Job: Multiple tasks GT2: DUROC: Link tasks with.

Slides:

Advertisements

Similar presentations

C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.

Advertisements

© Geodise Project, University of Southampton, Applications and Middleware Hakki Eres, Fenglian Xu & Graeme Pound.

BiodiversityWorld GRID Workshop NeSC, Edinburgh – 30 June and 1 July 2005 Resource wrappers, web services, grid services Jaspreet Singh School of Computer.

1 Industry-Wide System Management Standard Bernd Sint Seminar Grid Computing II WS 2006/07.

USING THE GLOBUS TOOLKIT This summary by: Asad Samar / CALTECH/CMS Ben Segal / CERN-IT FULL INFO AT:

Globus Toolkit 4 hands-on Gergely Sipos, Gábor Kecskeméti MTA SZTAKI

Universität Dortmund Robotics Research Institute Information Technology Section Grid Metaschedulers An Overview and Up-to-date Solutions Christian.

Intelligent Grid Solutions 1 / 18 Convergence of Grid and Web technologies Alexander Wöhrer und Peter Brezany Institute for Software.

June 30th, 2005EuroPKI2005 “Towards a Unified Authentication and Authorization Infrastructure for Grid Services: Implementing an Enhanced OCSP Service.

4a.1 Grid Computing Standards ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4a.

The Globus Toolkit Gary Jackson. Introduction The Globus Toolkit is a product of the Globus Alliance ( It is middleware for developing.

Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.

1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.

OGF Standards Activity Steven Newhouse. © myOGF Part of the Standards Council Area Directror for Applications Working Groups Co-chair: Basic Execution.

12006/9/26 Emerging Grid Standards Mark Baker, Amy Apon, Clayton Ferner, Jeff Brown. IEEE Computer Society,Vol. 38, Issue 4, pp , Year of Publication:

4b.1 Grid Computing Software Components of Globus 4.0 ITCS 4010 Grid Computing, 2005, UNC-Charlotte, B. Wilkinson, slides 4b.

Globus Computing Infrustructure Software Globus Toolkit 11-2.

1 Globus Developments Malcolm Atkinson for OMII SC 18 th January 2005.

Globus 4 Guy Warner NeSC Training.

Kate Keahey Argonne National Laboratory University of Chicago Globus Toolkit® 4: from common Grid protocols to virtualization.

UCoMS: Grid Computing Framework for Petroleum Engineering.

1 Modeling Stateful Resources with Web Services ICE Ph.D lecture Byung-sang Kim.

Core Grid Functions: A Minimal Architecture for Grids William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (www-itg.lbl.gov/~wej)

Grid Workflow within Triana Ian Wang Cardiff University.

Grid Computing 7700 Fall 2005 Lecture 17: Resource Management Gabrielle Allen

© Geodise Project, University of Southampton, Data Management in Geodise Jasmin Wason, Zhuoan Jiao and Marc Molinari Engineering.

NAREGI WP4 (Data Grid Environment) Hideo Matsuda Osaka University.

Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.

OPEN GRID SERVICES ARCHITECTURE AND GLOBUS TOOLKIT 4

WP9 Resource Management Current status and plans for future Juliusz Pukacki Krzysztof Kurowski Poznan Supercomputing.

GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.

Information breakout. Things what we did What is the difference between a registry and a catalog? What do we mean by naming? What does OGSA define? Using.

© Geodise Project, University of Southampton, Data Management in Geodise Zhuoan Jiao, Jasmin Wason and Marc Molinari

Job Submission Condor, Globus, Java CoG Kit Young Suk Moon.

Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.

Computational grids and grids projects DSS,

GRAM5 - A sustainable, scalable, reliable GRAM service Stuart Martin - UC/ANL.

© 2008 Open Grid Forum Independent Software Vendor (ISV) Remote Computing Primer Steven Newhouse.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.

Interactive task invocation in the Virtual Laboratory M. Okoń, M. Lawenda, T. Rajtar, D. Stokłosa, D. Kaliszan, P. Mierzyński, N. Meyer, M. Stroiński 4.

Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.

© Geodise Project, University of Southampton, Geodise Middleware & Optimisation Graeme Pound, Hakki Eres, Gang Xue & Matthew Fairman Summer 2003.

Grid Security: Authentication Most Grids rely on a Public Key Infrastructure system for issuing credentials. Users are issued long term public and private.

CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.

OGSA-UK: Putting the users first Steven Newhouse OMII Deputy Director.

1 Application of UniTESK Technology for Functional Testing of Infrastructural Grid Software Sergey Smolov, Institute for System Programming, RAS

Scheduling Interactive Tasks in the Grid-based Systems M. Okoń, M. Lawenda, N. Meyer, D. Stokłosa, T. Rajtar, D. Kaliszan, M. Stroiński TERENA Networking.

Web Service Resource Framework WSMO Presentation Jos de Bruijn Digital Enterprise Research Institute http ://

Service Proforma Middleware Workshop. Notes Please complete as much of this proforma as possible – it will help make the workshop more informative & productive.

Easy Access to Grid infrastructures Dr. Harald Kornmayer (NEC Laboratories Europe) Dr. Mathias Stuempert (KIT-SCC, Karlsruhe) EGEE User Forum 2008 Clermont-Ferrand,

Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.

© 2004 IBM Corporation ICSOC2004 Panel Discussion: Grid Systems: What is needed from web service standards? Jeffrey Frey IBM.

© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.

© Geodise Project, University of Southampton, Integrating Data Management into Engineering Applications Zhuoan Jiao, Jasmin.

Service Proforma Middleware Workshop. Notes Please complete as much of this proforma as possible – it will help make the workshop more informative & productive.

CDDLM on HP SmartFrog Middleware Workshop. Service: CDDLM Distributed Deployment Framework HPL implementation of GGF CDDLM WG – (and.

1 OGSA-DAI: Service Grids Neil P Chue Hong. 2 Motivation  Access to data is a necessity on the Grid  The ability to integrate different data resources.

Data Breakout. OGSA Architecture – databases Eldas, OGSA-DAI and GridMiner implement a slightly old version of OGSA / DAIS –Architecture doc describes.

The GT 4 GRAM Service Sam Meder Middleware Workshop.

Current Globus Developments Jennifer Schopf, ANL.

EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI UMD Roadmap Steven Newhouse 14/09/2010.

ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.

The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.

Amy Krause EPCC OGSA-DAI An Overview OGSA-DAI on OMII 2.0 OMII The Open Middleware Infrastructure Institute NeSC,

Parallel Computing Globus Toolkit – Grid Ayaka Ohira.

WS-Resource Framework University of Amsterdam

Viet Tran Institute of Informatics Slovakia

Wide Area Workload Management Work Package DATAGRID project

Resource and Service Management on the Grid

Presentation transcript:

OGSA V1 Document (p19)

Terminology What is a job? Job made of multiple tasks –Task: Single unit of work –Job: Multiple tasks GT2: DUROC: Link tasks with barriers etc. GL: App=set of jobs, jobs=set of process COG: GridAnt (client side) SF: One provisioning jobs

OGSA Diagram Confusing: –What are all the services doing? –Allocation: Implementation of Auth policy with required resource. –Difference between Reservation & Resource Allocation

Duplication (P19) Workload Mgmt Framework –Proxies –Job factory –GL: GRMS (Job Submission) Resource Mgmt Framework –Information Provider (Glue Schema, class ad, JDL) Feed into MDS and other infor systems –Resource factory (Provisioning?) SmartFrog –Reservation (Very Basic concepts, Research level)

Workload Optimisation Framework (DRM) –Submit & monitoring & control job E.g. kill, suspend, signal sending Resource Optimisation Framework –Admission Control (gridmap, or equiv.)

Admission Control Workload Optimisation/Meta-Scheduling –ICENI, GRMS, CSF

User Functionality: Capability Security Context (e.g. Identity) Manipulation Submit, Control & Monitor Jobs Monitoring/Testing of the System Manipulating Remote File System –e.g. GridFTP ‘Virtual’ File Store & meta-data manipulation –e.g. RLS, WinFS –Better the viewing of the meta-data the FS structure becomes irrelevant

The Implementations Where are the differences? Geodise Matlab, Jython & Python environments –Gridmap: System Control –ACL on files in VirtualFS: User Control –Job Monitoring Capability –Explicit heartbeat & health monitoring GT2, GT3 & GT4 command line tools –Replica & meta-data services –Authorisation services –Infrastructure Discovery & Monitoring (soft state reg.==heartbeat) GAT (Grid Application Toolkit) implemented by GridLab –Resource Discovery (built on top of MDS & GRMS) –Registry for jobs, files, … or any object/endpoint! –Monitor all of the above objects. –Reservation API ICENI –Scheduling, performance & reservation support/implementation

What is being used beyond WS-I (/5) WS-Security [Username/PW/X509] (5) WS-Addressing (3.5) WS-Trust (2.5) WS-SecureConversation (2.5) JSDL (2) WS-Notification (1.5) WS-RF (1.5 – average) –WS-BaseFaults (2) –WS-ResourceProperties (2) –WS-ServiceGroup (1) –WS-ResourceLifetime (1) WS-Eventing (1)