Activity Instance Schema

Slides:



Advertisements
Similar presentations
© 2006 Open Grid Forum GHPN-RG Status update co-chairss:Cees de Laat Dimitra Simeonidou GGF22, Boston, February 2008.
Advertisements

© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps OGF 23, June 2008, Barcelona, Spain.
© 2006 Open Grid Forum Network Services Interface OGF30: Connection Services Guy Roberts, 27 th Oct 2010.
© 2006 Open Grid Forum Ellen Stokes, IBM Michel Drescher, Fujitsu Information Model, JSDL and XQuery: A proposed solution OGF-19 Chapel Hill, NC USA.
© 2006 Open Grid Forum Network Services Interface Introduction to NSI Guy Roberts.
© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps: Examples OGF 22, February 2008, Cambridge, MA.
© 2006 Open Grid Forum OGF19 Federated Identity Rule-based data management Wed 11:00 AM Mountain Laurel Thurs 11:00 AM Bellflower.
© 2007 Open Grid Forum JSDL-WG Session OGF27 – General Session 10:30-12:00, 14 October 2009 Banff, Canada.
©2010Open Grid Forum OGF28 OGSA-DMI Status Chairs: Mario Antonioletti, EPCC Stephen Crouch, Southampton Shahbaz Memon, FZJ Ravi Madduri, UoC.
© 2006 Open Grid Forum JSDL Session (CIM Job) OGF 21 - Seattle, 17 October 2007.
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 20 - Manchester, 7 May 2007.
© 2007 Open Grid Forum JSDL-WG Session OGF21 – Activity schema session 17 October 2007 Seattle, U.S.
© 2008 Open Grid Forum Resource Selection Services OGF22 – Boston, Feb
© 2006 Open Grid Forum Network Services Interface OGF29: Working Group Meeting Guy Roberts, 19 th Jun 2010.
© 2007 Open Grid Forum JSDL-WG Session 1 OGF25 – General Session 11:00-12:30, 3 March 2009 Catania.
© 2006 Open Grid Forum JSDL Optional Elements OGF 24 Singapore.
© 2007 Open Grid Forum Data/Compute Affinity Focus on Data Caching.
© 2007 Open Grid Forum OGSA-RUS Specification Update, Adoption and WS-RF Profile Discussions (Molly Pitcher) Morris Riedel (Forschungszentrum Jülich –
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources (OGSA Modeling Activities) OGF 21 - Seattle, 16 October 2007.
© 2006, 2007 Open Grid Forum Michel Drescher, FujitsuOGF-20, Manchester, UK Andreas Savva, FujitsuOGF-21, Seattle, US (update) Extending JSDL 1.0 with.
© 2009 Open Grid Forum Usage Record Working Group Alignment and Production Profile.
1 ©2013 Open Grid Forum OGF Working Group Sessions Security Area – FEDSEC Jens Jensen, OGF Security Area.
© 2006 Open Grid Forum DCI Federation Protocol BoF Alexander Papaspyrou, TU Dortmund University Open Grid Forum March 15-18, 2010, Munich, Germany.
© 2010 Open Grid Forum Standards All Hands Meeting OGF28, München, March 2010.
© 2006 Open Grid Forum Network Services Interface OGF 32, Salt Lake City Guy Roberts, Inder Monga, Tomohiro Kudoh 16 th July 2011.
© 2010 Open Grid Forum OCCI Status Update Alexander Papaspyrou, Andy Edmonds, Thijs Metsch OGF31.
© 2006 Open Grid Forum Activity Instance Schema Activity Instance Document Schema Wednesday, 17 September, 2008 Singapore.
© 2007 Open Grid Forum JSDL-WG Session OGF22 – General Session (11:15-12:45) 25 February 2008 Boston, U.S.
© 2006 Open Grid Forum FEDSEC-CG Andrew Grimshaw and Jens Jensen.
© 2006 Open Grid Forum Activity Instance Schema Philipp Wieder (with the help of the JSDL-WG) Activity Instance Document Schema BoF Monday, 25 February,
© 2006 Open Grid Forum Network Services Interface OGF 33, Lyon Guy Roberts, Inder Monga, Tomohiro Kudoh 19 th Sept 2011.
© 2006 Open Grid Forum HPC Job Delegation Best Practices Grid Scheduling Architecture Research Group (GSA-RG) May 26, 2009, Chapel Hill, NC, US.
© 2006 Open Grid Forum GridRPC Working Group 15 th Meeting GGF22, Cambridge, MA, USA, Feb
© 2006 Open Grid Forum Network Services Interface CS Errata Guy Roberts, Chin Guok, Tomohiro Kudoh 29 Sept 2015.
© 2006 Open Grid Forum OGSA-WG: EGA Reference Model GGF18 Sept. 12, 4-5:30pm, #159A-B.
© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Introduction Marcin Płóciennik Banff, OGF 27 Marcin Płóciennik.
© 2006 Open Grid Forum NML Progres OGF 28, München.
© 2007 Open Grid Forum OGF Management Area Meeting OGF20 7 May, am-12:30pm Manchester, UK.
© 2007 Open Grid Forum Status Reviews and Plans Production Grid Infrastructure (PGI) - WG Morris Riedel et al. Juelich Supercomputing Centre PGI Co-Chair.
© 2006 Open Grid Forum Grid Resource Allocation Agreement Protocol GRAAP-WG working session 1 Thursday, 5 March, 2009 Catania, Sicily.
© 2006 Open Grid Forum VOMSPROC WG OGF36, Chicago, IL, US.
© 2007 Open Grid Forum OGF20 Levels of the Grid Workflow Interoperability OGSA-WG F2F meeting Adrian Toth University of Miskolc NIIF 11 th May, 2007.
© 2006 Open Grid Forum 1 Application Contents Service (ACS) ACS-WG#1 Monday, September 11 10:30 am - 12:00 am (158A-B) ACS-WG#2 Wednesday, September 13.
© 2006 Open Grid Forum Network Services Interface 2015 Global LambdaGrid Workshop Prague Guy Roberts, Chin Guok, Tomohiro Kudoh 28 Sept to 1 Oct 2015.
© 2008 Open Grid Forum Production Grid Infrastructure WG State Model Discussions PGI Team.
© 2007 Open Grid Forum JSDL-WG Session OGF26 – General Session 11:00-12:30, 28 May 2009 Chapel Hill, NC.
Network Services Interface
Welcome and Introduction
OGSA EMS Session OGF19 OGSA-WG session #3 30 January, :30pm
RISGE-RG use case template
GridRPC Working Group 13th Meeting
Grid Resource Allocation Agreement Protocol
OGF session PMA, Florence, 31 Jan 2017.
Sharing Topology Information
Network Services Interface
Network Services Interface Working Group
OGSA-Workflow OGSA-WG.
Information Model, JSDL and XQuery: A proposed solution
Network Measurements Working Group
WS Naming OGF 19 - Friday Center, NC.
Activity Delegation Kick Off
Universal Dynamic Activity Package - Concepts
SAGA: Java Language Binding
Network Services Interface Working Group
OGSA-RSS-WG EPS Discussion.
Introduction to OGF Standards
SAGA: Java Language Binding
Proposed JSDL Extension: Parameter Sweeps
UR 1.0 Experiences OGF 24, Singapore.
OGF 40 Grand BES/JSDL Andrew Grimshaw Genesis II/XSEDE
Presentation transcript:

Activity Instance Schema Activity Instance Document Schema Tuesday 03 March, 2007 Le Ciminiere, Italy

OGF IPR Policies Apply “I acknowledge that participation in this meeting is subject to the OGF Intellectual Property Policy.” Intellectual Property Notices Note Well: All statements related to the activities of the OGF and addressed to the OGF are subject to all provisions of Appendix B of GFD-C.1, which grants to the OGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in OGF meetings, as well as written and electronic communications made at any time or place, which are addressed to: the OGF plenary session, any OGF working group or portion thereof, the OGF Board of Directors, the GFSG, or any member thereof on behalf of the OGF, the ADCOM, or any member thereof on behalf of the ADCOM, any OGF mailing list, including any group list, or any other list functioning under OGF auspices, the OGF Editor or the document authoring and review process Statements made outside of a OGF meeting, mailing list or other function, that are clearly not intended to be input to an OGF activity, group or function, are not subject to these provisions. Excerpt from Appendix B of GFD-C.1: ”Where the OGF knows of rights, or claimed rights, the OGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant OGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non-discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the OGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the OGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification.” OGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process. IPR Notices Note Well for OGF meetings 2

Content Objectives of the Activity Schema activity Quick review Timeline Schema discussion 3

Objectives - General JSDL comprises a core Resource Request Language (RRL) and exists within an environment of other languages like Scheduling Description Language (SDL), Job Policy Language (JPL), etc. more requirements, dependencies, etc. wrt to an Activity Activity Instance Schema to capture those requirements, ... 4

Problem Domain - the Activity view Activity concept is broader than just compute Think about business scenarios using SLAs Modelling SLA lifecycle Creation and Monitoring of SLAs Evaluation SLA = “Business Activity” Comprises compute, but also ... ... data, accounting info, provenance, lifecycle, etc. This information has to be captured and related to an activity 5

Objectives - Current Work Activity Instance Schema provides holistic description of activity initiated by a JSDL document Usage of existing OGF standards (JSDL, BES, UR, …) More general version of the schema later Current focus: Schema rendering Have document in public comment asap Final discussion today 6

Example Use Case - Scheduling 7

Quick review Use cases Requirements Schema Four different have been collected Will be available either as a separate doc. or an attachment to the spec Requirements Gathered from use cases Discussed and prioritised Schema Most requirements already captured 8

Timeline Final discussion at OGF 25 Document ready until OGF 25 Schema description Document ready until OGF 25 Implementations TU Dortmund asa document is ready Anybody else? 9

Schema – Activity Document 10

Schema – Activity History Entry 11

Schema – Remaining Issues Integration of JSDL/UR versus xsd:any and profiling Security (aka activity related security constraints) versus activity document access rights Anything essential missing? 12

Old slides .... 13

Activity - Status Quo Focus is on “Compute Activities” Client defines Activity using JSDL Activity is executed on a compute resource Related OGF specifications OGSA-BES JSDL (GLUE) 14

Problem Domain - the JSDL view JSDL comprises a core Resource Request Language and exists within an environment of other languages like Scheduling Description Language, Job Policy Language, etc. --> more requirements, dependencies, etc. wrt to an Activity 15

Content Objectives of the BoF Status Quo of activity discussion Problem Domain Universal Dynamic Activity Package Concept Model Existing schema discussion 16

UDAP - Activity Definition A unit of work A job A task A data processing operation A data access operation An application execution A Web Service invocation A “thing” you need to do/take care of/execute! …etc. From the OGSA-BES specification: “…computational entities such as UNIX or Windows processes, Web Services, or parallel programs—what we call activities…” 17

UDAP - Activity Definition We take a holistic view of an activity We, therefore, consider ALL that there is to know about an activity: ALL of its requirements ALL of its dependencies (on data and other activities) ALL of its contextual information Topical domain (financial markets, weather forecasting, etc.) Security (who owns the activity, who is allowed to run it, etc.) SLAs, QoS and other related policies ALL of its monitoring information Status, history, resource information, accounting, policy conformation etc. 18

UDAP - Concept The UDAP package can contain any information about an activity, regardless of the schema used to present that information The values of the activity information can be updated or appended to reflect the past, present, and future state of the activity All of the information associated with each activity is contained in a single package The information in a UDAP package is kept up-to-date for its activity, once it is submitted to and managed within a Grid 19

UDAP Model - Overview ID and Description The Record is the core of an Activity Result is xsd:any 20

UDAP Model - Record 21

UDAP and JSDL <UDAP ...> <ActivityID>ID1</ActivityID> <ActivityDescription Dialect=”JSDL">Example using JSDL</ActivityDescription> <Record> <Entry Category="original"> <TimeStamp>2006-05-04T18:13:51.0Z</TimeStamp> <State>pending</State> <Resource> <jsdl:jobDocument> ... </jsdl:jobDocument> </Resource> <Context> <jsdl:schedulingPolicy> ... </jsdl:schedulingPolicy> <jpl:somePolicy> ... </jpl:somePolicy> </Context> <Dependency> <wf:someWorkflowDependencies> ... </wf:someWorkflowDependencies> </Dependency> </Entry> </Record> <Result> </Result> </UDAP> 22

A word on Resource & Context “Resource” element in UDAP actually captures the resource request Can be JSDL Can be RSL, … “Context” may contain the security, legal, billing, … etc. context in which the activity is executed Much broader Naming should be discussed … 23

We proudly present … … Steve McGough on GridSAM … Shahbaz Memon on UNICORE 24

Discussions since OGF 21 The UDAP schema and use cases have been discussed during JSDL telecons Current schema seems to be good starting point Minor issues came up, only major until now: UDAP schema has no specific element for resource usage 25

Decisions Go for a Activity Instance Document schema Define it high-level, then profile it for specific OGF use cases JSDL Usage Records … Issues to resolve wrt UDAP schema 26

Next steps Collect requirements GridSAM and UNICORE presentations Discussion during the BoF Discuss requirements in the light of existing schema Wednesday, 10:45 (William Dawes) AOB 27

Post BoF situation GridSAM and UNICORE usage scenarios have been presented In addition two other usage scenarios have been briefly discussed Actions: Decide whether stay within JSDL or form new group Gather requirements OGF activity instance schema 28

Seven questions Is the scope of the proposed group sufficiently focused? Are the topics that the group plans to address clear and relevant for the Grid research, development, industrial, implementation, and/or application user community? Will the formation of the group foster (consensus-based) work that would not be done otherwise? Do the group's activities overlap inappropriately with those of another OGF group or to a group active in another organization such as IETF or W3C? Are there sufficient interest and expertise in the group's topic, with at least several people willing to expend the effort that is likely to produce significant results over time? Does a base of interested consumers (e.g., application developers, Grid system implementers, industry partners, end-users) appear to exist for the planned work? Does the OGF have a reasonable role to play in the determination of the technology? 29

Usage Scenarios (brief) Managed Execution Use Case Track the general lifecycle of an activity (Chris?) Keep activity delegation information (Dortmund/GSA-RG) UNICORE Use Case (FZJ) GridSAM (Stephen) 30

Full Copyright Notice Copyright (C) Open Grid Forum (2007, 2008). All Rights Reserved. This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works. The limited permissions granted above are perpetual and will not be revoked by the OGF or its successors or assignees. OGF Full Copyright Notice if necessary 31