GGF TM-RG GGF14 Group Results. Intellectual Property Policy I acknowledge that participation in GGFx is subject to the GGF Intellectual Property Policy.

Slides:



Advertisements
Similar presentations
© 2006 Open Grid Forum GHPN-RG Status update co-chairss:Cees de Laat Dimitra Simeonidou GGF22, Boston, February 2008.
Advertisements

© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps OGF 23, June 2008, Barcelona, Spain.
© 2006 Open Grid Forum Network Services Interface OGF30: Connection Services Guy Roberts, 27 th Oct 2010.
© 2006 Open Grid Forum Ellen Stokes, IBM Michel Drescher, Fujitsu Information Model, JSDL and XQuery: A proposed solution OGF-19 Chapel Hill, NC USA.
© 2006 Open Grid Forum Network Services Interface Introduction to NSI Guy Roberts.
© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps: Examples OGF 22, February 2008, Cambridge, MA.
© 2006 Open Grid Forum OGF19 Federated Identity Rule-based data management Wed 11:00 AM Mountain Laurel Thurs 11:00 AM Bellflower.
© 2007 Open Grid Forum JSDL-WG Session OGF27 – General Session 10:30-12:00, 14 October 2009 Banff, Canada.
©2010Open Grid Forum OGF28 OGSA-DMI Status Chairs: Mario Antonioletti, EPCC Stephen Crouch, Southampton Shahbaz Memon, FZJ Ravi Madduri, UoC.
© 2007 Open Grid Forum JSDL-WG Session OGF21 – Activity schema session 17 October 2007 Seattle, U.S.
© 2006 Open Grid Forum 2 nd March 09 Enterprise Grid Requirements Research Group OGF25 EGR-RG Session Group.
© 2006 Open Grid Forum OGSA Next Steps Discussion Providing Value Beyond the Specifications.
Oct 15 th, 2009 OGF 27, Infrastructure Area: Status of FVGA-WG Status of Firewall Virtualization for Grid Applications - Working Group
© 2008 Open Grid Forum Resource Selection Services OGF22 – Boston, Feb
© 2006 Open Grid Forum Network Services Interface OGF29: Working Group Meeting Guy Roberts, 19 th Jun 2010.
Feb OGF22NML-WG: Welcome and Introduction Welcome and Introduction Paola Grosso - UvA Martin Swany - UDelaware.
© 2006 Open Grid Forum JSDL Optional Elements OGF 24 Singapore.
© 2007 Open Grid Forum Data/Compute Affinity Focus on Data Caching.
© 2006 Open Grid Forum Grid Resource Allocation Agreement Protocol GRAAP-WG working session 2 Wenesday, 17 September, 2008 Singapore.
© 2006, 2007 Open Grid Forum Michel Drescher, FujitsuOGF-20, Manchester, UK Andreas Savva, FujitsuOGF-21, Seattle, US (update) Extending JSDL 1.0 with.
GGF TM-RG GGF14 Group Results. TM-RG Group History  Founded at GGF10 Berlin (03/2004) Co-Chairs  Torsten Steinbach (IBM)  Jim Webber (University of.
1 ©2013 Open Grid Forum OGF Working Group Sessions Security Area – FEDSEC Jens Jensen, OGF Security Area.
© 2006 Open Grid Forum DCI Federation Protocol BoF Alexander Papaspyrou, TU Dortmund University Open Grid Forum March 15-18, 2010, Munich, Germany.
NMWG GGF13 Seoul March 2005 R. Hughes-Jones Manchester Network Measurements Working Group Discussion: Current Work & Milestones Richard Hughes-Jones NM-WG.
© 2007 Open Grid Forum Data Grid Management Systems: Standard API - community development Arun Jagatheesan, San Diego Supercomputer Center & iRODS.org.
© 2006 Open Grid Forum Service Level Terms Andrew Grimshaw.
© 2010 Open Grid Forum Standards All Hands Meeting OGF28, München, March 2010.
Peter Ziu Northrop Grumman ACS-WG Grid Provisioning Appliance Concept GGF13, March 14, 2005 (Revised 8/4/2005)
OGF DMNR BoF Dynamic Management of Network Resources Documents available at: Guy Roberts, John Vollbrecht.
© 2006 Open Grid Forum Network Services Interface OGF 32, Salt Lake City Guy Roberts, Inder Monga, Tomohiro Kudoh 16 th July 2011.
© 2007 Open Grid Forum Enterprise Best (Community) Practices Workshop OGF 22 - Cambridge Nick Werstiuk February 25, 2007.
© 2007 Open Grid Forum JSDL-WG Session OGF22 – General Session (11:15-12:45) 25 February 2008 Boston, U.S.
© 2006 Open Grid Forum FEDSEC-CG Andrew Grimshaw and Jens Jensen.
© 2006 Open Grid Forum Network Services Interface OGF 33, Lyon Guy Roberts, Inder Monga, Tomohiro Kudoh 19 th Sept 2011.
© 2015 Open Grid Forum ETSI CSC activities Wolfgang Ziegler Area Director Applications, OGF Fraunhofer Institute SCAI Open Grid Forum 44, May 21-22, 2015.
© 2006 Open Grid Forum HPC Job Delegation Best Practices Grid Scheduling Architecture Research Group (GSA-RG) May 26, 2009, Chapel Hill, NC, US.
© 2006 Open Grid Forum GridRPC Working Group 15 th Meeting GGF22, Cambridge, MA, USA, Feb
OGSA-RSS Face-to-Face Meeting Sunnyvale, CA, US Aug 15-16, 2005.
© 2008 Open Grid Forum OGSA-DMI WSDL Renderings & Interop OGF23 OGSA-DMI session Michel Drescher 2 June, 2008 Barcelo Sants Hotel.
© 2006 Open Grid Forum Network Services Interface CS Errata Guy Roberts, Chin Guok, Tomohiro Kudoh 29 Sept 2015.
© 2006 Open Grid Forum OGSA-WG: EGA Reference Model GGF18 Sept. 12, 4-5:30pm, #159A-B.
© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Introduction Marcin Płóciennik Banff, OGF 27 Marcin Płóciennik.
© 2006 Open Grid Forum Grid High-Performance Networking Research Group (GHPN-RG) Dimitra Simeonidou
Peter Ziu Northrop Grumman ACS-WG Grid Provisioning Appliance Concept GGF13, March 14, 2005
© 2008 Open Grid Forum PGI - Information Security in the UNICORE Grid Middleware Morris Riedel (FZJ – Jülich Supercomputing Centre & DEISA) PGI Co-Chair.
© 2007 Open Grid Forum OGF Management Area Meeting OGF20 7 May, am-12:30pm Manchester, UK.
© 2006 Open Grid Forum Grid Resource Allocation Agreement Protocol GRAAP-WG working session 1 Thursday, 5 March, 2009 Catania, Sicily.
© 2006 Open Grid Forum 1 Application Contents Service (ACS) ACS-WG#1 Monday, September 11 10:30 am - 12:00 am (158A-B) ACS-WG#2 Wednesday, September 13.
© 2008 Open Grid Forum Production Grid Infrastructure WG State Model Discussions PGI Team.
OGSA Data Architecture WG Data Transfer Session Allen Luniewski, IBM Dave Berry, NESC.
© 2007 Open Grid Forum JSDL-WG Session OGF26 – General Session 11:00-12:30, 28 May 2009 Chapel Hill, NC.
Network Services Interface
SLIDES TITLE Your name Session Name, OGSA-WG #nn
Welcome and Introduction
RISGE-RG use case template
Hiro Kishimoto, OGSA-WG co-chair GGF16 in Athens February 17, 2006
Grid Resource Allocation Agreement Protocol
OGF session PMA, Florence, 31 Jan 2017.
WS-Agreement Working Session
Network Services Interface
OGSA-Workflow OGSA-WG.
Information Model, JSDL and XQuery: A proposed solution
Network Measurements Working Group
WS Naming OGF 19 - Friday Center, NC.
Activity Delegation Kick Off
SAGA: Java Language Binding
Network Services Interface Working Group
Introduction to OGF Standards
Proposed JSDL Extension: Parameter Sweeps
OGF 40 Grand BES/JSDL Andrew Grimshaw Genesis II/XSEDE
Presentation transcript:

GGF TM-RG GGF14 Group Results

Intellectual Property Policy I acknowledge that participation in GGFx is subject to the GGF Intellectual Property Policy. Intellectual Property Notices Note Well: All statements related to the activities of the GGF and addressed to the GGF are subject to all provisions of Section 17 of GFD-C.1 (.pdf), which grants to the GGF and its participants certain licenses and rights in such statements. Such statements include verbal statements in GGF meetings, as well as written and electronic communications made at any time or place, which are addressed to: the GGF plenary session, any GGF working group or portion thereof, the GFSG, or any member thereof on behalf of the GFSG, the GFAC, or any member thereof on behalf of the GFAC, any GGF mailing list, including any working group or research group list, or any other list functioning under GGF auspices, the GFD Editor or the GWD process Statements made outside of a GGF meeting, mailing list or other function, that are clearly not intended to be input to an GGF activity, group or function, are not subject to these provisions. Excerpt from Section 17 of GFD-C.1 Where the GFSG knows of rights, or claimed rights, the GGF secretariat shall attempt to obtain from the claimant of such rights, a written assurance that upon approval by the GFSG of the relevant GGF document(s), any party will be able to obtain the right to implement, use and distribute the technology or works when implementing, using or distributing technology based upon the specific specification(s) under openly specified, reasonable, non- discriminatory terms. The working group or research group proposing the use of the technology with respect to which the proprietary rights are claimed may assist the GGF secretariat in this effort. The results of this procedure shall not affect advancement of document, except that the GFSG may defer approval where a delay may facilitate the obtaining of such assurances. The results will, however, be recorded by the GGF Secretariat, and made available. The GFSG may also direct that a summary of the results be included in any GFD published containing the specification. GGF Intellectual Property Policies are adapted from the IETF Intellectual Property Policies that support the Internet Standards Process.

TM-RG Group History  Founded at GGF10 Berlin (03/2004) Co-Chairs  Torsten Steinbach (IBM)  Jim Webber (University of Newcastle)  Can Türker (ETH Zürich)  Agreed Group Charter  Meetings GGF GGF11, GGF12, GGF13  Chairing issue Jim & Can had to resign end of 2004 Tony Fletcher (Choreology) became co-chair

TM-RG – The People Active People  Tony Fletcher (Choreology)  Dieter Gawlick (Oracle)  Torsten Steinbach (IBM)  Jim Webber (University of Newcastle)  Robert Haugen (Choreology)  Malik Saheb (Arjuna)  Mark Little (Arjuna)  Jörg Seitter (Brunel University, London) About 60 people on the mailing list

TM-RG Group Status Groups Tasks:  Collect Transactional Use Cases rg/document/Transaction_Use_cases/en/4 rg/document/Transaction_Use_cases/en/4  Educational Sessions on transactional specifications (BTP, WS-Coor/AT/BA, WS-CAF)  Analyze realization of use cases using the specs Current task to do So far no common agreement within group if existing specifications are sufficient or not  Informational paper Groups report available: ( ) Report_of_the_Transaction_Management_Research_Group/en/3

Use Case Document  Available on GridForge:  Use Cases (per category): Agreement Negotiation and execution  Trip Support  Grid Resource Allocation  Credit Verification  TWIST - Financial Instrument trading Information Dissemination  Speculative Computation Information Aggregation  Distributed available-to-promise Process Tracking  Long-running Computations on the Grid (Checkpointing)

Options Model (Unplanned) outcome of discussions around “Agreement Negotiation and Execution“ use cases Options:  An option is a reservation of a resource (or parts of it) bound to some condition.  The typical condition is a time constraint. If the option is not confirmed within a certain period of time it will automatically expire.

Options Model Architecture

Option Model States

Other Transactional Challenges in the Grid Control Recoverability Message-based communication imposes possibility for work to be externalized once it is committed but not yet recoverable (Credit Verification Use Case) Coordinate Distributed Processes for recoverability via synchronized checkpoints (see Checkpointing Use Case)

Future Outstanding task:  Analysis of transactional specs with regard to identified use cases Chairing issue:  Tony has to resign at GGF14 since his company (Choreology) has shrunk and can no longer support his involvement  Torsten now has to resign as well due to different assignment within IBM TM RG will now shut down in a controlled manner, if nobody else stands up and takes the lead

Group Results There are basically three results we can claim:  Use Cases  Recoverability Findings  Options Model

Recommendations 1.Pick up use cases and refine and add new ones if necessary 2.Perform analysis if existing transactional specs are suitable for implementing the use cases 3.Perform reference implementation of options model A sample implementation already being done by Joerg Seitter in context of master thesis about options model (supervised by Peter van Santen, Brunel University of Check status at 4.Identify solution for recoverability/visibility issue (Credit Verification Use Case)

Backup

Typical Properties of a Grid Req. 1: Resources are used very dynamically and with late binding. One can not tell which concrete resource is used at development time and usually not even at deployment time. Req. 2: Resources are shared very dynamically and to a large extent by multiple clients. Req. 3: A concrete resource can be integrated in and disintegrated from a grid very dynamically. Req. 4: There is typically no persistent legal relationship between client and resources. Instead ad-hoc legal relationships are established during runtime. Options Model Details

Distributed Transaction Management ACID with Distributed 2PC  Scalability Problem in terms of resource sharing Compensation  Problems with dynamic resource availability Options Model Details

Usage of Options in a Transaction To gather a set of resources required to accomplish a certain task.  Once all required options are retrieved they are committed in an atomic way. To reserve one or more sets of alternative resources and decide later which ones to confirm.  Once a complete set of required resources are retrieved they are confirmed. The others are cancelled or they just expire. Options Model Details

Option Clearing An option is a promise of the resource manager (legal issue) Imagine an option valid for 2 hours a confirmation is sent 1 second before expiration:  Someone needs to decide if this was in time or not (you nee to consider message transfers and other latencies). Proposed Solution: Clearing Manager (CM)  Resource Manager must not drop an option without asking CM for approval Options Model Details

Option Clearing Consequences Coordinating options to the Resource Manager can be done asynchronously  High fault-tolerance (see Req. 3)  High scalability (see Req. 2) Clearing Manager is the legal instance  Dynamic agreement between application and resource managers (see. Req. 1)  Ad-hoc legal relationships are managed (see. Req. 4) Options Model Details

Option Model Protocols Application-2-RM  Application to retrieve list of supported CMs.  Application to request an option (signed with public key of CM). Application-2-CM  Application to confirm a certain option explicitly.  Application to open, commit or cancel a transaction. Options are passed with commit/rollback call  Application to pass 1-out-of-N confirmation groups with commit call. CM-2-RM  RM to ask the CM to drop a certain option it has registered.  CM to tell RM that a certain option has been confirmed or cancelled. Options Model Details