Grid File System Working Group SAGA and GFS-WG Grid File System Working Group (GFS-WG) Global Grid Forum (GGF)

Slides:



Advertisements
Similar presentations
© 2006 Open Grid Forum GHPN-RG Status update co-chairss:Cees de Laat Dimitra Simeonidou GGF22, Boston, February 2008.
Advertisements

© 2006 Open Grid Forum Discussion of File Catalog Standardization GFS-WG, OGF24 Singapore Osamu Tatebe, co-chair of GFS-WG Univ. of Tsukuba Sep 16, 2008.
© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps OGF 23, June 2008, Barcelona, Spain.
© 2006 Open Grid Forum Network Services Interface OGF30: Connection Services Guy Roberts, 27 th Oct 2010.
© 2006 Open Grid Forum Network Services Interface Introduction to NSI Guy Roberts.
© 2006 Open Grid Forum JSDL 1.0: Parameter Sweeps: Examples OGF 22, February 2008, Cambridge, MA.
© 2006 Open Grid Forum OGF19 Federated Identity Rule-based data management Wed 11:00 AM Mountain Laurel Thurs 11:00 AM Bellflower.
© 2007 Open Grid Forum JSDL-WG Session OGF27 – General Session 10:30-12:00, 14 October 2009 Banff, Canada.
©2010Open Grid Forum OGF28 OGSA-DMI Status Chairs: Mario Antonioletti, EPCC Stephen Crouch, Southampton Shahbaz Memon, FZJ Ravi Madduri, UoC.
© 2006 Open Grid Forum JSDL Session (CIM Job) OGF 21 - Seattle, 17 October 2007.
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 20 - Manchester, 7 May 2007.
© 2007 Open Grid Forum JSDL-WG Session OGF21 – Activity schema session 17 October 2007 Seattle, U.S.
© 2008 Open Grid Forum Resource Selection Services OGF22 – Boston, Feb
© 2006 Open Grid Forum Network Services Interface OGF29: Working Group Meeting Guy Roberts, 19 th Jun 2010.
© 2007 Open Grid Forum JSDL-WG Session 1 OGF25 – General Session 11:00-12:30, 3 March 2009 Catania.
© 2006 Open Grid Forum JSDL Optional Elements OGF 24 Singapore.
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources (OGSA Modeling Activities) OGF 21 - Seattle, 16 October 2007.
© 2009 Open Grid Forum Usage Record Working Group Alignment and Production Profile.
Architecture of Grid File System (GFS) - Based on the outline draft - Arun swaran Jagatheesan San Diego Supercomputer Center Global Grid Forum 11 Honolulu,
1 ©2013 Open Grid Forum OGF Working Group Sessions Security Area – FEDSEC Jens Jensen, OGF Security Area.
OGF26 Grid Information Retrieval Research Group May 26, 2008 Chapel Hill.
© 2006 Open Grid Forum DCI Federation Protocol BoF Alexander Papaspyrou, TU Dortmund University Open Grid Forum March 15-18, 2010, Munich, Germany.
Leading the pervasive adoption of grid computing for research and industry © 2005 Global Grid Forum The information contained herein is subject to change.
Designing the Architecture for Grid File System (GFS) Arun swaran Jagatheesan San Diego Supercomputer Center Global Grid Forum 12 Brussels, Belgium.
Resource Management in OGSA Authored by the CMM-WG.
© 2006 Open Grid Forum Global resource naming for data grid federation GFS-WG, OGF22 Cambridge Osamu Tatebe, co-chair of GFS-WG Univ. of Tsukuba Feb 27,
Grid File System WG – GGF 17 Arun Jagatheesan San Diego Supercomputer Center GGF 17 May 11, 2006 Tokyo, Japan.
© 2006 Open Grid Forum Network Services Interface OGF 32, Salt Lake City Guy Roberts, Inder Monga, Tomohiro Kudoh 16 th July 2011.
© 2007 Open Grid Forum Kick Off BOF Reference Model Working Group Paul Strong 1 st Feb, 2007.
© 2006 Open Grid Forum FEDSEC-CG Andrew Grimshaw and Jens Jensen.
© 2006 Open Grid Forum Activity Instance Schema Philipp Wieder (with the help of the JSDL-WG) Activity Instance Document Schema BoF Monday, 25 February,
© 2006 Open Grid Forum Network Services Interface OGF 33, Lyon Guy Roberts, Inder Monga, Tomohiro Kudoh 19 th Sept 2011.
© 2006 Open Grid Forum HPC Job Delegation Best Practices Grid Scheduling Architecture Research Group (GSA-RG) May 26, 2009, Chapel Hill, NC, US.
Nomenclature for the OGSA Platform document Fred Maciel.
© 2006 Open Grid Forum GridRPC Working Group 15 th Meeting GGF22, Cambridge, MA, USA, Feb
© 2006 Open Grid Forum Joint Session on Information Modeling for Computing Resources OGF 21, Seattle, Tuesday 16 October 2007.
© 2006 Open Grid Forum Network Services Interface CS Errata Guy Roberts, Chin Guok, Tomohiro Kudoh 29 Sept 2015.
© 2006 Open Grid Forum OGSA-WG: EGA Reference Model GGF18 Sept. 12, 4-5:30pm, #159A-B.
© 2006 Open Grid Forum Remote Instrumentation Services in Grid Environment Introduction Marcin Płóciennik Banff, OGF 27 Marcin Płóciennik.
September, 2004 CMM-WG presentation1 I acknowledge that participation in GGF is subject to the GGF Intellectual Property Policy. Intellectual Property.
© 2006 Open Grid Forum NML Progres OGF 28, München.
© 2007 Open Grid Forum OGF Management Area Meeting OGF20 7 May, am-12:30pm Manchester, UK.
© 2006 Open Grid Forum VOMSPROC WG OGF36, Chicago, IL, US.
© 2007 Open Grid Forum OGF20 Levels of the Grid Workflow Interoperability OGSA-WG F2F meeting Adrian Toth University of Miskolc NIIF 11 th May, 2007.
© 2008 Open Grid Forum Production Grid Infrastructure WG State Model Discussions PGI Team.
© 2007 Open Grid Forum JSDL-WG Session OGF26 – General Session 11:00-12:30, 28 May 2009 Chapel Hill, NC.
Network Services Interface
OGSA-WG session #7 Resource Management – session #2
GGF Intellectual Property Policy
Models for Resources and Management
RISGE-RG use case template
Resource Management in OGSA
Grid File System WG & Architecture
OGSA-WG Information Services and Resource Management
Management and Manageability in OGSA
GridRPC Working Group 13th Meeting
OGF session PMA, Florence, 31 Jan 2017.
Network Services Interface
OGSA Service Classifications
CMM-WG: Updates and Gap Analysis Discussion
Network Services Interface Working Group
GFS-WG: Informal Status Report
Network Measurements Working Group
Designing the Architecture for Grid File System (GFS)
Activity Delegation Kick Off
OGF20 Information Model Joint Session
Network Services Interface Working Group
Architecture of Grid File System (GFS) - Based on the outline draft -
RNS Interoperability and File Catalog Standardization
OGF 40 Grand BES/JSDL Andrew Grimshaw Genesis II/XSEDE
Presentation transcript:

Grid File System Working Group SAGA and GFS-WG Grid File System Working Group (GFS-WG) Global Grid Forum (GGF)

2 Global Grid Forum-10, BerlinGrid File System Working Group IP & © The GGF takes no position regarding the validity or scope of any intellectual property or other rights that might be claimed to pertain to the implementation or use of the technology described in this document or the extent to which any license under such rights might or might not be available; neither does it represent that it has made any effort to identify any such rights. Copies of claims of rights made available for publication and any assurances of licenses to be made available, or the result of an attempt made to obtain a general license or permission for the use of such proprietary rights by implementers or users of this specification can be obtained from the GGF Secretariat. The GGF invites any interested party to bring to its attention any copyrights, patents or patent applications, or other proprietary rights which may cover technology that may be required to practice this recommendation. Please address the information to the GGF Executive Director. This document and translations of it may be copied and furnished to others, and derivative works that comment on or otherwise explain it or assist in its implementation may be prepared, copied, published and distributed, in whole or in part, without restriction of any kind, provided that the above copyright notice and this paragraph are included on all such copies and derivative works However, this document itself may not be modified in any way, such as by removing the copyright notice or references to the GGF or other organizations, except as needed for the purpose of developing Grid Recommendations in which case the procedures for copyrights defined in the GGF Document process must be followed, or as required to translate it into languages other than English. The limited permissions granted above are perpetual and will not be revoked by the GGF or its successors or assigns. This document and the information contained herein is provided on an "AS IS" basis and THE GLOBAL GRID FORUM DISCLAIMS ALL WARRANTIES, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTY THAT THE USE OF THE INFORMATION HEREIN WILL NOT INFRINGE ANY RIGHTS OR ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE." Intellectual Property Statement Copyright (C) Global Grid Forum (2004). All Rights Reserved.

3 Global Grid Forum-10, BerlinGrid File System Working Group Outline How GFS-WG maps or “un-maps” to SAGA (Structure and Gap Analysis – long run transaction?) Content and context management, Virtualizations Comments from GFS-WG on SAGA’s view point Classification as in the Concept Space of Data Area Additional comments / suggestions Suggestion: DGMS as a synchronized effort in DATA area

4 Global Grid Forum-10, BerlinGrid File System Working Group How GFS-WG maps to SAGA (1) Context Management and Content Management Management of context that maps to any data content Logical Views on the same distributed heterogeneous data Content represented as Grid Datasets Files, SQL files, XML files.. (some are virtual/executable files) Context represented as logical namespace of collections Tree structure, Hierarchical View, Organization by aggregation

5 Global Grid Forum-10, BerlinGrid File System Working Group How GFS-WG maps to SAGA (2) Virtualizations (Data Grid Transparencies) Virtualization in terms of Storage Space, Data/Information Storage space and information in data grid from different domains Transparencies or abstractions: storage resource, location, data identifier, replicas, data-state, … (we stand on the shoulders of GSM, DAIS, OREP, INFOD etc) Putting it in a picture … Since a picture is worth a 1000 KB and helps us to revalidate

6 Global Grid Forum-10, BerlinGrid File System Working Group Data Grid Transparencies (bits,data,information,..) Storage Resource Transparency Storage Location Transparency E:\srbVault\image.jpg /users/srbVault/image.jpg Select … from srb.mdas.td where... Data Identifier Transparency image_0.jpg…image_100.jpg Data Replica Transparency images.sqlimages.cgiimages.wsdl Virtual Data Transparency GFS: Logical namespace of data in data grid patientRecordsCollectionmyActiveNeuroCollection One of the possible logical views or schema of a data grid INFOD, OREP DAIS? GSM

7 Global Grid Forum-10, BerlinGrid File System Working Group Comment(s) from GFS-WG Data Area Concept Space Topic We are NOT “Storage” (refer Classification in SAGA chart) GFS-WG is either Data Management or Logical Organization (view) GFS-WG services operate on a higher-level on top of other services/interfaces provided by other WG

8 Global Grid Forum-10, BerlinGrid File System Working Group Additional View Point Data Grid is made of all these interfaces Loosely coupled, extending/inheriting other interfaces Data Grid Management System Cyberinfrastructure composed of GGF services / interfaces Again putting it in 1000 KB…

9 Global Grid Forum-10, BerlinGrid File System Working Group Data Area : DGMS Cyberinfrastructure Applications (P2P Inter-organizational Information Management, Data Grid, Digital Library, Persistent Archive, Data flow Management, Data Provenance Management, …) Messaging and Data Transport Physical storage and Physical data access Logical Namespace and Access Data/Information Access Logical View / Realizations (relational, hierarchical) Administration and Performance