Grid File System Working Group

Slides:



Advertisements
Similar presentations
© 2006 Open Grid Forum Discussion of File Catalog Standardization GFS-WG, OGF24 Singapore Osamu Tatebe, co-chair of GFS-WG Univ. of Tsukuba Sep 16, 2008.
Advertisements

© 2006 Open Grid Forum OGF19 Federated Identity Rule-based data management Wed 11:00 AM Mountain Laurel Thurs 11:00 AM Bellflower.
© 2008 Open Grid Forum Data Grid Federation by RNS GFS-WG, OGF23 Balcelona Hideo Matsuda Osaka University / NAREGI.
OGSA-WG charter discussion Dec. 3, 2003 F2F meeting at ANL.
© 2006 Open Grid Forum OGSA Next Steps Discussion Providing Value Beyond the Specifications.
© 2007 Open Grid Forum DMTF-OGF Work Register Current and Proposed Items OGF 22 Boston, MA 26 February 2008.
GGF16, Athens AuthZ Interoperability Here and Now Workshop, 16 Feb 2006.
Russ Housley IETF Chair 23 July 2012 Introduction to the IETF Standards Process.
Architecture of Grid File System (GFS) - Based on the outline draft - Arun swaran Jagatheesan San Diego Supercomputer Center Global Grid Forum 11 Honolulu,
San Diego Supercomputer Center National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center National Partnership for Advanced.
© 2008 Open Grid Forum Data Area Meeting OGF22 Barcelona, Spain Erwin Laure David E. Martin Data Area Directors.
© 2007 Open Grid Forum Data Grid Management Systems: Standard API - community development Arun Jagatheesan, San Diego Supercomputer Center & iRODS.org.
DAIS for RDF BOF Isao Kojima Data Grid Team Grid Technology Research Center AIST Japan
Designing the Architecture for Grid File System (GFS) Arun swaran Jagatheesan San Diego Supercomputer Center Global Grid Forum 12 Brussels, Belgium.
OGSA Security Roadmap Discussion GGF5 – 7/24/02. Outline l Introduction l Architecture Goal l Roadmap Goal l Proposed Specs l Challenges l Next Steps.
GGF9 GFS WG BOF10/07/2003, Chicago Grid File System Group Proposal BOF Osamu Tatebe (AIST) Jane Xu (IBM) Arun Jagatheesan (SDSC)
OGF DMNR BoF Dynamic Management of Network Resources Documents available at: Guy Roberts, John Vollbrecht.
Computing Sciences Directorate, L B N L 1 CHEP 2003 Standards For Storage Resource Management BOF Co-Chair: Arie Shoshani * Co-Chair: Peter Kunszt ** *
© 2006 Open Grid Forum Global resource naming for data grid federation GFS-WG, OGF22 Cambridge Osamu Tatebe, co-chair of GFS-WG Univ. of Tsukuba Feb 27,
Data Services (sample). OGSA cross WG discussion template2 Outline Requirements Key concepts/functionality Architecture/Model (if any) Services/portTypes.
Grid File System WG – GGF 17 Arun Jagatheesan San Diego Supercomputer Center GGF 17 May 11, 2006 Tokyo, Japan.
Peer to Peer Streaming Protocol (PPSP) BOF Gonzalo Camarillo Ericsson Yunfei Zhang China Mobile IETF76, Hiroshima, Japan 13:00~15:00 THURSDAY, Nov 12,
RUS: Resource Usage Service Steven Newhouse James Magowan
Distributed Accounting Working Group (DAWG) Distributed Accounting Models Research Group Monday, 22 July 2002 Tuesday, 23 July 2002 Edinburgh, Scotland.
Topics Ahead …. What would the WG produce? Charter description of what we do Things we don’t do.
Nomenclature for the OGSA Platform document Fred Maciel.
Grid File System Working Group SAGA and GFS-WG Grid File System Working Group (GFS-WG) Global Grid Forum (GGF)
MODERN BoF Managing, Ordering, Distributing, Exposing, and Registering telephone Numbers IETF 92.
Metadata Working Group Charter Update Jennifer Carlino, Acting Chair FGDC OS/USGS June 13, 2012 Coordination Group Meeting.
Design of File System Directory Services Osamu Tatebe Grid Technology Research Center, AIST GFS-WG, GGF10 March 2004, Berlin GGF10 GFS-WG March 2004, Berlin.
File System Directory Services Osamu Tatebe Grid Technology Research Center, AIST GFS-WG, F2F meeting April 2004, San Jose GFS-WG April 2004, San Jose.
Preservation Data Services Persistent Archive Research Group Reagan W. Moore October 1, 2003.
Page 1 R2AD *** DAY 1 (May 23) *** 10:00 Agenda bashing, role call, note taker & time keeper. (KF; 30 min) 10:40 ACS Overview (10 minutes) 11:00 Security.
GGF - © Birds of a Feather - Policy Architecture Working Group.
Co-Chair(s): Roger Kosak (US) J.P. Martin-Flatin (CERN, CH) Pascale Primet Vicat-Blanc (INRIA, FR) Secretary: Neil Chue Hong (EPCC, UK)
Update to the Community GGF16 - Athens
GGF Intellectual Property Policy
Models for Resources and Management
Expected meeting output/goal proposal
OGSA-WG Basic Profile Session #1 Security
GGF8 Authorization Frameworks and Mechanisms Working Group
Grid File System WG GGF11, Honolulu June 8-9, 2004.
Grid File System WG & Architecture
SACM Virtual Interim Meeting
Data services on the NGS
Topics Ahead …. What would the WG produce?
GGF OGSA-WG, Data Use Cases Peter Kunszt Middleware Activity, Data Management Cluster EGEE is a project funded by the European.
OGSA-WG Session #2 Program Execution Services
The OGSA Data Architecture
OGSA Service Classifications
Osamu Tatebe Grid Technology Research Center, AIST
Network Services Interface Working Group
Grid File System WG GGF16, Athens Feb 14, 2006.
Naming service BoF #2 & report session
GFS-WG: Informal Status Report
University of Virginia, USA GGF9, Chicago, Illinois, US
Database Access and Integration Services Working Group
Grid Datafarm and File System Services
Designing the Architecture for Grid File System (GFS)
WS Naming OGF 19 - Friday Center, NC.
Status and Future Steps
OGSA and Security Services GGF12 , September 20th, 2004 Hiro Kishimoto
Network Services Interface Working Group
OGF19 – Chapel Hill, NC, USA 30 January 2007
Proposed Grid Protocol Architecture Working Group
Service Oriented Architecture (SOA)
Global Grid Forum (GGF) Orientation
Architecture of Grid File System (GFS) - Based on the outline draft -
RNS Interoperability and File Catalog Standardization
CCWG-Accountability ICANN56 26 June 2016
Presentation transcript:

Grid File System Working Group Osamu Tatebe (AIST) Jane Xu (IBM) Arun Jagatheesan (SDSC)

Introduction Outline Follow up actions after GGF9 GFS-BOF WG Charter GGF10 Objectives Administration Staff

Actions after GGF9 BoF [GGF9 BoF] received great interests Post GGF9 Many participants (67 persons) Received consensus on whether should form a RG or WG Post GGF9 Chairs had meetings w/ Data Area directors Narrowed scope Modified charter Approved by GGF to form a WG

Charter Focus on two areas Grid File System Directory Services Describe and manage namespace for files, access control, and metadata management Architecture for Grid File System Services Provides architecture of virtual file system in grid environment Facilitates federation and sharing of virtualized data Uses Grid File System Directory Services and standard access protocols

Namespace for files = Virtual file system directory = OGSA Naming + a Virtual “path” name -> GSH (or WS-Addressing Endpoint Reference) = OGSA Naming + a Virtual Directory Tree /grid ggf jp data gfs file1 file2 translation GSH2 (could be file data, and others) GSH1

Deliverable 1 Recommendation Document: “Virtual File System Directory Services Specification” manage virtual file system directories in association with access permission, and other application-specific metadata Outline by GGF 10 Draft by GGF 11 Updated draft by GGF 12 Final by GGF 13 It is possible to deliver (as subset of the above document) “OGSA Naming Specification” manage Global namespace

Deliverable 2 Recommendation Document: "Architecture for Grid File System Services” provide a functionality of the grid file system using the File System Directory Services and other common services Outline by GGF 11 Draft by GGF 11 Updated draft by GGF 13 Final by GGF 14

Relationship with Other WGs OGSA WG Provide input to and follow the architecture OGSI WG Follow the spec and develop WS-RF-compliant file system services DAIS WG Collaborate through providing input on Data Services from file system perspectives, especially on access methods OREP WG Provide input to and leverage proposed Replication Services in GFS GridFTP WG Include GridFTP as a possible transport mechanism GSM BOF GSM will provide management of the storage system but not the virtual directory structure

GGF10 Objectives Outline “Survey of Grid File Systems” Document Receive more input on the existing draft Reach an agreement of document outline Assign authors of the document Get ready for GGF 11 finalization Outline “Virtual File System Directory Services Specification” Proposal presentation Provide a draft to GGF 11

Working Group Administration Staff Chairs Osamu Tatebe (AIST) Jane Xu (IBM) Arun Jagatheesan (SDSC) Secretaries Yves Denneulin (IMAD/INRIA) Pradeep Padala (UFL)

Agenda of GFS-WG #1 Introduction and survey document Introduction [20min] Survey document discussion Introduction [10min] Presentation: Metadata in SRB by Reagan Moore (SDSC) [15min] Presentation: AVAKI/Legion Grid filesystem & OGSA-Naming by Andrew Grimshaw (AVAKI/UvA) [15min] Presentation: Grid Datafarm by Osamu Tatebe (AIST) [15min] Discussion

Agenda of GFS-WG #2 File System Directory Services Introduction [5min] Presentation & discussion Grid namespace for files and VFDS by Leo Luan (IBM Almaden) [30min] http://www.ggf.org/Meetings/ggf10/GGF10%20Documents/ GridNamespaceforFiles.pdf  Design of File System Directory Services by Osamu Tatebe (AIST) [30min] http://phase.hpcc.jp/people/tatebe/draft-ggf-gfs-directory-02.pdf Discussion