EGEE is a project funded by the European Union under contract IST-2003-508833 Data Management Data Access From WN Paolo Badino Ricardo.

Slides:



Advertisements
Similar presentations
Data Management Expert Panel - WP2. WP2 Overview.
Advertisements

Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.
DataGrid is a project funded by the European Commission under contract IST WP2 – R2.1 Overview of WP2 middleware as present in EDG 2.1 release.
OSG AuthZ Architecture AuthZ Components Legend VO Management Services Grid Site GUMS Site Services SAZ CE Gatekeeper Prima Is Auth? Yes / No SE SRM gPlazma.
Grid Data Management Assaf Gottlieb - Israeli Grid NA3 Team EGEE is a project funded by the European Union under contract IST EGEE tutorial,
E-science grid facility for Europe and Latin America A Data Access Policy based on VOMS attributes in the Secure Storage Service Diego Scardaci.
The LCG File Catalog (LFC) Jean-Philippe Baud – Sophie Lemaitre IT-GD, CERN May 2005.
INFSO-RI Enabling Grids for E-sciencE Comparison of LCG-2 and gLite Author E.Slabospitskaya Location IHEP.
INFSO-RI Enabling Grids for E-sciencE gLite Data Management Services - Overview Mike Mineter National e-Science Centre, Edinburgh.
EGEE-III INFSO-RI Enabling Grids for E-sciencE The Medical Data Manager : the components Johan Montagnat, Romain Texier, Tristan.
Data Management The GSM-WG Perspective. Background SRM is the Storage Resource Manager A Control protocol for Mass Storage Systems Standard protocol:
The LCG File Catalog (LFC) Jean-Philippe Baud – Sophie Lemaitre IT-GD, CERN May 2005.
EGEE Catalogs Peter Kunszt EGEE Data Management Middleware Service Grids NeSC, July 2004 EGEE is a project funded by the.
SAML support in VOMS Valerio Venturi EGEE JRA1 AH Meeting, Amsterdam 20/23 February 2008.
Δ Storage Middleware GridPP10 What’s new since GridPP9? CERN, June 2004.
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
Author - Title- Date - n° 1 Partner Logo WP5 Summary Paris John Gordon WP5 6th March 2002.
EGEE is a project funded by the European Union under contract IST Common Security Components Olle Mulmo JRA3 JRA1 all-hands meeting, June 29.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE middleware: gLite Data Management EGEE Tutorial 23rd APAN Meeting, Manila Jan.
EGEE is a project funded by the European Union under contract IST Gap analysis draft v2 Olle Mulmo, David Groep, Joni Hahkala JRA3 Gap, 10.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Security Token Service Valéry Tschopp - SWITCH.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
Replica Management Services in the European DataGrid Project Work Package 2 European DataGrid.
INFSO-RI Enabling Grids for E-sciencE gLite Data Management and Interoperability Peter Kunszt (JRA1 DM Cluster) 2 nd EGEE Conference,
SRM & SE Jens G Jensen WP5 ATF, December Collaborators Rutherford Appleton (ATLAS datastore) CERN (CASTOR) Fermilab Jefferson Lab Lawrence Berkeley.
EGEE is a project funded by the European Union under contract IST Gap Analysis JRA3 12/7/2015
INFSO-RI Enabling Grids for E-sciencE EGEE Security Joni Hahkala, UH-HIP On behalf of JRA3 JRA1 AH March 22-24, 2006.
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
Status and Plans EGEE data management team Middleware Security Meeting 4 EGEE is a project funded by the European Union under.
EGEE is a project funded by the European Union under contract IST Data Management Gaps Krzysztof Nienartowicz Gavin McCance EGEE JRA1 Data.
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
NorduGrid plans and questions for gLite Marko Niinimaki, NorduGrid 3 rd EGEE meeting Athens, April 2005.
Security Middleware 3 June 2004 Security Middleware Current Status – GridSite deployments – Architecture GridPP2 – Web services.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Data management in LCG and EGEE David Smith.
JAliEn Java AliEn middleware A. Grigoras, C. Grigoras, M. Pedreira P Saiz, S. Schreiner ALICE Offline Week – June 2013.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks gLite Data Management Components Presenter.
Ákos FROHNER – DataGrid Security n° 1 Security Group TODO
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks GSI with OpenSSL Vincenzo Ciaschini EGEE-3.
Distributed Data Access Control Mechanisms and the SRM Peter Kunszt Manager Swiss Grid Initiative Swiss National Supercomputing Centre CSCS GGF Grid Data.
SESEC Storage Element (In)Security hepsysman, RAL 0-1 July 2009 Jens Jensen.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Data Management cluster summary David Smith JRA1 All Hands meeting, Catania, 7 March.
VOX Project Status T. Levshina. 5/7/2003LCG SEC meetings2 Goals, team and collaborators Purpose: To facilitate the remote participation of US based physicists.
Site Authorization Service Local Resource Authorization Service (VOX Project) Vijay Sekhri Tanya Levshina Fermilab.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks OpenSAML extension library and API to support.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Data management in EGEE.
INFSO-RI Enabling Grids for E-sciencE University of Coimbra gLite 1.4 Data Management System Salvatore Scifo, Riccardo Bruno Test.
INFSO-RI Enabling Grids for E-sciencE University of Coimbra Data Management System gLite – LCG – FiReMan Salvatore Scifo INFN Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Architecture of LHC File Catalog Valeria Ardizzone INFN Catania – EGEE-II NA3/NA4.
Bologna, March 30, 2006 Riccardo Zappi / Luca Magnoni INFN-CNAF, Bologna.
Grid Data Management Assaf Gottlieb Tel-Aviv University assafgot tau.ac.il EGEE is a project funded by the European Union under contract IST
EGEE is a project funded by the European Union under contract IST Datamat Status Report F. Pacini Datamat S.p.a. Milan, IT-CZ JRA1 meeting,
Scuola Grid INFN, Trieste, 1-12 Dic Managing Confidential Data in the gLite Middleware – The Secure Storage.
Martedi 8 novembre 2005 Consorzio COMETA “Progetto PI2S2” FESR Data Management System Annamaria Muoio -- INFN Catania PI2S2 First Tutorial -- Messina,
EGEE Data Management Services
GFAL Grid File Access Library
GFAL Grid File Access Library
GFAL: Grid File Access Library
gLite Basic APIs Christos Filippidis
StoRM: a SRM solution for disk based storage systems
Java API del Logical File Catalog (LFC)
Scuola Grid INFN, Martina Franca, Nov
GGF OGSA-WG, Data Use Cases Peter Kunszt Middleware Activity, Data Management Cluster EGEE is a project funded by the European.
Comparison of LCG-2 and gLite v1.0
A gLite Authorization Framework
Encrypted Data Store, Hydra & Delegation Interface
GFAL 2.0 Devresse Adrien CERN lcgutil team
Data Management cluster summary
Data services in gLite “s” gLite and LCG.
Architecture of the gLite Data Management System
INFNGRID Workshop – Bari, Italy, October 2004
Presentation transcript:

EGEE is a project funded by the European Union under contract IST Data Management Data Access From WN Paolo Badino Ricardo Rocha JRA1 all-hands meeting, 29-June

JRA1 all-hands meeting, 29-June glite I/O Goals  Provides a library for accessing files stored on a remote a SE in a transparent way Release Plan  First version foreseen for PM03  Two weeks late… 

JRA1 all-hands meeting, 29-June Guiding Principles Based on existing libraries  Aiod, gfal, rfio, dcap  Stable Quickly deployable POSIX-like I/O API  Remote open, read, write  Minimum impact on existent code Extensible  Plug-ins and callouts to support additional protocols and authorization models

JRA1 all-hands meeting, 29-June API POSIX-like I/O API glite_handle glite_open(char * name, int32 flags, int32 mode) int32 glite_read(glite_handle fh, void * buf, size_t count) int32 glite_write(glite_handle fh, void *buf, size_t count) int32 glite_lseek(glite_handle fh, int64 offset, int32 whence) int32 glite_close(glite_handle fh) int64 glite_size(glite_handle fh) Support both GUID and LFN name = “guid:2cd ae af6d-b1f ” name = “lfn:egee/foo12345”

JRA1 all-hands meeting, 29-June Example int main(int argc, char **argv){ int i; glite_handle fh; char buf[BUFF_LEN]; int rc; if ((fh = glite_open (argv[1], O_RDONLY, 0)) == NULL){ return -1; } rc = glite_read (fh, buf, BUFF_LEN); if (rc < 0){ (void) glite_close (fh); return -1; } //... if ((rc = glite_close (fh)) < 0) { return -1; } return 0; }

JRA1 all-hands meeting, 29-June Flow glite-io client rfio glite-io daemon FAS SRM Authorization callout Protocol Plug-in Name Resolution callout GUID ACL SURL TURL RC GUID SURL LFN FC LFN GUID AlienIOclient aiod gfal LFN HANDLE SE

JRA1 all-hands meeting, 29-June Open Issues Is Read-Only access ok for now? Writes (later): updating is not a problem, synchronization with other replicas is. Depends on semantics of file update policy – single master, multi-master with reconciliation, etc. Creation of a new file through this interface? We think not.. Problems: glite_open (name, O_WRONLY | O_CREAT, mode)  Is name a GUID/LFN?  Should the file name already be registered or should it be inserted into the File Catalog later?  When should the file be inserted in Replica Catalog? During open or close?

JRA1 all-hands meeting, 29-June File Access Service File Access Service (FAS) Authz Framework CLIENT SITE POLICYVO POLICY GUIDUSER (RWX)GROUP (RWX)OTHER (RWX) ACL PRINCIPAL (RWX) Storage Element VOMS CERTIFICATE GROUPS / ROLES Transfer FILE request GET PERMISSIONS SRM User Mapping File Transfer Service XFER Buffer Use protocol X

JRA1 all-hands meeting, 29-June Security Implementation Authentication  GSI / Proxy Certificates Authorization  VOMS – Attribute Certificates  Authz Framework XACML compatible End of summer (alpha / beta before that) Toolkits  Java – Java CoG  C++ – gSOAP with GSI plugin Delegation  JRA3 magic