GFAL: Grid File Access Library

Slides:



Advertisements
Similar presentations
Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.
Advertisements

Workflows over Grid-based Web services General framework and a practical case in structural biology gLite 3.0 Data Management David García Aristegui Grid.
Grid Data Management Assaf Gottlieb - Israeli Grid NA3 Team EGEE is a project funded by the European Union under contract IST EGEE tutorial,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
EGEE-II INFSO-RI Enabling Grids for E-sciencE gLite Data Management System Yaodong Cheng CC-IHEP, Chinese Academy.
INFSO-RI Enabling Grids for E-sciencE gLite Data Management Services - Overview Mike Mineter National e-Science Centre, Edinburgh.
D C a c h e Michael Ernst Patrick Fuhrmann Tigran Mkrtchyan d C a c h e M. Ernst, P. Fuhrmann, T. Mkrtchyan Chep 2003 Chep2003 UCSD, California.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE middleware: gLite Data Management EGEE Tutorial 23rd APAN Meeting, Manila Jan.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
Data Access for Analysis Jeff Templon PDP Groep, NIKHEF A. Tsaregorodtsev, F. Carminati, D. Liko, R. Trompert GDB Meeting 8 march 2006.
Programming API(s) for gLite services Giuseppe LA ROCCA INFN Catania Joint EGEE and SEE-GRID Summer.
T3 analysis Facility V. Bucard, F.Furano, A.Maier, R.Santana, R. Santinelli T3 Analysis Facility The LHCb Computing Model divides collaboration affiliated.
E-science grid facility for Europe and Latin America Data Management Services E2GRIS1 Rafael Silva – UFCG (Brazil) Universidade Federal.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
SEE-GRID-SCI Storage Element Installation and Configuration Branimir Ackovic Institute of Physics Serbia The SEE-GRID-SCI.
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
David Adams ATLAS ATLAS distributed data management David Adams BNL February 22, 2005 Database working group ATLAS software workshop.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Data management in LCG and EGEE David Smith.
EGEE is a project funded by the European Union under contract IST Data Management Data Access From WN Paolo Badino Ricardo.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Data management in EGEE.
1 DIRAC Data Management Components A.Tsaregorodtsev, CPPM, Marseille DIRAC review panel meeting, 15 November 2005, CERN.
Istituto Nazionale di Astrofisica Information Technology Unit INAF-SI Job with data management Giuliano Taffoni.
INFSO-RI Enabling Grids for E-sciencE University of Coimbra gLite 1.4 Data Management System Salvatore Scifo, Riccardo Bruno Test.
INFSO-RI Enabling Grids for E-sciencE University of Coimbra Data Management System gLite – LCG – FiReMan Salvatore Scifo INFN Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Architecture of LHC File Catalog Valeria Ardizzone INFN Catania – EGEE-II NA3/NA4.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Algiers, EUMED/Epikh Application Porting Tutorial, 2010/07/04.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) LFC Installation and Configuration Dong Xu IHEP,
Bologna, March 30, 2006 Riccardo Zappi / Luca Magnoni INFN-CNAF, Bologna.
Grid Data Management Assaf Gottlieb Tel-Aviv University assafgot tau.ac.il EGEE is a project funded by the European Union under contract IST
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Data Management Maha Metawei
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
Scuola Grid INFN, Trieste, 1-12 Dic Managing Confidential Data in the gLite Middleware – The Secure Storage.
Riccardo Zappi INFN-CNAF SRM Breakout session. February 28, 2012 Ingredients 1. Basic ingredients (Fabric & Conn. level) 2. (Grid) Middleware ingredients.
Martedi 8 novembre 2005 Consorzio COMETA “Progetto PI2S2” FESR Data Management System Annamaria Muoio -- INFN Catania PI2S2 First Tutorial -- Messina,
EGEE Data Management Services
Grid2Win Porting of gLite middleware to Windows XP platform
GFAL Grid File Access Library
GFAL Grid File Access Library
gLite Basic APIs Christos Filippidis
StoRM: a SRM solution for disk based storage systems
Java API del Logical File Catalog (LFC)
The gLite Data Management System
Data Bridge Solving diverse data access in scientific applications
LFC Installation and Configuration
gLite 1.4. Data Mangement Exercises
Scuola Grid INFN, Martina Franca, Nov
gLite Data management system overview
Comparison of LCG-2 and gLite v1.0
Gfal/lcg-util -> Gfal2/gfal2-util
Grid2Win: Porting of gLite middleware to Windows XP platform
SRM Developers' Response to Enhancement Requests
AMGA Web Interface Salvatore Scifo INFN sez. Catania
Introduction to reading and writing files in Grid
The gLite API – Part II Giuseppe LA ROCCA ACGRID-II School
Hands-On Session: Data Management
GFAL 2.0 Devresse Adrien CERN lcgutil team
GSAF Grid Storage Access Framework
The INFN Tier-1 Storage Implementation
Grid2Win: Porting of gLite middleware to Windows XP platform
Stephen Burke, PPARC/RAL Jeff Templon, NIKHEF
GSAF Grid Storage Access Framework
Data Management cluster summary
Data Management Ouafa Bentaleb CERIST, Algeria
AMGA Web Interface Vincenzo Milazzo
Data services in gLite “s” gLite and LCG.
gLite Grid Services Riccardo Bruno
Architecture of the gLite Data Management System
gLite Data and Metadata Management
Data Management system in gLite middleware
Presentation transcript:

GFAL: Grid File Access Library Salvatore Scifo INFN - Catania Tutorial TriGrid su gLite 3.0 Catania, 27.07.2006

SUMMARY This presentation covers the following points: GFAL Overview GFAL Available APIs GFAL C API Overview GFAL Java API Overview GFAL C API Practical (hands on session) GFAL Java API Practical (hands on session) GFAL References. Catania, Tutorial TriGrid su gLite 3.0, 27.07.2006

GFAL: Introduction What is GFAL for? Grid storage interactions today require using some existing software components: The replica catalog services to locate valid replicas of files in order to : Download them to the user local machine Move them from a SE to another one Make job running on the worker node able to access and manage files stored on remote storage element. The SRM software to ensure: Files existence on disk or disk pool (they are recalled from mass storage if necessary) Space allocation on disk for new files (they are possibly migrated to mass storage later) Catania, Tutorial TriGrid su gLite 3.0, 27.07.2006

GFAL: Main features The GFAL Features Hides interactions to the SRM to the end user Provides a Posix-like interface for File I/O Operation Based on shared libraries (both threaded e unthreaded version) Needs only one header file (gfal_api.h) to write C applications Supports following protocols : file for local access nfs-like dcap, gsidcap and kdcap for dCache access protocol rfio for CASTOR access protocol. Access to SRMs in secure mode, i.e. using a valid Grid proxy obtained by voms-proxy-init command. Catania, Tutorial TriGrid su gLite 3.0, 27.07.2006

GFAL: File Names GFAL works with all Grid types name: Logical File Name (LFN) lfn:baud/testgfal15 Grid Unique IDentifier (GUID) guid:2cd59291-7ae7-4778-af6d-b1f423719441 File Replica (SURL) srm://wacdr002d.cern.ch:8443/castor/cern.ch/user/b/baud/testgfal Transport file name (TURL). rfio:////castor/cern.ch/user/b/baud/testgfal15 Catania, Tutorial TriGrid su gLite 3.0, 27.07.2006

GFAL: Environment Auxiliary linked libraries Environment Variables libcgsi_plugin_gsoap_2.3 libglobus_gss api_gsi_gcc32dbg libglobus_gss_assist_gcc32dbg). Environment Variables LCG_GFAL_VO LCG_GFAL_INFOSYS LCG_CATALOG_TYPE LCG_RFIO_TYPE LFC_HOST LD_LIBRARY_PATH Catania, Tutorial TriGrid su gLite 3.0, 27.07.2006

GFAL: Available API C API Java API (C API Wrapper) The header file gfal_api.h needs to be included in the application source code to get the prototype of the functions. The function names are obtained by prepending gfal_ to the Posix names,for example gfal_open, gfal_read, gfal_close ... The argument lists and the values returned by the functions are identical. The variable errno is set to the Posix Error Codes in the case of failure. Java API (C API Wrapper) It provides three main Java Objects that need to be imported in the java applications in order to hide the underlying C functions. GFalFile : to handle and read/write files GFalDirectory : to handle and manage directories (create, delete, list) GFalUtilities : to manage file (rename, stat, lstat, delete) Catania, Tutorial TriGrid su gLite 3.0, 27.07.2006

GFAL References Examples in gLite3 User Guide (Appendix F) https://edms.cern.ch/file/722398//gLite-3-UserGuide.pdf GFAL C API Description: http://grid-deployment.web.cern.ch/grid-deployment/documentation/LFC_DPM/gfal/html/ GFAL JAVA API https://grid.ct.infn.it/twiki/bin/view/GILDA/APIGFAL GFAL Java API code and libraries: https://grid.ct.infn.it/twiki/pub/GILDA/APIGFAL/GFAL_Java_API.zip On-line JavaDoc of Java API: https://grid.ct.infn.it/twiki/GFAL/ GFAL Excercises (C/Java): https://grid.ct.infn.it/twiki/bin/view/GILDA/UsingGFAL Catania, Tutorial TriGrid su gLite 3.0, 27.07.2006