GFAL Grid File Access Library

Slides:



Advertisements
Similar presentations
Data Management Expert Panel. RLS Globus-EDG Replica Location Service u Joint Design in the form of the Giggle architecture u Reference Implementation.
Advertisements

Workflows over Grid-based Web services General framework and a practical case in structural biology gLite 3.0 Data Management David García Aristegui Grid.
EGEE is a project funded by the European Union under contract IST Using SRM: DPM and dCache G.Donvito,V.Spinoso INFN Bari
Grid Data Management Assaf Gottlieb - Israeli Grid NA3 Team EGEE is a project funded by the European Union under contract IST EGEE tutorial,
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
EGEE-II INFSO-RI Enabling Grids for E-sciencE gLite Data Management System Yaodong Cheng CC-IHEP, Chinese Academy.
INFSO-RI Enabling Grids for E-sciencE gLite Data Management Services - Overview Mike Mineter National e-Science Centre, Edinburgh.
FESR Consorzio COMETA Grid Introduction and gLite Overview Corso di formazione sul Calcolo Parallelo ad Alte Prestazioni (edizione.
D C a c h e Michael Ernst Patrick Fuhrmann Tigran Mkrtchyan d C a c h e M. Ernst, P. Fuhrmann, T. Mkrtchyan Chep 2003 Chep2003 UCSD, California.
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE middleware: gLite Data Management EGEE Tutorial 23rd APAN Meeting, Manila Jan.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
Data Access for Analysis Jeff Templon PDP Groep, NIKHEF A. Tsaregorodtsev, F. Carminati, D. Liko, R. Trompert GDB Meeting 8 march 2006.
T3 analysis Facility V. Bucard, F.Furano, A.Maier, R.Santana, R. Santinelli T3 Analysis Facility The LHCb Computing Model divides collaboration affiliated.
E-science grid facility for Europe and Latin America Data Management Services E2GRIS1 Rafael Silva – UFCG (Brazil) Universidade Federal.
INFSO-RI Enabling Grids for E-sciencE Αthanasia Asiki Computing Systems Laboratory, National Technical.
SEE-GRID-SCI Storage Element Installation and Configuration Branimir Ackovic Institute of Physics Serbia The SEE-GRID-SCI.
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
David Adams ATLAS ATLAS distributed data management David Adams BNL February 22, 2005 Database working group ATLAS software workshop.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Data management in LCG and EGEE David Smith.
EGEE is a project funded by the European Union under contract IST Data Management Data Access From WN Paolo Badino Ricardo.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Data management in EGEE.
1 DIRAC Data Management Components A.Tsaregorodtsev, CPPM, Marseille DIRAC review panel meeting, 15 November 2005, CERN.
Istituto Nazionale di Astrofisica Information Technology Unit INAF-SI Job with data management Giuliano Taffoni.
INFSO-RI Enabling Grids for E-sciencE University of Coimbra gLite 1.4 Data Management System Salvatore Scifo, Riccardo Bruno Test.
INFSO-RI Enabling Grids for E-sciencE University of Coimbra Data Management System gLite – LCG – FiReMan Salvatore Scifo INFN Catania.
EGEE-II INFSO-RI Enabling Grids for E-sciencE Architecture of LHC File Catalog Valeria Ardizzone INFN Catania – EGEE-II NA3/NA4.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Algiers, EUMED/Epikh Application Porting Tutorial, 2010/07/04.
Martina Franca (TA), 07 November Installazione, configurazione, testing e troubleshooting di Storage Element.
Bologna, March 30, 2006 Riccardo Zappi / Luca Magnoni INFN-CNAF, Bologna.
Grid Data Management Assaf Gottlieb Tel-Aviv University assafgot tau.ac.il EGEE is a project funded by the European Union under contract IST
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Data Management Maha Metawei
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America LFC Server Installation and Configuration.
Scuola Grid INFN, Trieste, 1-12 Dic Managing Confidential Data in the gLite Middleware – The Secure Storage.
Riccardo Zappi INFN-CNAF SRM Breakout session. February 28, 2012 Ingredients 1. Basic ingredients (Fabric & Conn. level) 2. (Grid) Middleware ingredients.
Martedi 8 novembre 2005 Consorzio COMETA “Progetto PI2S2” FESR Data Management System Annamaria Muoio -- INFN Catania PI2S2 First Tutorial -- Messina,
EGEE Data Management Services
Gri2Win: Porting gLite to run under Windows XP Platform
Grid2Win Porting of gLite middleware to Windows XP platform
GFAL Grid File Access Library
GFAL: Grid File Access Library
gLite Basic APIs Christos Filippidis
StoRM: a SRM solution for disk based storage systems
Java API del Logical File Catalog (LFC)
The gLite Data Management System
Data Bridge Solving diverse data access in scientific applications
gLite 1.4. Data Mangement Exercises
Scuola Grid INFN, Martina Franca, Nov
gLite Data management system overview
Comparison of LCG-2 and gLite v1.0
John Gordon EDG Conference Barcelona, May 2003
Gfal/lcg-util -> Gfal2/gfal2-util
SRM Developers' Response to Enhancement Requests
Introduction to reading and writing files in Grid
Grid Services Ouafa Bentaleb CERIST, Algeria
The gLite API – Part II Giuseppe LA ROCCA ACGRID-II School
Hands-On Session: Data Management
GFAL 2.0 Devresse Adrien CERN lcgutil team
Gri2Win: Porting gLite to run under Windows XP Platform
GSAF Grid Storage Access Framework
The INFN Tier-1 Storage Implementation
Stephen Burke, PPARC/RAL Jeff Templon, NIKHEF
Data Management cluster summary
Data Management Ouafa Bentaleb CERIST, Algeria
Data services in gLite “s” gLite and LCG.
gLite Grid Services Riccardo Bruno
Architecture of the gLite Data Management System
gLite Data and Metadata Management
Data Management system in gLite middleware
Presentation transcript:

GFAL Grid File Access Library Annamaria Muoio INFN Catania I Corso di formazione INFN su aspetti pratici dell'integrazione di applicazioni in GRID Martina Franca, 13/11/2007

SUMMARY This presentation covers the following points: GFAL Overview GFAL Available APIs GFAL C API Overview GFAL Java API Overview GFAL C API Practical (hands on session) GFAL Java API Practical (hands on session) GFAL References.

GFAL: Introduction What is GFAL? It stands for Grid File Access Library! Grid storage interactions today require using some existing software components: The file catalog services to locate valid replicas of files in order to Download them to the user local machine Copy them from a SE to another one Make job running on the worker node able to access and manage files stored on remote storage element. The SRM to ensure: Files existence on disk or disk pool (they are recalled from mass storage if necessary) Space allocation on disk for new files (they are possibly migrated to mass storage later)

GFAL: Main features The GFAL Features Hides interactions to the SRM to the end user Provides a Posix-like interface for File I/O Operation Based on shared libraries (both threaded e unthreaded version) Needs only one header file (gfal_api.h) to write C applications Supports following protocols : file for local access nfs-like dcap, gsidcap and kdcap for dCache access protocol rfio for CASTOR/DPM access protocol. Access to SRMs in secure mode, i.e. using a valid Grid proxy obtained by voms-proxy-init command.

GFAL: File Names GFAL works with all Grid types name: Logical File Name (LFN) lfn:baud/testgfal15 Grid Unique IDentifier (GUID) guid:2cd59291-7ae7-4778-af6d-b1f423719441 File Replica (SURL) srm://wacdr002d.cern.ch:8443/castor/cern.ch/user/b/baud/testgf al Transport file name (TURL). rfio:////castor/cern.ch/user/b/baud/testgfal15

GFAL: Environment Auxiliary linked libraries Environment Variables libcgsi_plugin_gsoap_2.3 libglobus_gss api_gsi_gcc32dbg libglobus_gss_assist_gcc32dbg. Environment Variables LCG_GFAL_VO LCG_GFAL_INFOSYS LCG_CATALOG_TYPE LCG_RFIO_TYPE LFC_HOST LD_LIBRARY_PATH

GFAL: Available API C API The header file gfal_api.h needs to be included in the application source code to get the prototype of the functions. The function names are obtained by prepending gfal_ to the Posix names, for example gfal_open, gfal_read, gfal_close ... The argument lists and the values returned by the functions are identical. The variable errno is set to the Posix Error Codes in the case of failure.

GFAL: Available API Java API (C API Wrapper) It provides three main Java Objects that need to be imported in the java applications in order to hide the underlying C functions. GFalFile : to handle and read/write files GFalDirectory : to handle and manage directories (create, delete, list) GFalUtilities : to manage file (rename, stat, lstat, delete)

GFAL Java API GFAL API are available for C/C++ programmers We wrote a wrapper around the C APIs using Java Native Interface and a the Java APIs on top of it More information can be found here:

GFAL References Examples in gLite3 User Guide (Appendix F) https://edms.cern.ch/file/722398//gLite-3-UserGuide.pdf GFAL C API Description: http://grid-deployment.web.cern.ch/grid- deployment/documentation/LFC_DPM/gfal/html/

Evento, Luogo, Data odierna - 11

Hands on http://repository.gs.ba.infn.it/twiki/bin/view/GILDA/APIGFAL http://repository.gs.ba.infn.it/twiki/bin/view/GILDA/APICGFAL http://repository.gs.ba.infn.it/twiki/bin/view/GILDA/UsingGFAL