The Institute of High Energy of Physics, Chinese Academy of Sciences Sharing LCG files across different platforms Cheng Yaodong, Wang Lu, Liu Aigui, Chen.

Slides:



Advertisements
Similar presentations
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
Advertisements

Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
E-science grid facility for Europe and Latin America A Data Access Policy based on VOMS attributes in the Secure Storage Service Diego Scardaci.
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Services Abderrahman El Kharrim
John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
Globus Computing Infrustructure Software Globus Toolkit 11-2.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
DIRAC API DIRAC Project. Overview  DIRAC API  Why APIs are important?  Why advanced users prefer APIs?  How it is done?  What is local mode what.
Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug
National Computational Science National Center for Supercomputing Applications National Computational Science MyProxy: An Online Credential Repository.
Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Grid Engine Riccardo Rotondo
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America GENIUS server installation and configuration.
INFSO-RI Enabling Grids for E-sciencE The GENIUS Grid portal Tony Calanducci INFN Catania - Italy First Latin American Workshop.
TRASC Globus Application Launcher VPAC Development Team Sudarshan Ramachandran.
COMP3019 Coursework: Introduction to GridSAM Steve Crouch School of Electronics and Computer Science.
Topaz : A GridFTP extension to Firefox M. Taufer, R. Zamudio, D. Catarino, K. Bhatia, B. Stearn University of Texas at El Paso San Diego Supercomputer.
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
L ABORATÓRIO DE INSTRUMENTAÇÃO EM FÍSICA EXPERIMENTAL DE PARTÍCULAS Enabling Grids for E-sciencE Grid Computing: Running your Jobs around the World.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE middleware Data Management in gLite.
The Grid computing Presented by:- Mohamad Shalaby.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE middleware: gLite Data Management EGEE Tutorial 23rd APAN Meeting, Manila Jan.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.
© Geodise Project, University of Southampton, Geodise Middleware & Optimisation Graeme Pound, Hakki Eres, Gang Xue & Matthew Fairman Summer 2003.
E-science grid facility for Europe and Latin America GridwWin: porting gLite to run under Windows Fabio Scibilia – Consorzio COMETA 30/06/2008.
CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
Grid, Web services and Taverna Machiel Jansen Richard Holland.
1 Grid2Win: porting of gLite middleware to Windows Dario Russo INFN Catania
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE Site Architecture Resource Center Deployment Considerations MIMOS EGEE Tutorial.
INFSO-RI Enabling Grids for E-sciencE The gLite File Transfer Service: Middleware Lessons Learned form Service Challenges Paolo.
INFSO-RI Enabling Grids for E-sciencE Introduction Data Management Ron Trompert SARA Grid Tutorial, September 2007.
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Alexandre Duarte CERN IT-GD-OPS UFCG LSD 1st EELA Grid School.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin America Grid2Win: Porting of gLite middleware to.
© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
John Kewley e-Science Centre All Hands Meeting st September, Nottingham GROWL: A Lightweight Grid Services Toolkit and Applications John Kewley.
1 Egrid portal Stefano Cozzini and Angelo Leto. 2 Egrid portal Based on P-GRADE Portal 2.3 –LCG-2 middleware support: broker, CEs, SEs, BDII –MyProxy.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Scuola Grid INFN, Trieste, 1-12 Dic Managing Confidential Data in the gLite Middleware – The Secure Storage.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) Overveiw of the gLite middleware Yaodong Cheng
Grid Data Access: Proxy Caches and User Views EGI Technical Forum 19 September 2011 Jan Just Keijser Cristian Cirstea Jeff Templon.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
Gri2Win: Porting gLite to run under Windows XP Platform
Grid2Win: Porting of gLite middleware to Windows platform
Grid2Win Porting of gLite middleware to Windows XP platform
Grid Computing: Running your Jobs around the World
StoRM: a SRM solution for disk based storage systems
Grid2Win: Porting of gLite middleware to Windows XP platform
Grid2Win: Porting of gLite middleware to Windows XP platform
Grid Services Ouafa Bentaleb CERIST, Algeria
Short update on the latest gLite status
Gri2Win: Porting gLite to run under Windows XP Platform
Interoperability & Standards
Grid2Win: Porting of gLite middleware to Windows XP platform
Data Management cluster summary
EGEE Middleware: gLite Information Systems (IS)
Overview of gLite Middleware
a middleware implementation
Grid Computing Software Interface
Presentation transcript:

The Institute of High Energy of Physics, Chinese Academy of Sciences Sharing LCG files across different platforms Cheng Yaodong, Wang Lu, Liu Aigui, Chen Gang Currently more and more heterogeneous resources are integrated into LCG. Sharing LCG files across different platforms, including different OS and grid middleware, is a basic issue. We implemented web service interface for LFC and pseudo LCG file access commands based on the LFC WS and globus Java CoG Kit. By using the tool, user can access LCG files on a variety of platforms transparently and achieve high-performance data transfer as well. The following sections describe the architecture, security, implementation and an example of use scenario. LFC Server GFISH WS (gsoap) GFAL, lcg_util Linux (SLC) SRM, GRIDFTP RFIO… LCG SE MyProxy Server GFISH Client (axis) JVM Linux, windows… Pseudo LCG DM Figure 1: The architecture of GFISH WS In figure 1, left side is the GFISH server based on SLC OS and GFAL, LCG_util and so on, whereas the right side is the client and pseudo LCG DM commands which are possible shell scripts on Linux, or bat files on Window. The client is only a fat jar package, and it can be downloaded easily to where LCG DM commands are needed. GFISH is a tool which allows user to access grid files and other files transparently, such as, “/castor”, “/dpm”. It includes some commands and APIs. GFISH WS server is developed by using gSoap Web services tool. In fact, GFISH WS is web service for LFC and some other file systems. Client is designed and implemented on basis of JVM (JAVA virtual machine), axis tool and CoG jglobus. ① ② ③ ④ A: session-based GFISH Client GFISH Server ① ② ③ B: GSI-based GFISH Client GFISH Server Figure 2: Security in GFISH WS GFISH WS provides two methods to guarantee the security, one is session-based, and another is GSI-based. The two methods are shown in figure 2. In session-based mode, user logs in GFISH WS server and get session ID firstly. During the session, client sends requests with session ID, then WS server access third-party resource on client’s behalf by using user’s credential retrieved from MyProxy server. In GSI-based method, Client and server do mutual authentication by verifying grid certificate, then server creates a proxy for client and use it to connect third-party server in behalf of the client. Computing in High Energy and Nuclear Physics, Victoria, British Columbia, Canada from 2-7 September 2007 gataway Grid interoperability is an attractive work now, which aims to submit jobs from one grid infrastructure to another transparently. Typically, gateway nodes are introduced, that is also named gateway-based interoperability as shown in figure 3. Gateway is just a logical component, it can be handled as “facade” of underlying grid infrastructure. Here we take it as an example of GFISH WS use scenario. Suppose the interoperability of LCG and other Unknown Grid (UG) which is not compatible with GSI and GridFTP. Before using GFISH WS, consider the case that one gLite job is scheduled to UG platform, moreover, “lcg-cp” is used in the job to get large input data. At this time, it isn’t possible to run because “lcg-cp” doesn’t exist on UG platform. Extended LCG CE UG Client LCG UI LCG RB LCG SE LFC Server GFISH WS Server GFISH WEB UG Resources GFISH Client MyProxy Server Figure 3: An example of use scenario However, after the job find “lcg-cp” doesn’t exist, it can get GFISH client jar package from GFISH WEB as shown in figure 3. Then, the job can retrieve credential from MyProxy server, connect LFC server through GFISH WS server, and copy data from LCG SE by using pseudo “lcg-cp” command in GFISH client (described in dashed line). Actually, GFISH client is a small LCG DM environment, which can be built easily on demand.