Evaluation of “data” grid tools

Slides:

Advertisements

Similar presentations

Globus FTP Evaluation test Catania – 10/04/2001Antonio Forte – INFN Torino.

Advertisements

WP 1 (Globus) Status Report Massimo Sgaravatto INFN Padova for the INFN Globus group

Cross-site data transfer on TeraGrid using GridFTP TeraGrid06 Institute User Introduction to TeraGrid June 12 th by Krishna Muriki

Work Package 1 Installation and Evaluation of the Globus Toolkit Massimo Sgaravatto INFN Padova.

The Anatomy of the Grid: An Integrated View of Grid Architecture Carl Kesselman USC/Information Sciences Institute Ian Foster, Steve Tuecke Argonne National.

GridFTP: File Transfer Protocol in Grid Computing Networks

GridFTP Introduction – Page 1Grid Forum 5 GridFTP Steve Tuecke Argonne National Laboratory.

WP 1 Grid Workload Management Massimo Sgaravatto INFN Padova.

USING THE GLOBUS TOOLKIT This summary by: Asad Samar / CALTECH/CMS Ben Segal / CERN-IT FULL INFO AT:

Version Control What it is and why you want it. What is Version Control? A system that manages changes to documents, files, or any other stored information.

Status of Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group

The Internet Useful Definitions and Concepts About the Internet.

INFN-GRID Globus evaluation Massimo Sgaravatto INFN Padova for the INFN Globus group

Globus activities within INFN Massimo Sgaravatto INFN Padova for the INFN Globus group

Basics Globus Toolkit™ Developer Tutorial The Globus Project™ Argonne National Laboratory USC Information Sciences Institute Copyright.

1 Exploring Data Reliability Tradeoffs in Replicated Storage Systems NetSysLab The University of British Columbia Abdullah Gharaibeh Matei Ripeanu.

Object Linking and Embedding A tool which allows different software application packages to share data.

Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.

FTP File Transfer Protocol. Introduction transfer file to/from remote host client/server model  client: side that initiates transfer (either to/from.

GridFTP Guy Warner, NeSC Training.

The Data Replication Service Ann Chervenak Robert Schuler USC Information Sciences Institute.

10 May 2007 HTTP - - User data via HTTP(S) Andrew McNab University of Manchester.

Part Three: Data Management 3: Data Management A: Data Management — The Problem B: Moving Data on the Grid FTP, SCP GridFTP, UberFTP globus-URL-copy.

Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.

INFN-GRID Globus evaluation (WP 1) Massimo Sgaravatto INFN Padova for the INFN Globus group

Don Quijote Data Management for the ATLAS Automatic Production System Miguel Branco – CERN ATC

GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.

MySQL and GRID Gabriele Carcassi STAR Collaboration 6 May Proposal.

Topaz : A GridFTP extension to Firefox M. Taufer, R. Zamudio, D. Catarino, K. Bhatia, B. Stearn University of Texas at El Paso San Diego Supercomputer.

File and Object Replication in Data Grids Chin-Yi Tsai.

Reliable Data Movement using Globus GridFTP and RFT: New Developments in 2008 John Bresnahan Michael Link Raj Kettimuthu Argonne National Laboratory and.

Globus GridFTP and RFT: An Overview and New Features Raj Kettimuthu Argonne National Laboratory and The University of Chicago.

CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.

Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.

Globus Replica Management Bill Allcock, ANL PPDG Meeting at SLAC 20 Sep 2000.

Data Management and Transfer in High-Performance Computational Grid Environments B. Allcock, J. Bester, J. Bresnahan, A. L. Chervenak, I. Foster, C. Kesselman,

Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.

GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.

CEOS Working Group on Information Systems and Services - 1 Data Services Task Team Discussions on GRID and GRIDftp Stuart Doescher, USGS WGISS-15 May 2003.

GridFTP Richard Hopkins

Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,

Globus – Part II Sathish Vadhiyar. Globus Information Service.

DGC Paris WP2 Summary of Discussions and Plans Peter Z. Kunszt And the WP2 team.

Replica Management Kelly Clynes. Agenda Grid Computing Globus Toolkit What is Replica Management Replica Management in Globus Replica Management Catalog.

ALCF Argonne Leadership Computing Facility GridFTP Roadmap Bill Allcock (on behalf of the GridFTP team) Argonne National Laboratory.

Super Computing 2000 DOE SCIENCE ON THE GRID Storage Resource Management For the Earth Science Grid Scientific Data Management Research Group NERSC, LBNL.

Summary from WP 1 Parallel Section Massimo Sgaravatto INFN Padova.

Andrew McNab - Globus Distribution for Testbed 1 Globus Distribution for Testbed 1 Andrew McNab, University of Manchester

Status of Globus activities Massimo Sgaravatto INFN Padova for the INFN Globus group

GridFTP Guy Warner, NeSC Training Team.

Protocols and Services for Distributed Data- Intensive Science Bill Allcock, ANL ACAT Conference 19 Oct 2000 Fermi National Accelerator Laboratory Contributors:

EGEE-II INFSO-RI Enabling Grids for E-sciencE Architecture of LHC File Catalog Valeria Ardizzone INFN Catania – EGEE-II NA3/NA4.

Preservation Data Services Persistent Archive Research Group Reagan W. Moore October 1, 2003.

FILE TRANSFER SPEEDS OVER HTTP AND FTP Yibiao Li 06/01/2009 Christmas Meeting 2008/09.

TIBCO Business Events Online Training. Introduction to TIBCO BE Tibco Business Events is complex event processing software with a powerful engine enables.

EGRID Project: Experience Report Implementation of a GRID Infrastructure for the Analysis of Economic and Financial data.

EGEE Data Management Services

Workload Management Workpackage

Computing Clusters, Grids and Clouds Globus data service

Oxana Smirnova, Jakob Nielsen (Lund University/CERN)

The Data Grid: Towards an architecture for Distributed Management

Data Bridge Solving diverse data access in scientific applications

Study course: “Computing clusters, grids and clouds” Andrey Y. Shevel

GFAL 2.0 Devresse Adrien CERN lcgutil team

Data Management in Release 2

University of Technology

A conceptual model of grid resources and services

Part Three: Data Management

Distributed Systems Bina Ramamurthy 4/22/2019 B.Ramamurthy.

Data Management Components for a Research Data Archive

Presentation transcript:

Evaluation of “data” grid tools Massimo Sgaravatto INFN Padova

Globus Data Grid INFN has been offered to evaluate Globus Data Grid Alpha Release 2 Two main tools/services GlobusFTP Reference implementation of the GRIDFTP protocol (data transfer protocol based on FTP, focused on high performance and reliability) Replica Catalog software

GlobusFTP ncftp client and wu-ftpd server patched to enable GSI authentication wu-ftpd server patched to add support for partial file transfer and parallel transfer globus_ftp_control library (routines for managing a GridFTP connection) GSI authentication full-file get, put, and transfer capabilities Support for parallel data channel Support for partial file transfer globus_ftp_client library Higher level client features on top of the globus_ftp_control_library globus_gass_copy library Allows data to be copied between a source and a destination using any combination of GridFTP, HTTP, HTTPS, local file I/O globus-url-copy tool Command line tool implementing globus_gass_copy’s functionalities

Globus replica catalog globus_replica_catalog library Allows operations on a LDAP-based replica catalog (used to keep track of files within collections stored in multiple storage repositories) Command line tool implementing globus_replica_catalog’s functionalities

Documentation http://www.globus.org/gsiftp-alpha http://www.globus.org/datagrid gsiftp-alpha@globus.org

Actions Definition of a group willing to evaluate these tools The group will have to plan the activities ASAP !!! Coordinator of this group ??? Relationships with other WPs ??