DataGRID France – 12 Feb 2003 - 1 WP 7 High-Throughput Transfers with GridFTP EU Demo : GridFTP between CERN and NIKHEF New TCP stack implementation –High-Speed.

Slides:



Advertisements
Similar presentations
DataTAG WP4 Meeting CNAF Jan 14, 2003 Interfacing AliEn and EDG 1/13 Stefano Bagnasco, INFN Torino Interfacing AliEn to EDG Stefano Bagnasco, INFN Torino.
Advertisements

The Replica Location Service In wide area computing systems, it is often desirable to create copies (replicas) of data objects. Replication can be used.
1 Grid networking in EU DataGRID TERENA conference Limerick - 5 th of June 2002 Pascale PRIMET Manager of the workpackage Network of the DataGRID project.
EU DataGrid progress Fabrizio Gagliardi EDG Project Leader
Andrew McNab - Manchester HEP - 15 February 2002 Testbed Release in the UK EDG Testbed 1 GridPP sources of information GridPP VO GIIS and Resource Broker.
DataGrid is a project funded by the European Union CHEP 2003 – March 2003 – HEP Assessment of EDG – n° 1 HEP Applications Evaluation of the EDG Testbed.
1 WP2: Data Management Paul Millar eScience All Hands Meeting September
All Hands MeetingD. Colling, Imperial College London, for the GridPP Project 1 Hans Hoffman has described the scale of the problems that we are facing,
S.L.LloydGrid Steering Committee 8 March 2002 Slide 1 Status of GridPP Overview Financial Summary Recruitment Status EU DataGrid UK Grid Status GridPP.
EU DataGrid TestBed 2 Component Review Paul Millar (University of Glasgow) (slides based on a presentation by Erwin Laure)
GridPP Meeting, Cambridge, 14 Feb 2002 Paul Mealor, UCL Networking Paul Mealor.
Metadata Progress GridPP18 20 March 2007 Mike Kenyon.
ATLAS/LHCb GANGA DEVELOPMENT Introduction Requirements Architecture and design Interfacing to the Grid Ganga prototyping A. Soroko (Oxford), K. Harrison.
Partner Logo UK GridPP Testbed Rollout John Gordon GridPP 3rd Collaboration Meeting Cambridge 15th February 2002.
Bernd Panzer-Steindel, CERN/IT WAN RAW/ESD Data Distribution for LHC.
Exporting Raw/ESD data from Tier-0 Tier-1s Wrap-up.
HEPiX GFAL and LCG data management Jean-Philippe Baud CERN/IT/GD.
Bob Jones – Project Architecture - 1 March n° 1 Information & Monitoring Services Antony Wilson WP3, RAL
Presenter Name Facility Name EDG Testbed Status Moving to Testbed Two.
Grid Application Builders Teach In31/01/02Antony Wilson Information & Monitoring Services WP3.
INFN Testbed1 status L. Gaido, A. Ghiselli WP6 meeting CERN, 11 December 2001.
EU 2nd Year Review – Jan – Title – n° 1 WP1 Speaker name (Speaker function and WP ) Presentation address e.g.
F o r m u l a M a s s. F o r m u l a a n d M o l e c u l a r M a s s z E v e r y M o l e c u l a r m a s s i s a f o r m u l a m a s s. z N o t e v e.
19/06/2002WP4 Workshop - CERN WP4 - Monitoring Progress report
EU 2nd Year Review – Feb – WP2/WP7 demonstration – n° 1 WP7 Report Status on Release 2.0 and plans CNRS/UREC.
IoP HEPP 2004 Birmingham, 7/4/04 David Cameron, University of Glasgow 1 Simulation of Replica Optimisation Strategies for Data.
Réunion DataGrid France, Lyon, fév CMS test of EDG Testbed Production MC CMS Objectifs Résultats Conclusions et perspectives C. Charlot / LLR-École.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
E. Ronchieri – n° 1 EDG release 2 Elisabetta Ronchieri INFN CNAF - DataGrid WP1 – Workload Management System
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
CAIDA Bandwidth Estimation Meeting San Diego June 2002 R. Hughes-Jones Manchester 1 EU DataGrid - Network Monitoring Richard Hughes-Jones, University of.
ALICE DATA ACCESS MODEL Outline ALICE data access model - PtP Network Workshop 2  ALICE data model  Some figures.
EU 2nd Year Review – Jan – WP9 WP9 Earth Observation Applications Demonstration Pedro Goncalves :
1 WP7 (Network) status &plans Paris 6 th of March 2002 Pascale PRIMET INRIA/ RESO - ENS Lyon
ALICE data access WLCG data WG revival 4 October 2013.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Tiziana FerrariNetwork metrics usage for optimization of the Grid1 DataGrid Project Work Package 7 Written by Tiziana Ferrari Presented by Richard Hughes-Jones.
Computing Infrastructure Status. LHCb Computing Status LHCb LHCC mini-review, February The LHCb Computing Model: a reminder m Simulation is using.
Experiment Support CERN IT Department CH-1211 Geneva 23 Switzerland t DBES P. Saiz (IT-ES) AliEn job agents.
File and Object Replication in Data Grids Chin-Yi Tsai.
DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help.
Your university or experiment logo here Caitriana Nicholson University of Glasgow Dynamic Data Replication in LCG 2008.
CMS Stress Test Report Marco Verlato (INFN-Padova) INFN-GRID Testbed Meeting 17 Gennaio 2003.
1 WP2: Data Management Gavin McCance RAL Middleware Workshop 24 February 2003.
Andrew McNabETF Firewall Meeting, NeSC, 5 Nov 2002Slide 1 Firewall issues for Globus 2 and EDG Andrew McNab High Energy Physics University of Manchester.
Author - Title- Date - n° 1 Partner Logo EU DataGrid, Work Package 5 The Storage Element.
Enabling Grids for E-sciencE Introduction Data Management Jan Just Keijser Nikhef Grid Tutorial, November 2008.
Replica Management Services in the European DataGrid Project Work Package 2 European DataGrid.
Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future.
CGW 04, Stripped replication for the grid environment as a web service1 Stripped replication for the Grid environment as a web service Marek Ciglan, Ondrej.
Jens G Jensen RAL, EDG WP5 Storage Element Overview DataGrid Project Conference Heidelberg, 26 Sep-01 Oct 2003.
29/1/2002A.Ghiselli, INFN-CNAF1 DataTAG / WP4 meeting Cern, 29 January 2002 Agenda  start at  Project introduction, Olivier Martin  WP4 introduction,
A Grid Approach to Geographically Distributed Data Analysis for Virgo F. Barone, M. de Rosa, R. De Rosa, R. Esposito, P. Mastroserio, L. Milano, F. Taurino,
ALICE DATA ACCESS MODEL Outline 05/13/2014 ALICE Data Access Model 2  ALICE data access model  Infrastructure and SE monitoring.
Data Management The European DataGrid Project Team
1.3 ON ENHANCING GridFTP AND GPFS PERFORMANCES A. Cavalli, C. Ciocca, L. dell’Agnello, T. Ferrari, D. Gregori, B. Martelli, A. Prosperini, P. Ricci, E.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 Parallelization of Monte Carlo simulations.
EGEE is a project funded by the European Union under contract IST Information and Monitoring Services within a Grid R-GMA (Relational Grid.
1 A Scalable Distributed Data Management System for ATLAS David Cameron CERN CHEP 2006 Mumbai, India.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
TIFR, Mumbai, India, Feb 13-17, GridView - A Grid Monitoring and Visualization Tool Rajesh Kalmady, Digamber Sonvane, Kislay Bhatt, Phool Chand,
J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen
Networking for grid Network capacity Network throughput
WP7 objectives, achievements and plans
WP2/WP7 Demonstration WP7 High Throughput Data transfers WP2/WP7 Replica Selection based on Network Cost Functions WP2 Replica Location Service.
Stephen Burke, PPARC/RAL Jeff Templon, NIKHEF
A conceptual model of grid resources and services
ExaO: Software Defined Data Distribution for Exascale Sciences
Grid Data Replication Kurt Stockinger Scientific Data Management Group Lawrence Berkeley National Laboratory.
The LHCb Computing Data Challenge DC06
Presentation transcript:

DataGRID France – 12 Feb WP 7 High-Throughput Transfers with GridFTP EU Demo : GridFTP between CERN and NIKHEF New TCP stack implementation –High-Speed TCP –Scalable TCP Achievements –More than 350 Mbit/s with one stream 165 Mbit/s with default TCP implementation Conclusions –Multi-streaming is NOT the solution (efficiency and fairness) –Firewalls are more and more often the bottleneck –System optimisation is important. SurfNe t NIKHEF CERN GEANT

DataGRID France – 12 Feb WP 7 NetworkCost functions RBUIRMNetwork APIGIS Decision JDL (Env, LFNs) CEs Match (Env) List of CEs getAccessCost (CEs, LFNs) getNetworkCost (CEs, SEs) Network Cost Matrix Full Cost Matrix ARCHICTURE CERMNetwork API getBestFile (LFN) getNetworkCost (CE, SEs) Network Cost Vector File copy

DataGRID France – 12 Feb WP 7 NetworkCost functions getNetworkCost FileSize = 10 MB Results = time to transfer (sec.) CERN RAL NIKHEF IN2P3 CNAF CERN RAL NIKHEF IN2P3 CNAF 13,084,046,534,5 CNAF 7,086,2410,385,03 IN2P3 2,6611,863,2511,13 NIKHEF 4,357,122,447,46 RAL 35,4444,8777,7846,75 CERN CNAFIN2P3NIKHEFRALCERN

DataGRID France – 12 Feb WP 7 Network Monitoring Nodes EDG 1.x : static performances analysis EDG 2.0 : used by networkCost suite A network monitoring node is RECOMMANDED on each site, but not MANDATORY PCP TopoGridRTPL Distributed Data Collector Raw IPerfErUDPmon NetLoad Agent PingEr Measure on each site Collect And Storage Visualization MapCenter Replica Managers & resources brokers Network Managers Forecaster Processing Archive MDS R-GMA MDS R-GMA NetworkCost