WP7 objectives, achievements and plans

Slides:



Advertisements
Similar presentations
Update on Advanced Networking in Singapore L.W.C. Wong & F.B.S. Lee Singapore Advanced Research & Education Network.
Advertisements

Pete Clarke– GridPP 6 – 31 Jan n° 1 EGEE EGEE - The Network Sector.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
4 th DataGRID Project Conference, Paris, 5 March 2002 Testbed Software Test Plan I. Mandjavidze on behalf of L. Bobelin – CS SI; F.Etienne, E. Fede – CPPM;
Nicolas Simar – DANTE : Premium IP and LBE transparency on GEANT QoS on GÉANT Premium IP and Less than Best Effort.
Connect. Communicate. Collaborate TNC Bruges, 22 May 2008 GÉANT2: The Good the Bad and the Ugly - What worked and what didn’t work? Robin G. Arak.
EU 2nd Year Review – Feb – WP2/WP7 demonstration – n° 1 WP7 Report Status on Release 2.0 and plans CNRS/UREC.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
The CrossGrid project Juha Alatalo Timo Koivusalo.
Connect. Communicate. Collaborate The Technological Landscape of GÉANT2 Roberto Sabatino, DANTE
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
Connect. Communicate. Collaborate Implementing Multi-Domain Monitoring Services for European Research Networks Szymon Trocha, PSNC A. Hanemann, L. Kudarimoti,
D0RACE: Testbed Session Lee Lueking D0 Remote Analysis Workshop February 12, 2002.
Connect communicate collaborate GÉANT3 Services Connectivity and Monitoring Services by and for NRENs Ann Harding, SWITCH TNC 2010.
GridPP Collaboration Meeting Networking: Current Status Robin Tasker CCLRC, Daresbury Laboratory 3 June 2004.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 DataGrid Project Status Fabrizio Gagliardi.
Franck Bonnassieux- WP7- n° 1 WP7 Budapest Collaboration with Dante Monitoring & R-GMA GridFTP Logging Network Cost Function MapCenter & TopoGRID Future.
DataGRID PTB, Geneve, 10 April 2002 Testbed Software Test Plan Status Laurent Bobelin on behalf of Test Group.
BalticGrid-II Project BalticGrid-II Kick-off meeting, May 2008, Vilnius SA2 - Network Provisioning Katrina Sataki, IMCS UL.
CEOS Working Group on Information Systems and Services - 1 Data Services Task Team Discussions on GRID and GRIDftp Stuart Doescher, USGS WGISS-15 May 2003.
E-infrastructure shared between Europe and Latin America FP6−2004−Infrastructures−6-SSA gLite Information System Pedro Rausch IF.
NORDUnet Nordic Infrastructure for Research & Education Workshop Introduction - Finding the Match Lars Fischer LHCONE Workshop CERN, December 2012.
A demonstrator for IST 2001 G. Romier UREC Lyon. What is IST2001? the IST projects Exhibition is dedicated to displaying the results of projects within.
INFSO-RI Enabling Grids for E-sciencE NRENs & Grids Workshop Relations between EGEE & NRENs Mathieu Goutelle (CNRS UREC) EGEE-SA2.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 DataGrid Project Status Fabrizio Gagliardi.
EGEE is a project funded by the European Union under contract IST Information and Monitoring Services within a Grid R-GMA (Relational Grid.
Javier Orellana JRA4 Coordinator Face to Face Partners Meeting University College London 11 December 2003 EGEE is proposed as a project funded by the European.
INFSO-RI Enabling Grids for E-sciencE SA2 and JRA4: Network Services K. Kavoussanakis J-P. Gautier.
EGEE is a project funded by the European Union under contract IST JRA4 Overview Javier Orellana JRA4 Coordinator EGEE Kick Off Meeting SA2.
DataTAG is a project funded by the European Union International School on Grid Computing, 23 Jul 2003 – n o 1 GridICE The eyes of the grid PART I. Introduction.
Bob Jones – Project Architecture - 1 March n° 1 Project Architecture, Middleware and Delivery Schedule Bob Jones Technical Coordinator, WP12, CERN.
INFSO-RI Enabling Grids for E-sciencE Network Services Development Network Resource Provision 3 rd EGEE Conference, Athens, 20 th.
DataTAG is a project funded by the European Union CERN, 8 May 2003 – n o 1 / 10 Grid Monitoring A conceptual introduction to GridICE Sergio Andreozzi
EGEE is a project funded by the European Union under contract IST Network Activities Jean-Paul Gautier CNRS/UREC French Federation meeting.
Javier Orellana EGEE-JRA4 Coordinator CERN March 2004 EGEE is proposed as a project funded by the European Union under contract IST Network.
Network Flow Bandwidth Requirements. UK GRID Networking Research Projects Network Infrastructure GRS, GRID resource management MB-NG, QoS Features GRIDprobe,
J Jensen / WP5 /RAL UCL 4/5 March 2004 GridPP / DataGrid wrap-up Mass Storage Management J Jensen
INFSO-RI Enabling Grids for E-sciencE TNC 2005 Networking activities in EGEE Mathieu Goutelle (CNRS UREC, France) EGEE-SA2 activity.
A Brief Introduction to The GÉANT GN3 Project
Bob Jones EGEE Technical Director
Regional Operations Centres Core infrastructure Centres
Grid Optical Burst Switched Networks
Welcome Network Virtualization & Hybridization Thomas Ndousse
GENUS Virtualisation Service for GÉANT and European NRENs
Agent-Based Grid Load-Balancing
Report from WLCG Workshop 2017: WLCG Network Requirements GDB - CERN 12th of July 2017
EGEE Middleware Activities Overview
INFN-GRID Work Package 5 - NETWORK
JRA3 Introduction Åke Edlund EGEE Security Head
G R N E T-2 Update Tryfon Chiotis, Technical Director
EO Applications Parallel Session
EGEE SA2 / TERENA NRENs & Grids joint workshop
Ian Bird GDB Meeting CERN 9 September 2003
The GEANT Perspectives
Grid related projects CERN openlab LCG EDG F.Fluckiger
Establishing End-to-End Guaranteed Bandwidth Network Paths Across Multiple Administrative Domains The DOE-funded TeraPaths project at Brookhaven National.
Testbed Software Test Plan Status
WP1 activity, achievements and plans
Integration of Network Services Interface version 2 with the JUNOS Space SDK
Networking for grid Network capacity Network throughput
Network Requirements Javier Orellana
LCG Operations Centres
CERN-USA connectivity update DataTAG project
Overlay Networking Overview.
Grid Networking issues
Big-Data around the world
GN2 (and its support for GRIDs)
Wide Area Workload Management Work Package DATAGRID project
Presentation transcript:

WP7 objectives, achievements and plans Network Services WP7 objectives, achievements and plans Franck Bonnassieux

Outline Objectives from the technical annex Achievements, what we delivered Lessons learned throughout the project Exploitation and future Questions

Objectives Review the network service requirements of DataGrid and make detailed plans in collaboration with the European and national actors involved take into account both the evolving needs of the Data Grid project Based on the European research network infrastructure (GEANT project and NRENs evolutions) Monitor the traffic and performance of the network develop models and provide tools and data for the planning of future networks concentrating on the requirements of grids handling significant volumes of data. Study, deploy and manage advanced network and transport services

Achievements Network Monitoring Definition and deployment of a scalable Grid network monitoring architecture (large-scale successful usage of RGMA) Probe Coordination Protocol deployed, scheduling all network measurements between NMs Central MySQL Archive hosting all network metrics and GridFTP logging for online analysis RTT between sites GridFTP analysis Total Grid Traffic

Achievements Network Provisioning follow-up Traffic over GEANT (last 3 months)

Achievements Network Services A network transfer “cost” estimation service to provide applications and middleware with the costs of data transport Called from the WP2 Replica Optimisation Service Used by RBs for optimized matchmaking (getAccessCost), and also directly by applications (getBestFile) GEANT network tests campaign Network Quality Of Service LBE, IP Premium High-Throughput Transfers Standard and advanced TCP stacks Close collaboration with DANTE Set-up of the testbed Analysis of results Access granted to all internal GEANT monitoring tools

Lessons Learned Network monitoring is a key activity, both for provisioning and to provide accurate aggregate function for global grid schedulers. The investigations on network QoS carried out have led to a much greater understanding of how to utilise the network to benefit Grid operations Due to the newness of theses technologies, Network QOS (LBE, IP Premium, Multicast …) implementation is a very complex task. Dynamic QoS configuration and peering must be enhanced in order to work in multi-domain networks. We have largely benefited from close contact with DANTE and DataTAG, both at technical and management level Adding significant richness to the work undertaken in WP7 Participation to How-to to bring network advances to the end-users Building of a firm basis for the future interaction of the network with production Grids, and in EGEE.

Exploitation WP7 has worked closely with Grid standardization bodies: Large participation to GGF areas and working groups, and in particular with Grid High-Performance Networking (GHPN-RG) and with Network Measurement (NM-WG). Work towards a first prototype of an OGSI (Grid service) based measurement architecture Close participation in the GLUE initiative Products developed by WP7 have been successfully deployed on EDG testbeds and also on other grid environments: The WP7 Network Monitoring Infrastructure, based on standard and homemade measurement tools: CrossGrid, LCG MapCenter, a grid monitoring and visualization tool: DataGRID, DataTAG, CrossGrid, LCG, GridIreland, PlanetLab, L-Bone, Atlas Grid, E-Toile, CEOS Grid, Nanyang Campus Grid, etc…

Future GEANT and most of NRENs are currently far from being saturated … in term of bandwidth. All future European network projects, and especially GN2 will concentrate efforts on network services Layer 2/3 VPNs Secure channels Inter-domains QOS End-to-end monitoring Solutions for automatic and dynamic bandwidth allocation and reservation Future grid projects will be the major consumers of these network services Large collaboration between EGEE, GN2 and others (6Net, …)

Questions ?