1. The EU DataTAG Project Olivier H. Martin CERN - IT Division
Presented at the Grid Workshop LISHEP conference
7th February Rio de Janeiro, Brazil
Olivier H. Martin
CERN - IT Division

2. The project Two main focus:
Grid related network research
Interoperability between European and US Grids
2.5 Gbps transatlantic lambda between CERN (Geneva) and StarLight (Chicago)
dedicated to research (no production traffic)
Expected outcomes:
Hide complexity of Wide Area Networking, i.e. the network becomes truly transparent.
Better interoperability between GRID projects in Europe and North America
DataGrid, possibly other EU funded Grid projects
PPDG, GriPhyN, DTF, iVDGL (USA)
11/27/2018
The EU DataTAG Project

3. The project (cont)
European partners: INFN (IT), PPARC (UK), University of Amsterdam (NL) and CERN, as project coordinator. INRIA (FR) & ESA (European Space Agency) will join soon.
Significant contributions to the DataTAG workplan have been made by Jason Leigh of Illinois), Joel Mambretti (Northwestern University), Brian Tierney (LBNL).
Strong collaborations already in place with ANL, Caltech, FNAL, SLAC, University of Michigan, as well as Internet2 and ESnet.
Budget: 3.98 MEUR
Start date: January, 1, Duration: 2 years
Funded manpower: ~ 15 persons/year
NSF support through the existing collaborative agreement with CERN (Eurolink award)
11/27/2018
The EU DataTAG Project

4. DataTAG project Abilene UK IT ESNET CERN GEANT MREN NL NewYork
SuperJANET4 IT
GARR-B
STAR-LIGHT
ESNET
GEANT
CERN
MREN NL
SURFnet
STAR-TAP

5. DataTAG planned set up (second half 2002)
DataTAG test equipment
CERN PoP Chicago
DataTAG test equipment
DataTAG test equipment
STARLIGHT
UvA
INFN
PPARC
…...
(Qwest NBC PoP)
DataTAG test equipment
ESNET
GEANT
ABILENE
2.5 Gb
DataGRID
PPDG
iVDGL
CERN
CIXP
DTF
GriPhyN
DataTAG test equipment

6. Workplan (1) WP5: Information dissemination and exploitation (CERN)
WP1: Provisioning & Operations (P. Moroni/CERN)
Will be done in cooperation with DANTE
Two major issues:
Procurement
Routing, how can the DataTAG partners have transparent access to the DataTAG circuit across GEANT and their national network?
WP5: Information dissemination and exploitation (CERN)
WP6: Project management (CERN)
11/27/2018
The EU DataTAG Project

7. Workplan (2) WP2: High Performance Networking (Robin Tasker/PPARC)
High performance Transport
tcp/ip performance over large bandwidth*delay networks
Alternative transport solutions
End to end inter-domain QoS
Advance network resource reservation
11/27/2018
The EU DataTAG Project

8. Workplan (3)
WP3: Bulk Data Transfer & Application performance monitoring (Cees deLaat/UvA)
Performance validation
End to end user performance
Validation
Monitoring
Optimization
Application performance
Netlogger
11/27/2018
The EU DataTAG Project

9. Workplan (4)
WP4: Interoperability between Grid Domains (Antonia Ghiselli/INFN)
GRID resource discovery
Access policies, authorization & security
Identify major problems
Develop inter-Grid mechanisms able to interoperate with domain specific rules
Interworking between domain specific Grid services
Test Applications
Interoperability, performance & scalability issues
11/27/2018
The EU DataTAG Project

10. Planning details
The lambda availability is expected in the second half of 2002
Initially, test systems will be either at CERN or connect via GEANT
GEANT is expected to provide VPNs (or equivalent) for Datagrid and/or access to the GEANT PoPs.
Later, it is hoped that dedicated lambdas for Datagrid will be made available through GEANT or other initiatives (e.g. Flag Telecom)
Initially, a 2.5 Gbps POS link
WDM later, depending on equipment availability
11/27/2018
The EU DataTAG Project

11. The STAR LIGHT
Next generation STAR TAP with the following main distinguishing features:
Neutral location (Northwestern University)
1/10 Gigabit Ethernet based
Multiple local loop providers
Optical switches for advanced experiments
The STAR LIGHT will provide 2*622 Mbps ATM connection to the STAR TAP
Started in July 2001
Also hosting other advanced networking projects in Chicago & State of Illinois
N.B. Most European Internet Exchanges Points have already been implemented along the same lines.
11/27/2018
The EU DataTAG Project

12. StarLight Infrastructure
…Soon, Star Light will be an optical switching facility for wavelengths
University of Illinois at Chicago

13. Evolving StarLight Optical Network Connections
Asia-Pacific
SURFnet, CERN
Vancouver
CA*net4
CA*net4
Seattle
Portland
U Wisconsin
Chicago*
NYC
PSC
San Francisco IU
DTF 40Gb
NCSA
Asia-Pacific
Caltech
Atlanta
SDSC
*ANL, UIC, NU, UC, IIT, MREN
AMPATH

14. OMNInet Technology Trial @ StarLight
West Taylor
Evanston GE
10GE l
10GE l GE
OPTera
Metro
5200
Optical
Switching
Platform
Optical
Switching
Platform
Passport
8600
Passport
8600
Application
Cluster
Application
Cluster
OPTera
Metro
5200
OPTera
Metro
5200
Lakeshore
S. Federal
10GbE WAN
To Ca*Net4
(future) GE
10GE l
10GE l GE
OPTera
Metro
5200
Optical
Switching
Platform
Application
Cluster
Optical
Switching
Platform
Passport
8600
Passport
8600
Application
Cluster
OPTera
Metro
5200
A four site network in Chicago -- the first 10GE service trial!
A test bed for all-optical switching, advanced high-speed services, and and new applications including high-performance streaming media and collaborative applications for health-care, financial, and commercial services.
Partners: SBC, Nortel, International Center for Advanced Internet Research (iCAIR) at Northwestern, Electronic Visualization Lab at Univ of Illinois, Argonne National Lab, CANARIE
OMNInet Technology Trial November 2001

15. Major Grid networking issues
QoS (Quality of Service)
still largely unresolved on a wide scale because of complexity of deployment
TCP/IP performance over high bandwidth, long distance networks
The loss of a single packet will affect a 10Gbps stream with 200ms RTT (round trip time) for 5 hours. During that time the average throughput will be 7.5 Gbps.
End to end performance in the presence of firewalls
There is a lack of products, can we rely on products becoming available or should a new architecture be evolved?
11/27/2018
The EU DataTAG Project

16. Multiple Gigabit/second networking Facts, Theory & Practice
Gigabit Ethernet (GBE) nearly ubiquitous
10GBE coming very soon
10Gbps circuits have been available for some time already in Wide Area Networks (WAN).
40Gbps is in sight on WANs, but what after?
THEORY:
1GB file transferred in 11 seconds over a 1Gbps circuit (*)
1TB file transfer would still require 3 hours
and 1PB file transfer would require 4 months
PRACTICE:
Rather disappointing results are obtained on high bandwidth, large RTT networks.
Multiple streams have become the norm
(*) according to the 75% empirical rule
11/27/2018
The EU DataTAG Project

17. Single stream vs Multiple streams effect of a single packet loss (e. g
Single stream vs Multiple streams effect of a single packet loss (e.g. link error, buffer overflow)
Streams/Throughput 10 5 10
Avg. 7.5 Gbps
Throughput Gbps
7 5
Avg Gbps
Avg Gbps 5
2.5
Avg Gbps
T = 2.37 hours!
(RTT=200msec, MSS=1500B) T T T
Time T
11/27/2018
The EU DataTAG Project