Presentation is loading. Please wait.

Presentation is loading. Please wait.

Wide Area Networking at SLAC, Feb ‘03

Published byEllen Dennis Modified over 6 years ago

Similar presentations

Presentation on theme: "Wide Area Networking at SLAC, Feb ‘03"— Presentation transcript:

1 Wide Area Networking at SLAC, Feb ‘03
Warren Matthews, Les Cottrell, Paola Grosso SLAC/SCS Prepared for BaBar Data Distribution meeting, SLAC February

2 Outline SLAC Connections to the Internet Usage Performance

3 WAN Connections Stanford (CalREN and Internet2) GigE link OC12
(622Mbps) ESnet These networks connect (peer) with other networks providing SLAC connectivity to the world.

4 ESnet provides SLACs primary connectivity,
This slide taken from the ESnet web site ESnet provides SLACs primary connectivity, Including DoE labs and non-research sites

5 The California Research and Education Network (CalREN) connects
Stanford and SLAC to UC sites and provides Connectivity to the Internet2 Networks. This slide taken from the UCOP web site. OC48 OC12

6 Abilene Topology This slide taken from Paul Love’s talk at the Internet2 Joint-Tech Meeting in Miami, February 2003.

7 Performance Monitoring
PingER – low impact RTT, loss etc by ping IEPM-BW – higher impact throughput Netflow – passive, characterization of traffic Looking at a combination of inter-packet delay variation (packet pair dispersion) for lightweight available bandwidth normalized to less frequent heavier weight iperf measurements

8 SLAC Internet Utilization 2002 -
Increase by 2.5 in 12 months Most European links now route through GEANT which peers via Internet 2 at the moment. Hence lack of increase in ESnet traffic.

9 Utilization History

10 SLAC Link Utilization (from NetFlow)
FTP Iperf SSH

11 Collaborator sites

12 SLAC and IN2P3 PHYnet (Renater) SLAC IN2P3 Geant Internet2 622Mbps
Note difference in iperf or bbcp memory to memory vs. BBFTP or BBCP disk-to-disk throughput (disks?) Geant Internet2 622Mbps 2.5Gbps 1Gbps

13 SLAC and RAL 1Gbps RAL TVN JAnet ESnet SLAC Geant 622Mbps 2.5Gbps

14 SLAC and Padova GARR SLAC Geant INFN/Padova Internet2 622Mbps 2.5Gbps

15 9/01 105 Mbps 30 Streams: SLAC-IN2P3; 102 Mbps 1 Stream CIT-CERN
HENP is Learning How to Use Gbps Networks Fully: Factor of 100 Gain in Maximum Sustainable Thruput in 15 Months, On Some US+TransAtlantic Routes 9/ Mbps 30 Streams: SLAC-IN2P3; 102 Mbps 1 Stream CIT-CERN 11/5/ Mbps in One Stream (modified kernel): CIT-CERN 1/09/ Mbps for One stream shared on Mbps links 3/11/ Mbps Disk-to-Disk with One Stream on 155 Mbps link (Chicago-CERN) 5/20/ Mbps SLAC-Manchester on OC12 with ~100 Streams 6/1/ Mbps Chicago-CERN One Stream on OC12 (mod. Kernel) 9/ , 1350, Mbps Chicago-CERN 1,2,3 GbE Streams, 2.5G Link 11-12/02 FAST TCP: Mbps in 1 Stream California-CERN; Gbps in 10 Flows California-Chicago

16 Improving Performance
More bandwidth, less cross traffic Tune TCP/IP parameters Windows, streams, MTU New TCP stacks Tom Kelly's Scalable TCP, Caltech's FAST TCP Sally Floyd's High-Speed TC Can achieve ~1Gbps trans-Atlantic SLAC and collaborators hold the world record (Nov-02) 923Mbps for 6800miles

17 Other gotchas Linux memory leak Linux TCP configuration caching
What is the window size actually used/reported 32 bit counters in iperf and routers wrap, need latest releases with 64bit counters Effects of number of packets in queue for NIC (txqueuelen) Routers do not pass jumbos Some applications have problems with big windows Firewalls

18 Toward a Monitoring Infrastructure
A ubiquitous network monitoring infrastructure Grid Middleware Guide Applications Troubleshooting Resource Allocation Set expectations Putting together a proposal (MAGGIE) to DoE for a high performance Grid network monitoring infrastructure with LBNL, ICSI, PSC & SLAC>

19 Summary Multiple high-speed connections Well Engineered Networks
Optimize routing Backup paths Well Engineered Networks Negligible packet loss, Good Round Trip Times Traffic doubled on ESnet every year since 1990 Need continued upgrades to keep up with demand Transmitting TBytes/day today Room for improvement (bottlenecks at edges) Needs funding & Improved TCP or other protocols TCP works up to Gbits/s rates, but needs wizards today to make it perform

20 More Information Any Questions ?
High-performance Monitoring www-iepm.slac.stanford.edu/bw/ TCP stack evaluation and 10GE testbed www-iepm.slac.stanford.edu/monitoring/bulk/fast/ Measurement reports Land Speed Record www-iepm.slac.stanford.edu/lsr/ Any Questions ?

21

Download ppt "Wide Area Networking at SLAC, Feb ‘03"

Similar presentations

GSFC to Alaska Performance Results Tino Sciuto Swales Aerospace ESDIS Network Prototype Lab. NASA GSFC Greenbelt, MD.

GSFC to Alaska Performance Results Tino Sciuto Swales Aerospace ESDIS Network Prototype Lab. NASA GSFC Greenbelt, MD.
Web100 at SLAC Presented at the Web100 Workshop, Boulder, CO, August 2002.

Web100 at SLAC Presented at the Web100 Workshop, Boulder, CO, August 2002.
Maximizing End-to-End Network Performance Thomas Hacker University of Michigan October 5, 2001.

Maximizing End-to-End Network Performance Thomas Hacker University of Michigan October 5, 2001.
1 High Performance Active End-to- end Network Monitoring Les Cottrell, Connie Logg, Warren Matthews, Jiri Navratil, Ajay Tirumala – SLAC Prepared for the.

1 High Performance Active End-to- end Network Monitoring Les Cottrell, Connie Logg, Warren Matthews, Jiri Navratil, Ajay Tirumala – SLAC Prepared for the.
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.

GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
High-Performance Throughput Tuning/Measurements Davide Salomoni & Steffen Luitz Presented at the PPDG Collaboration Meeting, Argonne National Lab, July.

High-Performance Throughput Tuning/Measurements Davide Salomoni & Steffen Luitz Presented at the PPDG Collaboration Meeting, Argonne National Lab, July.
PIPE Dreams Trouble Shooting Network Performance for Production Science Data Grids Presented by Warren Matthews at CHEP’03, San Diego March 24-28, 2003.

PIPE Dreams Trouble Shooting Network Performance for Production Science Data Grids Presented by Warren Matthews at CHEP’03, San Diego March 24-28, 2003.
EDG WP7 Networking Demonstration uDemonstration sending HEP data CERN to SARA Multiple streams of TCP packets Tuned TCP parameters: ifconfig eth0 txqueuelen.

EDG WP7 Networking Demonstration uDemonstration sending HEP data CERN to SARA Multiple streams of TCP packets Tuned TCP parameters: ifconfig eth0 txqueuelen.
1 High Performance WAN Testbed Experiences & Results Les Cottrell – SLAC Prepared for the CHEP03, San Diego, March 2003

1 High Performance WAN Testbed Experiences & Results Les Cottrell – SLAC Prepared for the CHEP03, San Diego, March 2003
02 nd April 03Networkshop 20031 Managed Bandwidth Next Generation F. Saka UCL NETSYS (NETwork SYStems centre of excellence)

02 nd April 03Networkshop Managed Bandwidth Next Generation F. Saka UCL NETSYS (NETwork SYStems centre of excellence)
The Effects of Systemic Packets Loss on Aggregate TCP Flows Thomas J. Hacker May 8, 2002 Internet 2 Member Meeting.

The Effects of Systemic Packets Loss on Aggregate TCP Flows Thomas J. Hacker May 8, 2002 Internet 2 Member Meeting.
KEK Network Qi Fazhi 2004.8. KEK SW L2/L3 Switch for outside connections Central L2/L3 Switch A Netscreen Firewall Super Sinet Router 10GbE 2 x GbE IDS.

KEK Network Qi Fazhi KEK SW L2/L3 Switch for outside connections Central L2/L3 Switch A Netscreen Firewall Super Sinet Router 10GbE 2 x GbE IDS.
1 ESnet Network Measurements ESCC Feb 15 2007 Joe Metzger

1 ESnet Network Measurements ESCC Feb Joe Metzger
What we have learned from developing and running ABwE Jiri Navratil, Les R.Cottrell (SLAC)

What we have learned from developing and running ABwE Jiri Navratil, Les R.Cottrell (SLAC)
Maximizing End-to-End Network Performance Thomas Hacker University of Michigan October 26, 2001.

Maximizing End-to-End Network Performance Thomas Hacker University of Michigan October 26, 2001.
1 Using Netflow data for forecasting Les Cottrell SLAC and Fawad Nazir NIIT, Presented at the CHEP06 Meeting, Mumbai India, February 2006 www.slac.stanford.edu/grp/scs/net/talk06/icfa-

1 Using Netflow data for forecasting Les Cottrell SLAC and Fawad Nazir NIIT, Presented at the CHEP06 Meeting, Mumbai India, February
Data transfer over the wide area network with a large round trip time H. Matsunaga, T. Isobe, T. Mashimo, H. Sakamoto, I. Ueda International Center for.

Data transfer over the wide area network with a large round trip time H. Matsunaga, T. Isobe, T. Mashimo, H. Sakamoto, I. Ueda International Center for.
1 ESnet/HENP Active Internet End-to-end Performance & ESnet/University performance Les Cottrell – SLAC Presented at the ESSC meeting Albuquerque, August.

1 ESnet/HENP Active Internet End-to-end Performance & ESnet/University performance Les Cottrell – SLAC Presented at the ESSC meeting Albuquerque, August.
1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.

1 Overview of IEPM-BW - Bandwidth Testing of Bulk Data Transfer Tools Connie Logg & Les Cottrell – SLAC/Stanford University Presented at the Internet 2.
1 High performance Throughput Les Cottrell – SLAC Lecture # 5a presented at the 26 th International Nathiagali Summer College on Physics and Contemporary.

1 High performance Throughput Les Cottrell – SLAC Lecture # 5a presented at the 26 th International Nathiagali Summer College on Physics and Contemporary.

Similar presentations

Ads by Google