1. Delivering order-of-magnitude improvements to research data throughput David Wilde Network Architect, AARNet David Wilde Network Architect, AARNet TNC 2015 - Porto, Portugal 16 June 2015 TNC 2015 - Porto, Portugal 16 June 2015

2. AARNet

3. 3 Universities Schools TAFEs Hospitals Cultural Research AARNet AARNetAARNet

4. 4 Typical AARNet Office

5. Brisbane Canberra Melbourne Perth Darwin Sippy Downs Gladstone Rockhampton Mackay Cairns Townsville Armidale Geraldton AARNet POP < 1 Gbps < 2.5 Gbps < 10 Gbps WDM Transmission KEY AARNet 5 AARNet Domestic Network Hobart Murchison Radio-Astronomy Observatory Sydney Adelaide Alice Springs 100Gbps Optical Network

6. Singapore Seattle Palo Alto San Jose Los Angeles Honolulu Muana Auckland AARNet 6 Sydney Perth AARNet International Network Suva Guam

7. Products and Services 7 Supporting the AARNet Portfolio It used to be about the plumbing, now it’s so much more …

8. 8 InnovationIncubatorInnovationIncubatorCollaborationEnablerCollaborationEnablerCommunity Developer DeveloperCommunity AARNet Three Pivotal Activities It used to be about the plumbing, now it’s so much more...

9. 9 CollaborationEnablerCollaborationEnabler AARNet Three Pivotal Activities

10. The project: RDSI

11. RDSI eResearch infrastructure 11 www.rdsi.edu.au

12. RDSI 12 RDSI : cloud storage for researchers “Enabling researchers to use, reuse and manipulate significant data collections ” https://www.rdsi.edu.au/node-statuses

13. RDSI 13 RDSI : cloud storage for researchers “Enabling researchers to use, reuse and manipulate significant data collections ” https://www.rdsi.edu.au/node-statuses

14. The New World of Research 14 Research Drivers: “ Really Big Data” Square Kilometre Array Large Hadron Collider Climate Change DataGenomics Data

15. 15 RDSI Other research projects Catlin Global Reef Record Global research on greenhouse gases Disease transmission among lizards Historical newspaper record https://www.rdsi.edu.au/use-cases

16. The problem: data sharing

17. 17 DataData Data sharing Problems to solve ResourcesResources UsersUsers

18. Science DMZ The problem: 18 Brisbane-Melbourne (30ms) Perth-Sydney (50ms) NYC- London (75ms) Perth-LAX (160ms!) Image: ESNet

19. The solution: Science DMZ

20. Science DMZ 20 The solution: “Friction free networking” 2. Dedicated systems for data transfer 3. Performance and network measurement tools 4. Security mechanisms designed for high performance 1. Network devices selected for high performance applications

21. Science DMZ 21 The solution: “Friction free networking” Tionette Stoddard - February 14, 2010 - Source: Richard Heathcote/Getty Images North America

22. Science DMZ 22 The solution: http://fasterdata.es.net Tionette Stoddard - February 14, 2010 - Source: Richard Heathcote/Getty Images North America

23. Science DMZ and RDSI

24. Science DMZ 24 Standard campus connection

25. Science DMZ 25 Campus connection with Science DMZ

26. 26 Science DMZ Science DMZ deployment 26

27. Primary Node Secondary Node Inter-node VPN AARNet 4 Routed Access Science DMZ 27 RDSI : high speed network connectivity

28. Science DMZ 28 ComponentsComponents Data transfer nodes: Dell Poweredge 720XD, 64GB RAM, 2 x SSD, 2 x 3.4GHz 8-core CPU 3 x Mellanox Connect3 VPI card (10/40 ethernet 10/40/56 IB) Data transfer nodes: Dell Poweredge 720XD, 64GB RAM, 2 x SSD, 2 x 3.4GHz 8-core CPU 3 x Mellanox Connect3 VPI card (10/40 ethernet 10/40/56 IB) PerfSonar: 2-blade Supermicro + Mellanox NICs PerfSonar Toolkit; MadDash dashboard PerfSonar: 2-blade Supermicro + Mellanox NICs PerfSonar Toolkit; MadDash dashboard Data transfer tools: Aspera, Globus/GridFTP Border edge switch: Juniper EX4550; Cisco 6800/NX6K/NX5K; Dell Force10 Border edge switch: Juniper EX4550; Cisco 6800/NX6K/NX5K; Dell Force10

29. 29 Science DMZ PerfSonarPerfSonar 29

30. 30 Science DMZ DTN : Aspera + Globus Online 30

31. Challenges

32. 32 Challenges Latency… 32

33. 33 Challenges LatencyLatency 33 Solution: tightly manage the DTN: NIC drivers, OS updates … Careful choice of TCP congestion avoidance algorithm Solution: tightly manage the DTN: NIC drivers, OS updates … Careful choice of TCP congestion avoidance algorithm

34. Challenges 34 Compatibility of storage architectures & vendors

35. Inter-node VPN AARNet 4 Routed Access Challenges 35 Compatibility of storage architectures & vendors

36. Inter-node VPN AARNet 4 Routed Access Challenges 36 Compatibility of storage architectures & vendors Solution: Science DMZ architecture + L3VPN for inter-Node traffic Solution: Science DMZ architecture + L3VPN for inter-Node traffic

37. Challenges 37 User tools & familiarity Images: fasterdata.es.net and pinterest.com Command line tools Typical Australian researcher ====

38. Challenges 38 User tools & familiarity Solution: keep it simple => Focus on one tool (eg. Aspera) => Many users just want a mapped drive => Many users just want a mapped drive … although non-web authentication an issue … although non-web authentication an issue => Partner with eResearch organisations for training and outreach => Partner with eResearch organisations for training and outreach Solution: keep it simple => Focus on one tool (eg. Aspera) => Many users just want a mapped drive => Many users just want a mapped drive … although non-web authentication an issue … although non-web authentication an issue => Partner with eResearch organisations for training and outreach => Partner with eResearch organisations for training and outreach =

39. Moving forward

40. Future plans 40 Improved integration with other projects

41. Future plans 41 Improved integration with other projects

42. Future plans 42 Better integration with cloud providers

43. Future plans 43 Add SDN for more flexibility…

44. Brisbane Canberra Melbourne Perth Darwin Sippy Downs Gladstone Rockhampton Mackay Cairns Townsville Armidale Geraldton AARNet POP < 1 Gbps < 2.5 Gbps < 10 Gbps WDM Transmission KEY Future plans 44 Increased bandwidth Hobart Murchison Radio-Astronomy Observatory Sydney Adelaide Alice Springs 100Gbps Optical Network

45. Brisbane Canberra Melbourne Perth Darwin Sippy Downs Gladstone Rockhampton Mackay Cairns Townsville Armidale Geraldton AARNet POP < 1 Gbps < 2.5 Gbps < 10 Gbps WDM Transmission KEY Future plans 45 Increased bandwidth Hobart Murchison Radio-Astronomy Observatory Sydney Adelaide Alice Springs 100Gbps Optical Network

46. David Wilde david.wilde@aarnet.edu.au David Wilde david.wilde@aarnet.edu.au