DOE Facilities - Drivers for Science: Experimental and Simulation Data Richard Carlson – ASCR PM Richard.Carlson@science.doe.gov Joint Techs Winter 2012 Jan 24, 2012 Baton Rouge, LA

Advanced Scientific Computing Research- Program Office 2

DOE Facilities

DOE Science

Next-Generation Networks for Science Mission: The Goals of the program are 1) to research, develop, test and deploy advanced network technologies critical in addressing networking capabilities unique to DOE’s science mission and 2) identify scientific principles that lead to understanding about network and application behavior.  The program’s portfolio consists of two main elements: High-Performance Networks High-Performance Middleware DOE ESnet

Data Transfer Basics Time to transfer 1 TB on various networks 1 TB/hour uses ¼ of a 10 Gbps network 10 TB/hour uses ¼ of a 100 Gbps network 100 TB/hour uses ¼ of a 1 Tbps network Conversely a 1 Tbps network will move 10 PB/day Real-time aspects at 100 Gbps Voice (128B): 20.5 nsec/packet Jumbo frame Ethernet (9KB): 720 nsec/packet

CEDPS - SaaS Data Management 4.1 Gbps 1.6 Gbps Moving 322 TeraBytes of data from ANL to each remote site 7.34 Days to NERSC 18.56 Days to ORNL

Esnet – DOE’s R&D Network

DOE Distributed Science Complex

Challenges for Next-Gen Program Develop a fundamental understanding about how DOE scientists use networks and how those networks behave Provide scientists with advanced technologies that simplify access to experimental facilities, Supercomputers and scientific data Provide dynamic and hybrid networking capabilities to support diverse types of high-end science applications at scale.

Themes and Portfolio Directions Research Activities: Challenges: Network/Middleware Core Research: Fast data movement service 100 Gbps NICs Application performance analysis service Science driven on-demand circuits 100 GE LAN/MAN/WAN integration Comprehensive data mgt service Computational Science for ASCR Radical new network architecture/protocols Comprehensive scientific workflow services Scalable network – middleware architectures, protocols, and services Federated scientific collaborations 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 Effectively identifying performance bottlenecks Routine movement of terabyte datasets Understanding complex network infrastructures Extreme collaborations with 100K+ participants Risk-informed decision-making through modeling and simulation Creating hybrid networks Managing large collaboration space Emergent Area Research Multi-layer hybrid network control systems Multi-domain monitoring and measurement systems Grid infrastructures and data management services Massively parallel data streams Massive numbers of independent collaborations Middleware libraries and APIs for Large Systems ESnet Traffic 20 PB 100 PB 1 EB 10 EB 50 EB 100 Gbps 400 Gbps 1 Tbps 4 Tbps 10 Tbps ESnet Backbone Capacity Massive Data – from ESnet projected data traffic

Research Questions and Directions Predictable Develop networks, tools, and services that offer predictable performance to a user. Guaranteed Develop networks, tools, and services that guarantee some level of performance. Scientific Understanding Identify why the network or application behave in the observed manner. Advanced tools and services Tools and services to allow scientists to complete their tasks without worrying about the infrastructure.