1. DOE Facilities - Drivers for Science: Experimental and Simulation Data
Richard Carlson – ASCR PM
Joint Techs Winter 2012
Jan 24, 2012
Baton Rouge, LA

2. Advanced Scientific Computing Research- Program Office2

3. DOE Facilities

4. DOE Science

5. Next-Generation Networks for Science
Mission:
The Goals of the program are 1) to research, develop, test and deploy advanced network technologies critical in addressing networking capabilities unique to DOE’s science mission and 2) identify scientific principles that lead to understanding about network and application behavior.  The program’s portfolio consists of two main elements:
High-Performance Networks
High-Performance Middleware
DOE ESnet

6. Data Transfer Basics Time to transfer 1 TB on various networks
1 TB/hour uses ¼ of a 10 Gbps network
10 TB/hour uses ¼ of a 100 Gbps network
100 TB/hour uses ¼ of a 1 Tbps network
Conversely a 1 Tbps network will move 10 PB/day
Real-time aspects at 100 Gbps
Voice (128B): 20.5 nsec/packet
Jumbo frame Ethernet (9KB): 720 nsec/packet

7. CEDPS - SaaS Data Management
4.1 Gbps
1.6 Gbps
Moving 322 TeraBytes of data from ANL to each remote site
7.34 Days to NERSC
18.56 Days to ORNL

8. Esnet – DOE’s R&D Network

9. DOE Distributed Science Complex

10. Challenges for Next-Gen Program
Develop a fundamental understanding about how DOE scientists use networks and how those networks behave
Provide scientists with advanced technologies that simplify access to experimental facilities, Supercomputers and scientific data
Provide dynamic and hybrid networking capabilities to support diverse types of high-end science applications at scale.

11. Themes and Portfolio Directions
Research Activities:
Challenges:
Network/Middleware Core Research:
Fast data movement service
100 Gbps NICs
Application performance analysis service
Science driven on-demand circuits
100 GE LAN/MAN/WAN integration
Comprehensive data mgt service
Computational Science for ASCR
Radical new network architecture/protocols
Comprehensive scientific workflow
services
Scalable network – middleware architectures, protocols, and services
Federated scientific collaborations 07 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25
Effectively identifying performance bottlenecks
Routine movement of terabyte datasets
Understanding complex network infrastructures
Extreme collaborations with 100K+ participants
Risk-informed decision-making through modeling and simulation
Creating hybrid networks
Managing large collaboration space
Emergent Area Research
Multi-layer hybrid network control systems
Multi-domain monitoring and measurement systems
Grid infrastructures and data management services
Massively parallel data streams
Massive numbers of independent collaborations
Middleware libraries and APIs for Large Systems
ESnet Traffic
20 PB
100 PB
1 EB
10 EB
50 EB
100 Gbps
400 Gbps
1 Tbps
4 Tbps
10 Tbps
ESnet Backbone Capacity
Massive Data – from ESnet projected data traffic

12. Research Questions and Directions
Predictable
Develop networks, tools, and services that offer predictable performance to a user.
Guaranteed
Develop networks, tools, and services that guarantee some level of performance.
Scientific Understanding
Identify why the network or application behave in the observed manner.
Advanced tools and services
Tools and services to allow scientists to complete their tasks without worrying about the infrastructure.