1. Cyberinfrastructure and Internet2
Eric Boyd Deputy Technology Officer
Internet2

2. What is Cyberinfrastructure (CI)?
A strategic orientation supported by NSF
Calls for large-scale public investment to encourage the evolution of widely distributed computing via the telecommunications network
Goal is to deploy the combined capacity of multiple sites to support the advance of current research, initially in science and engineering

3. General Session Thursday: Cyberinfrastructure: The Way Forward
Francine Berman, San Diego Supercomputer Center, Moderator
Paul Avery, University of Florida
Thomas Knab, Case Western Reserve University
Alan Whitney, MIT Haystack Observatory
Eric Boyd, Internet2

4. The Distributed CI Computer
Instrumentation
Security
Control
Data
Generation
Human
Support
Training
Researcher
Control
Program
Viewing
Security
Help
Desk
Education
And
Outreach
Collab
Tools
Publishing
Policy and
Funding
Resource
Providers
Agencies
Campuses
Management
Security and
Access
Authentication
Control
Authorization 3D
Imaging
Display and
Visualization .
Display
Tools
Security
Data
Input
Behind all the functions is the Network. The Network is the backplane for the Distributed CI Computer
Search
Data Sets
Storage
Security
Retrieval
Input
Schema
Metadata
Data
Directories
Ontologies
Archive
Computation
Analysis
Simulation
Program
Security
Network 4

5. The Network is the Backplane for the Distributed CI Computer
Instrumentation
Security
Control
Data
Generation
Human
Support
Training
Researcher
Control
Program
Viewing
Security
Help
Desk
Education
And
Outreach
Collab
Tools
Publishing
Policy and
Funding
Resource
Providers
Agencies
Campuses
Management
Security and
Access
Authentication
Control
Authorization 3D
Imaging
Display and
Visualization .
Display
Tools
Security
Data
Input
Behind all the functions is the Network. The Network is the backplane for the Distributed CI Computer
Search
Data Sets
Storage
Security
Retrieval
Input
Schema
Metadata
Data
Directories
Ontologies
Archive
Computation
Analysis
Simulation
Program
Security
Network 5

6. Challenge and Opportunity
The R&E community thinks of CI primarily in terms of building distributed computing clusters
Opportunity:
The network is a key component of CI
Internet2 is leading the development of solutions for the network component of CI

7. Robust campus infrastructure Security and Authorization
CI Requirements
Data storage
Robust campus infrastructure
Security and Authorization
IT support for local and remote resources
Network performance monitoring tools
Network resources to meet demand spikes 7 7

8. LHC epitomizes the CI Challenge8

9. Large Hadron Collider (LHC) at CERN will go operational in 2008
Current Situation
Large Hadron Collider (LHC) at CERN will go operational in 2008
Over 68 U.S. Universities and National Laboratories are poised to receive data
More than 1500 scientists are waiting for this data
Are campus, regional, and national networks ready for the task? 9 9

10. CERN
Tier 0
Raw Data 10 10

11. US Tier 4 (1500 US scientists) Scientists Analyze Data
US Tier 3 (68 orgs)
Scientists Request Data
CMS (7)
Atlas (6-7)
US Tier 2 (15 orgs)
Provides Data to
Tier 3
FNAL
BNL
Shared Data Storage and Reduction
Tier 1 (12 orgs)
Tier 4 represents an estimated 1500 US scientists or 6000 worldwide
CERN
Tier 0
Raw Data 11 11

12. GEANT-ESNet-Internet2
Local Infrastructure
US Tier 4 (1500 US scientists)
Scientists Analyze Data
US Tier 3 (68 orgs)
Scientists Request Data
Internet2/Connectors
Internet2/Connectors
CMS (7)
Atlas (6-7)
US Tier 2 (15 orgs)
Provides Data to
Tier 3
GEANT-ESNet-Internet2
FNAL
BNL
Shared Data Storage and Reduction
Tier 1 (12 orgs)
This is the final build including local networking
LHCOPN
CERN
Tier 0
Raw Data 12 12

13. GEANT-ESNet-Internet2
Peak Flow Network Requirements
Local Infrastructure
Tier 1 or 2 to Tier 3: Estimate: Requires 1.6 Gbps per transfer (2 TB's in 3 hours)
Internet2/Connectors
Internet2/Connectors
Tier 1 to Tier 2: Requires Gbps
GEANT-ESNet-Internet2
Network usage requirements. Tier 2 to Tier 3: Requires 1.6 Gbps per transfer (2 TB's in 3 hours).  Please note that transfers will occur on a regular basis.
Tier 0 to Tier1: Requires Gbps
LHCOPN
CERN 13 13

14. Traffic Characteristics
Science Network Requirements Aggregation Summary (slide courtesy of ESNet)
Science Drivers
Science Areas / Facilities
End2End Reliability
Connectivity
2006 End2End Band width
2010 End2End Band width
Traffic Characteristics
Network Services
Advanced Light Source -
DOE sites
US Universities
Industry
1 TB/day
300 Mbps
5 TB/day
1.5 Gbps
Bulk data
Remote control
Guaranteed bandwidth
PKI / Grid
Bioinformatics
625 Mbps
12.5 Gbps in two years
250 Gbps
Point-to-multipoint
High-speed multicast
Chemistry / Combustion
10s of Gigabits per second
Climate Science
International
5 PB per year
5 Gbps
High Energy Physics (LHC)
99.95+%
(Less than 4 hrs/year)
US Tier1 (DOE)
US Tier2 (Universities)
International (Europe, Canada)
10 Gbps
60 to 80 Gbps
(30-40 Gbps per US Tier1)
Traffic isolation 14

15. Traffic Characteristics
Science Network Requirements Aggregation Summary (slide courtesy of ESNet)
Science Drivers
Science Areas / Facilities
End2End Reliability
Connectivity
2006 End2End Band width
2010 End2End Band width
Traffic Characteristics
Network Services
Magnetic Fusion Energy
99.999%
(Impossible without full redundancy)
DOE sites
US Universities
Industry
200+ Mbps
1 Gbps
Bulk data
Remote control
Guaranteed bandwidth
Guaranteed QoS
Deadline scheduling
NERSC -
International
10 Gbps
20 to 40 Gbps
Deadline Scheduling
PKI / Grid
NLCF
Backbone Band width parity
Backbone band width parity
Nuclear Physics (RHIC)
12 Gbps
70 Gbps
Spallation Neutron Source
High
(24x7 operation)
640 Mbps
2 Gbps 15

16. CI Components Bulk Transport 2-Way Interactive Video Applications ….
Real-Time Communications ….
Applications call on Network Cyberinfrastructure
Phoebus …. …. ….
Network Cyberinfrastructure
Performance Infrastructure / Tools
Middleware
Control Plane
Middleware (Federated Trust) = Shibboleth, Grouper, Signet
Performance Framework = perfSONAR
Performance Tools = BWCTL, NDT, OWAMP
Control Plane = Dragon
Library = Pheobus
Measurement Nodes
Network
Control Plane Nodes 16

17. Internet2 Network CI Software
Dynamic Circuit Control Infrastructure
DRAGON (with ISI, MAX)
Oscars (with ESnet)
Middleware (Federated trust Infrastructure)
Shibboleth
Signet
Grouper
Comanage
Performance Monitoring Infrastructure
perfSONAR (with ESnet, GEANT2 JRA1, RNP, many others)
BWCTL, NDT, OWAMP, Thrulay
Distributed System Infrastructure
Topology Service (with University of Delaware)
Distributed Lookup Service (with University of Delaware, PSNC)

18. Internet2 Network CI Standardization
Dynamic Circuit Control Protocol (IDC)
DICE-Control, GLIF
Measurement Schema / Protocol
OGF NMWG
IETF IPPM
perfSONAR Consortium
Middleware Arena
Liberty Alliance
OASIS
Possible emerging corporate consortium
Topology Schema / Protocol
OGF NML-WG
DICE-Control

34. Internet2’s CI Vision Internet2’s CI vision:
Be a networking cyber-service provider
Be a trust cyber-service provider
Be a CI technology developer.

35. Internet2’s CI Position
Internet2’s position:
Backbone network provider
Federated trust infrastructure provider
Forum for collaboration by members of the R&E community
Gives Internet2 a unique vision and strategy for Cyberinfrastructure.

36. Internet2’s CI Definition
Components
Supercomputing / Cycles / Computational
Supercomputing / Storage (Non-volatile)
Analysis / Visualization
Interconnecting Networks (Campuses, Regionals, Backbones)
Network Cyberinfrastructure Software

37. Internet2’s CI Audience
Application Software
Instrumentation / Remote Instruments / Sensors
Data Sets

38. Internet2’s CI Constituencies
Collaborators
University Members
Regional Networks
Regional CI Organizations
High Performance Computing Centers
Federal Partners
International Partners
CI Integrators
EXAMPLES
Collaborators: Teragrid, Open Science Grid
University Members: Discipline group researchers (e.g. LHC, eVLBI), IT Organizations
Regional CI Organizations: NYS Grid
CI Integrators: Teragrid

39. Early Thoughts: Internet2’s CI Strategy (1)
Requirements
Informed by our membership
Agenda set by our governance mechanisms
Offer, and in some cases develop, services and technology that are key components of a coherent CI software suite.
For CI to work, it has to be a workable end-to-end system; Internet2 is emphasizing a systems approach towards CI.
Internet2 is offering new services such as the Internet2 Network, InCommon, and the VO Service Center.
Internet2 is developing and offering new technologies such as GridShib and perfSONAR.
Internet2 may do systems integration work assembling open source communication tools into a common veneer.

40. Early Thoughts: Internet2’s CI Strategy (2)
Play the role of community CI coordinator, convening community conversations.
Partner with other community coordinators (e.g. Teragrid, EDUCAUSE).
Play a convening function in order to facilitate the development, use, and dissemination of CI (e.g. Bridging the Gap workshop).
Take a lead in international outreach efforts at several different layers of CI.
Work with campuses to build valuable CI.
Facilitate conversations among various federal agencies (e.g. DOE, NSF, NIH), each of which is developing its own CI, and present a consistent vision back to the campuses.

41. Internet2’s CI Tactics
Target campus, national, and international audiences
Integrate campus CI into regional national/international CI
Target Application-community CI (quasi-national)
Enable effective use of authorized resources, regardless of where they exist
Enable integration of new resources as they become available
Facilitate interoperability of multiple, autonomous CI providers
Take a “toolkit” approach
Make sure it still looks like a wall jack to end user
Push for best practices for campuses
What to do
How to do it
Community learns as a whole / avoid reinventing the wheel
Contribute to the support structure for use of CI
Open source CI software
Centers of Excellence for various kinds of things
Training)

42. Questions?
Eric Boyd