Cyberinfrastructure and Internet2 Eric Boyd Deputy Technology Officer Internet2

What is Cyberinfrastructure (CI)? A strategic orientation supported by NSF Calls for large-scale public investment to encourage the evolution of widely distributed computing via the telecommunications network Goal is to deploy the combined capacity of multiple sites to support the advance of current research, initially in science and engineering

General Session Thursday: Cyberinfrastructure: The Way Forward Francine Berman, San Diego Supercomputer Center, Moderator Paul Avery, University of Florida Thomas Knab, Case Western Reserve University Alan Whitney, MIT Haystack Observatory Eric Boyd, Internet2

The Distributed CI Computer Instrumentation Security Control Data Generation Human Support Training Researcher Control Program Viewing Security Help Desk Education And Outreach Collab Tools Publishing Policy and Funding Resource Providers Agencies Campuses Management Security and Access Authentication Control Authorization 3D Imaging Display and Visualization . Display Tools Security Data Input Behind all the functions is the Network. The Network is the backplane for the Distributed CI Computer Search Data Sets Storage Security Retrieval Input Schema Metadata Data Directories Ontologies Archive Computation Analysis Simulation Program Security Network 4

The Network is the Backplane for the Distributed CI Computer Instrumentation Security Control Data Generation Human Support Training Researcher Control Program Viewing Security Help Desk Education And Outreach Collab Tools Publishing Policy and Funding Resource Providers Agencies Campuses Management Security and Access Authentication Control Authorization 3D Imaging Display and Visualization . Display Tools Security Data Input Behind all the functions is the Network. The Network is the backplane for the Distributed CI Computer Search Data Sets Storage Security Retrieval Input Schema Metadata Data Directories Ontologies Archive Computation Analysis Simulation Program Security Network 5

Challenge and Opportunity The R&E community thinks of CI primarily in terms of building distributed computing clusters Opportunity: The network is a key component of CI Internet2 is leading the development of solutions for the network component of CI

Robust campus infrastructure Security and Authorization CI Requirements Data storage Robust campus infrastructure Security and Authorization IT support for local and remote resources Network performance monitoring tools Network resources to meet demand spikes 7 7

LHC epitomizes the CI Challenge 8

Large Hadron Collider (LHC) at CERN will go operational in 2008 Current Situation Large Hadron Collider (LHC) at CERN will go operational in 2008 Over 68 U.S. Universities and National Laboratories are poised to receive data More than 1500 scientists are waiting for this data Are campus, regional, and national networks ready for the task? 9 9

CERN Tier 0 Raw Data 10 10

US Tier 4 (1500 US scientists) Scientists Analyze Data US Tier 3 (68 orgs) Scientists Request Data CMS (7) Atlas (6-7) US Tier 2 (15 orgs) Provides Data to Tier 3 FNAL BNL Shared Data Storage and Reduction Tier 1 (12 orgs) Tier 4 represents an estimated 1500 US scientists or 6000 worldwide CERN Tier 0 Raw Data 11 11

GEANT-ESNet-Internet2 Local Infrastructure US Tier 4 (1500 US scientists) Scientists Analyze Data US Tier 3 (68 orgs) Scientists Request Data Internet2/Connectors Internet2/Connectors CMS (7) Atlas (6-7) US Tier 2 (15 orgs) Provides Data to Tier 3 GEANT-ESNet-Internet2 FNAL BNL Shared Data Storage and Reduction Tier 1 (12 orgs) This is the final build including local networking LHCOPN CERN Tier 0 Raw Data 12 12

GEANT-ESNet-Internet2 Peak Flow Network Requirements Local Infrastructure Tier 1 or 2 to Tier 3: Estimate: Requires 1.6 Gbps per transfer (2 TB's in 3 hours) Internet2/Connectors Internet2/Connectors Tier 1 to Tier 2: Requires 10-20 Gbps GEANT-ESNet-Internet2 Network usage requirements. Tier 2 to Tier 3: Requires 1.6 Gbps per transfer (2 TB's in 3 hours).  Please note that transfers will occur on a regular basis. Tier 0 to Tier1: Requires 10-40 Gbps LHCOPN CERN 13 13

Traffic Characteristics Science Network Requirements Aggregation Summary (slide courtesy of ESNet) Science Drivers Science Areas / Facilities End2End Reliability Connectivity 2006 End2End Band width 2010 End2End Band width Traffic Characteristics Network Services Advanced Light Source - DOE sites US Universities Industry 1 TB/day 300 Mbps 5 TB/day 1.5 Gbps Bulk data Remote control Guaranteed bandwidth PKI / Grid Bioinformatics 625 Mbps 12.5 Gbps in two years 250 Gbps Point-to-multipoint High-speed multicast Chemistry / Combustion 10s of Gigabits per second Climate Science International 5 PB per year 5 Gbps High Energy Physics (LHC) 99.95+% (Less than 4 hrs/year) US Tier1 (DOE) US Tier2 (Universities) International (Europe, Canada) 10 Gbps 60 to 80 Gbps (30-40 Gbps per US Tier1) Traffic isolation 14

Traffic Characteristics Science Network Requirements Aggregation Summary (slide courtesy of ESNet) Science Drivers Science Areas / Facilities End2End Reliability Connectivity 2006 End2End Band width 2010 End2End Band width Traffic Characteristics Network Services Magnetic Fusion Energy 99.999% (Impossible without full redundancy) DOE sites US Universities Industry 200+ Mbps 1 Gbps Bulk data Remote control Guaranteed bandwidth Guaranteed QoS Deadline scheduling NERSC - International 10 Gbps 20 to 40 Gbps Deadline Scheduling PKI / Grid NLCF Backbone Band width parity Backbone band width parity Nuclear Physics (RHIC) 12 Gbps 70 Gbps Spallation Neutron Source High (24x7 operation) 640 Mbps 2 Gbps 15

CI Components Bulk Transport 2-Way Interactive Video Applications …. Real-Time Communications …. Applications call on Network Cyberinfrastructure Phoebus …. …. …. Network Cyberinfrastructure Performance Infrastructure / Tools Middleware Control Plane Middleware (Federated Trust) = Shibboleth, Grouper, Signet Performance Framework = perfSONAR Performance Tools = BWCTL, NDT, OWAMP Control Plane = Dragon Library = Pheobus Measurement Nodes Network Control Plane Nodes 16

Internet2 Network CI Software Dynamic Circuit Control Infrastructure DRAGON (with ISI, MAX) Oscars (with ESnet) Middleware (Federated trust Infrastructure) Shibboleth Signet Grouper Comanage Performance Monitoring Infrastructure perfSONAR (with ESnet, GEANT2 JRA1, RNP, many others) BWCTL, NDT, OWAMP, Thrulay Distributed System Infrastructure Topology Service (with University of Delaware) Distributed Lookup Service (with University of Delaware, PSNC)

Internet2 Network CI Standardization Dynamic Circuit Control Protocol (IDC) DICE-Control, GLIF Measurement Schema / Protocol OGF NMWG IETF IPPM perfSONAR Consortium Middleware Arena Liberty Alliance OASIS Possible emerging corporate consortium Topology Schema / Protocol OGF NML-WG DICE-Control

Internet2’s CI Vision Internet2’s CI vision: Be a networking cyber-service provider Be a trust cyber-service provider Be a CI technology developer.

Internet2’s CI Position Internet2’s position: Backbone network provider Federated trust infrastructure provider Forum for collaboration by members of the R&E community Gives Internet2 a unique vision and strategy for Cyberinfrastructure.

Internet2’s CI Definition Components Supercomputing / Cycles / Computational Supercomputing / Storage (Non-volatile) Analysis / Visualization Interconnecting Networks (Campuses, Regionals, Backbones) Network Cyberinfrastructure Software

Internet2’s CI Audience Application Software Instrumentation / Remote Instruments / Sensors Data Sets

Internet2’s CI Constituencies Collaborators University Members Regional Networks Regional CI Organizations High Performance Computing Centers Federal Partners International Partners CI Integrators EXAMPLES Collaborators: Teragrid, Open Science Grid University Members: Discipline group researchers (e.g. LHC, eVLBI), IT Organizations Regional CI Organizations: NYS Grid CI Integrators: Teragrid

Early Thoughts: Internet2’s CI Strategy (1) Requirements Informed by our membership Agenda set by our governance mechanisms Offer, and in some cases develop, services and technology that are key components of a coherent CI software suite. For CI to work, it has to be a workable end-to-end system; Internet2 is emphasizing a systems approach towards CI. Internet2 is offering new services such as the Internet2 Network, InCommon, and the VO Service Center. Internet2 is developing and offering new technologies such as GridShib and perfSONAR. Internet2 may do systems integration work assembling open source communication tools into a common veneer.

Early Thoughts: Internet2’s CI Strategy (2) Play the role of community CI coordinator, convening community conversations. Partner with other community coordinators (e.g. Teragrid, EDUCAUSE). Play a convening function in order to facilitate the development, use, and dissemination of CI (e.g. Bridging the Gap workshop). Take a lead in international outreach efforts at several different layers of CI. Work with campuses to build valuable CI. Facilitate conversations among various federal agencies (e.g. DOE, NSF, NIH), each of which is developing its own CI, and present a consistent vision back to the campuses.

Internet2’s CI Tactics Target campus, national, and international audiences Integrate campus CI into regional national/international CI Target Application-community CI (quasi-national) Enable effective use of authorized resources, regardless of where they exist Enable integration of new resources as they become available Facilitate interoperability of multiple, autonomous CI providers Take a “toolkit” approach Make sure it still looks like a wall jack to end user Push for best practices for campuses What to do How to do it Community learns as a whole / avoid reinventing the wheel Contribute to the support structure for use of CI Open source CI software Centers of Excellence for various kinds of things Training)

Questions? Eric Boyd eboyd@internet2.edu