Scalable Bandwidth on Demand: A New Model for the Era of Entitlement? Educause Mid-Atlantic Regional Conference January 17, 2003 Gregory D. Palmer Jennifer MacDougall

Copyright Gregory D. Palmer/Jennifer MacDougall This work is the intellectual property of the authors. Permission is granted for this material to be shared for non- commercial, educational purposes, provided that this copyright statement appears on the reproduced materials and notice is given that the copying is by permission of the authors. To disseminate otherwise or to republish requires written permission from the authors.

Topics For Today 1. An Overview of the MAGPI GigaPoP 2. Problem: Matching the transport to the Payload 3. University of Pennsylvania Beta Site 4. Importance to other institutions 5. Future implications 6. Q & A

MAGPI Overview - Vision Striving to serve the needs of the research and education communities Striving to serve the needs of the research and education communities –Enabling Applications –Responsive to the Community’s Needs –Proactively Introducing Technology –Creatively Deploying Solutions –Innovative Financial Models –Self Sustaining Over the Long Term

MAGPI Overview - Staffing Two employees dedicated to MAGPI Two employees dedicated to MAGPI –Administrative –Applications Penn ISC Networking & Telecommunications Penn ISC Networking & Telecommunications –Engineering –Network Operations Center –Budget Coordination

MAGPI Overview - Topology

How to meet the growing bandwidth requirements of the research community efficiently and cost effectively. Problem Statement:

Have you ever heard… “I need ……. TOMORROW!” “My grant requires………….” “But my NSF demo is in two weeks!” “There is no line item for telecom in my budget” “But the University should pay for this!”

Offsetting Market Trends IT Budgets Infrastructure New Technology Bandwidth Costs $ $ $ $ $$$

Efficiency… (or lack of )

Challenge: Most Efficient, Cost-Effective Path Researcher AResearcher B ?

Challenge: The WAN Connectivity Expense Researcher A Researcher B Campus Network Cross-Campus Regional National International $$$ WANs $$$

Problem Summary Research and education will require increasing amounts of bandwidth in an un-sustained manner Research and education will require increasing amounts of bandwidth in an un-sustained manner It is neither efficient nor cost-effective to create independent WAN connections It is neither efficient nor cost-effective to create independent WAN connections A general lack of flexibility from the vendor/providers A general lack of flexibility from the vendor/providers

Match the Transport to the Payload

A Solution in Beta Testing NTII – National TeleImmersion Initiative NTII – National TeleImmersion Initiative –3D Videoconferencing between UNC Chapel Hill and the Univ of Penn –Have accomplished data streams of 700 Mbps –Pittsburgh SuperComputing Center used for interim processing –Experiments in progress 30 days per year –Normal traffic is < 3Mbps

3-D Videoconferencing TeleImmersion TeleImmersion Penn->PSC->UNC Penn->PSC->UNC 300 to 700 Mbps 300 to 700 Mbps

Network Infrastructure High density Ethernet switch with 100 Mbps ports and Gig-E uplink interface High density Ethernet switch with 100 Mbps ports and Gig-E uplink interface Single mode fiber to the campus router that also has the Internet2 link Single mode fiber to the campus router that also has the Internet2 link Yipes! provided scalable Gig-E WAN link to MAGPI routing core Yipes! provided scalable Gig-E WAN link to MAGPI routing core Yipes! provided web interface to control rate limits on a Gig-E circuit Yipes! provided web interface to control rate limits on a Gig-E circuit

Connection Diagram

The Process Researcher sends an request to the MAGPI NOC for the amount of additional bandwidth and the required date Researcher sends an request to the MAGPI NOC for the amount of additional bandwidth and the required date A confirmation is returned by a technician and the event is scheduled through a standard work order A confirmation is returned by a technician and the event is scheduled through a standard work order Through the Yipes! Web interface, bandwidth is increased the evening before the event Through the Yipes! Web interface, bandwidth is increased the evening before the event

The Process 24 hours later, the NOC technician returns the bandwidth to normal 24 hours later, the NOC technician returns the bandwidth to normal A copy of the work order is sent to MAGPI with the date, amount of bandwidth, and duration of the event A copy of the work order is sent to MAGPI with the date, amount of bandwidth, and duration of the event Researcher is invoiced Researcher is invoiced

Financial Aspects Building to Building infrastructure upgrades are a University function Building to Building infrastructure upgrades are a University function Equipment at the laboratory end are the responsibility of the researcher Equipment at the laboratory end are the responsibility of the researcher Risers, fiber, wallplates are the school, researcher’s responsibility Risers, fiber, wallplates are the school, researcher’s responsibility Router, interface cards are a joint responsibility Router, interface cards are a joint responsibility

Financial Aspects Cost Components Cost Components –NOC technicians 40 minutes per event 40 minutes per event –YIPES! Scalable WAN service $1.00/Mb/day $1.00/Mb/day –GigaPoP Bandwidth availability $ 1.65/Mb/day (minimum) $ 1.65/Mb/day (minimum) –Grant Telecom Costs $ 2.65/Mb/day $ 2.65/Mb/day

Comparative Costs – 300 Mbps OC12 Direct OC12 Direct –$ 270,000 – Abilene –$ 24,000 – Qwest –$ 60,000 – loop chg __________________ –$ 354,000 – Basic Tot –Not Included Equipment Equipment Staff Staff OC12 Shared (30 events) OC12 Shared (30 events) –$ 23,850 – GigaPoP –$ 9,000 – YIPES! _____________________ –$ 32,850 – Operations –Not included Infrastructure Builds Equipment

Efficiency - Revisited

Outcomes High end research is appropriately supported High end research is appropriately supported Campus networking costs maintained Campus networking costs maintained Cost-recovery budget models reinforced Cost-recovery budget models reinforced Needs met on a usage basis–not paying for idle, unused bandwidth Needs met on a usage basis–not paying for idle, unused bandwidth Baseline bandwidth expectation is set (10 Mbps) Baseline bandwidth expectation is set (10 Mbps)

Importance to Others Within the region Within the region –GigaPoP efficiency in bandwidth allocation To the University To the University –Research enabling –Cost sharing To the research community To the research community –Bandwidth as needed –Affordable

Subjective Benefits Builds trusted relationships Builds trusted relationships –Research and central IT –University IT and the GigaPoP –IT, GigaPoP, and the vendor/provider Sets appropriate expectation levels Sets appropriate expectation levels –Between research, central IT, and the University

Future GigaPoP Services Vendor negotiated scalable uplinks for Institutions needing “on demand” bandwidth Vendor negotiated scalable uplinks for Institutions needing “on demand” bandwidth Scheduling services to prevent conflicts between applications Scheduling services to prevent conflicts between applications Internal research to determine applicability of DWDM implementation Internal research to determine applicability of DWDM implementation

Thank You – Q&A Greg Palmer Greg Palmer Jennifer MacDougall Jennifer MacDougall