1 The Future of the Internet: It’s About A New Services Architecture Randy H. Katz The United Microelectronics Corporation Distinguished Professor Computer Science Division, EECS Department University of California, Berkeley Berkeley, CA USA

2 Presentation Outline Convergence/Divergence, Uniformity/Diversity Computing “inside” the Network Services, Peering, and Overlays Summary and Conclusions

3 Presentation Outline Convergence/Divergence, Uniformity/Diversity Computing “inside” the Network Services, Peering, and Overlays Summary and Conclusions

4 Evolution of the Computer Eniac, 1947 Telephone, 1876 Computer + Modem 1957 Early Wireless Phones, 1978 First Color TV Broadcast, 1953 HBO Launched, 1972 Interactive TV, 1990 Handheld Portable Phones, 1990 First PC Altair, 1974 IBM PC, 1981 Apple Mac, 1984 Apple Powerbook, 1990 IBM Thinkpad, 1992 HP Palmtop, 1991 Apple Newton, 1993 Pentium PC, 1993 Red Herring, 10/99

5 Game Consoles Personal Digital Assistants Digital VCRs (TiVo, ReplayTV) Communicators Smart Telephones E-Toys (Furby, Aibo) Evolution of the Computer Pentium PC, 1993 Atari Home Pong, 1972 Apple iMac, 1998 Pentium II PC, 1997 Palm VII PDA, 1999 Network Computer, 1996 Free PC, 1999 Sega Dreamcast, 1999 Internet-enabled Smart Phones, 1999 Red Herring, 10/99 Proliferation of diverse end devices and access networks

6 Automobiles 663 Million Telephones 1.5 Billion Electronic Chips 30 Billion X-Internet “X-Internet” Beyond the PC Forrester Research, May Million 407 Million Internet Computers Internet Users Today’s Internet

7 “X-Internet” Beyond the PC Forrester Research, May 2001 Millions Year X Internet PC Internet

8 The Shape of Things NOW! Siemens SL45 –A cellular phone with voice command, voice dialing, intelligent text for short messages –An MP3 player & headset –A digital voice recorder –Supports “Mobile Internet” with a built-in WAP Browser –Can store »45 minutes of music »5 hours of voice notes »“Unlimited” addresses/phone numbers

9 The Shape of Things to Come Toyota Pod Concept Car –Co-designed with Sony –Detects driver’s skill level and adjust suspension –Detects driver’s mood (pulse rate, perspiration), compensates for road rage and incorporates a mood meter (happy vs. angry face) –Inter-pod wireless LAN to communicate intentions between vehicles, such as passing –Individual entertainment stations for each passenger

10 The iMode Story: It is About Services 27M Internet-capable cell phone sub- scribers (10/01); 50K iMode Web Sites World’s largest ISP, first to deploy 3G “Freedom of Multimedia Access” (FOMA) Not just about Japanese teenagers Applications UsedUser Ages Economist Magazine, 13 Oct 2001

11 After the PC … Not just about gadgets or access technologies About services and applications, and how the network can best support them Increasing, not decreasing, diversity Bottlenecks moving from core towards edge Enabled by computing embedded in communications fabric: wide-area, topology- aware, distributed computing

12 Presentation Outline Convergence/Divergence, Uniformity/Diversity Computing “inside” the Network Services, Peering, and Overlays Summary and Conclusions

13 ARPANet Evolves into Internet Web Hosting Multiple ISPs Internet2 Backbone Internet Exchanges Application Hosting ASP: Application Service Provider AIP: Application Infrastructure Provider (e-commerce tookit, etc.) ARPANet SATNet PRNet TCP/IPNSFNetDeregulation & Commercialization WWW ISP ASP AIP

14 Network “Cloud”

15 Regional Net Regional Nets + Backbone Regional Net Regional Net Regional Net Regional Net Regional Net Backbone LAN

16 ISP Backbones + NAPs + ISPs ISP Business ISP Consumer ISP LAN NAP Backbones Dial-up

17 Core Networks PacBell DSL Core Networks + Access Networks ISP Cingular Sprint AOL LAN NAP Dial-up DSL Always on NAP Cable Head Ends Cell Satellite Fixed Wireless

18 PacBell DSL Computers Inside the Core ISP Cingular Sprint AOL LAN NAP Dial-up DSL Always on NAP Cable Head Ends Cell Satellite Fixed Wireless

19 Interconnected World: Agile or Fragile? Baltimore Tunnel Fire 18 July 2001 –“… The fire also damaged fiber optic cables, slowing Internet service across the country, …” –“… Keynote Systems … says the July 19 Internet slowdown was not caused by the spreading of Code Red. Rather, a train wreck in a Baltimore tunnel that knocked out a major UUNet cable caused it.” –“PSINet, Verizon, WorldCom and AboveNet were some of the bigger communications companies reporting service problems related to ‘peering,’ methods used by Internet service providers to hand traffic off to others in the Web's infrastructure. Traffic slowdowns were also seen in Seattle, Los Angeles and Atlanta, possibly resulting from re-routing around the affected backbones.” –“The fire severed two OC-192 links between Vienna, VA and New York, NY as well as an OC-48 link from, D.C. to Chicago. … Metromedia routed traffic around the fiber break, relying heavily on switching centers in Chicago, Dallas, and D.C.”

20 Presentation Outline Convergence/Divergence, Uniformity/Diversity Computing “inside” the Network Services, Peering, and Overlays Summary and Conclusions

21 Services Within the Network: Content Distribution “Internet Grid” Parallel Network Backbones Internet Exchange Points Co-Location Scalable Servers Web Caches

22 Services Within the Network: Per-to-Per/Self-Organization... Madonna Like a Virgin Madonna Material Girl... Directory Service Register my copy Find me a copy Look here Grid computing: sharing resources/enabling collaboration

23 Services Within the Network: Streaming Media Clients Broadcasters Content Broadcast Management Platform and Tools Steve McCanne Edge Servers Load Balancing Thru Server Redirection; Content Broadcast Network Content Distribution Through Multicast Overlay Network Redirection Fabric Inter-ISP Redirection Peering

24 Scalable Services: Redirection and Load Balancing Redirection Delay + Load Information

25 Scalable Services: Denial of Service Redirection Black Hole

26 Transformation and Redirection IP Core PSTN Pager WLAN Cellular Network Cellular Network H.323 GW iPOP IAP Transducer Agent Redirection Agent

27 Cooperation and Peering 3G Spectrum Auctions: 150 billion ECU; Capital outlays may match spectrum expenses, all before first revenue New business models in Mobile Networks –Compelling services make the difference –Collaborate on deployment of physical network –Compete on provisioning of services Peering For More Than Connectivity –Horizontal architecture of services on top of networks –Virtual Home Environments –Relationships between operators, billing agents, service providers

28 Service-Level Peering Need common architecture for different vendors to create components and work with one another while still competing Some Observations –IP originally designed for cooperative administrative environments –BGP “recently” retrofitted to architecture to manage administrative relationships –How to design in managed peering from first principles? Solution Based on Redirection Above IP –Define the redirection architecture –New client/infrastructure protocol & API (a la DNS) –Do so in backward compatible way

29 Isolated multicast clouds Traditional unicast peering multicast cloud multicast cloud multicast cloud multicast cloud multicast cloud Application-Specific Overlays E.g., solve the multicast management and peering problems by moving up the protocol stack Steve McCanne

30 Application-Level Servers/Routers Solve the multicast management and peering problems by moving up the protocol stack Steve McCanne

31 The Existing Service Stack TCP service IP service Applications End Host Router Network Services End host Services End-to-end argument here Steve McCanne

32 DNS as an Overlay Service IP service Applications DNS End Host Overlay Router Network Services End host Services Infrastructure Services TCP service DNS stub Steve McCanne

33 Other Overlay Services TCP service IP service Cache Services Proxy Services Applications DNS End Host Overlay Router Network Services End host Services Infrastructure Services DNS stub Steve McCanne

34 From Overlay Services to Infrastructure Services IP service Cache Services Proxy Services Applications DNS redirection End Host Overlay Router Network Services End host Services Infrastructure Services TCP service DNS stub Steve McCanne

35 Services for Internet Content TCP service IP and Scoped IP Multicast Network Services End host Services Infrastructure Services BroadcastRedirection DNS stub Applications DNS End Host Overlay Router redirection stub Steve McCanne

36 Presentation Outline Convergence/Divergence, Uniformity/Diversity Computing “inside” the Network Services, Peering, and Overlays Summary and Conclusions

37 Global Packet Network Internetworking (Connectivity) ISP CLEC A New Kind of Internet Application-specific Overlay Networks (Multicast Tunnels, Mgmt Svrcs) Applications (Portals, E-Commerce, E-Tainment, Media) Application-specific Servers (Streaming Media, Transformation) ASP Internet Data Centers Appl Infrastructure Services (Distribution, Caching, Searching, Hosting) AIP ISV

38 Server and site availability Balanced server and site load Rapid change Network and application flexibility Scalability Complex site administration From Network Management to Service Management Server Load Balancing Rapid problem diagnosis/ isolation Service level measurement Multi-tier resource monitoring Preferential Services Resource Provisioning Self-tuning Problem prevention Chris Morino, Resonate

39 Network Failure 18.2% ISP connection down LAN segment overloaded Service Reliability is Critical Systems Server Failure 20% OS Failure 24.6% CPU overloaded NIC failure Administration 8.7% Applications Failure 28.5% Process hung Slowed database performance Source: IDC Chris Morino, Resonate

40 Reference Architecture Path Provider (ISP Cloud) Server Center Provider Perf Measurement Service Service Placement Service SLAsVerify Path BrokerServer Broker Server Registration Advertisement Registration Service Registration Service Redirection Distributed Application Pricing Service Constraint Specification Adapt Marshal Resources Based on Economic Constraints

41 Observations and Challenges “Quality of Service” –Quality depends on services in the network –Manage caches, redistributors, latency –24-7 utility functionality Network Issues –Not b/w: Tier 1 ISP 192 (9.6 gbs!), 30% utilization –Bottlenecks: at peering points and access networks –Lacking: rapid response to failures Supporting Old Services in the New Internet –Overlay services: IP Multicast, DNS, … –Rethinking the End-to-End Principle –Service/content-level peering, just like routing-level peering –Managed peering and security relationships in service provisioning

42 Wireless Internet Might Be Different Than Wired Internet Wireless is a smarter pipe –Location-awareness –UI dictates need for personalization, mediation Clear billing authority: it’s the access provider –People actually do pay for transport –Reverse billing allows content provider to charge for service Peering as a necessity –Operators provide local service –Roaming agreements provide basis for service peering –Well understood arrangements for settlements –New economies driving towards shared network deployment Person-to-Person communications is a killer app Microsoft’s non-monopoly

43 Future of the Internet Huge diversity of interconnected devices Bottlenecks move towards the edges Services spanning access networks, to achieve high performance/manage device diversity Builds on the New Internet –Opening up of the connectivity “cloud” –Embedding computing in the communications fabric –Managed peering of services –Separation of services from connectivity via overlays Pervasive support for “intelligent” services –Near you for faster access, more personalized, more localized –Scalable to deal with surges in demand as needed