1. June 1999 www.canarie.ca www.canet3.net Bernard Turcotte Director Special projects TURCOTTE@canarie.ca “Canada’s National Optical Internet”

2. Background: Yesterday  Telcos: What is the Internet anyway?  If you want a real network use X.25!  You will never need anything faster that DS3!  Commercial institutions will NEVER use the Internet because it can NEVER be secure.  Home users will NEVER be able to understand IP

3. Background: Today  World’s largest bookstore is Amazon.com  Most major banks offer Internet based services  Major retailers all offer Internet based shopping  Transmission speed limitations are starting to fade  Basic Internet usage is thought in grade school  Telework is becoming a reality

4. Background: Tomorrow  IP telephony will be common and will fundamentally alter the business model for carriers  MP3 is becoming a defacto standard for music and will fundamentally alter the business model for recording and distribution houses.  MPEG2 is the standard for digital video and will fundamentally alter the business model for the film, video, television, cable and satellite industries  Telework, telelearning and telehealth will become commonplace.

5.  Mission: To facilitate the development of Canada’s communications infrastructure and stimulate next generation products, applications and services  Canadian equivalent to Internet 2 and NGI  private-sector led, not-for-profit consortium  consortium formed 1993  federal funding of $104.5 M (1993-99)  total project costs estimated over $500 M  currently over 140 members; 21 Board members  Phase III funding to be announced 1998-2001  $55 million announced for Optical Internet -March 1998 CANARIE Inc

6. CA*net II 2xOC3 GigaPOP T3 + OC3 to US OC3 to Europe CA*net 2 Network Vancouver Calgary Regina Winnipeg Windsor Ottawa Montreal Toronto Halifax St. John’s Fredericton Charlottetown RAN BCnet WURCnet SRnet MRnet ONet RISQ ACORN OC3 DS3 OC12 OC12 - OC3 OC48 DS3

7. ARDNOC  to provide traditional NOC as well as advanced network services support to the CA*net II/3 user (R&E) community.  to facilitate and coordinate development, testing and deployment of next generation Internet networks, applications and services between CA*net II users as well as international R&E users  to explore, modify, test and deploy new services, tools, and techniques that could be required in future commercial NOCs  to document and disseminate knowledge

8. The Year in Review  13 GigaPOPs up and running  over 30 universities and research institutes connected  Over 20 Demos of advanced applications  about half between Europe and North America  Several “persistent” high performance applications e.g.  NRC BioInformatics  Callisto video server  ARDNOC up and running with 8 staff  Qbone about to start in 5 sites

9. The Year in Review  Still some problems with ATM switches and SVCs  MBGP multicast now working  Native IPv6 network up and running  Hierarchical Cache now working with 5 GigaPOPs & 12 universities  Stats & Measurements - Surveryor and OC3mon working  Peering with 5 international next gen Internets - 12 more expected next year  Close collaboration with Internet 2, NSF and NGI

10. CA*net 3 Objectives  In partnership with industry, universities and research community carry out R&D in optical Internet technologies, services and applications  To showcase different Canadian technologies, applications and services - Cambrian, PMC Sierra, Newbridge, etc  To facilitate a partnership between industry, carriers, RAN’s and R&E community in order to accelerate the deployment of next generation Internet products and services; and  To catalyze the building of a sustainable virtual high performance R&E network

11. 1999 Program  Network to be fully deployed 1st quarter  2 x OC-48 wavelengths with POS - 5 Gbps  Layer 3 restoral & route diversity provided by CA*net 2 (IP over ATM) running in parallel  Fast restoral and explicit routing with MPLS  Optical Internet Exchange - 3rd quarter  Gigabit Ethernet over WDM in metro - 1st quarter  10xGbE on additional wavelengths- 3rd quarter  Cut through wavelengths - 4th quarter  Use of both sides of fiber ring with layer 3 restoral - 4th quarter  Several Schoolnet Caching Pilots underway - 2nd quarter  High Speed Video Delivery - 3rd quarter  Advanced route diversity - 1st qtr 2000

12. GigaPOP CA*net 3 National Optical Network Vancouver Calgary Regina Winnipeg Ottawa Montreal Toronto Halifax St. John’s Fredericton Charlottetown RAN BCnet WURCnet SRnet MRnet ONet RISQ ACORN OC3 DS3 OC12 OC48 Chicago STAR TAP CA*net 3 OC12 Teleglobe Seattle New York

13. National IP/WDM Network Ottawa Montreal Toronto Winnipeg ReginaCalgary Edmonton Vancouver Saskatoon - CANARIE Drop Site Halifax Fredericton Chicago CANARIE OC-192 Route CANARIE OC-48 Route Charlettown St. John’s Teleglobe 16 Wavelengths per route 8 for CANARIE 8 reserved for traditional SONET 4/BLSR by carrier Possible 10xGbE over DWDM Seattle New York

14. Exciting Developments in 10xGbE  Several companies have announced long haul 10xGbE CWDM with transceivers at 50km spacing  Costs are less than $12K US per node (or transceiver) for OC- 192 data rates  Future versions will allow rate adaptive clocking for use with “gopher bait” fiber, auto discovery, CPE self manage  Excellent jitter specification  Most network management and signaling done at IP layer  Anybody with LAN experience can build a long haul WAN – all you need is dark fiber  Maybe the beginning of the end of managed bandwidth  Interesting parallel with time share computing of the 60s & 70s

15. Gigabit Ethernet vs SONET Gigabit Switch SONET Router Tributray With SONET links everything must terminate on SONET gear - either routers or SONET mux With Gigabit Ethernet costs are much less as you can back haul bridged devices to and expensive high performance router $50K $25K Gigabit Ethernet Regen Gigabit Ethernet Tributray with Router $25K G Gigabit Ethernet Tributray with Bridged Switch $125k $125K SONET Regen $250K Gigabit Ethernet SONET GG GGGG

16. Third Generation Router  Terabit routing - 32 x OC 192 - “Tiny Tera”  Juniper, Pluris, Nortel Avici, CISCO, Argonne, Ironbridge, Torrent, Nexabit, Terabit Corp, Netcore  5 Tiny Tera = all existing switch capacity in North America  Routing on a chip with no caching  wire speed routing with HPCC techniques  BGP+, CBQ and MPLS Only  “let it smoke” packets  Integrated OADM with SONET path/link protection services and Fast IP framing  Advanced routing functions like multicast, interior routing be handled by GigaPOP or CPE router

17. Future Optical Internet ATM will play a key role Different Protocol Stacks Integrated to provide different size bandwidth pipes and CoS HDWDM OC-3084 OXC ADM IP/ATM Network IP SONET Network IP Optical Network OADMADM IP/ATM Network OADMADM IP SONET Network IP over ATM IP OpticalIP Sonet QoS & VPNs up to OC3 OC3, OC12, OC48 Greater than OC-48

18. National Film Board of Canada VOD Project  Joint project between NFB, CANARIE and RISQ  800 documentary films on-line on CA*Net 2 and soon on CA*Net 3.  100 simultaneous connections  Currently looking at:  Creating an international VOD exchange site  IP owners workshop  MPEG2 version  Integration the Canadian Broadcasting Corporation (CBC)

19. Connectedness  Canada has highest penetration of telephone and cable  Highest ranking of G7 countries on technology potential  World leader in optical networking technology  Major government initiative on connecting all schools  Major government initiative on community access  World first high speed optical Internet backbone  Connectedness seems to be a unique Canadian strength  So, maybe our next grand challenge is…..

20. Gigabit Internet to Every Canadian School, Library & eventually Home?  Building on CA*net 3, a new research initiative in partnership with industry, R&E, federal government provinces to explore and develop the technology that can be used deliver extreme high speed Internet to every school and library in Canada, and eventually to every home

21. Why should we do this??  Many school boards and provinces are deploying T1 and DSL services to the schools  But is this fast enough?  Particularly if want to connect every class room  And each class room is downloading their own video stream  Soon we will need 10/100/1000 Mbps each school  Schools and universities are in many ways early adopters of information technology  By leveraging our research in optical Internets this might enable early deployment of high speed Internet to the school and then eventually an architecture for high speed Internet to the home

22. Promote Canadian Content  One of the big costs of Internet delivery is not the network, but buying Internet access from a US service provider  But a Gigabit Network to every school could be used to promote development of Canadian high speed multimedia content  Canadian content would be fast, immediate and exciting and very low cost  Foreign content would be slow and expensive

23. Early examples of GITS  Palo Alto has built a municipal owned regional network to deliver 100 Mbps Internet to every home and school  Cost $40 per month  MFS has proposed building a new sewer system for Palo Alto so it can pull fiber into the home  Bell South has a 10/100 Mbps Internet service trial  no telephone, no video - just the Internet  Washington State is deploying Gigabit Ethernet to every school  approx $100 month  Sweden has deployed Gigabit Internet to major universities  $3500 per month including Internet access

24. Possible GITS program  CANARIE, industry and government establish a research program to investigate the technologies and develop a possible framework for GITS  Build on the lessons and technology that we are developing with CA*net 3 and the regional optical Internets  Many research issues in scalability, management, low cost DWDM, layer 3 optical Internet services, IPv6, etc  Leading to early field trials and pilots across Canada  Actual deployment will be done by private sector  Competitive equal access at all levels essential  competition not technology that drives innovation and reduced pricing

25. Possible GITS Concepts  A third commercial network running in parallel to telephone and cable  Avoids regulatory and technical issues of 911, number portability, etc  Encourages SMEs and entrepreneurs to build the infrastructure  Deliver high speed Internet only  IP telephony and IP video maybe can be added at a later date  Build on the infrastructure we are putting in place for CA*net 3 with optical RANs, GigaPOPs, etc

26. Possible GITS Concepts  Federal and Provincial government encourages deployment by funding schools as first customer and early adopter  But governments specify an architecture that guarantees competitive access that can lead to deployment to every home  Electric utility companies, municipal governments, CLECs, and traditional telco and cableco can participate equally

27. Preliminary Analysis  Early Fiber to the Home was too expensive because it assumed fiber from every home to a CO  expensive terminal equipment required to provide voice and video  but voice traffic is going wireless  and broadcast is going by satellite  GITS requires no CPE, only 10/100/1000 NIC card  With low cost DWDM, PON, new architectures that feature competitive equal access...  GITS may be marginally more expensive than xDSL or cable modems  and with 1000 times the bandwidth!!!

28. Possible GITS Architecture ATM GigaBit Ethernet OADM Optical RAN ring in partnership with cableco, telco, or CLEC OADM POS ISP A ISPC Commercial Internet CA*net 3 GigaPOP OADM Local WDM Fiber Ring Provided by Cable Company, Telco or CLEC OADM Local WDM Fiber Ring Provided by Cable Company, Telco or CLEC OADM Major University

29. POM Gigabit to the Home ISP A ISP B Competitive Access Pedestal House Dual Homed Routing Puck OADM POM 2  Fibers OADM Multi carrier ring provided by competitive access provider with separate wavelengths or fiber assigned to each ISP Single carrier ring with individual fibers using POM OADM ISPC Internet Connection ISPA Internet Connection Copper Pair ISP C POM 100 Base T 10 Base T 2 wavelengths

30. Opportunity for Canada  World leadership in optical Internet technologies  PMC Sierra, QNX, Cambrian, Nortel, Newbridge, CISCO, etc  Opportunity to quickly incorporate and act on lessons learned from CA*net 3 and ORANs  Opportunity to promote and encourage Canadian high bandwidth multimedia content for schools and libraries  Canada has the highest penetration and lowest cost first residential network  Canada was the first country to build the second residential network - cable TV  Canada can be the first country to build a “third” residential network - high speed Internet- and continue to be the most connected nation in the world