1. IntroductionNauka-NetCIV-NetFriendsGridsThe Future GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS DEVELOPMENT Russia-China-USA Science & Education Network April 14, 2003 Greg Cole, Natasha Bulashova, National Center for Supercomputing Applications (NCSA) University of Illinois at Urbana-Champaign (gcole@uiuc.edu, natasha@uiuc.edu)gcole@uiuc.edu

2. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Presentation Objectives Update on US-Russian NaukaNet Program Introduce Russia-China-USA GLORIAD program

3. IntroductionNauka-NetCIV-NetFriendsGridsThe Future NaukaNet Overview 5 year $4.1 million NSF Cooperative Agreement under HPIIS Program Co-funded by Russian Ministry of Industry, Science & Technology 1998-2001: MIRnet –Univ of Tennessee –6 Mbps ATM Service (Moscow M9 - STARTAP) 2001-2002: FASTnet –NCSA, Univ of Illinois at Urbana-Champaign –45 Mbps ATM Service (Moscow M9 - STARTAP) 2002-[June, 2004]: NaukaNet –155 Mbps POS Service (Moscow M9 - Starlight) –Upgrade in 2003 to 2x155 Mbps POS Service 5 year goal

4. IntroductionNauka-NetCIV-NetFriendsGridsThe Future NaukaNet Traffic Growth, 1999 - 2003

5. IntroductionNauka-NetCIV-NetFriendsGridsThe Future NaukaNet Growth in IP Flows > 200 Mbytes

6. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Number of Unique IP Addresses Using NaukaNet, 2000-2002

7. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

8. IntroductionNauka-NetCIV-NetFriendsGridsThe Future NaukaNet Traffic to Novosibirsk, Russia

9. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

10. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

11. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

12. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

13. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Top Institutional Users of NaukaNet in Russia Nov. 2002

14. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Top Institutional Users of NaukaNet in U.S., Nov. 2002

15. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Application Communities High Energy Physics International Thermonuclear Experimental Reactor (ITER) Atmospheric Sciences Spallation Neutron Source Space Sciences Cooperation Astronomical Sciences/IVO US-Russian Plutonium Disposition Project Non-proliferation/Arms Control Program US-Russia Materials Protection, Control & Accountability Program Security Studies/Issues Geosciences Bioinformatics

16. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

17. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

18. IntroductionNauka-NetCIV-NetFriendsGridsThe Future NaukaNet: Congestion ahead

19. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Near-Future Plans Add second OC3 Starlight - Moscow Complete European exchange for Russia-Europe traffic Improved (live) Monitoring System Access Grid Node in Moscow Switched Ethernet testbed project (Moscow- Novosibirsk) New IPv6 Services / experimentation June Conference in Moscow and St. Petersburg Russian domestic infrastructure improvement

20. IntroductionNauka-NetCIV-NetFriendsGridsThe Future GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS DEVELOPMENT Russia-China-USA Science & Education Network

21. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Why GLORIAD? Time to develop follow-on to NaukaNet program Science applications demand it (HEP, ITER, NVO, Atmospheric Sciences, Spallation Neutron Source, Nanomaterials collaborations, network security, etc.) Desire to extend S&E network in Russia to Far East TransTelecom network in place Highest level interest in US for improving US-China S&E cooperation Highest level interest in Russia for improving Russia- China S&E cooperation Good opportunity to develop general framework for tri- lateral cooperation around a most advanced S&E network

22. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Introduction to GLORIAD Proposed network/program to be operational in 2004 Co-developed (and to-be-co-funded) by U.S., Russia, China Expanded capacity for science and education collaboration (10 Gbps) New Global Ring topology for reliability and new applications Essential for supporting advanced S&E applications (particularly HEP, Astronomy, Atmospheric Sciences, optical network research, network security research) Follow-on to US-Russian NaukaNet Program

23. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Details (initial proposal) Layer 1: 10 Gbps Lambda ring across Russia, China, US (and the oceans between) (likely access point in Amsterdam also) Layer 2: Switched Ethernet Layer 3: IPv6 Program to develop network management, utilization, monitoring, resource allocation and scheduling tools Program to develop Cyberinfrastructure supporting S&E collaboration Program to educate potential users and to educate/inform continuously scientists/educators in all 3 countries about opportunities to collaborate

24. IntroductionNauka-NetCIV-NetFriendsGridsThe Future The 4 Layer GLORIAD Model Application Communities Collaboration Framework Sculpted Network Platform Lightwave/Lambda Network Scientists, educators, policy-makers, public organizations, students Middleware/grid tools, technologies tying together networks, computers and communities Ethernet (layer 2) switching, IPv6 migration, Network monitoring and management (scheduling, allocation) tools Lambda-based network; optical switching

25. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Goal: Applications Network will carry the full mix of S&E traffic Emphasis, however, on supporting single applications that need Gbps+ capacity –ITER-Grid (US, China have just (re-) joined) –HEP: LHC data distribution –National Astronomy Virtual Observatory –Climate change / atmospheric sciences –Digital Sky –Digital Earth –Wavelength Disk Drive (based on Canadian efforts) –Data mining, security monitoring and visualization –Large scale digital video services

26. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Serving Major Science/Education Application Areas GLORIAD is being developed to serve global S&E collaborations. The following lists a few typical programs or program areas in which at least two (and in many cases, all three) of the countries jointly participate. USA: International Space Station Alpha DOE Arms Control Policy Studies National Nanotechnology Initiative Human Genomics Nuclear Threat Initiative (NTI) Grid Physics Network Cooperative Threat Reduction Program MPC&A Antarctic Research Programs Earth Observation The Globe Program Russia: ITER Large Hadron Collider (LHC) U.S.-Russia Joint Commission on Economic & Technological Cooperation Seismic / Geological Research Programs HERA-B (proton-electron accelerator) Forest and Wildfire Research Controlled Thermonuclear Fusion Irkutsk Project Junior Achievement Simple Words Childrens Program Neurosurgery International Plasma Physics China:Yangtze River / Three Gorges Space Telescope Program Large Radio Telescope (FAST / KARST) U.S.-China National Laboratory Interactions in Arms Control / Nonproliferation China Biodiversity Network U.S.-China Joint S&T Commission Russia-China Oil Pipeline Project Shanghai Cooperation Organization

27. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Technical Details (initial proposal) Initial capability to switch multiple ethernet segments Later capability to switch multiple lambdas (year 3) Optical (initially, Ethernet) switches in Chicago (Starlight), Amsterdam (NetherLight), Moscow (RusLight), Novosibirsk (SiberLight), Beijing (ChinaLight), Hong Kong (HKLight) Self-healing ring topology (ex: if network outage across Atlantic, US traffic to Moscow transits Pacific/China/Siberia) IPv6 proposed for advanced applications, security, future of IP networking

28. IntroductionNauka-NetCIV-NetFriendsGridsThe Future A series of Starlight type facilities providing services for lambda-switching, ethernet-switching, IPv6 routing, IPv4 routing. Also, a testbed for advanced network research.

29. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Russian Backbone Network (RBnet)

30. IntroductionNauka-NetCIV-NetFriendsGridsThe Future China CSTNet (800 research facilities/institutions)

31. IntroductionNauka-NetCIV-NetFriendsGridsThe Future US High Performance Network (Abilene, pictured here, is one of several US networks; others include DOEs Esnet, NASAs NREN, US Govt network, etc.)

32. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Financing Proposed 5 year Project (2003-2008) Backbone cooperatively managed by US, China, Russia partners Project cooperatively funded by US, China, Russia. US commitment anticipated at $2.5M annually Proposal: each country funds transit across its territory. US funds 1/2 circuit to Russia and 1/2 circuit to China. Russia funds 1/2 circuit to US. China funds 1/2 circuit to US. Each country funds personnel, equipment, operations necessary for full program operation (i.e., distributed 24/7 NOC, training/support, security services, grid development, etc.)

33. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Organizational Details Russian Federation: Kurchatov Institute (Dr. Velikhov), Russian Academy of Science (Dr. Velikhov), Joint Supercomputing Center (RAS), Ministry of Industry, Science & Technology, Ministry of Communications, Ministry of Education, Ministry of Atomic Energy. (TransTelecom: likely network provider) Peoples Republic of China: CSTnet/CNIC, Chinese Academy of Science. (Dr. Jiang) U.S.A.: University of Illinois National Center for Supercomputing Applications (lead university), National Computational Science Alliance, U.S. National Science Foundation, U.S. Department of Energy. (several telecomm companies being evaluated as possible network providers) Also, National Academy of Engineering, San Diego Supercomputing Center, Argonne National Laboratory, Oak Ridge National Laboratory, Sandia National Laboratory, International Center for Advanced Internet Research (ICAIR) at Northwestern University, others. (Challenge: must present a nation-wide consortium of U.S. S&E community to match interest/level of commitment in Russia and China)

34. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Academician Evgeny Velikhov Academician, Russian Academy of Science Academician-Secretary, Info. & Computing Division, RAS President, RRC Kurchatov Institute Science Advisor, President, Russian Federation Leader, ITER Leader, Russian NaukaNet (GLORIAD) Founder and Director, Russian Junior Achievement

35. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Mianheng Jiang Vice President, China Academy of Sciences (Computing and IT Division) Telecommunications/IT developer in China Leader, China GLORIAD program

36. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Baoping Yan Director, Computer Network Information Center, China Academy of Sciences

37. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Organizing Trip to Beijing December 7-16, 2002

38. IntroductionNauka-NetCIV-NetFriendsGridsThe Future GLOBAL RING NETWORK FOR ADVANCED APPLICATIONS DEVELOPMENT Russia-China-USA Science & Education Network Organizing Trip with Chinese Academy of Sciences Computer Network Information Center (CNIC) December 7 - 16, 2002 Beijing, Peoples Republic of China Visitors Acad. Evgeny Velikhov, Kurchatov Institute Natasha Bulashova, NCSA, University of Illinois Greg Cole, NCSA, University of Illinois

39. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Trip Purpose Explore Opportunities to Expand the US-Russian NaukaNet S&E Program: with partners from Chinese Academy of Science (CAS), with CAS CSTnet and with a global ring network based on lightwave technology

40. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Trip Results December 14, 2002 Memorandum of Understanding Signed by China (Jiang Mianheng), Russia (E. Velikhov), and US (G. Cole) to develop GLORIAD

41. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Consensus Reached on GLORIAD program With Plans for Program Development, Program Management, Network Topology, Technology, Science Collaborations Trip Results

42. IntroductionNauka-NetCIV-NetFriendsGridsThe Future The Memorandum of Understanding The Chinese Academy of Sciences represented by the Computer Network Information Center (CNIC), the Russian Research Center Kurchatov Institute and the US National Center for Supercomputing Applications (NCSA) of the University of Illinois jointly propose a new strategic framework for advancing S&E cooperation among the three countries and across the myriad disciplines comprising current and future collaborative research. Linking their scientific communities with an advanced S&E network and Grid-based services, the multi-national GLORIAD program will actively encourage and coordinate applications across multiple disciplines and provide for sharing such scientific resources as databases, instrumentation, computational services, software, etc. In addition to supporting active scientific exchange with network services, the program will provide a test bed for advancing the state-of-the-art in collaborative and network technologies – including Grid-based applications, optical network switching, an IPv6 backbone, network traffic engineering and network security. Supporting the increasing growth in global S&E cooperation, GLORIAD will cooperate with other national S&E networks and scientific resources as required.

43. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Lightwave/Lambda Network 10 Gbps Lambda Continuous Ring (segmented into multiple GigE ethernets) Need to decide carrier issues, meet points, etc. Russias network will be ready (to Russia-China border) in late 2003 Chinas network will be ready (to Russia-China border) in early 2004 Important in later phase of project (year 3) that we have multiple lambdas (at least, when needed) and capability to switch lambdas on demand

44. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Action Items Determine carrier issues for trans-Atlantic and trans- Pacific links. Must choose carrier with stable financial base, excess lambda capacity, eagerness to work on large R&D project. Finalize arrangements with Russian company TransTelecom Finalize transit issues within and to/from China Finalize network topology (optical nodes, facilities, equipment)

45. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Resource Access/Scheduling System Provide for ability to advance-schedule resource allocation requests end-to-end Software system to automatically update network devices Must handle Level 2 switching for end-to-end VLAN provisioning Must handle Level 3 routing for providing improved QoS through core network (for example, using MPLS or other service) Must by year 3 provide for scheduling/switching (at optical level) lightwaves Must provide back-end reporting and surveying to determine how well network met customers needs

46. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Collaboration Framework Middleware/grid tools, technologies (Cyberinfrastructure) –Collaboration –Sharing of computational resources –Sharing of storage/data resources –Sharing of expensive/scarce instrumentation, sensor data, etc.

47. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Global Grid Development GLORIAD will provide the network linking GRID communities in US, Russia and China (and, via Starlight and Netherlight, other countries) Will support the general US-Russian NaukaGrid program and other focused Grid communities

48. IntroductionNauka-NetCIV-NetFriendsGridsThe Future ITER-Grid Development Dr. Velikhovs goal: Virtual ITER sites with ready, immediate access to conferencing facilities, live data streams generated by experiments/operations, distributed access to computational resources, remote instrumentation, monitoring and control applications. Need conferencing/lecture capabilities immediately (AG?) Network needs will eventually exceed 10 Gbps Preparing concept paper on what the ITER-Grid will be Would like to propose joint development effort: NCSA, Argonne, ORNL, others?

49. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Kurchatov Institute Conferencing Facilities Currently based on several H.323 (polycom) devices Would like to add Access Grid node –Useful for KI collaborations with NCSA, ORNL, Argonne, Sandia, ITER/fusion community –Useful model for other Russian sites (implement multicast network across Russian S&E network) –NaukaNet network capable

50. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Application Communities GLORIAD is to focus on application communities - especially those with needs which could not be met without such an advanced network First, need to identify and document needs of these communities Second, need to educate/inform scientists, educators, students about potential services, capabilities Third, need to continually inform/update broad community about opportunities of collaboration

51. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Active interest in GLORIAD program Signed Statement of the US-Russian Joint Committee for Science and Technology (J. Marburger, M.P. Kirpichnikov) Presentation to Presidents Science Advisory Council, Russian Federation Signed Agreement (March 12, 2003) between 7 Russian Ministries, Russian Academy of Science & RRC Kurchatov Institute

52. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Signed Statement of US-Russian S&T Commission Informational and Telecommunication Technologies in Science and Education The Committee gave a favorable appraisal of the results achieved through cooperation between the Russian Ministry of Industry, Science, and Technology (MIST) and the Russian Academy of Sciences (RAS) and the U.S. National Science Foundation (NSF) on high capacity computing and new generation computer networks, including under the NaukaNet (FASTnet) Project, carried out by the Interagency Supercomputer Center, the Russian Science Center Kurchatov Institute, the National Center for Supercomputing Applications (University of Illinois, Urbana-Champaign), and the Supercomputer Center at the University of California, San Diego. The Committee recommended that U.S. and Russian cooperation partners continue their active cooperation and discussions of the potential of next-generation computing and networking projects, such as those envisioned as the "TERRA GRID" network and the Global Network For Advanced Application Development (GLORIAD).

53. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Presentation to Russian S&T Council January 2003: The forum was the President's Science & Technology Council and the participants included -- in addition to the President (who presides over this council) -- the nation's most senior science officials (including the Minister of Science, Industry & Technology, the President of the Russian Academy of Science and the President of the Kurchatov Institute (Dr. Velikhov)), and also the Finance Minister (and Vice Premier), the Minister of Commerce, the Minister of Atomic Energy and the head of the National Security Council. Where the Kurchatov Institute leads, Russia follows (Russian President)

54. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Signed Russian Agreement On Wednesday, March 12, 2003, Dr. Velikhov placed the final signature on a document developed by 7 senior organizations in Russia indicating support and intention to pursue implementation of GLORIAD. It was signed at the Minister level by Ministry of Industry, Science & Technology, Ministry of Communications, Ministry of Atomic Energy and Ministry of Education. Also, the President of the Russian Academy of Sciences signed on behalf of the Academy and Dr. Velikhov on behalf of Kurchatov Institute (and as project organizer/lead). The agreement is to not only fund the international and networking parts of GLORIAD but also domestic infrastructure and programs to enable the science and education communities to utilize GLORIAD. Finally, we understand that Russian federal funds are now obligated for GLORIAD -- from the above organizations -- the Ministry of Industry, Science & Technology will be the financially responsible organization.

55. IntroductionNauka-NetCIV-NetFriendsGridsThe Future GLORIAD Proposal Ready in summer, 2003 Joint proposal preparation so that document is useful in US, Russia and China Primary focus on applications served by unique network services as well as advanced network research development test bed Beginning to coordinate closely with other HPIIS teams: TransPAC (J. Williams), EuroLink (T. DeFanti), Starlight (T. DeFanti, J. Mambretti) (next meetings: May 2003)

56. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

57. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

58. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

59. IntroductionNauka-NetCIV-NetFriendsGridsThe Future

60. IntroductionNauka-NetCIV-NetFriendsGridsThe Future GLORIAD Management Team Issues Science and Network Policy Cybersecurity Export Control Issues Technical Network Engineering Grid Development Corporate Relations Government Relations Cultural Affairs Youth Programs/Applications Evaluation and Audit

61. IntroductionNauka-NetCIV-NetFriendsGridsThe Future Other Events/Project Ideas/Plans April 14 discussions with Russian/Chinese partners (Washington) Workshop in June (ship, St. Petersburg Russia) International Simple Words program (global essay contest for children) Program to encourage science/education collaboration among young people (School- Grid) US-Russia-China Edu-Cultural Channel

62. IntroductionNauka-NetCIV-NetFriendsGridsThe Future … the end … (thank you!)