0 Tsukuba WAN & the community EGUCHI Hisashi Tsukuba WAN Steering Committee APAN 2003 Conference in Fukuoka Meetings and Workshops NOC Meeting January 23, 2002

1 Tsukuba WAN is the network for research collaboration and cooperation among industry, university and government. It links with many institutes in Tsukuba area by ultrahigh- speed access ring network. As a result, they are able to use almost recourse of research institutes in Tsukuba, such as supercomputer, large-scale database, and computer simulations software. Construction of Network began in 2000, and operation started at May The Tsukuba WAN symposium was held at May 2, 2002 as Opening ceremony. At the symposium, some program occurred such as the presentation on the results of research, which was using Tsukuba WAN, and discussion about the concept. What’s the Tsukuba WAN ?

2 Outline High Energy Accelerator Research Organization NTT Access Network Service Systems Laboratories National Research Institute for Earth Science and Disaster Prevention University of Tsukuba 光伝送路 Tsukuba Science City map （ Optical ring length 50km ） Tsukuba Gigabit Laboratory Gbit-SWRouter SuperComputer National Institute for Materials Science National Institute for Environmental Studies National Institute for Land and Infrastructure Management National Institute of Advanced Industrial Science and Technology MAFFIN The ultrahigh-speed 10G (total bandwidth is 570Gbps) access ring network for research collabolation, by the connection with supercomputer of research institutes and universities in Tsukuba. Adoption of advanced network technology, such as Wavelength Division Multiplexing by OADM (Optical Add-Drop Multiplexer) Research, development and field verification about technology such as interface between supercomputer and network, and security of each large scale simulations Tsukuba Center for Institutes

3 Organization Advisory Board (1)up-to-date technology in the computer science field (2)concept as the advanced research and information network (3)the future Executive Committee It deliberates utilization and research themes of Tsukuba WAN Participate organization - National Research Institute for Earth Science and Disaster Prevention (NIED) - National Institute of Advanced Industrial Science and Technology (AIST) - National Institute for Environmental Studies (NIES) - National Institute for Land and Infrastructure Management (NILIM) - National Institute for Materials Science (NIMS) - Ministry of Agriculture, Forestry and Fisheries Research Network (MAFFIN) - Japan Science and Technology Corporation (JST) - Telecommunications Advancement Organization of Japan (TAO) Tsukuba Gigabit Laboratory - Tsukuba Center for Institutes - NTT Access Network Service Systems Laboratories - High Energy Accelerator Research Organization (KEK) [plan] - University of Tsukuba [plan] Participate organization - National Research Institute for Earth Science and Disaster Prevention (NIED) - National Institute of Advanced Industrial Science and Technology (AIST) - National Institute for Environmental Studies (NIES) - National Institute for Land and Infrastructure Management (NILIM) - National Institute for Materials Science (NIMS) - Ministry of Agriculture, Forestry and Fisheries Research Network (MAFFIN) - Japan Science and Technology Corporation (JST) - Telecommunications Advancement Organization of Japan (TAO) Tsukuba Gigabit Laboratory - Tsukuba Center for Institutes - NTT Access Network Service Systems Laboratories - High Energy Accelerator Research Organization (KEK) [plan] - University of Tsukuba [plan] Steering Committee It steers the system operation of Tsukuba WAN.

4 8 places and 11 systems of supercomputer in Tsukuba are rank in. TOP500 of the world. If they connected each other by Tsukuba WAN, it would become global area of technology and an industrial simulation field. Tsukuba research organization in SuperComputer TOP500 TOP500 List for November

5 Optical Fiber Ring To each research organization Tsukuba Center for Institutes National Institute for Materials Science National Institute of Advanced Industrial Science and Technology Ministry of Agriculture, Forestry and Fisheries Research Network (MAFFIN) National Institute for Environmental Studies Tsukuba-NOC TAO Tsukuba Gigabit Laboratory NTT Access Network Service Systems Laboratories National Institute for Land and Infrastructure Management National Research Institute for Earth Science and Disaster Prevention NAS OADM ADM SC OADM ADM SC OADM ADM SC OADM ADM SC OADM ADM SC OADM ADM SC ADM SC ADM APAN IMnet SINET SC ： Super- Ｃ omputer NAS ： Network Attached Strage OADM ： Optical Add-Drop Multiplexer ADM ： Add-Drop Multiplexer POS OC-12 POS OC-192 Optical Fiber Ring ATM/SONET OC-3, 12 JGN

6 Transmitter Receiver DCMDCM DCMDCM O／ＥO／Ｅ Ｅ／ＯＥ／Ｏ SMF DCM ： Dispersion Compensating Module The method of transmitting 1.55um signals on SMF When 1.55um signals transmits on SMF (Single Mode Fiber, 1.3um zero- dispersion optical fiber), it is necessary to do dispersion compensation, because of chromatic dispersion degrades optical signals Optical Amplifier

7 Variety of WDM systems typefeaturesWavelength allocation DWDM (Dense WDM) CWDM (Coarse WDM) ・ accommodate dozens of channels in 1.5~1.6um ・ wavelength grid ： ~0.8nm (ITU-T G.694.1) ・ Precise wavelength control is required ・ accommodate 4~8 channels in 1.3~1.6um ・ wavelength grid ： 20nm (ITU-T G.694.2) ・ precise wavelength control is unnecessary ・ use of less costly optical components is capable ・・ 1260 ～ 1360nm1360 ～ 1460nm1460 ～ 1530nm1565 ～ 1625nm O-bandE-bandS-bandC-bandL-bandU-band 1530 ～ 1565nm1625 ～ 1675nm name band nm 32, 64 and beyond

8 Wavelength arrangement on Tsukuba WAN 10Gbps-ADM Main signal (40λ) L-band C-band Control Main signal (16λ)Control

9 DMUXDMUX WDM signal （ λ1, λ2, λn ） … Transponder Signal 1 Signal 2 Signal n ・・・・・・・・ λ1 λ2 λn λ1 λ2 λn MUXMUX Optical fiber Outline of the WDM system ・・・・・・・・ Optical Amplifier Optical Amplifier DMUXDMUX ・・・・・・・・ λ1 λ2 λn λ1 λ2 λn MUXMUX ・・・・・・・・ Optical Amplifier Optical Amplifier OADM λｉλｉ λｉλｉ λｊλｊ λｊλｊ WDM System OADM System Transponder Signal 1 Signal 2 Signal n

10 OADM system specifications ItemSpecifications Architecture2 fiber UPSR ring Nodes in ring (max.)16 node Ring loss budget (8 node)88dB and more WDM -IF No. of wavelength 56 （ L-band ： 40 、 C-band ： 16 ） Types of Optical fiber SMF ， DSF Line loss budget11dB and more Client -IF Type STM-64 （ OC-192 ）， STM-16/4/1 （ OC-48/12/3 ）， Gigabit Ethernet ， Fibre Channel （ 1Gbit/s ， 2Gbit/s ） No. of Add/Drop channel Large node ： 40ch ， Small node ： 6ch Rack Dimensions2100mm(H)×600mm(W)×600mm(D) Power inputDC-48V Power Consumption (max) Large node ： 4700W ， Small node ： 1020W OADM: Optical Add Drop Multiplexer

11 AMP （ EDFA ） ﾄﾗﾝｽﾎﾟﾝﾀﾞ部へ W→E Add/Drop filter Add/Drop filter Add/Drop filter Add/Drop filter AMP （ EDFA ） Add/Drop filter Add/Drop filter Add/Drop filter Add/Drop filter E→W AMP （ EDFA ） Transponder OADM node configurations Small node

12 CW CCW failure Working channel Protection channel Before a failure After a failure Large node Small node A selector chooses a protection channel automatically. To/From external terminals Optical Channel Protection (UPSR) UPSR:Uni-directional Pass Switched RIng To/From external terminals Selector

13 `Weekly‘ Graph (30 Minute Average) Max In:546.2 Mb/s (54.6%) Average In:26.8 Mb/s (2.7%) Current In:13.4 kb/s (0.0%) Max Out:505.7 Mb/s (50.6%) Average Out:17.1 Mb/s (1.7%) Current Out:22.9 kb/s (0.0%) Tsukuba WAN & APAN NSPIXP2IMnet APAN KDDI-Ootemachi/Tokyo GbE FE OC-3 OC-192 POS Tsukuba-WAN Juniper M160 Juniper M160 Juniper M160 Juniper M160 M5 60km

14 1 Joint research of ultra-high-speed access network 2 Remote access of supercomputers through Tsukuba WAN and network extension 3 Network establishment of disaster condition and bulletin by remote sensing technology which mainly uses VEXCEL for supercomputer system (VPP5000,ORIGIN3800) 4 Remote access of supercomputer across Tsukuba WAN and JGN. 5 Data Grid 6 Establishment of computing environment with the connection with heterogeneous computer by global network 7 Establishment of computing environments (GridLib) 8 Distance portal access of ITBL Research collaboration on Tsukuba WAN

15 平成１４年１２月５日 独立行政法人 防災科学技術研究所 Network establishment of disaster condition and bulletin by remote sensing technology which mainly uses VEXCEL for supercomputer system (VPP5000,ORIGIN3800) National Research Institute for Earth Science and Disaster Prevention (NIED)

16 National Backbone National Backbone Super SINET Data Grid SCinet NOC 3com Gbps By courtesy of Force10 SC2002, Baltimore Indiana Univ. Cluster Indiana Univ. Cluster SDSC Cluster SDSC Cluster NOC Tokyo NOC OC-12 x2 Japan APAN/TransPAC KEK Cluster KEK Cluster Titech Cluster Titech Cluster AIST Cluster AIST Cluster ICEPP Cluster ICEPP Cluster AIST M160 Tsukuba -U MAFFIN M160 GbE 10 GbE GbE NOC GbE NOC AIST Booth AIST Booth Abiline National Institute of Advanced Industrial Science and Technology (AIST) Tsukuba WAN Abiline

17 Internation al Backbone Internation al Backbone iHPC. SV1 iHPC. SV1 HLRS T3E HLRS T3E NOC Tokyo NOC Japan APAN NIED SV1 NIED SV1 AIST SV1 AIST SV1 AIST M160 MAFFIN M GbE GbE StarLight GbE Abiline GbE AIST O2K AIST O2K GbE NOC Pitts SC T3E Pitts SC T3E Manchester T3E Manchester T3E Tsukuba WAN National Institute of Advanced Industrial Science and Technology (AIST) Establishment of computing environment with the connection with heterogeneous computer by global network

18 Super SINET NIED SV1 NIED SV1 RIKEN VPP500 RIKEN VPP500 JAERI GP JAERI GP International Backbone International Backbone Tokyo NOC Japan APAN AIST SR8000 AIST SR8000 AIST M160 MAFFIN M GbE GbE StarLight GbE Abiline GbE AIST RS6000/SP AIST RS6000/SP GbE NOC iHPC(Singapore) SV1 iHPC(Singapore) SV1 MEXTTCI FileServer MEXTTCI FileServer NTT AS Client NTT AS Client ITBL FireWall Tsukuba WAN National Institute of Advanced Industrial Science and Technology (AIST) GridLib