SDSS Data Transfer Jing-Jou Yen Division Manager National Center for High-Performance Computing (August 26, 2005)

2 OUTLINE  Project Background  Introduction to NCHC/TWAREN  Sloan Digital Sky Survey (SDSS) Overview  Network Architecture and Configuration  Network Performance Monitoring  Future Plan

3 SDSS Data Transfer Project  It is a joint program NCHC with the Fermi Laboratories to mirror the SDSS data.  The goal is to speed up the SDSS information sharing for physicists working in R&E institutes in Taiwan.  NCHC computing, storage and networking resources enhance functions in the astronomical research.  NCHC uses TaiWan Advanced Research and Education Network (TWAREN) for the SDSS data transfer.  NCHC’s Operations teams will ensure the quality for all efforts. Computing Center Network Operation Center Knowledge Center Taipei Tainan Hsinchu Taichung Core node equipment

4  NCHC is Taiwan’s only National Lab Dedicated to  High-Performance Computing & Applications  Storage, Networking & the Applications Development  NCHC Mission  Provide resources and services  Do research and development  Offer education, training, and outreach National Center for High-performance Computing NCHC High-performance Computers TANet2/TWAREN PC Clusters Storage/Databases Application SW Education, Training and Outreach Consultation Training Workshops Lectures Exhibits Industrial, Government, Academic Projects International Collaborations Conferences High-performance Computing & Networking Research and Development Resources and Services

5 TaiWan Advanced Research and Education Network TWAREN  TWAREN - Successor of TANet2  TWAREN - One of the Most Advanced Networks/Operations in the World  TWAREN Goals To provide a network infrastructure for academic and R&E community. To stimulate creativity and foster talents  TWAREN Architecture A hybrid network with 20G POS and DWDM technologies at its core. Hierarchical topology: 3 layers (core, GigaPoPs, end nodes) Eleven GigaPoPs - each links to the core node at 20 Gbps and 1 dark fiber. Highly scalable and flexible Providing multiple services International links to the USA Integrated NMS Architecture Taipei NCU NDHU NCTU NTHU CCU NCKU NSYSU NCNU NCHU SINICA NTU Tainan Hsinchu Taichung

6 TWAREN Network topology Taipei Hsinchu Taichung Tainan NTU NSYSU NCKU CCU NCNU NCHU NTHU NCTU NCU Sinica NTUStarLightCANARIE CANARIE Pacific Wave LALALAN MAN LAN 3*STM-4+2*STM-1 3*STM-4+3*STM-1 2.5G 2G 1.25G NETHERLand 1.8G 2.5G

7 HP OpenView Network Node Manager (NNM) & CiscoWorks2000 for LAN/WAN & CTM Cisco IP Solution Center Cisco Secure ACS HP OpenView Extend Topology & Multicast Network Elements EMS NMS SMS BMS WAN/LA N Cisco Info Center (Micromuse) Remedy Help Desk (Trouble Ticket System) NOC IPv6 MPLS IP Telephony Multicast Multimedi a HP OpenView Operation Manager HP OpenView Performance Insight & Report Pack for Cisco MPLS VPN / IP QoS / Cisco Ping / SA/ Netflow / IPT / CAR / RMON & Customize Report Raw Data HP OpenView Service Information Portal (SIP) Apps Service Desk Apps Carrier OSS/ NMS Alarm SLA Reports TWAREN NMS Architecture

8 Sloan Digital Sky Survey (SDSS) Overview  It is an very ambitious astronomical survey project.  The goal is to image one-half of the northern celestial hemisphere, and a smaller portion of the southern sky.  It determines the positions and absolute brightnesses of more than 100 million celestial objects.  The SDSS Southern Coadd project combines all images to detect very faint and distant astronomical objects.  Fermi National Accelerator Laboratory (FNAL) uses Grid3 to carry out a full coadd of all available data.

9 TWAREN Connections to Fermi Lab Taipei Hsinchu Taichung Tainan NTU NSYSU NCKU CCU NCNU NCHU NTHU NCTU NCU Sinica NTUStarLightCANARIE CANARIE Pacific Wave LALALAN MAN LAN 3*STM-4+2*STM-1 3*STM-4+3*STM-1 2.5G 2G 1.25G NETHERLand 1.8G 2.5G

/24 HC-7609P (NCHC-SW2) TWAREN International Optical Network / / /29 NCHC-SW1 FNAL-SW [SDSS-server] [SDSS client] [FNAL measurement client for CDF] [NCHC measurement server] ONS in Sartlight NCHC ONS (HC) [FNAL measurement server for CDF] Network Topology CH SF TP TP HC

/24 HC-7609P (NCHC-SW2) TWAREN International Optical Network / / /29 NCHC-SW1 FNAL-SW [SDSS-server] [SDSS client] [FNAL measurement client for CDF] [NCHC measurement server] ONS in Chicago Sartlight HC NCHC ONS [FNAL measurement server for CDF] Network Connections

12  Use Cisco 7609 & ONS (15454/15600) for connection  Use CTC, CTM or UCLP for lightpath set-up  Layer 1 international link for Hsin-Chu – Chicago  622 Mbps lightpath (Hsin-Chu – Taipei – S.F. – Chicago)  7 ONS ’ s included in the lightpath  Rsync: 2MB/s  8MB/s  Data Fragmentation  Policy Route  5.0 TB Storage Network Set-ups TWAREN International Network ONS Starlight FNAL Hsin-chu NCHC

13 IPERF.MBPS: Max= Mbps Reverse IPERF.MBPS: Max= Mbps Available BW(Mbps): Max= Mbps RTT: 182 ms No. of Hops: 3 Network Performance Monitoring

14 Network Monitoring Topology at Fermilab

15  Resources (Computing + Storage+ Network)  Partnership with Universities and Institutes  Production Certificate Authority  Processing Functions  Applications Definition  International Collaborations Future Plan