TEIN3 NOC Updates (Feb 2011 – Jul 2011) Zhonghui Li TEIN3 NOC Service Manager

Outline TEIN3 General Operation Updates Traffic Analysis between TEIN3 and GEANT Total Traffic over TEIN3 Backbone Traffic Volume over TEIN3 Link Yearly Operation Report for 2010 Collaboration with CAREN

TEIN3 General Operation Updates (Feb 2011 – Jul 2011) TEIN3 Topology Major Operation Issues Trouble Ticket Statistics Link Availability Link Utilization Current Status of Advanced Service

TEIN3 Topology TEIN3 BJ PoP  CNGI-6IX BJ PoP 1G  10G 622M  10G (rate-limit 2.5G) 622M  10G (rate-limit 2.5G) AS4758  AS55824

Major Operation Issues Upgraded HK-JP link from STM4 to 10GE Upgraded HK-NICT link from GE to 10GE Upgraded SG-JP link from STM4 to 10GE (rate-limit 2.5Gbps) Upgraded SG-NICT link from GE to 10GE (rate-limit 2.5Gbps) Migrated BJ-COP STM16 circuit from TEIN3 to CNGI-6IX Finished BGP amendment for NKN (India) AS number revision (AS4758  AS55824)

Major Operation Issues Finished the migration of TEIN3 BJ PoP (different racks in same room)

Major Operation Issues Brought up IPv6 BGP peering with CAREN Submitted the new version of TEIN3 Routing Guideline (v1.3)

Trouble Ticket Statistics

Trouble Ticket Statistics No routing problem and other problem during last 6 months

Link Availability (w/o maintenance)

Link Availability (with maintenance) SG-TW(GE) ~ 34%: Link has been decommissioned since 1 Apr HK-PH(FE) & PH-MNL(DS3) ~ 87%: ASTI HK PoP router problem which has been solved since 20 Feb HK-KR(STM16) ~ 93%: EAC cable cut from 20 Mar to 3 Apr The average availability of all the other TEIN3 links is higher than 99.7%

Link Utilization (average) Inbound > 15%: BJ-COP(2.5G), AU-PER(622M) Outbound > 20%: HK-ID(155M), HK-HK(70M), SG-MY(155M), AU-PER(622M)

Link Utilization (maximum) Maximum > 97%: BJ-HK(1G), HK-ID(155M), HK-HK(70M), SG-SG(45M), SG-TH(155M), AU-PER(622M), PH-MNL(45M), MB-LK(45M), MB-NP(45M)

Current Status of Advanced Service TEIN3 NREN/Partner BGP IPv4 Unicast BGP IPv6 Unicast PIM IPv4 Neighbor BGP IPv4 Multicast MSDP IPv4 Neighbor PIM IPv6 Neighbor BGP IPv6 Multicast MPLS BGP IPv4 Labeled Unicast AARNet (AU) Yes No ASTI (PH) CNGI-6IX (CN) HARNET (HK) ITB (ID) KOREN (KR) LEARN (LK) MYREN (MY) NCTU (TW) NKN (IN) NREN (NP) PERN2 (PK) SINET (JP) SingAREN (SG) ThaiREN (TH) VinaREN (VN) GEANT APAN-JP CAREN TEIN3 JP POP TEIN3 BJ/HK/SG/MB POP No major change during last 6 months.

Traffic Analysis between TEIN3 and GEANT 2 links between TEIN3 and GEANT BJ-COP (STM16) MB-MAD (STM16) Statistics based on cflow Sample rate: 100:1 Time scale BJ-COP: 2011.02.01 to 2011.05.25 MB-MAD: 2011.02.01 to 2011.07.31

Packet Length (BJ-COP)

Packet Length (MB-MAD) The total percentage of small packets (<64B) and large packets (1024-1500B) over BJ-COP and MB-MAD links is about 80-90%, which is the major part of traffic.

AS Top 10 (BJ-COP, inbound) Top 3 of Source AS: JANET/UK (AS786), RENATER/FR (AS2200), GARR/IT (AS137) Top 3 of Destination AS: CSTNET/CN (AS7497), CERNET/CN (AS4538), KNU/KR (AS10052) By source AS By destination AS

AS Top 10 (BJ-COP, outbound) Top 3 of Source AS: CSTNET/CN (AS7497), CERNET/CN (AS4538), KNU/KR (AS10052) Top 3 of Destination AS: JANET/UK (AS786), RENATER/FR (AS2200), GARR/IT (AS137) By source AS By destination AS

AS Top 10 (MB-MAD, inbound) Top 3 of Source AS: JANET/UK (AS786), GARR/IT (AS137), RENATER/FR (AS2200) Top 3 of Destination AS: KNU/KR (AS10052), ARRNet/AU (AS7575), PERN/PK (AS45773) By source AS By destination AS

AS Top 10 (MB-MAD, outbound) Top 3 of Source AS: ARRNet/AU (AS7575), PERN/PK (AS45773), ERNET/IN (AS2697) Top 3 of Destination AS: JANET/UK (AS786), DFN/DE (AS680), GARR/IT (AS137) By source AS By destination AS

Protocol Top 10 (BJ-COP) TCP: 80.2% UDP: 15.4%

Protocol Top 10 (MB-MAD) TCP: 81.0% UDP: 18.2%

Service Top 10 (BJ-COP) Traffic Distribution: 84.9% Unknown (Grid, P2P etc.) 14.2% WWW 0.2% DNS 0.2% FTP 0.2% Telnet 0.1% E-mail (SMTP)

Service Top 10 (MB-MAD) Traffic Distribution: 76.6% Unknown (Grid, P2P etc.) 21.7% WWW 0.5% DNS 0.5% E-mail (SMTP) 0.3% FTP 0.2% E-mail (POP3)

Address Block Top 10 (BJ-COP, inbound) JANET, RENATER, KIT CSTNET, KNU, CERNET By source IP By destination IP

Address Block Top 10 (BJ-COP, outbound) CSTNET, CERNET, KNU GARR, JANET, KIT By source IP By destination IP

Address Block Top 10 (MB-MAD, inbound) RENATER, JANET, GARR KNU, PERN, AARNet By source IP By destination IP

Address Block Top 10 (MB-MAD, outbound) PERN, ERNET, University of Melbourne GARR, SUNET, CERN By source IP By destination IP

Total Traffic over TEIN3 Backbone (inbound, TBytes)

Total Traffic over TEIN3 Backbone (outbound, TBytes) The decrease of total traffic (both inbound and outbound) since Jun 2011 is due to the migration of BJ-COP from TEIN3 to CNGI-6IX, i.e. the re-direction of EU-CN traffic

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) BJ-2G_to_CN

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) HK-2.5G_to_KR

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) HK-155M_to_VN

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) HK-155M_to_ID

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) HK-70M_to_HK

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) HK-22.5M_to_PH

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) HK-1G_to_CAREN

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) SG-155M_to_MY

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) SG-155M_to_PK

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) SG-45M_to_SG

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) SG-1G_to_AU

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) SG-155M_to_TH

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) SG-155M_to_TW

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) MB-10G_to_IN

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) MB-2.5G_to_EU-MAD

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) MB-45M_to_LK

Traffic Volume over TEIN3 Link (inbound/outbound, TBytes) MB-45M_to_NP

Yearly Operation Report for 2010 Trouble Ticket Statistics Link Availability Link Utilization Comparison with 2009

Trouble Ticket Statistics Tickets opened in 2010 Totally 271 Outage: 168 Maintenance: 93 Routing Problem: 1 Other Problem: 9

Trouble Ticket Statistics

Link Availability

Link Utilization (average)

Link Utilization (maximum)

Comparison with 2009 2009 2010 PoP 5 Backbone Link 4 (SG-MB 2.5G) Europe-Asia Intercontinental Link 2 x 2.5G (SG-LON  MB-MAD) NREN 13 16 (India, Sri Lanka, Nepal) Partner Network 2 3 (CAREN) Total Traffic (in/out, TB) 2928.281/2794.473 5167.408/4882.687 ( increased by 76%/75%) BGP Prefix (IPv4/IPv6) ~12100/~390 ~12500/~620 (increased by 3%/59%) Advanced Service IPv4/IPv6 inter-domain multicast IPv4/IPv6 inter-domain multicast, Inter-domain MPLS/L2VPN

Collaboration with CAREN Allocated rack space for CAREN M7i router at TEIN3 HK PoP Cooperated with CAREN NOC on CAREN routing policy design Provided on-site support for CAREN M7i installation in MEGA-I (DANTE contract) Provided remote console access to CAREN M7i for CAREN NOC via TEIN3 HK PoP 2811 access router Brought up HK-CAREN GE link The first BGP peer to TEIN3 backbone with 4-byte AS number (AS197118) Provided L2VPN local-switching for CAREN NREN’s FE access circuit (HK-Ashgabat) termination in MEGA-I via TEIN3 HK PoP EX3200 switch and M120 router (due to CAREN M7i’s lack of additional FE & GE interface) Providing ongoing support for CAREN operations (DANTE contract)

Virtual link implementation for CAREN over TEIN3 backbone

Thanks!