NOAA’s NWS Telecommunication Gateway RTH Washington Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information Officer NOAA’s National Weather Service APSDEU-7 Meeting Sep 22-23, 2006 Fred Branski, Chief, Performance Monitoring, Support & Data Management Branch Office of the Chief Information Officer NOAA’s National Weather Service APSDEU-7 Meeting Sep 22-23, 2006
“Taking the pulse of the planet” NWSTG Functional Overview The NWSTG is the central communication facility of the NWS; the primary acquisition and distribution center for NWS data and products; the primary acquisition and distribution center for international data and products to meet WMO, ICAO and bi-laterally agreed US requirements; A major data exchange hub for NOAA and other agency data and products. The NWSTG is the central communication facility of the NWS; the primary acquisition and distribution center for NWS data and products; the primary acquisition and distribution center for international data and products to meet WMO, ICAO and bi-laterally agreed US requirements; A major data exchange hub for NOAA and other agency data and products.
“Taking the pulse of the planet” NWSTG Functional Overview The NWSTG includes WMO Regional Telecommunication Hub (RTH) Washington ICAO OPMET Databank (KWBCYMYX) the ASOS Operations and Monitoring Center (AOMC) Operational oversight of U.S. federal automated surface observing systems the AWIPS Network Control Facility (NCF) AWIPS is the main NWS’ system which supports the NWS forecast and warning mission requirement The NCF is the central communications hub and technical support center for AWIPS The NWSTG includes WMO Regional Telecommunication Hub (RTH) Washington ICAO OPMET Databank (KWBCYMYX) the ASOS Operations and Monitoring Center (AOMC) Operational oversight of U.S. federal automated surface observing systems the AWIPS Network Control Facility (NCF) AWIPS is the main NWS’ system which supports the NWS forecast and warning mission requirement The NCF is the central communications hub and technical support center for AWIPS
“Taking the pulse of the planet” Data Input to the RTH IP / Sockets / Frame Relay X.25 Asynchronous Dial up FTP – – Web - IP / Sockets / Frame Relay X.25 Asynchronous Dial up FTP – – Web -
“Taking the pulse of the planet” Dissemination Systems GTS ISCS EMWIN Internet GMDSS NWS Telecom. Gateway * GTS ISCS EMWIN Internet GMDSS NWS Telecom. Gateway * NWWS NWR LDAD Family Of Services (FOS) Interagency Connections SBN/NOAAPORT AWIPS* * Although not dissemination systems these are systems that are critical to the process International National
“Taking the pulse of the planet” Dissemination and Distribution NWSTG FOS SBN/NOAAPORT GOES NCEP Product Suite NWWS (10 sec) WAN NESDIS Internet-Based Dissemination EMWIN (> 1 min) Telecommunications Operations Center Satellite Legend: EMWIN NOAAPORT NWWS Commercial Satellite GOES NWR WSR-88D Field Offices NCEP Data Servers NCF Media & Other Customers Public Specialized Customers Other Agencies LDAD Designated Local Customers Commercial Weather Services Research Institutions FAA, etc. ISCS GTSEMWIN Private line Dissemination Observations Imagery WMO ICAO
“Taking the pulse of the planet”
Major Initiatives Replacement Telecommunications Gateway Backup Telecommunications Gateway NOAANet – National MPLS network WIS development planning Code migration Improved Monitoring RMTN upgrade Replacement Telecommunications Gateway Backup Telecommunications Gateway NOAANet – National MPLS network WIS development planning Code migration Improved Monitoring RMTN upgrade
“Taking the pulse of the planet” Replacement NWSTG (RTH) Full functional replacement of existing capabilities Expanded capacity and capability Transition to new technology –Message queuing (MQ) for internal transport –Network centric systems interconnectivity –Relational database central processing engine –NAS/SAN storage solutions Highly scaleable architecture Hardware refresh Full functional replacement of existing capabilities Expanded capacity and capability Transition to new technology –Message queuing (MQ) for internal transport –Network centric systems interconnectivity –Relational database central processing engine –NAS/SAN storage solutions Highly scaleable architecture Hardware refresh
“Taking the pulse of the planet” Geographically separated backup system in northern Virginia Replacement / Backup TG Description / Data Handling Projection Worldwide users WMO/ICAO Family of services Govt. agencies Internet users Foreign countries Emergency mgrs NWS users Nat’l Centers for Environ. Prediction NWS Regional Offices Domestic/int’l observation & forecast offices AWIPS NWS Telecom Gateway Located in Silver Spring New message switching syst. allows future upgrades x 2 upgradeability Much improved response time Redundancy ensures uninterrupted service Full configuration management 120GB/ GB 85GB/ GB 90GB/ GB 950GB/ GB Daily Throughput/# of circuits Legacy over 5 year projection for replacement Daily total message flow: Legacy TB RTG/BTG – 6.15TB (2011) Measurements/Projections based on May 2006 WMO message flow
“Taking the pulse of the planet” RTG Performance Measures: Requirement FOC Actual Variance Threshold FY06 FY06 FY07 Message (Watch&Warning) Avg. Transit Time (seconds) Message (Routine&Model) Avg. Transit Time (seconds) Avg. Message Traffic (send/receive) (daily) 1.2TB 1.2 TB 00 Requirement FOC Actual Variance Threshold FY06 FY06 FY07 Message (Watch&Warning) Avg. Transit Time (seconds) Message (Routine&Model) Avg. Transit Time (seconds) Avg. Message Traffic (send/receive) (daily) 1.2TB 1.2 TB 00
“Taking the pulse of the planet” For Watches and Warnings: Avg time (seconds) to queue to outbound FEP: 6.16 Max time (seconds) to queue to outbound FEP: 182 (3.03 minutes) Avg time (seconds) to send from outbound FEP: Max time (seconds) to send from outbound FEP: 3838 (63.96 minutes) Avg time (seconds) to queue to outbound FEP: 6.16 Max time (seconds) to queue to outbound FEP: 182 (3.03 minutes) Avg time (seconds) to send from outbound FEP: Max time (seconds) to send from outbound FEP: 3838 (63.96 minutes) Note: Not all connections are moved to the RTG infrastructure. Those still moving through legacy systems have the longest delays. We still see occasional spikes in the RTG processing stream which we are investigating with IBM to determine the cause and resolve.
“Taking the pulse of the planet” For all other data (except Watches and Warnings): Avg time (seconds) to queue to outbound FEP: 6.97 Max time (seconds) to queue to outbound FEP: 236 (3.93 minutes) Avg time (seconds) to send from outbound FEP: Max time (seconds) to send from outbound FEP: 4039 (67.32 minutes) Avg time (seconds) to queue to outbound FEP: 6.97 Max time (seconds) to queue to outbound FEP: 236 (3.93 minutes) Avg time (seconds) to send from outbound FEP: Max time (seconds) to send from outbound FEP: 4039 (67.32 minutes) Note: Not all connections are moved to the RTG infrastructure. Those still moving through legacy systems have the longest delays. We still see occasional spikes in the RTG processing stream which we are investigating with IBM to determine the cause and resolve.
“Taking the pulse of the planet” For Model data: Avg time (seconds) to queue to outbound FEP: Max time (seconds) to queue to outbound FEP: 189 (3.15 minutes) Avg time (seconds) to send from outbound FEP: Max time (seconds) to send from outbound FEP: 1910 (31.83 minutes) Avg time (seconds) to queue to outbound FEP: Max time (seconds) to queue to outbound FEP: 189 (3.15 minutes) Avg time (seconds) to send from outbound FEP: Max time (seconds) to send from outbound FEP: 1910 (31.83 minutes) Note: Not all connections are moved to the RTG infrastructure. Those still moving through legacy systems have the longest delays. We still see occasional spikes in the RTG processing stream which we are investigating with IBM to determine the cause and resolve.
“Taking the pulse of the planet” Government Networking Requirements IP-based networking solution − Any-to-any connectivity − High degree of bandwidth scalability − Optimum redundancy and survivability − IP convergence (i.e., voice, video and data over IP) − High-end performance Network security remains paramount, particularly in light of today’s socio-political threats Segmentation from the public Internet Minimizes risk of security or privacy breaches
“Taking the pulse of the planet” NOAANet Backbone Sprint Peerless IP Network Map Internet Transport Node OC48 Chicago Anaheim San Jose Pennsauken, NJ Kansas City Stockton Cheyenne Fort Worth New York Tacoma Atlanta Relay, MD DC
“Taking the pulse of the planet” NOAANet Status NOAANet Transition: –Internal underway, NWS regions, NCF, NESDIS soon –External – begin December 01, 2006 –Initially two Access Points One within the RTG facility but external to the infrastructure One at Parsippany New York – GTS, AFTN / FAA / Hawaii / Micronesia, Others??? Possibly Atlanta, Chicago, Tacoma, ??? NOAANet Transition: –Internal underway, NWS regions, NCF, NESDIS soon –External – begin December 01, 2006 –Initially two Access Points One within the RTG facility but external to the infrastructure One at Parsippany New York – GTS, AFTN / FAA / Hawaii / Micronesia, Others??? Possibly Atlanta, Chicago, Tacoma, ???
“Taking the pulse of the planet” Status for RTG/BTG NOAANet Projects RTG IOC - June 19, 2006 RTG FOC – 31 September 2006 NOAANet OC-3 connection to BTG – June 2006, OC-12 – 01 October 2006 BTG IOC / OC-12 – 4Q 2006 NOAANet Transition: –Internal underway, NWS regions, NCF, NESDIS soon –External – begin December 01, 2006 BTG IOC (4Q 2006) All 3 projects end – May 31, 2006 RTG IOC - June 19, 2006 RTG FOC – 31 September 2006 NOAANet OC-3 connection to BTG – June 2006, OC-12 – 01 October 2006 BTG IOC / OC-12 – 4Q 2006 NOAANet Transition: –Internal underway, NWS regions, NCF, NESDIS soon –External – begin December 01, 2006 BTG IOC (4Q 2006) All 3 projects end – May 31, 2006
“Taking the pulse of the planet” Other Major Initiatives WIS development planning –TOC undertaking planning of VGISC development and US WIS plan –Basis provide by RTH upgrade and MPLS rollout –Will coordinate with Region IV to develop regional plan Code migration –Workstations throughout the regional capable of processing TDCF –Capability for Upper Air translation exists within RTH. –Extension of translation capability is main enabling method outside of native processing Improved Monitoring –New initiative to be further developed within the RTH and Region. –Part of Phase two of RTH upgrade. WIS development planning –TOC undertaking planning of VGISC development and US WIS plan –Basis provide by RTH upgrade and MPLS rollout –Will coordinate with Region IV to develop regional plan Code migration –Workstations throughout the regional capable of processing TDCF –Capability for Upper Air translation exists within RTH. –Extension of translation capability is main enabling method outside of native processing Improved Monitoring –New initiative to be further developed within the RTH and Region. –Part of Phase two of RTH upgrade.
“Taking the pulse of the planet” Other Major Initiatives Cont. RMTN upgrade ISCS follow on planning beginning EMWIN expansion –Third Border Initiative funding two pilot projects –Plan to implement 10 to 15 additional EMWIN site within Region IV - Caribbean, Central American area Enhanced extra regional connections –Region III –Russia RMTN upgrade ISCS follow on planning beginning EMWIN expansion –Third Border Initiative funding two pilot projects –Plan to implement 10 to 15 additional EMWIN site within Region IV - Caribbean, Central American area Enhanced extra regional connections –Region III –Russia
“Taking the pulse of the planet” Major Concern Existing GTS Frame relay contract ends December 2007 BT may be willing to extend for 1 year What will be its replacement ??? MPLS ??? Existing GTS Frame relay contract ends December 2007 BT may be willing to extend for 1 year What will be its replacement ??? MPLS ???
“Taking the pulse of the planet” Backup slides
“Taking the pulse of the planet” Backup NWSTG
“Taking the pulse of the planet” Issues Data Explosion –Increased resolution of observations and models –Increased frequency of observations and models –Increased number of sensors –Improved sensing technology –New spatial and temporal requirements –Graphics, imagery, and video –Thousands of small products Bandwidth –Technology selection –Estimation of capacity growth –Transmission of ‘information’ versus ‘raw data’ Data Explosion –Increased resolution of observations and models –Increased frequency of observations and models –Increased number of sensors –Improved sensing technology –New spatial and temporal requirements –Graphics, imagery, and video –Thousands of small products Bandwidth –Technology selection –Estimation of capacity growth –Transmission of ‘information’ versus ‘raw data’
“Taking the pulse of the planet” Challenges and Opportunities Demand for Data and Prediction Services Has Dramatically Increased –Climate Services: Drought / El Niño/La Niña –Seismic data for Tsunami Warning Systems –Non traditional data sets –Mesonet Data –Extra-disciplinary (other sciences) data sets International Data Policy: Open and Unrestricted Use of Weather, Climate and Ocean Data Inter/Intra Regional Cooperation Global Earth Observing System of Systems (GEOSS) WMO Information System (WIS) WMO Code Migration Technology Infusion: Keeping Up With Advances in Science and Technology Demand for Data and Prediction Services Has Dramatically Increased –Climate Services: Drought / El Niño/La Niña –Seismic data for Tsunami Warning Systems –Non traditional data sets –Mesonet Data –Extra-disciplinary (other sciences) data sets International Data Policy: Open and Unrestricted Use of Weather, Climate and Ocean Data Inter/Intra Regional Cooperation Global Earth Observing System of Systems (GEOSS) WMO Information System (WIS) WMO Code Migration Technology Infusion: Keeping Up With Advances in Science and Technology
“Taking the pulse of the planet” New Technologies Geographic Information Systems (GIS) Digital Video Broadcast Optical Networks Multi Protocol Label Switching (MPLS) Wireless Public-Key Infrastructure (PKI) New Data Formats –Table driven – Binary & XML Data discovery based exchange Geographic Information Systems (GIS) Digital Video Broadcast Optical Networks Multi Protocol Label Switching (MPLS) Wireless Public-Key Infrastructure (PKI) New Data Formats –Table driven – Binary & XML Data discovery based exchange
“Taking the pulse of the planet” Your Data and Product Advocates Fred Branski - Chief, Performance Monitoring, Analysis, Support & Data Management Branch Data Management Staff (301) ext 146 Walter Smith - Team Leader, Data Management (301) ext 139 Julie Hayes – Customer Relationship Manager (301) ext 120 Richard Robinson - Data Manager (301) ext 179 Cynthia Cromwell – Data Manager (301) ext 143 KWBC Communication Control Center (CCC) - Tech Control Point of contact 24 hours every day Phone: (301) Fax: (301)