David Ruth Meteorological Development Laboratory National Weather Service, NOAA NOAA System-of-Systems Workshop October 2009

NDFD in System-of-Systems 2 The NWS Strategic Plan Deliver a credible, timely, and relevant suite of seamless weather, water, and climate products and services which exploit technology to the fullest to meet customer and partner needs. Post NWS products and data on the Internet in graphic-oriented format (2002) Post NWS products and data on the Internet in graphic-oriented format (2002) Prepare and disseminate NWS forecast products in digital form (2003) Prepare and disseminate NWS forecast products in digital form (2003)

NDFD in System-of-Systems 3 The National Academies

NDFD in System-of-Systems 4 National Digital Forecast Database (NDFD) Contains a seamless mosaic of NWS digital forecastsContains a seamless mosaic of NWS digital forecasts Is available to all users and partners – public and privateIs available to all users and partners – public and private Allows users and partners to create wide range of text, graphic, and image productsAllows users and partners to create wide range of text, graphic, and image products

NDFD in System-of-Systems 5 User-Generated Products How is NDFD Produced? – –Detailed – –Interactive – –Collaborative NWS Automated Products Text Graphic Digital Voice TODAY...RAIN LIKELY. SNOW LIKELY ABOVE 2500 FEET. SNOW ACCUMULATION BY LATE AFTERNOON 1 TO 2 INCHES ABOVE 2500 FEET. COLDER WITH HIGHS 35 TO 40. SOUTHEAST WIND 5 TO 10 MPH SHIFTING TO THE SOUTHWESTEARLY THIS AFTERNOON. CHANCE OF PRECIPITATION 70%. National Digital Forecast Database Local Digital Forecast Database Field Offices National Centers Collaborate Data and Science Focus National Centers Model Guidance Grids

NDFD in System-of-Systems 6 Current NDFD Elements Current NDFD Elements MaxT, MinT Temp, Dew, AppT, RH Sky, PoP12, QPF, Snow Wave Height, Tropical Winds Weather, Wind, Wind Gusts Hazards, Convection, Climate Outlooks Climate Outlooks

NDFD in System-of-Systems 7 Individual Decision Assistance General Access to NWS Information Sector-Specific Decision Support Information Organization- Specific Decision Support Information Group Decision Assistance Standard NWS information products and services for a broad set of needs Standard NWS information products and services for a group of users with common interests Standard NWS information products and services for a specific organization (usually a government agency) NWS expert(s) who interact directly with a group of decision makers and/or information providers in a specific decision context NWS expert(s) who interact directly with and support an individual decision maker in a specific decision context Tier 5Tier 4Tier 3Tier 2Tier 1 WHAT NWS Provides in Each Tier Role of NDFD in Decision Support Services Decision Support Services NDFD

NDFD in System-of-Systems 8 NDFD in NextGen Era “All support facilities will have a common forecast and communications toolset of hardware and software, including the NWS National Digital Forecast Database (NDFD). The NDFD is a step toward the NextGen 4D Weather Cube.”“All support facilities will have a common forecast and communications toolset of hardware and software, including the NWS National Digital Forecast Database (NDFD). The NDFD is a step toward the NextGen 4D Weather Cube.” “We currently have a National Digital Forecast Database (NDFD) and a National Digital Guidance Database (NDGD), the foundation and building blocks for moving forward into the NextGen era.”“We currently have a National Digital Forecast Database (NDFD) and a National Digital Guidance Database (NDGD), the foundation and building blocks for moving forward into the NextGen era.” excerpted from NWS response to FAA’s CWSU Requirements Document May 9, 2008 NextGen

NDFD in System-of-Systems 9 New NWS Flagship Service “The NDFD is now our flagship service, so we need to ensure it provides the most accurate and current information possible. “ “The NDFD is now our flagship service, so we need to ensure it provides the most accurate and current information possible. “ Mary M. Glackin, Acting Director, National Weather Service NWS Focus - July 5, 2007 NWS Focus - July 5, 2007

NDFD in System-of-Systems 10 The Limited Reach of Weather.gov Source:

NDFD in System-of-Systems 11 HAMweather Civil Aviation Weather Bug Weather Underground Google Maps ESRI GIS AccuWeather Custom Weather The Weather Network Weather Central TV QuickCast Dow Home Products FORECA Energy Production Hurricane Alley PASDA Map Services Fire Danger nowCOAST Univ of Texas Astronomy Hydro One Web Icons University Research State Government Federal Agencies Agricultural Weather Armed Forces The Unlimited Reach of NDFD The Unlimited Reach of NDFD Real Estate Data Sharewar e Chumby GRIBv2 100,000 files/day 100,000 files/day ~200 users ~200 usersSOAP/XML 2,000,000 requests/day 2,000,000 requests/day ~10,000 users ~10,000 users

NDFD in System-of-Systems 12 IT Infrastructure and Major System Interfaces NDFD Central Server System (CSS) consists of three dual- server clusters. 2 redundant clusters at AWIPS Network Control Facility (ANCF) 2 redundant clusters at AWIPS Network Control Facility (ANCF) 1 cluster at AWIPS Backup Network Control Facility (BNCF) 1 cluster at AWIPS Backup Network Control Facility (BNCF) Two sources of data to NDFD CSS WFOs – IFPS Service Backup netCDF files via SvcBu rsync servers WFOs – IFPS Service Backup netCDF files via SvcBu rsync servers NCEP – GRIB2 from TPC, SPC, CPC, and EMC; text from HPC NCEP – GRIB2 from TPC, SPC, CPC, and EMC; text from HPC Three sinks of data from NDFD CSS Telecommunications Operations Center (TOC) – GRIB2, XML Telecommunications Operations Center (TOC) – GRIB2, XML NWS Web Farm – GRIB2 NWS Web Farm – GRIB2 River Forecast Centers (pulled via AWIPS WAN) – GRIB2 River Forecast Centers (pulled via AWIPS WAN) – GRIB2

NDFD in System-of-Systems 13 ap2-emix db2-emix Secondary NDFD cluster AWIPS NCF LAN ap1-emix db1-emix Primary NDFD cluster IFPS Service Backup Servers NAS Internet Partners & Customers AWIPS WAN WFO (120+) NDFD Data Flow RFC (13) NWS Web Farm NWS TOC NCEP

NDFD in System-of-Systems 14 NDFD Standards and Format Grid forecasts netCDF (from WFOs) netCDF (from WFOs) GRIB2 via HTTP and FTP GRIB2 via HTTP and FTP Point forecasts Digital Weather Markup Language (DWML) via SOAPDigital Weather Markup Language (DWML) via SOAP Web Feature Service employing OGC standardsWeb Feature Service employing OGC standards Tabular XML Products (TPEX)Tabular XML Products (TPEX)

NDFD in System-of-Systems 15 NDFD Development Spatial resolution that better resolves complex terrainSpatial resolution that better resolves complex terrain –2.5km 4 th quarter FY10 Hourly temporal resolution (#1 customer request)Hourly temporal resolution (#1 customer request) More frequent than hourly updatesMore frequent than hourly updates Additional forecast elementsAdditional forecast elements – Fire weather (3 rd quarter FY 10) – Probabilistic – Digital forecasts from NCEP service centers – 4D grids capable of supporting Next Generation Air Transportation System