Real-Time GOES/POES Data Access Donna McNamara, Distribution and Scheduling Lead Bonnie Morgan, McIDAS Lead NOAA / NESDIS / OSPO / Mission Operations Division (MOD) Matt Seybold, User Service Team NOAA / NESDIS / OSPO / Satellite Product and Services Division (SPSD) NOAA Satellite Conference – April 10, 2013 Title Slide Background and Banner were designed by TeddyPavlis@gmail.com

NESDIS Office of Satellite and Product Operations (OSPO) Key Roles Ground System Command & Control, Ingest, Product Generation and Distribution for the nation’s 17 environmental satellites 4 Geostationary (GOES) by NOAA 5 Polar-Orbiting (POES) by NOAA 6 Defense Meteorological Satellite Program (DMSP) operated by NOAA 1 OSTM Jason-2 (Ocean Surface Topography Mission) Joint NOAA, NASA, CNES, EUMETSAT effort 1 Suomi National Polar-orbiting Partnership (NPP) by NOAA & NASA NSOF Pre-Launch and Post-Launch Testing Operational Testing, Validation, and Verification User Readiness Long-Term Continuity of Products and Services

NESDIS Office of Satellite and Product Operations (OSPO) Locations at four facilities housing 700 OSPO staff NOAA Satellite Operations Facility (NSOF) in Suitland, MD Mission Operations Division NOAA Center for Weather & Climate Prediction (NCWCP) in College Park, MD Satellite Product and Services Division Command and Data Acquisition in AK and VA NSOF Fairbanks CDA NCWCP Wallops CDA

Satellite Information Flow POES NOAA-19 (PM) Center for Satellite Applications and Research (STAR) GOES-15 (West) GOES-13 (East) Non-NOAA (Jason, DMSP, Meteosat, MTSAT, EOS, COSMIC, others) Product Development Algorithm Development Science Maintenance METOP-A (AM) Office of Satellite and Product Operations (OSPO) Also: GOES-14 (Standby) GOES-12 (S.A.) POES-18/17/16/15 Satellite Operations Control Center Environmental Satellite Processing Center Fairbanks Ground Station - POES Wallops Ground Station - GOES Process and Distribute Command and Control Data Products Office of Systems Development (OSD) Customers Ground Systems IT Enterprise Architecture Archive and Access (CLASS) NESDIS Data Centers

Products (Derived & Interpretive) Atmospheric Chemistry Atmospheric Temperature Fire and Smoke Hurricane Intensity and Position Imagery (e.g. Visible, IR, WV) Land Cover – Ice, Snow, Vegetation Ocean Color Satellite Derived Winds (WS,WD,H) Sea Surface Height & Temperature Sounder Profiles and Imagery Space Weather Volcanic Ash and many more… More on products later in the week

Data Access Services Current Access Services (in addition to Direct Broadcast) Data Distribution Service (DDS) – (s)FTP push/pull from secure accounts * NWS Telecommunications Gateway GINI (GOES Ingest and NOAAPORT Interface) / NOAAPORT for Advanced Weather Interactive Processing System (AWIPS) SATEPSDIST – GOES, POES, and Derived Products; McIDAS * Shared Processing DAPE Gateway – for military partners * MODIS server – subset of products made by NASA * Websites - http://www.ospo.noaa.gov/ * Require Data Access Request Archival NODC, NGDC, and NCDC archive data products using CLASS Note photo of customer antennas from one of the local companies – SSEC at U. of Wisconson-Madison. The NOAAPORT broadcast system provides a one-way broadcast communication of NOAA environmental data and information in near-real time to NOAA and external users. This broadcast service is implemented by a commercial provider of satellite communications utilizing C-band. Customer Use of Servers… GINI: NOAAPort/AWIPS, NWS, Unidata Satepsdist: NWS/NCEP, DOD, STAR, SAB, Universities, Private Industry DDS: NWS/NCEP/EMC, ECMWF, UKMET, STAR, DOD

McIDAS Data Delivery Summary SATEPSDIST – Geostationary satellite data is ingested on a Satellite Data Ingestor (SDI), converted to McIDAS format and placed on a server. In addition, some foreign geostationary data, polar data, model data and derived products are converted into McIDAS. This data is served via McIDAS ADDE software: Data NSOF Server ADDE Name Derived Products SATEPSDIST1e DPD GOES-E SATEPSDIST2e GER GOES-W SATEPSDIST3e GWR Polar SATEPSDIST4e PLR Model data SATEPSDIST5 MOD Global Mosaic 5 Sat. Comp. SATEPSDIST6 MOS MSG/MET SATEPSDIST6e MSG / MET MTSAT SATEPSDIST7e MTS Select requested data SATEPSANONE PUB (not operational) Surface/Ship Buoy/RAOBs FOS2 FOS (Family of Services)

Sample of GINI and AWIPS Products Created and distributed through GINI Imagery Sounder “images” Created outside of GINI, but distributed through GINI Five satellite composite files (VIS, IR, WV) Sounder Derived Products (TPW, LI, CTP, ECA, Skin-T) Imager Derived Products (LCB) Polar (POES and DMSP) microwave derived products (TPW, Rain Rate, blended TPW) SSM/I AMSU Blended RR products Created outside of GINI, distributed outside of GINI, but appearing within AWIPS Precipitation Autoestimator (PG on satepsdist1, PD from DDS to AWIPS) GOES BUFR and POES BUFR Soundings High Density Winds ASCAT Text Messages: SPENES, VAA, Tropical Bulletins, Help Desk messages ASOS Satellite Cloud Products

Total Precipitable Water SuperN.PW.1A Lifted Index SuperN.LI.1A Surface Skin Temperature SuperN.SKT.1A Cloud-Top Height SuperN.CTP.1A Not shown… Effective Cloud Amount SuperN.ECA.1A

Plus Many Direct Readout Users! End Product Metrics 35 satellites carrying 182 instruments are used in 183 applications to produce 1,065 end products1 170 Servers conduct ingest, generation, distribution2 568 User organizations access the end products 568 Users A B C D E 1,065 End Products 1 2 3 4 5 30,500+ Subscriptions An Application is the image or science software running in ESPC that ingests satellite data & generates End Products. An End Product is generated by an Application and may vary by satellite, instrument, region, format, resolution, etc. Frequency of data delivery varies by product (e.g. event-driven, 1/day, 6/day, 300/day). Plus Many Direct Readout Users! 1 End products vary by satellite, instrument, region, format, resolution 2 Frequency of data delivery varies by product (e.g. event-driven, 1/day, 6/day, 300/day).

Data Access & Distribution Policy Contact: NESDIS.data.access@noaa.gov Full policy and forms at http://www.ospo.noaa.gov/Organization/About/access.html Security requirement to know and document all users accessing operational data servers and what products they are receiving Users request data using a Data Access Request (DAR) form. Ever increasing data volumes require prioritization of users to effectively manage data distribution resources to ensure effective system performance Higher priority access will be given to organizations with: Mission and statutory authority that supports the requirement for data access Signed NESDIS cooperative agreements or other legislative authorities A demonstrated timeliness requirement for near-real time satellite data and products to support operational user applications. If available, users will be directed to sources of data that are external to NESDIS but still fulfill data requirement. We will make best efforts to recommend alternative distribution sources for users that are denied access to operational servers.

Data Access & Distribution DDS Re-Validation was accomplished in 2012 Migration to new DDS was completed There was a 17% reduction in the number of approved accounts SATEPSDIST Re-Validation starting around May 1 Part of migration to new GEODIST servers GEODIST will likely host ONLY McIDAS ADDE access McIDAS GROUP/DESCRIPTOR access restrictions will be enacted for external users It very important users identify all datasets they need All non-McIDAS files will be served via DDS Contact information for SATEPSDIST users were not well maintained, so if you are a current user who has not been contacted, let us know ASAP to get a DAR form. GEODIST scheduled to be operational in Aug (may be delayed) -- Planning for 30 days parallel test period prior to becoming operational -- Planning to have SATEPSDIST run with 8x5 support for 2 weeks after cut-over date.

Future Data Access & Distribution New enterprise system Product Distribution and Access (PDA) is coming Will be used for legacy GOES/POES, NPP, IJPS and GOES-R data access Operational for legacy and NPP planned for Oct 2014 – talk to follow McIDAS ADDE access will remain on GEODIST

Notifications & Status Email SPSD.userservices@noaa.gov and ask to be added to ESPC Notification email list. General Satellite Messages from ESPC: http://www.ssd.noaa.gov/PS/SATS/messages.html WMO Bulletins on the GTS (Global Telecommunications System): WMO header NOUS71 KNES (AWIPS ID ADANES) for urgent notices (e.g., outages or anomalies) http://www.weather.gov/view/validProds.php?prod=ADM&node=KNES WMO header NOUS72 KNES (AWIPS ID ADMNES) for routine notices (e.g., eclipse schedule, RSO, etc.) http://www.weather.gov/view/validProds.php?prod=ADA&node=KNES Non-Operational Sources: Sat Ops Status: http://www.oso.noaa.gov/daily-news/index.asp Twitter: http://twitter.com/noaasatellites Facebook: https://www.facebook.com/NOAANESDIS Press Release: http://www.nesdis.noaa.gov/news_archives/goes_reposition.html

Contact Information 24/7 Help Desk ESPCOperations@noaa.gov User Services SPSD.UserServices@noaa.gov Data Access NESDIS.Data.Access@noaa.gov Webmaster SSDWebmaster@noaa.gov Web www.ospo.noaa.gov www.facebook.com/NOAANESDIS www.twitter.com/noaasatellites