Preparing for GOES-R: Post Launch Test Planning Wayne MacKenzie GOES-R Product Area Lead GOES-R Product Readiness and Operations (PRO) Team Deputy GOES-R/JPSS.

Slides:



Advertisements
Similar presentations
Calibration of GOES-R ABI cloud products and TRMM/GPM observations to ground-based radar rainfall estimates for the MRMS system – Status and future plans.
Advertisements

Deirdre Kann National Weather Service WFO Albuquerque Deirdre Kann National Weather Service WFO Albuquerque 7 th GOES User’s Conference October 21, 2011.
Update on GOES-R Proving Ground Activities at the Operations Proving Ground Chad Gravelle GOES-R/JPSS All-Hands Call – 7 July 2014.
TRMM Tropical Rainfall Measurement (Mission). Why TRMM? n Tropical Rainfall Measuring Mission (TRMM) is a joint US-Japan study initiated in 1997 to study.
1 QPE / Rainfall Rate January 10, 2014 Presented By: Bob Kuligowski NOAA/NESDIS/STAR.
1 GOES Users’ Conference October 1, 2002 GOES Users’ Conference October 1, 2002 John (Jack) J. Kelly, Jr. National Weather Service Infusion of Satellite.
Transitioning unique NASA data and research technologies to operations Relevant OCONUS Products Gary Jedlovec NASA / MSFC, Earth Science Office
TOTAL OPERATIONAL WEATHER READINESS – SATELLITES (TOWR-S) PROJECT Corresponding author: User Readiness for GOES-R and JPSS is dynamic.
Processing Himawari-8 Geostationary Satellite Data Using GOES-R Algorithms for Algorithm Continuity in Operations Jonathan Wrotny1, A. Li1, H. Xie1, M.
Experiences with Operational Readiness through the TOWR-S On-site Operations Testing Mel Nordquist – WFO EKA Frank Alsheimer – WFO CHS.
Development of NWS Satellite User Readiness Mike Johnson NWS/OST November 4, 2009.
May 15, 2013 Space Weather Product Team (SWPT) Making Sense of the Nonsensical.
Introduction Land surface temperature (LST) measurement is important for understanding climate change, modeling the hydrological and biogeochemical cycles,
Jaime Daniels Program Manager (Acting) GOES-R Algorithm Working Group (AWG) NOAA/NESDIS, Center for Satellite Applications and Research September 21, 2011.
2013 GOES-R AWG 2 nd Validation Workshop January 2014 Status of Activities and Plans for the GOES-R Core Ground System 1 Satya Kalluri Ph.D. GOES-R.
EARLINET and Satellites: Partners for Aerosol Observations Matthias Wiegner Universität München Meteorologisches Institut (Satellites: spaceborne passive.
NOAA Satellite Proving Ground/User Readiness Meeting
1 CIMSS Participation in the Development of a GOES-R Proving Ground Timothy J. Schmit NOAA/NESDIS/Satellite Applications and Research Advanced Satellite.
GOES-R ABI PROXY DATA SET GENERATION AT CIMSS Mathew M. Gunshor, Justin Sieglaff, Erik Olson, Thomas Greenwald, Jason Otkin, and Allen Huang Cooperative.
Month day, year Comments from NWSHQ Perspective Need to produce table showing 68 baseline & option products vs products that PG is working on What is link.
Thanks also to… Tom Wrublewski, NOAA Liaison Office Steve Kirkner, GOES Program Office Scott Bachmeier, CIMSS Ed Miller, NOAA Liaison Office Eric Chipman,
1 The GOES-R Rainfall Rate / QPE Algorithm Status May 1, 2011 Presented By: Bob Kuligowski NOAA/NESDIS/STAR.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Current Status  Framework is in place and algorithms are being integrated.
1 CIMSS Participation GOES-R Proving Ground Status January 2011 UW-Madison Contributors to this presentation: Tim Schmit, Wayne Feltz, Jordan Gerth, Scott.
1 GOES-R AWG Product Validation Tool Development Aviation Application Team – Volcanic Ash Mike Pavolonis (STAR)
1 GOES-R AWG Product Validation Tool Development Aviation Application Team – Volcanic Ash Mike Pavolonis (STAR)
1 Center for S a t ellite A pplications and R esearch (STAR) Applicability of GOES-R AWG Cloud Algorithms for JPSS/VIIRS AMS Annual Meeting Future Operational.
TOWR-G Test for Operational Weather Readiness with GOES-R Joe Zajic NWS Office of Science & Technology – Science Plans Branch Integrity Applications Incorporated.
2015 AMS Annual Meeting Non Export-Controlled Information Progress in Development and Integration of the Product Generation Capabilities of the GOES- R.
1 Validated Stage 1 Science Maturity Review for VIIRS Cloud Base, Nighttime Optical Properties and Cloud Cover Layers Products Andrew Heidinger September.
2015 OCONUS Meeting Non Export-Controlled Information Progress in Development and Integration of the Product Generation Capabilities of the GOES-R Ground.
Near-Real-Time Simulated ABI Imagery for User Readiness, Retrieval Algorithm Evaluation and Model Verification Tom Greenwald, Brad Pierce*, Jason Otkin,
Hyperspectral Infrared Alone Cloudy Sounding Algorithm Development Objective and Summary To prepare for the synergistic use of data from the high-temporal.
January 7, 2015 Walter Wolf, Jaime Daniels, and Lihang Zhou NOAA/NESDIS, Center for Satellite Applications and Research (STAR) Shanna Sampson, Tom King,
GOES-R Proving Ground Status/Update Bonnie Reed January 2011.
GOES-R Recommendations from past GOES Users’ Conference: Jim Gurka Tim Schmit Tom Renkevens NOAA/ NESDIS Tony Mostek NOAA/ NWS Dick Reynolds Short and.
NOAA Science Week – Kansas City, MO. 30 April 2012 Non Export-Controlled Information GOES-R – System Validation and User Readiness Planning Stephen D.
Framework Details  All products may be run from one program  Coordination of input data:  Model Forecast data  Emissivity Data  Instrument Data 
VALIDATION AND IMPROVEMENT OF THE GOES-R RAINFALL RATE ALGORITHM Background Robert J. Kuligowski, Center for Satellite Applications and Research, NOAA/NESDIS,
Bill Campbell, Brian Gockel, and Jim Heil (NOAA/NWS) Marge Ripley and Jean-Jacques Bedet (NOAA/NESDIS/GOES-R) Improved Temporal Resolution GOES-R Sectorized.
Update on PG Program Plan & AWG product prioritization Bonnie Reed.
Transitioning research data to the operational weather community Overview of GOES-R Proving Ground Activities at the Short-term Prediction Research and.
R. T. Pinker, H. Wang, R. Hollmann, and H. Gadhavi Department of Atmospheric and Oceanic Science, University of Maryland, College Park, Maryland Use of.
AWIPS Readiness for New Satellite Products Mike Johnson (NWS/OBS) OCONUS Proving Ground 13 May,
NWS Satellite User Readiness - Overview Mike Johnson Proving Ground / User Readiness Conference June 2,
Stephen Ambrose GOES-R Data Operations Manager (DOM) OSPO/SPSD March 12, 2013 GOES-R Ground Segment Project Data Operations Support Team System Validation.
Satellite Precipitation Estimation and Nowcasting Plans for the GOES-R Era Robert J. Kuligowski NOAA/NESDIS Center for Satellite Applications and Research.
0 0 Robert Wolfe NASA GSFC, Greenbelt, MD GSFC Hydrospheric and Biospheric Sciences Laboratory, Terrestrial Information System Branch (614.5) Carbon Cycle.
Geostationary Operational Environmental Satellite R- Series GOES-R Proving Ground High Latitude and Arctic Test Bed Dr. Frank P Kelly Director Alaska Region.
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 2 June 2009 PDA Animated Weather (PAW) Status by Russ Dengel.
VIIRS Cloud Mask (VCM) CCR Dr. Thomas Kopp – VCM Validation Lead Dr. William Thomas – VCM JAM 1.
N A T I O N A L O C E A N I C A N D A T M O S P H E R I C A D M I N I S T R A T I O N NPP DATA ACCESS Mitch Goldberg JPSS Program Scientist June 21, 2012.
NOAA Satellite Proving Ground/User Readiness Meeting Kansas City, MO September 9, 2015.
1 GOES-R AWG Product Validation Tool Development AWG GRAFIIR Team June 16, 2011 Presented by: Mat Gunshor of CIMSS Ray Garcia, Allen Huang, Graeme Martin,
AWIPS Governance What are we Governing? –EDEX/CAVE plugins developed for an operational AWIPS system Out of Scope: GFE Smart inits and tools, µengine.
A. FY12-13 GIMPAP Project Proposal Title Page version 26 October 2011 Title: WRF Cloud and Moisture Verification with GOES Status: New GOES Utilization.
GOES-R Product Distribution Logistics Before and After Handover Kathryn Miretzky GOES-R User Services Coordinator Product Readiness and Operations (PRO)
NOAA, May 2014 Coordination Group for Meteorological Satellites - CGMS NOAA Activities toward Transitioning Mature R&D Missions to an Operational Status.
Band 14 (11um) Winds Low-Level >700 mb Mid-Level mb High-Level mb   NPP VIIRS Polar Winds Products The GOES-R AWG Derived Motion Winds.
Matt Seybold (OSPO/SPSD) GOES-R Data Operations Manager & PRO Team Lead NOAA Satellite Proving Ground and User Readiness Meeting May 9, /9/2016NOAA.
1 Preliminary Validation of the GOES-R Rainfall Rate Algorithm(s) over Guam and Hawaii 30 June 2016 Presented By: Bob Kuligowski NOAA/NESDIS/STAR.
Matt Seybold (OSPO/SPSD) GOES-R Data Operations Manager & PRO Team Lead NOAA Satellite Proving Ground and User Readiness Meeting May 9, /9/2016NOAA.
GOES-R AIT: Updating the Data Processing System with data from the Himawari-8 Geostationary Satellite Jonathan Wrotny1, A. Li1, A. Ken1, H. Xie1, M. Fan1,
TOTAL OPERATIONAL WEATHER READINESS – SATELLITES (TOWR-S) PROJECT
GOES-R Observational Requirements: Alternative 1 (no sounder)
Advanced Satellite Products Branch at the Cooperative Institute for Meteorological Satellite Studies (CIMSS) University of Wisconsin-Madison The Advanced.
Status of recent/near future VISIT/SHyMet as it relates to the Satellite Foundational Course for GOES-R (SatFC-G) NOAA Satellite Proving Ground / User.
McIDAS-X Software Development and Demonstration
Advanced Satellite Products Branch at the Cooperative Institute for Meteorological Satellite Studies (CIMSS) University of Wisconsin-Madison The Advanced.
Potential GEO Products/Users
Presentation transcript:

Preparing for GOES-R: Post Launch Test Planning Wayne MacKenzie GOES-R Product Area Lead GOES-R Product Readiness and Operations (PRO) Team Deputy GOES-R/JPSS OCONUS Satellite Proving Ground Meeting June 28, 2016

Agenda What does it take to make Imagery? Pre-Launch Activities PLT Validation Maturity Stages Algorithm Change Process L2+ Algorithm Updates 2

WHAT DOES IT TAKE TO MAKE A SATELLITE IMAGE? 3

Sectorized CMIL1b ImageL1β Data L0 Data … Calibrate L1α DataL1a Data Scale to Ref/BT Resample Data Processing 4 Image credit: Dave Pogorzala

PRE-LAUNCH ACTIVITIES 5

Data Operations Exercises DOEs are mission rehearsals executed by the Data Operations Support Team to support readiness Conducted in a “rehearse like we fly” manner DOE-4, July 18-August 26, 2016, will include participation by the NWS TOWR-S (Total Operational Weather Readiness - Satellites) project which is incorporating distribution to elements of the AWIPS community NWS sends data via the Satellite Broadcast Network (SBN) to select WFOs and NCEP Centers to ensure preparedness of their distribution systems. This test data is accessible to anyone with a SBN receiver. 6

DOE-4 Planning Supporting end-to-end LUT updates, and Algorithm Changes Cal/Val Teams will have access to data via PDA to evaluate the products in real-time Using near real-time simulated imagery Supporting anomaly resolution NWS sends data via the Satellite Broadcast Network (SBN) to select WFOs and NCEP Centers to ensure preparedness of their distribution systems. This test data is accessible to anyone with a SBN receiver. Will perform complete end-to-end L2 algorithm update 7

Simulated Cloud & Moisture Imagery (CMI) from the Ground Readiness Exercise GRE-DO1 (AAWDS) 8 GOES-R Inspection Program (GRIP) 10/21/15 NWS AWIPS 4-Panel Display 10/15/15 The GOES-R AWG Proxy Team at NESDIS/STAR’s Cooperative Institute for Meteorological Satellite Studies (CIMSS) creates 16 bands of real-time modeled data using WRF and GFS models, called AAWDS (ABI AWG/UW-Madison Data Set) RaFTR software formats the data and interpolates to the GOES-R real-time cadence for sampling Earth then the data are injected to the GOES-R GS data fabric Finally, PD sends the NetCDF files to NWS which broadcasts the file over the SBN to AWIPS-II terminals at select WFOs Forecasters then look at these simulated “GOES-R products” and can see the spatial/spectral/temporal benefits and make side-by-side comparisons against other tools

POST-LAUNCH ACTIVITIES: VALIDATION MATURITY 9

Product Maturity Levels What do the Product Maturity Levels mean? There is a PS-PVR at each stage as a method of informing the user community of the following readiness for use: Beta: Products are made available to users to gain familiarity with data formats and parameters. It has been minimally validated and may still contain significant errors and is not optimized for operational use. Provisional: Product ready for operational use but has documented known issues. Product analyses are sufficient to communicate product performance to users relative to expectations. Full: Product is operational. All known product anomalies are resolved and/or documented and shared with the user community.

Product Maturity Level Success Criteria

How much work is it to achieve these maturity levels?

Beta Validation Tests 13 L2 AlgorithmNumber of Tests Clear Sky Mask8 Aerosol Detection11 Aerosol Optical Depth6 Cloud Optical Properties8 Cloud Top Parameters8 Imagery7 DMW56 Shortwave Radiation8 Soundings (including TPW and DSI)32 Fire10 Hurricane Intensity5 LST8 Rainrate3 Snow Cover8 SST1 Volcanic Ash5

Provisional Validation Tests 14 L2 AlgorithmNumber of Tests Clear Sky Mask3 Aerosol Detection3 Aerosol Optical Depth2 Cloud Optical Properties3 Cloud Top Parameters3 Imagery3 DMW21 Shortwave Radiation3 Soundings (including TPW and DSI)12 Fire2 Hurricane Intensity1 LST3 Rainrate1 Snow Cover3 SST1 Volcanic Ash1

Full Validation Tests 15 L2 AlgorithmNumber of Tests Clear Sky Mask3 Aerosol Detection3 Aerosol Optical Depth2 Cloud Optical Properties3 Cloud Top Parameters3 Imagery3 DMW21 Shortwave Radiation3 Soundings (including TPW and DSI)12 Fire2 Hurricane Intensity1 LST3 Rainrate1 Snow Cover3 SST1 Volcanic Ash1

DATA RELEASE INFORMATION 16

Detailed Data Release Strategy 17 Internal Flow L+15 Days External Distribution L+88 Days Handover Readiness Review (HRR) & Operations Handover L+6 Months Internal Flow (ABI) for Cal/Val Teams L+30 Days 17

Detailed Data Release Strategy 18 nternal Flow L+15 Days External Distribution L+88 Days Handover Readiness Review (HRR) & Operations Handover L+6 Months Beta – ABI L1b, CMI GRB ABI Feed turned on, CMI over PDA L+88 Days 18

Detailed Data Release Strategy 19 nternal Flow L+15 Days External Distribution L+88 Days Handover Readiness Review (HRR) & Operations Handover L+6 Months 19 Beta – GLM GRB GLM Feed turned on L+148 Days

Detailed Data Release Strategy 20 nternal Flow L+15 Days External Distribution L+88 Days Handover Readiness Review (HRR) & Operations Handover L+6 Months Provisional – ABI L1b, CMI, GLM Beta – L2 Products L+6 Months 20

Detailed Data Release Strategy 21 nternal Flow L+15 Days External Distribution L+88 Days Handover Readiness Review (HRR) & Operations Handover L+6 Months East/West Assignment Provisional – L2 Products L+12 Months 21

Detailed Data Release Strategy 22 nternal Flow L+15 Days External Distribution L+88 Days Handover Readiness Review (HRR) & Operations Handover L+6 Months Full Validation – L1 Products L+18 Months 22

Detailed Data Release Strategy 23 nternal Flow L+15 Days External Distribution L+88 Days Handover Readiness Review (HRR) & Operations Handover L+6 Months Full Validation – L2 Products L+21 Months 23

ALGORITHM CHANGE PROCESS 24

L2 Algorithm Change Process Within the ground system, L2 algorithms are individual RPMs This enables changing individual algorithms without re- compiling the entire ground system and a fast deployment During PLT, we will be implementing a three week build cycle for algorithms Each build will contain 5-10 fixes depending on the level of effort Each build will involve system testing and working with the AWG to ensure algorithm output is correct. Promotion to ops can occur quickly after the DE testing is complete 26

Engineering Patch An engineering patch is multiple DAPs and/or changes that that require chain testing and coordination by multiple groups. – L1b changes that affect multiple algorithms – L2+ changes – Non-science changes that are needed quickly requested by the DCRB. This process will occur on 2 week schedule every 3 weeks where it does not interfere with an ITCO. The process involves 3 day chain testing and all changes will be included in a single OCCR.

2 Week Engineer Patch Overview CM Merge/DE Prep Test on Live Data Stop Test/ Send Data Test Data Review/ Write WR ARB Review/OCCR Review/Deployment 1.5 Days2.5 Days 3 Days 1 Days7 Days

2 Week Engineering Patch Overview con’t CM Merge/DE Prep – Thursday – Friday -The changes are merged into the PRO INT branch and back-out procedures are compiled. Test on Live Data - Tested on live data over the weekend. Stop Test/Send Data – On Monday the test is stopped. The changes are backed out of the DE and the test data is sent to the cal/val teams or appropriate party. CM Merge/DE Prep Test on Live Data Stop Test/ Send Data Test Data Review/ Write WRs ARB Review/OCCR Review/Deployment 1.5 Days2.5 Days 3 Days 1 Days7 Days

2 Week Engineering Patch Overview con’t Test Data Review/Write WRs – Tuesday – Thursday - The test data is reviewed by the cal/val teams. This is a regression test so not only are the cal/val teams looking for the changes to functioning properly but also that there are not adverse consequences. WRs are also written. On Friday if the test is successful the OCCR is written and goes out for review. CM Merge/DE Prep Test on Live Data Stop Test/ Send Data Test Data Review/ Write WRs ARB Review/OCCR Review/Deployment 1.5 Days2.5 Days 3 Days 1 Days7 Days

2 Week Engineering Patch Overview con’t Monday – The ARB approves the change. Tuesday – The WR is moved into work at WAM. Wednesday – The OCCR is approved and changes are deployed to the DE via Satellite Server. Thursday – The changes are deployed to the ITE and OE. CM Merge/DE Prep Test on Live Data Stop Test/ Send Data Test Data Review/ Write WRs ARB Review/OCCR Review/Deployment 1.5 Days2.5 Days 3 Days 1 Days7 Days

STATUS OF L2 ALGORITHMS 32

L2+ Algorithm Status 6/2/2016Operations Status Review (OSR) AlgorithmStatus ADPMatches AWG Test Data Results AODMatches AWG Test Data Results CMIMatches AWG Test Data Results Vol AshMatches AWG Test Data Results Clear Sky MaskMatches AWG Test Data Results CTP/CTT/CTHMatches AWG Test Data Results SoundingsMatches AWG Test Data Results Cloud PhaseMatches AWG Test Data Results DSR/RSRMatches AWG Test Data Results Snow Cover- Deferred. Degraded performance due to lack of Albedo product. Albedo was removed from Baseline in 2012, but is being developed by AWG. To accomplish delivery in 2016 Q4 & implementation in 2017 Q4. - User impact is to NIC which uses for comparisons in development of IMS. Four downstream products depend on Snow Cover, but all 4 have switched to IMS polar product (2km resolution matches GOES-R). DMWRemaining issues are being worked. Held a TIM with AWG/Harris/AER on 4/28 and 6/16. Several issues were identified and are being examined with AWG. Should be resolved and deployed in early PLT. LSTMatches AWG Test Data Results FireMatches AWG Test Data Results Rain RateMatches AWG Test Data Results – However, operational implementation is missing parallax correction which will impact operational implementation cal/val activities. Mitigation – implement parallax correction as one of the wrapped algorithm trade studies ASAP, which is likely after PLT. Hurricane IntensityMatches AWG Test Data Results SSTMatches AWG Test Data Results 33

Deltas to the Baseline Versions of the L2 Product Algorithms (Baseline Enhancements) Deltas to the Baseline Versions of the L2 Product Algorithms (Baseline Enhancements) L2 Product Algorithm Deltas? Change Type(s) Data Interface Changes? Aerosol Detection YTN Aerosol Optical Depth YI, LN Clear Sky Mask YT (baseline), M (new)N Cloud and Moisture Imagery (KPP) N--- Cloud Optical Depth YL,T--- Cloud Particle Size Distribution YL,T--- Cloud Top Height YI,TN Cloud Top Phase YTN Cloud Top Pressure YI,TN Cloud Top Temperature YI,TN Derived Motion Winds YI, C, TN Derived Stability Parameters N--- Downward Shortwave Radiation: SFC YLN 34 Change Types: Incremental (I) Major (M) Look-up Table (L) Threshold (T) Config (C)

Deltas to the Baseline Versions of the L2 Product Algorithms (Baseline Enhancements) Deltas to the Baseline Versions of the L2 Product Algorithms (Baseline Enhancements) L2 Product Algorithm Deltas? Change Type(s) Data Interface Changes? Fire/Hot Spot Characterization YT,LN Hurricane Intensity Estimation YI, TY Land Surface Temperature (Skin) YI, LY Legacy Vertical Moisture Profile YTN Legacy Vertical temperature Profile YTN Radiances N--- Rainfall Rate/QPE YIY Reflected Shortwave Radiation: TOA YLN Sea Surface Temperature (Skin) YI,T (Baseline), M (new)N Snow Cover YLY Total Precipitable Water N--- Volcanic Ash: Detection and Height YM (new)Y 35 Change Types: Incremental (I) Major (M) Look-up Table (L) Threshold (T) Config (C)

Deltas to the Baseline Versions of the L2 Product Algorithms (Baseline Enhancements) Deltas to the Baseline Versions of the L2 Product Algorithms (Baseline Enhancements) L2 Product Algorithm Deltas? Change Type(s) Data Interface Changes? Fire/Hot Spot Characterization YT,LN Hurricane Intensity Estimation YI, TY Land Surface Temperature (Skin) YI, LY Legacy Vertical Moisture Profile YTN Legacy Vertical temperature Profile YTN Radiances N--- Rainfall Rate/QPE YIY Reflected Shortwave Radiation: TOA YLN Sea Surface Temperature (Skin) YI,T (Baseline), M (new)N Snow Cover YLY Total Precipitable Water N--- Volcanic Ash: Detection and Height YM (new)Y 36 Change Types: Incremental (I) Major (M) Look-up Table (L) Threshold (T) Config (C) BOTTOM LINE: Algorithms that require a LUT or Threshold Change will be implemented during PLT. Incremental and configuration changes will be addressed on a per algorithm basis during PLT. BOTTOM LINE: Algorithms that require a LUT or Threshold Change will be implemented during PLT. Incremental and configuration changes will be addressed on a per algorithm basis during PLT.

Questions? For questions or general information, please contact me at: – 37