For Cryosphere Products – Sea Ice

Slides:



Advertisements
Similar presentations
1 1. FY09 GOES-R3 Project Proposal Title Page Title: Trace Gas and Aerosol Emissions from GOES-R ABI Project Type: GOES-R algorithm development project.
Advertisements

A thermodynamic model for estimating sea and lake ice thickness with optical satellite data Student presentation for GGS656 Sanmei Li April 17, 2012.
VIIRS LST Uncertainty Estimation And Quality Assessment of Suomi NPP VIIRS Land Surface Temperature Product 1 CICS, University of Maryland, College Park;
Sea Ice Thickness from Satellite, Aircraft, and Model Data Xuanji Wang 1 and Jeffrey R. Key 1 Cooperative.
A Multi-Sensor, Multi-Parameter Approach to Studying Sea Ice: A Case-Study with EOS Data Walt Meier 2 March 2005IGOS Cryosphere Theme Workshop.
1 Improved Sea Surface Temperature (SST) Analyses for Climate NOAA’s National Climatic Data Center Asheville, NC Thomas M. Smith Richard W. Reynolds Kenneth.
1 NOAA’s National Climatic Data Center April 2005 Climate Observation Program Blended SST Analysis Changes and Implications for the Buoy Network 1.Plans.
Analysis of High Resolution Infrared Images of Hurricanes from Polar Satellites as a Proxy for GOES-R INTRODUCTION GOES-R will include the Advanced Baseline.
May 15, 2013 Space Weather Product Team (SWPT) Making Sense of the Nonsensical.
Introduction Land surface temperature (LST) measurement is important for understanding climate change, modeling the hydrological and biogeochemical cycles,
1 Validated Stage 1 Science Maturity Review for {JPSS Algorithm} Presented by Date.
Aircraft spiral on July 20, 2011 at 14 UTC Validation of GOES-R ABI Surface PM2.5 Concentrations using AIRNOW and Aircraft Data Shobha Kondragunta (NOAA),
1 GOES-R AWG Hydrology Algorithm Team: Rainfall Probability June 14, 2011 Presented By: Bob Kuligowski NOAA/NESDIS/STAR.
Comparison of SSM/I Sea Ice Concentration with Kompsat-1 EOC Images of the Arctic and Antarctic Hyangsun Han and Hoonyol Lee Department of Geophysics,
VALIDATION OF SUOMI NPP/VIIRS OPERATIONAL AEROSOL PRODUCTS THROUGH MULTI-SENSOR INTERCOMPARISONS Huang, J. I. Laszlo, S. Kondragunta,
Orbit Characteristics and View Angle Effects on the Global Cloud Field
MODIS Sea-Surface Temperatures for GHRSST-PP Robert H. Evans & Peter J. Minnett Otis Brown, Erica Key, Goshka Szczodrak, Kay Kilpatrick, Warner Baringer,
1 GOES-R AWG Hydrology Algorithm Team: Rainfall Potential June 14, 2011 Presented By: Bob Kuligowski NOAA/NESDIS/STAR.
Assimilating Retrievals of Sea Surface Temperature from VIIRS and AMSR2 Bruce Brasnett and Dorina Surcel Colan CMDE November 21, 2014 Brasnett, B. and.
Data Release Requirements, decisions and plans. What we need New machine Implement (and test) all proposed changes from current Provide data quality summary,
Page 1© Crown copyright HadISST2: progress and plans Nick Rayner, 14 th March 2007.
11 Ice Cover and Sea and Lake Ice Concentration with GOES-R ABI Presented by Yinghui Liu Presented by Yinghui Liu 1 Team Members: Yinghui Liu, Jeffrey.
1 Validated Stage 1 Science Maturity Review for VIIRS Cloud Base, Nighttime Optical Properties and Cloud Cover Layers Products Andrew Heidinger September.
An analysis of Russian Sea Ice Charts for A. Mahoney, R.G. Barry and F. Fetterer National Snow and Ice Data Center, University of Colorado Boulder,
1) Canadian Airborne and Microwave Radiometer and Snow Survey campaigns in Support of International Polar Year. 2) New sea ice algorithm Does not use a.
11 The Cryosphere Team Members  Cryosphere Application Team  Jeff Key (Lead; STAR/ASPB) »Peter Romanov (CREST) »Don Cline (NWS/NOHRSC) »Marouane Temimi.
Andrew Heidinger and Michael Pavolonis
Hyperspectral Infrared Alone Cloudy Sounding Algorithm Development Objective and Summary To prepare for the synergistic use of data from the high-temporal.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 The Influences of Changes.
MODIS Snow and Sea Ice Data Products George Riggs SSAI Cryospheric Sciences Branch, NASA/GSFC Greenbelt, Md. Dorothy K.
Cloud Mask: Results, Frequency, Bit Mapping, and Validation UW Cloud Mask Working Group.
As components of the GOES-R ABI Air Quality products, a multi-channel algorithm similar to MODIS/VIIRS for NOAA’s next generation geostationary satellite.
The Variability of Sea Ice from Aqua’s AMSR-E Instrument: A Quantitative Comparison of the Team and Bootstrap Algorithms By Lorraine M. Beane Dr. Claire.
STAR Algorithm and Data Products (ADP) Provisional Maturity Review Suomi NPP Surface Type EDR Products X. Zhan, C. Huang, R. Zhang, K. Song, M. Friedl,
Introduction GOES-R ABI will be the first GOES imaging instrument providing observations in both the visible and the near infrared spectral bands. Therefore.
Bryan A. Baum, Richard Frey, Robert Holz Space Science and Engineering Center University of Wisconsin-Madison Paul Menzel NOAA Many other colleagues MODIS.
Initial Analysis of the Pixel-Level Uncertainties in Global MODIS Cloud Optical Thickness and Effective Particle Size Retrievals Steven Platnick 1, Robert.
0 0 Robert Wolfe NASA GSFC, Greenbelt, MD GSFC Hydrospheric and Biospheric Sciences Laboratory, Terrestrial Information System Branch (614.5) Carbon Cycle.
MODIS Cryosphere Science Data Product Metrics Prepared by the ESDIS SOO Metrics Team for the Cryosphere Science Data Review January 11-12, 2006.
1 Validated Stage 1 Science Maturity Review for Surface Reflectance Eric Vermote Sept 04, 2014.
Validation of Satellite-derived Clear-sky Atmospheric Temperature Inversions in the Arctic Yinghui Liu 1, Jeffrey R. Key 2, Axel Schweiger 3, Jennifer.
Request for VIIRS Ice Surface Temperature EDR Beta Maturity Cryosphere Products Validation Team Jeff Key, NOAA/NESDIS/STAR, Team Lead Paul Meade, Cryosphere.
N A T I O N A L O C E A N I C A N D A T M O S P H E R I C A D M I N I S T R A T I O N NPP DATA ACCESS Mitch Goldberg JPSS Program Scientist June 21, 2012.
AIRS Land Surface Temperature and Emissivity Validation Bob Knuteson Hank Revercomb, Dave Tobin, Ken Vinson, Chia Lee University of Wisconsin-Madison Space.
SeaWiFS Highlights July 2002 SeaWiFS Celebrates 5th Anniversary with the Fourth Global Reprocessing The SeaWiFS Project has just completed the reprocessing.
A comparison of AMSR-E and AATSR SST time-series A preliminary investigation into the effects of using cloud-cleared SST data as opposed to all-sky SST.
Cloud Detection: Optical Depth Thresholds and FOV Considerations Steven A. Ackerman, Richard A. Frey, Edwin Eloranta, and Robert Holz Cloud Detection Issues.
In order to accurately estimate polar air/sea fluxes, sea ice drift and then ocean circulation, global ocean models should make use of ice edge, sea ice.
NSIDC DAAC UWG Meeting August 9-10 Boulder, CO
Yinghui Liu1, Jeff Key2, and Xuanji Wang1
Passive Microwave Systems & Products
NSIDC DAAC UWG Meeting August 9-10 Boulder, CO
NWS Forecast Office Assessment of GOES Sounder Atmospheric Instability
VIIRS Cloud Mask Validation Exercises
David Gustafsson, Kristina Isberg, Jörgen Rosberg
Jeff Key*, Aaron Letterly+, Yinghui Liu+
NOAA-20 and Suomi NPP ATMS On-orbit Performance
Hyperspectral Wind Retrievals Dave Santek Chris Velden CIMSS Madison, Wisconsin 5th Workshop on Hyperspectral Science 8 June 2005.
Hyangsun Han and Hoonyol Lee
A Quick Look at JPSS Ice Products
VIIRS Polar Winds Jeff Key, Jaime Daniels, Rico Allegrino, Wayne Bresky NOAA/NESDIS ,
Summary of JPSS Ice Products Presented at Arctic Summit 2018
Dorothee Coppens.
Igor Appel Alexander Kokhanovsky
NOAA Objective Sea Surface Salinity Analysis P. Xie, Y. Xue, and A
Generation of Simulated GIFTS Datasets
Progress toward DCC Demo product
Estimation of Sea and Lake Ice Characteristics with GOES-R ABI
G16 vs. G17 IR Inter-comparison: Some Experiences and Lessons from validation toward GEO-GEO Inter-calibration Fangfang Yu, Xiangqian Wu, Hyelim Yoo and.
JPSS Ice Products for Alaska Demonstration
Presentation transcript:

For Cryosphere Products – Sea Ice Provisional Maturity Science Review For Cryosphere Products – Sea Ice Presented by Jeff Key, Rich Dworak, Xuanji Wang, Yinghui Liu Date: 2019/5/16

JPSS Data Products Maturity Definition Beta Product is minimally validated, and may still contain significant identified and unidentified errors. Information/data from validation efforts can be used to make initial qualitative or very limited quantitative assessments regarding product fitness-for-purpose. Documentation of product performance and identified product performance anomalies, including recommended remediation strategies, exists. Provisional Product performance has been demonstrated through analysis of a large, but still limited (i.e., not necessarily globally or seasonally representative) number of independent measurements obtained from selected locations, time periods, or field campaign efforts. Product analyses are sufficient for qualitative, and limited quantitative, determination of product fitness-for-purpose. Documentation of product performance, testing involving product fixes, identified product performance anomalies, including recommended remediation strategies, exists. Product is recommended for potential operational use (user decision) and in scientific publications after consulting product status documents. Validated Product performance has been demonstrated over a large and wide range of representative conditions (i.e., global, seasonal). Comprehensive documentation of product performance exists that includes all known product anomalies and their recommended remediation strategies for a full range of retrieval conditions and severity level. Product analyses are sufficient for full qualitative and quantitative determination of product fitness-for-purpose. Product is ready for operational use based on documented validation findings and user feedback. Product validation, quality assurance, and algorithm stewardship continue through the lifetime of the instrument.

PROVISIONAL MATURITY REVIEW MATERIAL

Algorithm Cal/Val Team Members Sea Ice Cal/Val Team Algorithm Cal/Val Team Members Name Organization Major Task Richard Dworak CIMSS/UW-Madison Sea ice product analysis and validation, data processing, and project management. Xuanji Wang Sea ice thickness/age algorithm development, analysis ,and validation. Mark Tschudi CCAR/UC-Boulder Sea ice product analysis and validation Yinghui Liu NOAA/NESDIS Sea ice temperate/concentration algorithm development, analysis ,and validation, and project management. Jeff Key Overall snow and sea ice project management, assistance on analysis and validation Thanks to the AIT/ASSISTT team for help with the data.

NOAA-20 Sea Ice Product Examples (NDE I&T v2r0) Ice Surface Temperature Ice Concentration Ice Thickness Ice Age Daily composites of sea ice temperature, concentration, thickness, and age on March 08, 2019. Top row is the Arctic; bottom row is the Antarctic. (Note: Validation results in the following slides are based on individual overpasses.)

Requirements: Sea Ice Concentration Product performance requirements from JERD Vol. II and L1RD versus observed/validated. Stats are relative to AMSR2 and S-NPP. Attribute Threshold Observed/validated Geographic coverage All ice-covered regions of the global ocean Vertical Coverage Ice surface Vertical Cell Size Horizontal Cell Size 1 km Mapping Uncertainty Measurement Range 0 – 100% Measurement Accuracy 10% NH: -1.3%, SH: -2.2% NH: 0.05%, SH: 0.17% Measurement Precision (L1RD, recommended) 25% NH: 6.2%, SH: 21.7% NH: 5.0%, SH: 12.0% Measurement Uncertainty (JERD) NH: 6.3%, SH: 21.8%

Requirements: Sea Ice Surface Temperature Product performance requirements from JERD Vol. II and L1RD versus observed/validated. Stats are relative to MODIS and S-NPP. Attribute Threshold Observed/validated Geographic coverage All ice-covered regions of the global ocean Vertical Coverage Ice surface Vertical Cell Size Horizontal Cell Size 1 km Mapping Uncertainty Measurement Range 213 - 275 K Measurement Accuracy (recommended) 1 K NH: 0.35K, SH: 0.59K NH: -0.055K, SH: 0.049 Measurement Precision (recommended) 1.5 K NH: 1.38K, SH: 1.35K NH: 1.17, SH: 1.02 Measurement Uncertainty (L1RD and JERD) NH: 1.42K, SH: 1.47K

Requirements: Sea and Lake Ice Age Product performance requirements from JERD Vol. II and L1RD versus observed/validated. Stats are relative to S-NPP and CryoSat-2/SMOS. Attribute Threshold Observed/validated Geographic coverage All ice-covered regions of the global ocean Lat.: ±45o ~ ±90o Lon.: ±180o ~ ±180o Vertical Coverage Ice surface Vertical Cell Size Horizontal Cell Size 1 km Mapping Uncertainty Measurement Range Ice free, New/Young ice, all Other ice Ice free, New/Young ice, all ice, and ice thickness Measurement Accuracy (recommended) 70% probability of correct typing >90% probability of correct typing; > 92% Measurement Precision n/a (see GOES-R definition for 2-category variables) less than two category Measurement Uncertainty (JERD and L1RD) 70% for ice age probability of correct typing

Requirements: Sea and Lake Ice Thickness Product performance requirements from JERD Vol. II and L1RD versus observed/validated. There is no requirement for ice thickness. Attribute Threshold Observed/validated Measurement Range none 0-6 m Measurement Accuracy 0.16 m Measurement Precision 0.24 m

NDE/STAR VIIRS Production Status Algorithm Suomi NPP NOAA-20 August 2018 DAP February 2018 Science Code delivery (v2r0) STAR Systematic production since June, 2018 NDE I&T on as of 28 September, 2018 Jan/Feb 2019 DAP August 2018 Science Code delivery (v2r1) Delivery and development in progress Delivery schedule provided by ASSISTT

Beta Review Outcomes, June 2018 Findings/Issues from Beta - From the Review Team: Ice Age/thickness, Ice concentration, and Ice Surface Temperature products have reached Beta Maturity. Good results so far with SNPP, but not enough data to be provisional. Noted problem with Cloud Mask, which should be fixed with Cloud LUT fix going into NDE this week (or next). Jeff key noted the need for Cloud Mask to be provisional prior to cryosphere products being declared provisional. Improvements since Beta Review Sea ice thickness/age algorithm has been improved. Algorithm Improvements: None for results presented here from NDE LUT / PCT updates: None

First Provisional Review Outcomes, Oct 2018 Findings/Issues from Provisional - From the Review Team: Recommend the team take advantage of the 2018 NH winter to conduct more thorough validation (eg conduct their Provisional maturity review in March 2019). Recommend the v2r0 cryosphere products be promoted to the operational string at the beta maturity status so that the science team have a consistent data set for validation. Improvements since first Provisional Review V2r0 ice products from December 2018 to March 2019 have been collected and validated with products S-NPP and independent products from MODIS, AMSR2, and Cryosat-. LUT / PCT updates: None The issues described in the October 2, 2018 maturity review have been resolved, e.g., missing granules, zero ice concentrations, some cloud mask problems, etc.

NOAA-20 Sea Ice Product Maturity Evaluation Maturity Evaluation Approaches Algorithms are described in detail in the Algorithm Theoretical Basis Documents (ATBDs) and journal papers. (See References slide) Our analysis has focused on the Arctic and Antarctic, for the period of December 16, 2018 – March 31, 2019. This is version v2r0. Comparisons have been done for all sea ice products with the data from NOAA-20, S-NPP, passive microwave AMSR2, MODIS, and CryoSat-2. Statistical comparisons have been done for most of the sea ice products, monthly and seasonally. Manual/visual inspection of sea ice product images have been done in some cases where temporal and spatial matching cannot be done.

Sea Ice Concentration: NOAA-20 Examples 04-08-2018, v2r0 % NOAA-20 AMSR2 \ Fix titles Matches well with AMSR2 SIC overall. NDE SIC does good job capturing lead features in the SIC field. A definite improvement over AMSR2 SIC. Still some issues with false ice due to cloud contamination.

Sea Ice Concentration: NOAA-20 Examples 04-19-2019, v2r0 % NOAA-20 AMSR2 \ Fix titles NDE SIC also does a good job over Antarctic. A few false ice pixels exist due to cloud contamination. However, with each update to the cloud mask, false ice pixels becomes less common. To mitigate problem further, recommend using scan angle threshold.

Sea Ice Concentration: NOAA-20 (NDE I&T) vs S-NPP, Arctic December January February March Data from Provisional review (NOAA-20/S-NPP v1r2 and v2r0, regenerated from STAR on 09/24/2018) Comparison done on individual overpasses to S-NPP (50 minutes apart) Histogram by month, 2018 Dec thru 2019 Mar.

Sea Ice Concentration: NOAA-20 (NDE I&T) vs S-NPP, Antarctic December January February March Data from Provisional review (NOAA-20/S-NPP v1r2 and v2r0, regenerated from STAR on 09/24/2018) Comparison done on individual overpasses to S-NPP (50 minutes apart) Histogram by month 2018 Dec thru 2019 Mar.

Sea Ice Concentration: Monitoring NOAA-20 versus AMSR2 12/14/2018 to 02/28/2019, Antarctic 12/14/2018 to 02/28/2019, Arctic NDE SIC meets specific requirements (25% Precision and Uncertainty) every day that has data available over Arctic winter when compared to AMSR2. NDE SIC meets specific requirements most days that has data available over Antarctic summer when compared to AMSR2. Note: AMSR2 has higher uncertainties in the summertime due to surface melting.

Sea Ice Concentration: Comparisons to AMSR2 SIC v2r0, post-beta Meets requirement with measurement precision less than 25% Larger differences over Antarctic. \

Sea Ice Concentration: NOAA-20 Examples Compared to Landsat Western Hudson Bay on 2019-04-15, Arctic \ NDE SIC does a good job capturing leads and other features in Sea Ice field. A definite improvement over AMSR2 SIC. NDE SIC Matches very well with this clear-sky Landsat scene. NDE SIC is able resolve features in ice field that AMSR2 cannot. Also get better resolution to location of sea ice edges.

Sea Ice Concentration: NOAA-20 Examples Compared to Landsat Weddell Sea on 2019-03-08, Antarctic \ NDE SIC does a good job capturing leads and other ice features in SIC field over Weddell Sea. A definite improvement over AMSR2 SIC. NDE SIC Matches very well with this clear-sky Landsat scene. NDE SIC is able resolve features in SIC field that AMSR2 cannot.

Sea Ice Temperature: NOAA-20 (NDE I&T v2r0) vs S-NPP NOAA-20 S-NPP NOAA-20 minus S-NPP Date: January 15, 2019 Statistical mean ice surface temperature: Comparison done with individual overpasses, NOT a daily composite NOAA-20 S-NPP Accuracy Precision Uncertainty (matched parts) 242.92 K 243.03K 0.65 K 0.97 K 0.98 K ISSUES: Some differences in cloud masking

Sea Ice Temperature: NOAA-20 (NDE I&T v2r0) vs S-NPP NOAA-20 S-NPP NOAA-20 minus S-NPP Date: April 21, 2019 Statistical mean ice surface temperature: Comparison done with individual overpasses, NOT daily composite. NOAA-20 S-NPP Accuracy Precision Uncertainty (matched parts) 253.96 K 253.93 K 0.81 K 1.16 K 1.16 K ISSUES: Some differences in cloud masking

Sea Ice Temperature: NOAA-20 (NDE I&T) vs S-NPP, Arctic December January February March Comparison done on individual overpasses Histogram by month, 2018 Dec thru 2019 Mar. S-NPP matches well with NOAA-20. Differences can be contributed to slight differences in cloud mask and moving surface temperature gradients over 50 minute period. Data from Provisional review (NOAA-20/S-NPP v1r2 and v2r0, regenerated from STAR on 09/24/2018)

Sea Ice Temperature: NOAA-20 (NDE I&T) vs S-NPP, Antarctic December January February March Comparison done on individual overpasses Histogram by month, 2018 Dec thru 2019 Mar. NPP matches well with NOAA-20. Slightly larger differences in March. Differences can be contributed to slight differences in cloud mask and moving surface temperature gradients over 50 minute period. Data from Provisional review (NOAA-20/S-NPP v1r2 and v2r0, regenerated from STAR on 09/24/2018)

Sea Ice Temperature: NOAA-20 vs MODIS NOAA-20 MODIS Includes SSTs March 10, 2019 0221 to 239 UTC March 10, 2019 0225 to 0245 UTC Note: MODIS has sea surface temperature included.

Sea Ice Temperature: NOAA-20 vs MODIS NOAA-20 MODIS Includes SSTs March 10, 2019 2018 0453 to 0511 UTC March 10, 2019 0455 to 515 UTC Note: MODIS has sea surface temperature included.

Sea Ice Temperature: NOAA-20 vs MODIS Arctic Antarctic December 14, 2018 thru February 28, 2019, v2r0 Comparisons done at 5 minute time threshold on same 1 km EASE grid. Meets requirements. Warm bias in NDE NOAA-20 IST compared to MODIS. Larger uncertainties observed, likely due to differences in cloud mask.

Sea Ice Temperature: NOAA-20 vs KT-19 April 08, 2018, 2101-05 and 2244-46 UTC over Beaufort Sea, totalling 139 Samples. Comparisons done with v2r0 at 30 minute time threshold with KT-19 temperatures (15 m resolution) averaged over 750 m VIIRS pixel. Meets requirements, however slight warm bias in NDE NOAA-20 IST compared to KT-19. Limited dataset, more robust comparisons expected over upcoming year to include Antarctic region and FLIR datasets.

Sea Ice Thickness/Age: NOAA-20 vs S-NPP, Arctic NOAA-20 S-NPP (Original resolution, daily composite) No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 778123 4263132 TMP 5473155 PCT 92% CTP: Correctly Typed Pixels TMP: Total Matched Pixels PCT: Probability of Correct Typing No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 562520 8767035 TMP 9192899 PCT 95% Because of the lack of water pixel information from actual NOAA-20/S-NPP ice concentration/ice thickness data, the water pixel number will not be done here due to the uncertainty unknown. So the probability of correct typing actually represent the new/young ice and other ice.

Sea Ice Thickness/Age: NOAA-20 vs S-NPP, Antarctic NOAA-20 S-NPP (Original resolution, daily composite) No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 119260 1479897 TMP 1727519 PCT 93% CTP: Correctly Typed Pixels TMP: Total Matched Pixels PCT: Probability of Correct Typing No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 152631 734136 TMP 9566864 PCT 93% Because of the lack of water pixel information from actual NOAA-20/S-NPP ice concentration/ice thickness data, the water pixel number will not be done here due to the uncertainty unknown. So the probability of correct typing actually represent the new/young ice and other ice.

Sea Ice Thickness/Age: NOAA-20 vs CryoSat-2, Arctic NOAA-20 CryoSat-2 Period composite of ice thickness over January 3 - 28, 2019 from NOAA-20. Monthly mean of ice thickness for January 2019 from CryoSat-2. Because CryoSat-2 cannot estimate sea ice thinner than 0.5m, so new/Young ice pixel number will not be done here due to the uncertainty unknown. So the probability of correct typing actually represent the water and other ice. No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 10106 7046 TMP 17639 PCT 97% Important: CryoSat-2 cannot estimate sea ice thinner than about 0.5 m. CTP: Correctly Typed Pixels TMP: Total Matched Pixels PCT: Probability of Correct Typing

Sea Ice Age: NOAA-20 vs CryoSat-2, Arctic Ice age category: Ice free, New/Young Ice (<0.30m), Other ice (>=0.30cm) Important: CryoSat-2 cannot estimate sea ice thinner than about 0.5 m. November 2018 No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 11621 5191 TMP 18627 PCT 90% CTP: Correctly Typed Pixels TMP: Total Matched Pixels PCT: Probability of Correct Typing December 2018 No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 10939 6054 TMP 18068 PCT 94% Because CryoSat-2 cannot estimate sea ice thinner than 0.5m, so new/Young ice pixel number will not be done here due to the uncertainty unknown. So the probability of correct typing actually represent the water and other ice. January 2019 No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 10106 7046 TMP 17639 PCT 97%

Sea Ice Thickness/Age: NOAA-20 vs SMOS, Arctic NOAA-20 Thickness SMOS Thickness SMOS Uncertainty Daily composite of ice thickness on November 29, 2018 from NOAA-20 (left) and SMOS (middle), and SMOS sea ice uncertainty (right). For SMOS data, there are ice thickness data with 0 value indicating water pixels. For NOAA-20, there are no water pixel information from ice concentration data of which missing value in ice concentration indicates water pixel or bad/non-retrieval ice pixel. To estimate total number of NOAA-20 water pixels, we use SMOS ice thickness (0 indicating water pixel, daily data available) to mask NOAA-20 water pixels that do not have valid ice thickness values, i.e., put the NOAA-20 ice thickness or ice concentration image onto the SMOS ice thickness image to figure out how many water pixels would be in NOAA-20 ice thickness/ or ice concentration image. So the actual NOAA-20 water pixel number should be less than the number calculated in this way, but not many, should be very few especially for monthly mean NOAA-20 data. No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 24028 301 5900 TMP 32384 PCT 93% CTP: Correctly Typed Pixels TMP: Total Matched Pixels PCT: Probability of Correct Typing SMOS: ESA's Soil Moisture Ocean Salinity satellite (passive microwave, L-band at 1.4 GHz).

Sea Ice Thickness/Age: NOAA-20 vs SMOS, Arctic NOAA-20 Thickness SMOS Thickness SMOS Uncertainty Daily composite of ice thickness on January 26, 2019 from NOAA-20 (left) and SMOS (middle), and SMOS sea ice uncertainty (right). SMOS can estimate sea ice thickness up to 1 m, though the uncertainty will be very high when sea ice is actually thicker than 1m. As for this work, SMOS sea ice pixels greater than 0.30 m do exist, making it good enough to compare all three category sea ice with NOAA-20, and SMOS daily data are available as well. No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 19755 375 12641 TMP 34693 PCT 94% CTP: Correctly Typed Pixels TMP: Total Matched Pixels PCT: Probability of Correct Typing

Sea Ice Thickness/Age: NOAA-20 vs CryoSat-2/SMOS, Arctic NOAA-20 CryoSat-2/SMOS Period composite of ice thickness over January 3 - 28, 2019 from NOAA-20. Monthly mean of ice thickness for January 2019 from CryoSat-2 and SMOS combined (Created by CIMSS). CryoSat-2 and SMOS combined sea ice thickness is generated by following method. Put them on the same grid that is 25 km by 25 km EASE grid. Find SMOS valid pixels that match CryoSat-2 pixels in space. Valid pixels mean that they do not have missing or bad values. Replace CryoSat-2 missing pixels with valid SMOS pixels of which sea ice thickness uncertainty is less than 1m. No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 19228 273 17156 TMP 39962 PCT 92% CTP: Correctly Typed Pixels TMP: Total Matched Pixels PCT: Probability of Correct Typing

Sea Ice Age: NOAA-20 vs CryoSat-2/SMOS, Arctic Ice age category: Ice free, New/Young Ice (<0.30m), Other ice (>=0.30cm) November 2018 No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 22133 468 11603 TMP 40274 PCT 85% December 2018 No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 20636 413 14852 TMP 40059 PCT 90% January 2019 No. of Pixels Water New/Young Ice (< 0.30 m) Other ice (>= 0.30 m) CTP 19228 273 17156 TMP 39962 PCT 92% CTP: Correctly Typed Pixels TMP: Total Matched Pixels PCT: Probability of Correct Typing

Evaluation of the effect of required algorithm inputs Primary Sensor Data: Ice products Ancillary Data: Surface mask Atmospheric profile data and snow depth data (optional) Upstream algorithms: Cloud mask LUTs / PCTs: internal LUT for ice cover/concentration algorithm to solve optimal LUT concentration Evaluation of the effect of required algorithm inputs The effect of the cloud mask depends on conditions: it will mask false ice due to wrong cloud mask. Low Sun conditions (solar zenith angle between 86o~93o) will cause larger uncertainties on ice products due to larger uncertainties for cloud masking and surface albedo. Suggest not to make estimates for any ice product under low Sun condition.

Error Budget: versus S-NPP and independent data Attribute Analyzed L1RD Threshold On-orbit Performance Meet Spec? Additional Comments Concentration: Accuracy 10% NH: -1.3%, SH: -2.2% NH: 0.05%, SH: 0.17% Yes Precision 25% NH: 6.2%, SH: 21.7% NH: 5.0%, SH: 12.0% Temperature: 1K NH: 0.35K, SH: 0.59K NH: -0.055K, SH: 0.049 1.5K NH: 1.38K, SH: 1.35K NH: 1.17, SH: 1.02 Age/Thickness: 70% probability of correct typing > 88% for all conditions; generally > 90% n/a

User Feedback Name Organization Application User Feedback - User readiness dates for ingest of data and bringing data to operations Mike Lawson NWS AK Sea Ice Program (ASIP) Ice operations around Alaska Concentration: Very useful. Temperature: Useful for certain analyses. Thickness: Useful in limited circumstances. Various National Ice Center (NIC) Ice operations, global Training done at the NIC in August; expressed interest in products Bob Grumbine NCEP/EMC Forecast modeling Concentration has been tested with positive results; thickness will be useful in the future. Mark Middlebusher NAVOCEAN Ice forecasting (modeling) Concentration improved the accuracy of the ice edge forecast by more than 30%.

Downstream Product Feedback There are no products that use the ice products as input. Algorithm Product Downstream Product Feedback - Reports from downstream product teams on the dependencies and impacts None

Risks, Actions, and Mitigations Identified Risk Description Impact Action/Mitigation and Schedule Cloud mask Still some false clear in Antarctic, in particular, but improved over v1r2. Some false ice Work with cloud team (ongoing) Provide updates for the status of the risks/actions identified during the previous maturity review(s); add new ones as needed

Science Maturity Check List Documentation Science Maturity Check List Yes ? ReadMe for Data Product Users Yes Algorithm Theoretical Basis Document (ATBD) Algorithm Calibration/Validation Plan (External/Internal) Users Manual Yes (README files with software) System Maintenance Manual (for ESPC products) Unknown Peer Reviewed Publications (Demonstrates algorithm is independently reviewed) Regular Validation Reports (at least annually) (Demonstrates long-term performance of the algorithm) As requested

Check List - Provisional Maturity Provisional Maturity End State Assessment Product performance has been demonstrated through analysis of a large, but still limited (i.e., not necessarily globally or seasonally representative) number of independent measurements obtained from select locations, periods, and associated ground truth or field campaign efforts. All requirements have been met with very limited datasets. Spatial coverage is adequate; seasonal coverage is not. Some Antarctic results did not meet requirements, possibly due to cloud mask errors. Product analysis is sufficient to communicate product performance to users relative to expectations (Performance Baseline). Yes Documentation of product performance exists that includes recommended remediation strategies for all anomalies and weaknesses. Any algorithm changes associated with severe anomalies have been documented, implemented, tested, and shared with the user community. Yes (no significant anomalies or weaknesses). However, important updates were recently made to the ice thickness algorithm. The updated code has been delivered to the AIT. Product is ready for operational use and for use in comprehensive cal/val activities and product optimization. Yes, at least for operational testing

Conclusion Cal/Val results summary: Based on the findings presented, the Team recommends that all three ice products be declared Provisional Maturity.

Path Forward Planned improvements: Ice thickness algorithm has significant improvements since the February DAP (since delivered) Further evaluate the cause of a positive IST bias, particularly in the Antarctic. Further evaluate the optimal scanning angle limit for ice products Future Cal/Val activities / milestones MOSAIC field experiment: on-ice sea ice measurements over winter 2019-2020 as icebreaker drifts along trans-polar drift stream IceBridge: more KT-19 data for IST, thickness Use additional ice charts (NIC, Canadian Ice Service, AARI) More comparison during Arctic (Antarctic) summer (winter) for Validated Maturity review.

References ATBDs Wang, X. and J. Key, 2019, ABI and VIIRS ice thickness and age algorithm theoretical basis document, version 2.2, NOAA/NESDIS Center for Satellite Applications and Research, 71 pp. Liu, Y. and J. Key, 2019, ABI and VIIRS ice surface temperature, ice concentration, and ice cover algorithm theoretical basis document, version 1.2, NOAA/NESDIS Center for Satellite Applications and Research, 42 pp. Journal Papers Key, J. R., R. Mahoney, Y. Liu, P. Romanov, M. Tschudi, I. Appel, J. Maslanik, D. Baldwin, X. Wang, and P. Meade, 2013, Snow and ice products from Suomi NPP VIIRS, J. Geophys. Res. Atmos., 118, doi:10.1002/2013JD020459. Liu, Y., J. Key, and R. Mahoney, 2016, Sea and Freshwater Ice Concentration from VIIRS on Suomi NPP and the Future JPSS Satellites, Remote. Sens., 8(6), 523; doi:10.3390/rs8060523. Wang, X., J. Key, R. Kwok, and J. Zhang, 2016, Comparison of sea ice thickness from satellites, aircraft, and PIOMAS data, Remote. Sens., 8, 713, doi:10.3390/rs8090713. Wang, X., J. Key, and Y. Liu, 2010, A thermodynamic model for estimating sea and lake ice thickness with optical satellite data, J. Geophys. Res.-Oceans, 115, C12035, doi:10.1029/2009JC005857.

Extra Slides

Requirement Check List – Ice Concentration JERD Requirement Meet Requirement (Y/N)? JERD-2436 The algorithm shall produce an ice concentration product that has a vertical coverage of the ice surface JERD-2505 The algorithm shall produce an ice concentration product that has a horizontal cell size of 1.0 km in clear conditions JERD-2506 The algorithm shall produce an ice concentration product that has a mapping uncertainty (3 sigma) of 1 km at Nadir for clear pixels JERD-2507 The algorithm shall produce an ice concentration product that has a measurement range of 0 – 100% JERD-2508 The algorithm shall produce an ice concentration product that has a measurement accuracy of 10% JERD-2509 The algorithm shall produce an ice concentration product that has a measurement uncertainty of 25% JERD-2510 The algorithm shall produce an ice concentration product in all ice-covered regions of the global ocean

Requirement Check List – Ice Surface Temperature JERD Requirement Meet Requirement (Y/N)? JERD-2437 The algorithm shall produce an ice surface temperature product with a sensing depth of the ice surface JERD-2511 The algorithm shall produce an ice surface temperature product with a horizontal cell size of 1 km at Nadir and 1.6 km at worst case JERD-2512 The algorithm shall produce an ice surface temperature product with a mapping uncertainty (3 sigma) of 1 km at Nadir and 1.6 km at worst case JERD-2513 The algorithm shall produce an ice surface temperature product with a measurement range of 213-275 K JERD-2514 The algorithm shall produce an ice surface temperature product with a measurement uncertainty of 1 K JERD-2515 The algorithm shall produce an ice surface temperature product with a geographic coverage of ice-covered oceans

Requirement Check List – Ice Age/Thickness JERD Requirement Meet Requirement (Y/N)? JERD-2435 The algorithm shall produce an ice age/thickness product that has a vertical coverage of the ice surface JERD-2500 The algorithm shall produce an ice age/thickness product that has a horizontal cell size of 1.0 km in clear conditions JERD-2501 The algorithm shall produce an ice age/thickness product that has a mapping uncertainty (3 sigma) of 1 km at Nadir for clear pixels JERD-2502 The algorithm shall produce an ice age/thickness product that has a measurement range of: Ice free, New/Young Ice, all other ice for Ice Age JERD-2503 The algorithm shall produce an ice age/thickness product that has a measurement uncertainty of 70% for Ice Age probability of correct typing JERD-2504 The algorithm shall produce an ice age/thickness product in all ice-covered regions of the global ocean