AVHRR Radiance Bias Correction Andy Harris, Jonathan Mittaz NOAA Cooperative Institute for Climate Studies University of Maryland Some concepts and some.

Slides:



Advertisements
Similar presentations
Improvements to the NOAA Geostationary Sea Surface Temperature Product Suite Eileen Maturi, NOAA/NESDIS/STAR Andy Harris, Jonathan Mittaz, Prabhat Koner.
Advertisements

Pathfinder –> MODIS -> VIIRS Evolution of a CDR Robert Evans, Peter Minnett, Guillermo Podesta Kay Kilpatrick (retired), Sue Walsh, Vicki Halliwell, Liz.
Upgrades to the MODIS near-IR Water Vapor Algorithm and Cirrus Reflectance Algorithm For Collection 6 Bo-Cai Gao & Rong-Rong Li Remote Sensing Division,
Characterization of ATMS Bias Using GPSRO Observations Lin Lin 1,2, Fuzhong Weng 2 and Xiaolei Zou 3 1 Earth Resources Technology, Inc.
VIIRS LST Uncertainty Estimation And Quality Assessment of Suomi NPP VIIRS Land Surface Temperature Product 1 CICS, University of Maryland, College Park;
Maintaining and Improving the AMSR-E and WindSat Ocean Products Frank J. Wentz Remote Sensing Systems, Santa Rosa CA AMSR TIM Agenda 4-5 September 2013.
Satellite SST Radiance Assimilation and SST Data Impacts James Cummings Naval Research Laboratory Monterey, CA Sea Surface Temperature Science.
A Fundamental Climate Data Record for the AVHRR Jonathan Mittaz Manik Bali & Andrew Harris CICS/ESSIC University of Maryland.
Karthaus, September 2005 Wouter Greuell IMAU, Utrecht, NL -Why? -Cloud masking -Retrieval method -An application: estimate surface mass balance from satellite.
Xin Kong, Lizzie Noyes, Gary Corlett, John Remedios, Simon Good and David Llewellyn-Jones Earth Observation Science, Space Research Centre, University.
Where m is the first order gain, q is the second order gain, is the observed blackbody counts, is the observed space counts, is the radiance of the blackbody,
GOES-13 Science Team Report SST Images and Analyses Eileen Maturi, STAR/SOCD, Camp Springs, MD Andy Harris, CICS, University of Maryland, MD Chris Merchant,
ESTEC July 2000 Estimation of Aerosol Properties from CHRIS-PROBA Data Jeff Settle Environmental Systems Science Centre University of Reading.
1 Remote Sensing of the Ocean and Atmosphere: John Wilkin Sea Surface Temperature IMCS Building Room 214C
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 NOAA Operational Geostationary Sea Surface Temperature Products from NOAA.
Improved NCEP SST Analysis
NASA MODIS-VIIRS ST Meeting, May 18 – 22, A Deterministic Inverse Method for SST Retrieval from VIIRS: Early Results Andy Harris, Prabhat Koner.
Motivation Many GOES products are not directly used in NWP but may help in diagnosing problems in forecasted fields. One example is the GOES cloud classification.
CRN Workshop, March 3-5, An Attempt to Evaluate Satellite LST Using SURFRAD Data Yunyue Yu a, Jeffrey L. Privette b, Mitch Goldberg a a NOAA/NESDIS/StAR.
4 June 2009GHRSST-X STM - SQUAM1 The SST Quality Monitor (SQUAM) 10 th GHRSST Science Team Meeting 1-5 June 2009, Santa Rosa, CA Alexander “Sasha” Ignatov*,
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 CLOUD MASK AND QUALITY CONTROL FOR SST WITHIN THE ADVANCED CLEAR SKY PROCESSOR.
Applications and Limitations of Satellite Data Professor Ming-Dah Chou January 3, 2005 Department of Atmospheric Sciences National Taiwan University.
Diagnosing Climate Change from Satellite Sounding Measurements – From Filter Radiometers to Spectrometers William L. Smith Sr 1,2., Elisabeth Weisz 1,
1 Detection and Determination of Channel Frequency Shift in AMSU-A Observations Cheng-Zhi Zou and Wenhui Wang IGARSS 2011, Vancouver, Canada, July 24-28,
MODIS Sea-Surface Temperatures for GHRSST-PP Robert H. Evans & Peter J. Minnett Otis Brown, Erica Key, Goshka Szczodrak, Kay Kilpatrick, Warner Baringer,
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 MAP (Maximum A Posteriori) x is reduced state vector [SST(x), TCWV(w)]
A physical basis of GOES SST retrieval Prabhat Koner Andy Harris Jon Mittaz Eileen Maturi.
Satellite-derived Sea Surface Temperatures Corey Farley Remote Sensing May 8, 2002.
AGU 2002 Fall Meeting NASA Langley Research Center / Atmospheric Sciences Validation of GOES-8 Derived Cloud Properties Over the Southeastern Pacific J.
AVHRR GAC/LAC Calibration Challenges for SST Jonathan Mittaz University of Reading National Physical Laboratory.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Developing GOES and POES Land Surface Temperature Products Yunyue Yu 1.
Evaluation of the Suomi NPP VIIRS Land Surface Temperature Product 1 CICS, University of Maryland, College Park; 2 STAR/NESDIS/NOAA Yuling Liu 1, Yunyue.
Andrew Heidinger and Michael Pavolonis
NASA MODIS-VIIRS ST Meeting, May 18 – 22, New physically based sea surface temperature retrievals for NPP VIIRS Andy Harris, Prabhat Koner CICS,
1 RTM/NWP-BASED SST ALGORITHMS FOR VIIRS USING MODIS AS A PROXY B. Petrenko 1,2, A. Ignatov 1, Y. Kihai 1,3, J. Stroup 1,4, X. Liang 1,5 1 NOAA/NESDIS/STAR,
Jinlong Li 1, Jun Li 1, Christopher C. Schmidt 1, Timothy J. Schmit 2, and W. Paul Menzel 2 1 Cooperative Institute for Meteorological Satellite Studies.
Cloud Mask: Results, Frequency, Bit Mapping, and Validation UW Cloud Mask Working Group.
Ocean Dynamics Algorithm GOES-R AWG Eileen Maturi, NOAA/NESDIS/STAR/SOCD, Igor Appel, STAR/IMSG, Andy Harris, CICS, Univ of Maryland AMS 92 nd Annual Meeting,
Retrieval Algorithms The derivations for each satellite consist of two steps: 1) cloud detection using a Bayesian Probabilistic Cloud Mask; and 2) application.
Purpose of project: Reduction of project risks related to quality of cloud detection / masking for multiple applications over land and sea. Will provide.
Physical retrieval (for MODIS) Andy Harris Jonathan Mittaz Prabhat Koner (Chris Merchant, Pierre LeBorgne)
Validation of Satellite-derived Clear-sky Atmospheric Temperature Inversions in the Arctic Yinghui Liu 1, Jeffrey R. Key 2, Axel Schweiger 3, Jennifer.
A step toward operational use of AMSR-E horizontal polarized radiance in JMA global data assimilation system Masahiro Kazumori Numerical Prediction Division.
Infrared and Microwave Remote Sensing of Sea Surface Temperature Gary A. Wick NOAA Environmental Technology Laboratory January 14, 2004.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Monitoring of IR Clear-sky Radiances over Oceans for SST (MICROS) Alexander.
Preliminary results from the new AVHRR Pathfinder Atmospheres Extended (PATMOS-x) Data Set Andrew Heidinger a, Michael Pavolonis b and Mitch Goldberg a.
Overview of Climate Observational Requirements for GOES-R Herbert Jacobowitz Short & Associates, Inc.
TS 15 The Great Salt Lake System ASLO 2005 Aquatic Sciences Meeting Climatology and Variability of Satellite-derived Temperature of the Great Salt Lake.
The MODIS SST hypercube is a multi-dimensional look up table of SST retrieval uncertainty, bias and standard deviation, determined from comprehensive analysis.
A comparison of AMSR-E and AATSR SST time-series A preliminary investigation into the effects of using cloud-cleared SST data as opposed to all-sky SST.
Radiance Simulation System for OSSE  Objectives  To evaluate the impact of observing system data under the context of numerical weather analysis and.
EARWiG: SST retrieval issues for High Latitudes Andy Harris Jonathan Mittaz NOAA-CICS University of Maryland Chris Merchant U Edinburgh.
EARWiG: SST retrieval issues for TWP Andy Harris Jonathan Mittaz Prabhat Koner NOAA-CICS University of Maryland Eileen Maturi NOAA/NESDIS, Camp Springs,
Directions for SST estimation activities Chris Merchant.
Assimilation of GPM satellite radiance in improving hurricane forecasting Zhaoxia Pu and ChauLam (Chris) Yu Department of Atmospheric Sciences University.
Bias analysis and correction for MetOp/AVHRR IR channel using AVHRR-IASI inter-comparison Tiejun Chang and Xiangqian Wu GSICS Joint Research and data Working.
ATSR Re-analysis for Climate (ARC) Chris Merchant The University of Edinburgh.
Joint GRWG and GDWG Meeting February 2010, Toulouse, France
ECMWF/EUMETSAT NWP-SAF Satellite data assimilation Training Course
A Probabilistic Nighttime Fog/Low Stratus Detection Algorithm
Validation of Satellite-derived Lake Surface Temperatures
Manik Bali Jonathan Mittaz
Component decomposition of IASI measurements
The SST CCI: Scientific Approaches
Sea Surface Temperature, Forward Modeling,
Dorothee Coppens.
Use of GSICS to Improve Operational Radiometric Calibration
Cal/Val-Related Activities at CICS
Andrew Heidinger JPSS Cloud Team Lead
G16 vs. G17 IR Inter-comparison: Some Experiences and Lessons from validation toward GEO-GEO Inter-calibration Fangfang Yu, Xiangqian Wu, Hyelim Yoo and.
Presentation transcript:

AVHRR Radiance Bias Correction Andy Harris, Jonathan Mittaz NOAA Cooperative Institute for Climate Studies University of Maryland Some concepts and some numbersSome concepts and some numbers Radiative transfer methodsRadiative transfer methods Physical bias correctionsPhysical bias corrections Bayesian cloud detectionBayesian cloud detection

Some concepts SST is a key environmental data record, and also comparatively easy to validateSST is a key environmental data record, and also comparatively easy to validate SST is traditionally retrieved using regression-based equations with in situ data used to trainSST is traditionally retrieved using regression-based equations with in situ data used to train –May get biases in remote regions with sparse/no in situ data –Also results in least confidence where satellite data have most impact New physically-based retrieval methodologies are reliant on accurate sensor calibration and characterizationNew physically-based retrieval methodologies are reliant on accurate sensor calibration and characterization Pursue physically-based methodologies to:Pursue physically-based methodologies to: –Develop techniques to identify & quantify AVHRR calibration and characterization errors post-launch –Improve SST retrieval capability –Feed back results to improve forward modeling for CRTM

Bias pattern for GOES-W similar to that predicted by radiative transfer Fixed viewing geometry of GOES emphasizes that single “global” linear retrieval equation is regionally sub-optimal Observed and RT-modeled SST biases RTM is a good way of predicting and removing such biases on a global basis prior to assimilation

July: bias in retrieved SST (all matchups)July: bias in retrieved SST (restricted matchups)July: bias change due to restricted matchups January: regional bias in retrieved SST (all matchups) January: regional bias in retrieved SST (restricted matchups) January: bias change due to restricted matchups Impact of restricted training data

RTM improvements: GOES-9 Case Study Unusually large scatter and warm bias at low atmospheric corrections may be due to diurnal warming Nighttime retrievals also show small trend vs atmospheric correction Updated RT model removes most of the trend Application of daytime coefficients to nighttime data gives small –ve bias (expected)

January 2001 Diurnal Cycle of SST using ERA-40 fluxes July 2001 Prominent seasonal cycle – effect must be taken into account to ensure bias-free SSTs in important climatic regions

Impact of spectral response error on RT modeling Impact is greater at high water vapor loadings Impact is greater at higher scan angles While top plot shows dependence on temperature, bottom plot is the key to identifying SRF error rather than calibration

Regional biases if 12 µm SRF is shifted by -5 cm -1 NLSST retrieval difference (true – error) Geographic impact of SRF shifts Regional biases in NLSST retrievals

Results of perturbing NOAA & 12 µm spectral responses Daytime split-window Nighttime split-window

In practice, split- window retrieval will be replace by physical retrieval method Triple-window uses adjusted filters as determined by analysis of 11 and 12 µm data Impact of adjusted spectral response Impact of adjusted spectral response

Value of triple-window Value of triple-window With three channels (3.7, 11 & 12 µm) the SST retrieval problem is essentially linear In the daytime, solar radiation contaminates the signal at 3.7 µm

Some Aspects of Calibration Some Aspects of Calibration Calibration difference between day and night due to “boost” in BB radiance from reflected solar 3.7 µm Digitization of PRTs resolvable if calibration is recalculated using a running full precision Variations in scene radiance also affect calibration…

Some Aspects of Calibration cont’d Some Aspects of Calibration cont’d Warm scene radiances boost perceived BB emission c.f. cold scenes Large-scale variation dominated by center- weighted scene radiance Small-scale variation shows more sensitivity where it might be anticipated “Correct” calibration can be obtained by estimating an efficiency for scattered scene radiance to remove dependency

Some Good News on Calibration Some Good News on Calibration “Correct” calibration [i.e. in night-time portion of orbit] is stable (FWHM is 0.05°K over 1 day, including PRT digitization noise) Most “Daytime” and some nighttimecalibration of 3.7µm is erroneous, but… Most “Daytime” and some nighttime calibration of 3.7µm is erroneous, but… Derive a single “best estimate” of calibration and apply to whole orbit

11µm BT image Bayesian P clear >0.99 Manually screened “truth” Threshold- based mask Bayesian Cloud Mask: Along-Track Scanning Radiometer

Calculated vs “Actual” Probability

Some results… MaskPPHRFARTSS P-clear < P-clear < P-clear < Standard Threshold mask Note that a hit rate of 97.2% (P clear < 0.99 → cloud) corresponds to a “failure to detect” rate of 2.8%Note that a hit rate of 97.2% (P clear < 0.99 → cloud) corresponds to a “failure to detect” rate of 2.8% Standard threshold-based mask fails to detect 3.7% of cloud-contaminated pixelsStandard threshold-based mask fails to detect 3.7% of cloud-contaminated pixels What is the impact of these “failures to detect” and “false arms”?

“False alarm” SST histogram “Failure to detect” SST histogram SST difference histogram Impact on retrieved SST Computed from 1°×1° cells Appropriate for “climate” SST analyses Cold clear ocean can sometimes be flagged as cloud Failures of Bayesian scheme tend to have less impact

Probability vs Error in SST Increasing Probability of Clear-Sky Bias and scatter improve with increased P clearBias and scatter improve with increased P clear Significant decrease in coverage as P clear → 1Significant decrease in coverage as P clear → 1

Summary SST is key environmental data record, and also comparatively easy to validate – a powerful tool for diagnosing AVHRR sensor performanceSST is key environmental data record, and also comparatively easy to validate – a powerful tool for diagnosing AVHRR sensor performance Pursue physically-based methodologies to provide: Pursue physically-based methodologies to provide: –Techniques to identify instrumental calibration and characterization post-launch –Improved AVHRR SST retrieval capability (inc. diurnal) –Feed back results to improve forward modeling Bayesian cloud detection a promising method for assigning quantitative errors to individual pixelsBayesian cloud detection a promising method for assigning quantitative errors to individual pixels