1 Algorithm Theoretical Basis (Fog/Low Stratus) Presented by Michael Pavolonis Aviation Application Team STAR With significant contributions from: Corey.

Slides:



Advertisements
Similar presentations
Improved Automated Cloud Classification and Cloud Property Continuity Studies for the Visible/Infrared Imager/Radiometer Suite (VIIRS) Michael J. Pavolonis.
Advertisements

A thermodynamic model for estimating sea and lake ice thickness with optical satellite data Student presentation for GGS656 Sanmei Li April 17, 2012.
VIIRS LST Uncertainty Estimation And Quality Assessment of Suomi NPP VIIRS Land Surface Temperature Product 1 CICS, University of Maryland, College Park;
GOES-R Fog/Low Stratus (FLS) IFR Probability Product.
TRMM Tropical Rainfall Measurement (Mission). Why TRMM? n Tropical Rainfall Measuring Mission (TRMM) is a joint US-Japan study initiated in 1997 to study.
Convective Initiation Studies at UW-CIMSS K. Bedka (SSAI/NASA LaRC), W. Feltz (UW-CIMSS), J. Sieglaff (UW-CIMSS), L. Cronce (UW-CIMSS) Objectives Develop.
NRL09/21/2004_Davis.1 GOES-R HES-CW Atmospheric Correction Curtiss O. Davis Code 7203 Naval Research Laboratory Washington, DC 20375
ATS 351 Lecture 8 Satellites
A 21 F A 21 F Parameterization of Aerosol and Cirrus Cloud Effects on Reflected Sunlight Spectra Measured From Space: Application of the.
GOES-13 Science Team Report SST Images and Analyses Eileen Maturi, STAR/SOCD, Camp Springs, MD Andy Harris, CICS, University of Maryland, MD Chris Merchant,
Cooperative Institute for Meteorological Satellite Studies University of Wisconsin - Madison Steve Ackerman Director, Cooperative Institute for Meteorological.
Profiling Clouds with Satellite Imager Data and Potential Applications William L. Smith Jr. 1, Douglas A. Spangenberg 2, Cecilia Fleeger 2, Patrick Minnis.
Satellite basics Estelle de Coning South African Weather Service
Motivation Many GOES products are not directly used in NWP but may help in diagnosing problems in forecasted fields. One example is the GOES cloud classification.
Introduction and Methodology Daniel T. Lindsey*, NOAA/NESDIS/STAR/RAMMB Louie Grasso, Cooperative Institute for Research in the Atmosphere
Spectral contrast enhancement
Aircraft spiral on July 20, 2011 at 14 UTC Validation of GOES-R ABI Surface PM2.5 Concentrations using AIRNOW and Aircraft Data Shobha Kondragunta (NOAA),
1 GOES-R AWG Hydrology Algorithm Team: Rainfall Probability June 14, 2011 Presented By: Bob Kuligowski NOAA/NESDIS/STAR.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 CLOUD MASK AND QUALITY CONTROL FOR SST WITHIN THE ADVANCED CLEAR SKY PROCESSOR.
SeaDAS Training ~ NASA Ocean Biology Processing Group 1 Level-2 ocean color data processing basics NASA Ocean Biology Processing Group Goddard Space Flight.
Applications and Limitations of Satellite Data Professor Ming-Dah Chou January 3, 2005 Department of Atmospheric Sciences National Taiwan University.
FRAM, Montreal, Que 15 June 2005 Analysis of Hazardous Fog and Low Clouds Using Meteorological Satellite Data Gary P. Ellrod NOAA/NESDIS, Camp Springs,
Federal Department of Home Affairs FDHA Federal Office of Meteorology and Climatology MeteoSwiss High Resolution Snow Analysis for COSMO
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 GOES Solar Radiation Products in Support of Renewable Energy Istvan Laszlo.
Satellite-derived Sea Surface Temperatures Corey Farley Remote Sensing May 8, 2002.
AGU 2002 Fall Meeting NASA Langley Research Center / Atmospheric Sciences Validation of GOES-8 Derived Cloud Properties Over the Southeastern Pacific J.
SATELLITE METEOROLOGY BASICS satellite orbits EM spectrum
1 GOES-R AWG Product Validation Tool Development Aviation Application Team – Volcanic Ash Mike Pavolonis (STAR)
1 GOES-R AWG Product Validation Tool Development Aviation Application Team – Volcanic Ash Mike Pavolonis (STAR)
1 Center for S a t ellite A pplications and R esearch (STAR) Applicability of GOES-R AWG Cloud Algorithms for JPSS/VIIRS AMS Annual Meeting Future Operational.
USING OF METEOSAT SECOND GENERATION HIGH RESOLUTION VISIBLE DATA FOR THE IMPOVEMENT OF THE RAPID DEVELOPPING THUNDERSTORM PRODUCT Oleksiy Kryvobok Ukrainian.
1 Geostationary Cloud Algorithm Testbed (GEOCAT) Processing Mike Pavolonis and Andy Heidinger (NOAA/NESDIS/STAR) Corey Calvert and William Straka III (UW-CIMSS)
Estimation of Cloud and Precipitation From Warm Clouds in Support of the ABI: A Pre-launch Study with A-Train Zhanqing Li, R. Chen, R. Kuligowski, R. Ferraro,
11 Ice Cover and Sea and Lake Ice Concentration with GOES-R ABI Presented by Yinghui Liu Presented by Yinghui Liu 1 Team Members: Yinghui Liu, Jeffrey.
Towards Operational Satellite-based Detection and Short Term Nowcasting of Volcanic Ash* *There are research applications as well. Michael Pavolonis*,
On the Use of Geostationary Satellites for Remote Sensing in the High Latitudes Yinghui Liu 1, Jeffrey R. Key 2, Xuanji Wang 1, Tim Schmit 2, and Jun Li.
The Second TEMPO Science Team Meeting Physical Basis of the Near-UV Aerosol Algorithm Omar Torres NASA Goddard Space Flight Center Atmospheric Chemistry.
J AMS Annual Meeting - 16SATMET New Automated Methods for Detecting Volcanic Ash and Retrieving Its Properties from Infrared Radiances Michael.
Characteristics of Fog/Low Stratus Clouds are composed mainly of liquid water with a low cloud base Cloud layers are highly spatially uniform in both temperature.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Using CALIPSO to Explore the Sensitivity to Cirrus Height in the Infrared.
Next Week: QUIZ 1 One question from each of week: –5 lectures (Weather Observation, Data Analysis, Ideal Gas Law, Energy Transfer, Satellite and Radar)
As components of the GOES-R ABI Air Quality products, a multi-channel algorithm similar to MODIS/VIIRS for NOAA’s next generation geostationary satellite.
Use of Solar Reflectance Hyperspectral Data for Cloud Base Retrieval Andrew Heidinger, NOAA/NESDIS/ORA Washington D.C, USA Outline " Physical basis for.
Studies of Advanced Baseline Sounder (ABS) for Future GOES Jun Li + Timothy J. Allen Huang+ W. +CIMSS, UW-Madison.
Satellite based instability indices for very short range forecasting of convection Estelle de Coning South African Weather Service Contributions from Marianne.
Consistency of reflected moonlight based nighttime precipitation product with its daytime equivalent. Andi Walther 1, Steven Miller 3, Denis Botambekov.
1 GOES-R AWG Aviation Team: SO 2 Detection Presented By: Mike Pavolonis NOAA/NESDIS/STAR.
A collaboration between Environment Canada will allow for a detailed analysis of the GOES-R FLS products that is not possible with standard surface based.
METEOSAT SECOND GENERATION FROM FIRST TO SECOND GENERATION METEOSAT
1 GOES-R AWG Land Team: ABI Land Surface Albedo (LSA) and Surface Reflectance Algorithm June 14, 2011 Presented by: Shunlin Liang Dongdong Wang, Tao He.
Visible optical depth,  Optically thicker clouds correlate with colder tops Ship tracks Note, retrievals done on cloudy pixels which are spatially uniform.
Satellites Storm “Since the early 1960s, virtually all areas of the atmospheric sciences have been revolutionized by the development and application of.
1 GOES-R AWG Aviation Team: Tropopause Folding Turbulence Product (TFTP) June 14, 2011 Presented By: Anthony Wimmers SSEC/CIMSS University of Wisconsin.
4. GLM Algorithm Latency Testing 2. GLM Proxy Datasets Steve Goodman + others Burst Test 3. Data Error Handling Geostationary Lightning Mapper (GLM) Lightning.
UCLA Vector Radiative Transfer Models for Application to Satellite Data Assimilation K. N. Liou, S. C. Ou, Y. Takano and Q. Yue Department of Atmospheric.
1 GOES-R AWG Aviation Team: ABI Visibility Algorithm (VP) June 14, 2011 Presented By: R. Bradley Pierce 1 1 NOAA/NESDIS/STAR.
NASA, CGMS-44, 7 June 2016 Coordination Group for Meteorological Satellites - CGMS LIMB CORRECTION OF POLAR- ORBITING IMAGERY FOR THE IMPROVED INTERPRETATION.
Radiance Simulation System for OSSE  Objectives  To evaluate the impact of observing system data under the context of numerical weather analysis and.
Cloud Detection: Optical Depth Thresholds and FOV Considerations Steven A. Ackerman, Richard A. Frey, Edwin Eloranta, and Robert Holz Cloud Detection Issues.
The GOES-R/JPSS Approach for Identifying Hazardous Low Clouds: Overview and Operational Impacts Corey Calvert (UW-CIMSS) Mike Pavolonis (NOAA/NESDIS/STAR)
Passive Microwave Remote Sensing
1 Product Overview (Fog/Low Cloud Detection). Example Product Output 2.
Fog/Low Clouds: Formation and Dissipation Scott Lindstrom University of Wisconsin-Madison CIMSS (Cooperative Institute for Meteorological Satellite Studies)
A Probabilistic Nighttime Fog/Low Stratus Detection Algorithm
Winds in the Polar Regions from MODIS: Atmospheric Considerations
ABI Visible/Near-IR Bands
Geostationary Sounders
GOES-R AWG Aviation Team: Fog/Low Cloud Detection
GOES-R AWG Aviation Team: SO2 Detection
Validation Specialized ground based instruments are better suited for observing fog, but are extremely limited by their lack of spatial coverage. Conventional.
Presentation transcript:

1 Algorithm Theoretical Basis (Fog/Low Stratus) Presented by Michael Pavolonis Aviation Application Team STAR With significant contributions from: Corey Calvert (UW/CIMSS)

2 Algorithm Theoretical Basis   Purpose: Provide product developers, reviewers and users with a theoretical description (scientific and mathematical) of the enterprise GS Fog/Low Stratus algorithm   Will be documented in the ATBD of enterprise GS Fog/Low Stratus products

3 CDR Requirements Low Cloud and Fog NameUser &PriorityGeographicCoverage(G, H, C, M)VerticalRes.Horiz.Res.MappingAccuracyMsmnt.RangeMsmnt.AccuracyRefreshRate/CoverageTime Option(Mode 3)Refresh RateOption (Mode4)DataLatencyLong-TermStabilityProductMeasurementPrecision Fog/Low Stratus Cloud Enterprise GS FD0.5 km (depth) 4 km1 kmFog/No Fog70% Correct Detection 15 min5 min159 secTBDUndefined C – CONUS FD – Full DiskM - Mesoscale

4 CDR Requirements Low Cloud and Fog NameUser &PriorityGeographicCoverage(G, H, C, M)TemporalCoverageQualifiersProductExtentQualifierCloud CoverConditionsQualifierProductStatisticsQualifier Fog/Low Stratus Clouds Enterprise GSFDDay and nightQuantitative out to at least 70 degrees LZA and qualitative beyond All cloud cover conditionsOver low cloud and fog cases with at least 42% occurrence in the region C – CONUS FD – Full DiskM - Mesoscale

5 Algorithm Development - Development Strategy  Aviation based fog/low cloud definition  Visual flight rules  ceiling > 3000 ft and/or surface visibility > 5 sm  Marginal visual flight rules  1000 ft < ceiling < 3000 ft and/or 3 sm < sfc vis < 5 sm  Instrument flight rules  500 ft < ceiling < 1000 ft and/or 1 sm < sfc vis < 3 sm  Low instrument flight rules  ceiling < 500 ft and/or sfc vis < 1 sm

6 Algorithm Development - Development Strategy  Aviation based fog/low cloud definition  Visual flight rules  ceiling > 3000 ft and/or surface visibility > 5 sm  Marginal visual flight rules  1000 ft < ceiling < 3000 ft and/or 3 sm < sfc vis < 5 sm  Instrument flight rules  500 ft < ceiling < 1000 ft and/or 1 sm < sfc vis < 3 sm  Low instrument flight rules  ceiling < 500 ft and/or sfc vis < 1 sm

7 ADR Algorithm   There was no ADR performed for the Enterprise GS fog/low stratus products   However, an algorithm was developed to detect fog/low stratus under the GOES-R Future Capabilities project and has already gone through a CDR and TRR   This algorithm was created to mitigate several issues seen in the current μm BTD product currently in operations » »Issues with the μm BTD products – –Method only designed for nighttime conditions. – –False alarms over barren surfaces. – –Non-hazardous water clouds are often detected as fog/low cloud – –Thresholds and empirical relationship depends on exact sensor characteristics.

8 CDR Algorithm Given that the F&PS requires fog/low stratus products to be produced during the day and night, our preferred solution is to utilize the algorithm developed under the GOES-R Future Capabilities project.Given that the F&PS requires fog/low stratus products to be produced during the day and night, our preferred solution is to utilize the algorithm developed under the GOES-R Future Capabilities project.

9 Algorithm Objectives  F&PS  Meet the F&PS requirements for low cloud and fog.   Provide needed performance information to allow for proper use of our products.

10 Low Cloud and Fog Sensor Inputs Future GOES Imager (ABI) Band Nominal Wavelength Range (μm) Nominal Central Wavelength (μm) Nominal Central Wavenumber (cm-1) Nominal sub-satellite IGFOV (km) Sample Use Fog detection Fog detection and depth Fog detection and depth Current Input Expected Added InputPossible Added Input

11 GOES-R ABI Low Cloud/Fog requires the following for each pixel: » »Calibrated/Navigated ABI brightness temperatures/radiances/reflectances » »Spectral response information » »Solar-view geometry (satellite zenith, relative azimuth, solar zenith) » »Geolocation (latitude, longitude) NameTypeDescriptionDimension Ch2 reflectanceinputCalibrated ABI level 1b reflectance for channel 2Scan grid (xsize, ysize) Ch 7 reflectanceInputCalibrated ABI level 1b reflectance for channel 7Scan grid (xsize, ysize) Ch7 brightness temp/ radiances input Calibrated ABI level 1b brightness temperatures for channel 7 Scan grid (xsize, ysize) Ch14 brightness temp/ radiances input Calibrated ABI level 1b brightness temperatures and radiances for channel 14 Scan grid (xsize, ysize) Fog and Low Cloud Input Sensor Input Details Possible Added Input

12 NameTypeDescriptionDimension LatitudeInputABI LatitudeScan grid (xsize, ysize) LongitudeInputABI LongitudeScan grid (xsize, ysize) Glint angleInputGlint Zenith angleScan grid (xsize, ysize) Solar geometryinputABI solar zenith angleScan grid (xsize, ysize) View anglesinputABI view zenith and relative azimuth anglesScan grid (xsize, ysize) QC flagsinputABI quality control flags with level 1b dataScan grid (xsize, ysize) Fog and Low Cloud Input Sensor Input Details

13 Sensor Inputs Channels used in low cloud/fog algorithm

14 NameTypeDescriptionDimension Snow Maskinput Daily global snow and ice mask available at a horizontal resolution of 4km in the northern hemisphere (IMS) and 25km in the southern (SSMI) 4 km resolution Land MaskinputDerived from global land cover land types Scan grid (xsize, ysize) SSTinput NOAA 1/4° daily Optimum Interpolation Sea Surface Temperature analysis Scan grid (xsize, ysize) Coast Maskinput Created from global 1-km land/water mask used for collection 5. Differentiates coast at distances from 1 km – 10 km. 1 km resolution Surface emissivity InputSeebor 5-km surface emissivity database5-km resolution Digital elevationinput NGDC-GLOBE global digital elevation model with a horizontal resolution of 1km 1 km resolution ●Non-ABI Static Data Fog and Low Cloud Input Ancillary Input Details

15 NameTypeDescriptionDimension Clear-sky TOA radiances Input TOA clear sky radiances for ABI channels 7 and 14 derived from PFAAST RTM Scan grid (xsize, ysize) Clear-sky radiance profiles Input Clear sky radiance profiles for ABI channels 7 and 14 derived from PFAAST RTM NWP grid (xsize, ysize, ivza, nprof) Atmospheric transmittance profiles Input Atmospheric transmittance profiles for ABI channels 7 and 14 derived from PFAAST RTM NWP grid (xsize, ysize, ivza, nprof) NWP temperature, RH and height profiles Input Profiles of NWP temperature, relative humidity and height for each cell. NWP grid (xsize, ysize) NWP/imager co- location Input X and Y cell number for each latitude and longitude Scan grid (xsize, ysize) NWP surface and troposphere levels Input NWP level for surface and troposphere for each pixel. NWP grid (xsize, ysize) NWP surface temperature Input Temperature of surface from NWP for each cell. NWP grid (xsize, ysize) ●Non-ABI Dynamic Data Fog and Low Cloud Algorithm Input Ancillary Input Details

16 NameTypeDescriptionDimension Cloud MaskInputDerived ABI Cloud Mask Scan grid (xsize, ysize) Cloud Phase/TypeInputDerived ABI Cloud Phase and Type Output Scan grid (xsize, ysize) Daytime Microphysical Properties Input Derived ABI VIS/NIR Cloud Microphysical Properties Scan grid (xsize, ysize) ●Products required to run algorithm Fog and Low Cloud Algorithm Product Precedence Details

17 Algorithm Output Output Name Description MVFR probability Probability that MVFR, or lower conditions are present IFR probability Probability that IFR, or lower conditions are present LIFR probability Probability that LIFR, or lower conditions are present Fog depth Fog geometrical depth in meters

18 ABI Proxy Data for Fog/Low Cloud AWG Products Geostationary satellite datasets are used as ABI proxies in algorithm verification/validation  GOES N-P Imagers  Moderate Resolution Imaging Spectroradiometer (MODIS) The data from GOES is considered as a good proxy of ABI since noise levels are close to expected ABI channels in geostationary orbit covering the same geographic area as the ABI Spatial resolution (4 km) somewhat similar to ABI (2 km) Co-located with high quality ground truth The data from MODIS is considered as a good proxy of ABI since Spatial resolution (1 km) somewhat similar to ABI (2 km)

19 MODIS Band Number MODIS Wavelength Range (μm) MODIS Central Wavelength (μm) MODIS Sensor Noise ABI Band Number ABI Wavelength Range (μm) ABI Central Wavelength (μm) – 21.8 W/m – K – K – ABI Proxy Data Used Current InputExpected Added InputPossible Added Input GOES Band Number GOES N-P Wavelength Range (μm) GOES N-P Central Wavelength (μm) GOES N-Ps Sensor Noise ABI Band Number ABI Wavelength Range (μm) ABI Central Wavelength (μm) W/m K K –

20 Retrieval Strategy (Naïve Bayesian Approach) Clear Sky RTM - Minimum channel requirement: 0.65, 3.9, 6.7/7.3, 11, and 12/13.3 μm -Previous image for temporal continuity (GEO only) -Cloud Phase + + Static Ancillary Data -DEM -Surface Type -Surface Emissivity Daily SST Data 0.25 degree OISST + NWP Naïve Bayesian Model IFR Probability NWP RH Profiles -RUC/RAP (2-3 hr forecast) or GFS (12 hr forecast) ***IMPORTANT: Other sources of relevant data (e.g. sfc obs) influence results through the model fields -Surface Temperature -Profiles of T and q -RUC/RAP (2-3 hr forecast) or GFS (12 hr forecast)

21 Retrieval Strategy (Naïve Bayesian Approach) Naïve Bayesian Model probability an event occurs given no measured features probability an event does not occur given no measured features Conditional probability a set of features are observed given an event occurs probability an event occurs given a set of measured features Calculated climatology of event Trained using known data

22 Retrieval Strategy (single layer liquid fog detection)   The ABI cloud phase/type product is used to identify liquid water clouds   For single layer liquid fog detection, the following physical properties are exploited: » »Since the top of fog/low stratus layers is often close to the ground, the temperature difference between the cloud and the surface temperature is typically small. » »Since fog/low stratus is not formed by adiabatic cooling brought about by spatially varying vertical motions, it tends to be horizontally uniform in albedo (e.g. reflectivity). » »Fog/low clouds are generally composed of small liquid droplets » »Fog/low clouds form in environments at or near saturation   Thus, the difference between the observed and clear sky surface temperature, the 3.9 micron reflectance and pseudo-emissivity, the standard deviation of reflectance in a 3 x 3 pixel array and low level moisture are used as fog detection metrics. The strength of the radiometric signal is also taken into account (via a cloud - clear reflectance difference or the 3.9/11  m nighttime signal).   As opposed to using specific fog/no fog thresholds, a training data set is used to assign a fog probability to each non-ice cloud pixel.   This approach does not rely on thresholds or metrics that are highly sensitive to the exact sensor characteristics, so it should not need to be extensively tuned when applied to actual ABI data.

23 Retrieval Strategy (IFR detection when multi-layered or ice clouds are present)   The ABI cloud phase/type product is used to identify ice clouds, including multilayered ice clouds.   When multi-layered or ice clouds are present, the following physical property is exploited: » »Ice clouds, including multi-layered clouds, tend to be elevated and can obscure lower clouds and fog from a satellite point of view » »Fog/low clouds beneath ice clouds form in environments at or near saturation » »Precipitation from convective clouds can create IFR conditions at or near the surface   Satellites can not see through multiple cloud layers so if the fog/low cloud layer is not the highest cloud layer then it’s spectral information is not seen.   For this reason, only the low level RH information from NWP models is used to detect IFR conditions.   As opposed to using specific fog/no fog thresholds, a training data set is used to assign a fog probability to each multi-layered or ice pixel.   This approach does not rely on thresholds or metrics that are highly sensitive to the exact sensor characteristics, so it should not need to be extensively tuned when applied to actual ABI data.

24 Retrieval Strategy (IFR detection in the terminator region)   At high daytime solar zenith angles accurate satellite data can be difficult to obtain due to scattering issues   The characteristics of fog/low stratus clouds usually do not drastically change in time so temporal data is used until accurate data is available at lower sun angles   A maximum of 2 scenes within 1 hr of the processed scene are used to temporarily fill gaps in the terminator region   Day-to-night transition »Temporal 3.9  m reflectance and the 0.65  m spatial uniformity metric are used for solar angles between 80-90°   Night-to-day transition »Temporal 3.9  m pseudo-emissivity data is used for solar angles between 85-90°   The NWP data is not dependent on solar angles so the modeled RH and sfc temperature bias are used for all pixels.  °  Cloud masking can also be difficult in the terminator region so a temporal cloud check is used for sun angles between 70-90° to re- classify ‘clear’ pixels as cloudy when fog/low stratus might be present   This approach does not rely on thresholds or metrics that are highly sensitive to the exact sensor characteristics, so it should not need to be extensively tuned when applied to actual ABI data.

25 Retrieval Strategy (fog depth)   The fog depth retrieval is performed on all pixels not characterized as ice from the cloud type algorithm   During the day, the fog depth is computed using the retrieved liquid water path and an assumed liquid water content consistent with in-situ measurements of fog.   At night, a regression relationship, conceptually similar to the one developed by Ellrod, is used.   Fog depth retrievals are not possible in the day/night terminator.

26 Retrieval Strategy (Fog/Low Cloud Detection)   The enterprise GS fog/low cloud detection algorithm can be broken into ????? separate steps Using the cloud mask and cloud type/phase results to differentiate water from ice clouds, compute fog detection metrics for all pixels at night and cloudy pixels during the day 2. 2.Based on the metrics, determine the fog/low cloud probability for each pixel using previously constructed fog probability look-up tables ?????

27 Retrieval Strategy (Fog/Low Cloud Detection)   The enterprise GS fog/low cloud detection algorithm can be broken into 4 separate steps Using the cloud mask and cloud type/phase results to differentiate water from ice clouds, compute fog detection metrics for all pixels at night and cloudy pixels during the day   Based on the metrics, determine the fog/low cloud probability for each pixel using previously constructed fog probability look-up tables.  ?????

28 Cloud Type/Phase Product Full disk cloud type results Water, Supercooled Water, Mixed Phase, Thick Ice, Thin Ice, Multilayered

29 Physical Description For cloudy scenes, the radiometric surface temperature tends to be much lower than the SST or LST given by NWP, unless fog/low cloud is present. In which case, the difference is smaller. The radiometric surface temperature can be derived from the 11-  m radiance by re-arranging the infrared radiative transfer equation. Note that if one were to use the difference between the observed 11-  m brightness temperature and the surface temperature, the results will be sensitive to the water vapor loading, view angle, and sensor characteristics. The radiometric surface temperature is derived as follows: Metric 1: Difference between the radiometrically derived surface temperature and the NWP surface temperature [Day and Night]

30 Physical Description Metric 1: Difference between the radiometrically derived surface temperature and the NWP surface temperature [Day and Night] : wavelength (11-  m in this case) R( ): observed radiance R sfc ( ): surface radiance T atm ( ): total atmospheric transmittance R atm ( ): atmospheric radiance  sfc ( ): surface emissivity B -1 ( ): inverse Planck Function T sfc : radiometric surface temperature T nwp : surface temperature from NWP T sfc_bias : the difference between the radiometric and NWP surface temperatures Assuming clear conditions

31 Physical Description Full disk view of “surface temperature bias”

32 Physical Description Full disk view of “surface temperature bias” Elevated clouds Low clouds

33 Metric 2: Low-level Relative Humidity [Day and night] Fog/low clouds form in environments at or near saturation low-level RH information is determined using the surface RH and RH profile data from NWP models (RAP/GFS) The vertical ceiling requirement for fog/low clouds is 1000 ft so the maximum RH from the surface up to 1000 ft above ground level (AGL) is used as the RH metric Physical Description

34 Physical Description Full disk view of Max RH in lowest 1000 ft layer AGL Dry low-level air Most low-level air at/near saturation

35 Physical Description As stated earlier, fog/low cloud tends to be spatially uniform in albedo. Consider the standard deviation of a given parameter over a 3 x 3 pixel window. The standard deviation of the visible reflectance is a useful indicator of fog during the day. Issues arise near cloud edges where the standard deviations in the visible reflectance are large. To mitigate this issue, the “gradient filter” procedure is used to determine the local radiative center (LRC) for each cloudy pixel during the day. The gradient filter allows the spectral information from an interior pixel within the same cloud to represent pixels with a very weak cloud radiative signal or sub-pixel cloudiness associated with cloud edges. Metric 3: Spatial uniformity at the cloud LRC [Day only]

36 Physical Description   Given a cloud parameter such as emissivity or reflectance, the LRC for a given pixel is defined as the location in the direction of the gradient vector upon which the gradient reverses or when a value greater than some threshold is found.   By definition, the gradient vector points from low to high values.   This concept is illustrated graphically on the next few slides. Metric 3: Spatial uniformity at the cloud LRC [Day only]

37 Mathematical Description The tail of each vector represents the pixel of interest. The head of each vector represents the LRC of the pixel of interest.

38 Mathematical Description The tail of each vector represents the pixel of interest. The head of each vector represents the LRC of the pixel of interest.

39 Mathematical Description Zoomed in view of gradient vectors

40 Mathematical Description Zoomed in view of gradient vectors

41 Physical Description Full disk view of the spatial uniformity at the cloud LRC

42 Physical Description Full disk view of the spatial uniformity at the cloud LRC

43 Physical Description Full disk view of the spatial uniformity at the cloud LRC Spatially uniform clouds Non-spatially uniform clouds

44 Physical Description Fog/low stratus clouds usually consist of small liquid water droplets compared to higher liquid water cloud layers. Smaller water droplets have a higher reflectivity at 3.9 μm than larger droplets, ice particles or snow. Thus, clouds with a relatively high 3.9 μm reflectance (e.g. small water droplets), high spatial uniformity in the visible reflectance, and a small surface temperature bias have a higher probability of being fog/low clouds. Metric 4: NIR (3.9 μm) reflectance [Day Only]

45 Physical Description Metric 4: NIR (3.9 μm) reflectance [Day Only]

46 Physical Description Metric 4: NIR (3.9 μm) reflectance [Day Only]

47 Physical Description Metric 4: NIR (3.9 μm) reflectance [Day Only] Surface Snow Ice cloud Water cloud

48 Physical Description Traditionally, the  m brightness temperature difference (BTD) has been used to detect fog/low cloud at night. While this BTD has been successfully used to make fog imagery, it is difficult to use for quantitative fog detection because of its dependence on moisture and view angle. Fortunately, these effects can be accounted for by deriving a radiometric parameter from the observed 3.9 and 11  m radiances. This radiometric parameter, called the “3.9-  m pseudo-emissivity” or ems (3.9  m), has less sensitivities to the spectral response functions and scene temperatures. ems(3.9  m) is derived as follows: Metric 5: The 3.9-  m pseudo-emissivity [Night Only]

49 Physical Description Metric 5: The 3.9-  m pseudo-emissivity [Night Only] ems(3.9  m) is computed as follows: where and ems(3.9  m): the 3.9-  m pseudo-emissivity R sfc (3.9  m): 3.9-  m surface radiance B[3.9  m,BT sfc (11  m)]: the 3.9-  m blackbody surface radiance relative to the 11-  m surface brightness temperature : wavelength R( ): observed radiance R sfc ( ): surface radiance T atm ( ): total atmospheric transmittance R atm ( ): atmospheric radiance  sfc ( ): surface emissivity B -1 ( ): inverse Planck Function

50 Physical Description Metric 5: The 3.9-  m pseudo-emissivity [Night Only] ems(3.9  m) is computed as follows: where and Converting the observed radiances to surface radiances (e.g. the radiance leaving the surface that is transmitted to the TOA) helps correct for water vapor absorption. Normalizing by the term in the denominator accounts for 11-  m temperature variability.

51 Physical Description Full disk view of water cloud ems(3.9)

52 Physical Description Full disk view of water cloud ems(3.9) Low values of ems(3.9) are generally associated with fog/low cloud

53 Retrieval Strategy (Fog/Low Cloud Detection)   The enterprise GS fog/low cloud detection algorithm can be broken into 4 separate steps Using the cloud mask and cloud type/phase results to differentiate water from ice clouds, compute fog detection metrics for all pixels at night and cloudy pixels during the day 2. 2.Based on the metrics, determine the fog/low cloud probability for each pixel using previously constructed fog probability look-up tables ?????

UPDATE LUT’s 54

55 Physical Description Categorical probability look-up tables (LUT’s) were created for 2 different spectral/spatial metric combinations. Only fog/low stratus and non-fog/low stratus water cloud pixels were used to generate the satellite metric LUTs. All pixels were used to generate the NWP max low-level RH LUT’s Observations of surface visibility and cloud ceiling were used to classify fog/no fog in this training data set.

56 Physical Description LUT Type 1: Visible reflectance x surface temperature difference x visible reflectance spatial uniformity [Day Only] Visible reflectance bin #3: % Water Surface Land Surface

57 Physical Description LUT Type 2: ems ac (3.9) x surface temperature difference x 11-  m brightness temperature spatial uniformity [Night Only] ems ac (3.9) bin #4: Water Surface Land Surface

58 Physical Description LUT Type 3: surface temperature difference x 11-  m brightnes temperature spatial uniformity [Day or Night] Produces more false alarms, but works regardless of solar zenith angle Water Surface Land Surface

59 Physical Description UPDATE THIS SLIDE During the day, LUT Type 1 is used (solar zenith angle < 85 o ). At night, LUT Type 2 is used (solar zenith angle > 90 o ). In the day/night terminator, LUT Type 3 is used (85 ≤ solar zenith angle ≤ 90). In order to convert the fog probability to a binary fog mask, a yes/no threshold of 0.75 is chosen in probability space. This threshold was chosen in order to have a low probability of false alarm.

60 Retrieval Strategy Summary: Fog/Low Stratus Detection  The cloud mask and cloud type/phase products are used to identify water, supercooled water and mixed phase clouds.  A set of spatial and spectral fog/low stratus detection metrics are computed for each of these pixels.  For a given set of metrics, the probability of a given flight rule category is determined.  The fog/low stratus detection algorithm is computationally stable and efficient (~60 sec. on a full disk, ~5 minutes including cloud dependencies and upfront CPU time)

61 Algorithm Output Full disk nighttime IFR probabilities for 1/10/2014 at 5:45 UTC

62 Algorithm Output Zoom in Full disk nighttime IFR probabilities for 1/10/2014 at 5:45 UTC

63 Algorithm Output The ABI algorithm detects much of what appears to be a large scale fog deck. nighttime IFR probabilities for 1/10/2014 at 5:45 UTC

64 Algorithm Output Surface Observations: VFR MVFR IFR LIFR nighttime IFR probabilities for 1/10/2014 at 5:45 UTC MAKE IMAGE WITH SFC OBS

65 Algorithm Output Full disk daytime IFR probabilities for 1/10/2014 at 17:45 UTC

66 Algorithm Output Zoom in Full disk daytime IFR probabilities for 1/10/2014 at 17:45 UTC

67 Algorithm Output daytime IFR probabilities for 1/10/2014 at 17:45 UTC

68 Algorithm Output Surface Observations: VFR MVFR IFR LIFR daytime IFR probabilities for 1/10/2014 at 17:45 UTC MAKE IMAGE WITH SFC OBS

69 Algorithm Output Full disk terminator IFR probabilities for 1/10/2014 at 13:15 UTC

70 Algorithm Output Zoom in Full disk terminator IFR probabilities for 1/10/2014 at 13:15 UTC

71 Algorithm Output IFR probabilities smoothly transition through the terminator region with the use of temporal data terminator IFR probabilities for 1/10/2014 at 13:15 UTC

72 Algorithm Output Surface Observations: VFR MVFR IFR LIFR MAKE IMAGE WITH SFC OBS terminator IFR probabilities for 1/10/2014 at 13:15 UTC

73 Retrieval Strategy (fog depth)   The fog depth retrieval is performed on all pixels not identified as ice by the cloud type algorithm   During the day, the fog depth is computed using the retrieved liquid water path and an assumed liquid water content consistent with in-situ measurements of fog.   At night, a regression relationship, conceptually similar to the one developed by Ellrod, is used.   Fog depth retrievals are not possible in the day/night terminator.

74 Retrieval Strategy (Fog depth)   The enterprise GS fog/low cloud depth retrieval can be broken into 1 step Apply the fog depth retrieval to all pixels not identified as ice clouds. · ·The fog depth retrieval methodology differs between day and night.

75 Physical Description Daytime approach: Use the retrieved liquid water path (LWP) and an assumed liquid water content (LWC) to calculate the cloud geometrical thickness (e.g. fog depth). The fog depth (  Z) is given by: The LWP is produced by the cloud team. The LWC is assumed to be 0.06 g/m 3 (Hess et. al, 1998). The LWP is only available for solar zenith angles < 70 o.

76 Physical Description Nighttime approach: Use a regression relationship between the ems(3.9  m) and fog depth determined from ground based instruments to estimate fog depth. The fog depth (  Z) is given by the following regression equation: This approach is analogous to the Ellrod method, except ems(3.9  m) is used in lieu of the  m brightness temperature difference. The following analysis will illustrate the benefits of using ems(3.9  m). A and B are regression constants.

77 Physical Description Nighttime approach: Use a regression relationship between the ems(3.9  m) and fog depth determined from ground based instruments to estimate fog depth. BTDems(3.9)

78 Physical Description Nighttime approach: Use a regression relationship between the ems(3.9  m) and fog depth determined from ground based instruments to estimate fog depth. BTDems(3.9) Correlation: -0.72Correlation: -0.06

79 Physical Description Terminator approach: Despite the ABI’s advanced capabilities, fog depth estimation is not possible in the day/night terminator. The fog depth (  Z) is set equal to missing in the day/night terminator.

80 Algorithm Output Daytime fog depth retrieval Fog depth not available in the terminator region

81 Algorithm Output Nighttime fog depth retrieval

82 Algorithm Output   Algorithm runs the same on conus, mesoscale, and full-disk scans.   Processing currently limited to viewing angles < 70 degrees (F&PS specifies 70 degrees).   Algorithm will output the fog mask, fog depth, and quality flags.

83 Practical Considerations: Exception Handling  During the day, the algorithm performs best when the 0.65, 3.9 and 11  m channels provide valid data.  At night, the algorithm performs best when the 3.9 and 11  m channels provide valid data.  If none of the above channel combinations are available, the quality flags will indicate that the fog mask and fog depth could not be determined and the fog mask will be set to “No fog”  If clear sky radiance calculations (based on NWP data) are unavailable, the algorithm output will also be set to unknown. However, the algorithm can tolerate any NWP hour forecast data valid for the ABI image time.

84 Assumptions and Limitations   Algorithm performance demands accurate NWP and computationally efficient and accurate clear- sky RTM calculations comparable to or better than what is available today.   The processing system allows for multiple scan lines of data (at least 200), preferably with overlap between scan segments.   Unknown spectral shifts in the ABI channels used in the fog/low cloud algorithm will cause biases in the clear sky radiance calculations which will adversely impact algorithm performance.

85 Performance Estimates  Specialized ground based instruments are better suited for observing fog, but are extremely limited by their lack of spatial coverage.  Conventional surface observations are generally limited to populated areas (e.g. very few maritime observations) and are sometimes difficult to physically interpret.  Despite the limitations of each data source, we will try to take advantage of the strength of each potential validation data set.  Validation results are summarized on the next few slides.

86 Performance Estimates (fog/low stratus detection) Accuracy statistics as a function of probability threshold

87 Performance Estimates (fog/low stratus detection) All Pixels Liquid Pixels Only Daytime IFR 91.3% (48%) 95.7% (52%) Nighttime IFR 87.4% (48%) 90.4% (56%) # of validation pts ~650,000~390,000 The validation data set was comprised of 12 (1 day from each month) 24-hr periods of GOES-13 data collocated with sfc obs The accuracy of the Enterprise GS fog/low stratus algorithm exceeds the 70% F&PS accuracy specification during both day and night. Max. Algorithm Accuracy (threshold)

88 Performance Estimates (fog/low stratus detection) Observed YES Observed NO Total Forecasted YES Forecasted NO Total Daytime IFR Accuracy (48% threshold)

89 Performance Estimates (fog/low stratus detection) Nighttime Reliability tables IFRLIFR MVFR

90 Performance Estimates (fog/low stratus detection) Daytime Reliability tables IFRLIFR MVFR

91 Performance Estimates A combination of ceilometer and SODAR measurements are used to infer the geometric boundaries of low clouds in the San Francisco Bay Area. This network of instruments is operated by the FAA and NWS. The acoustic SODAR (Sonic Detection And Ranging) is an upwardly pointing parabolic antenna that emits an audible signal whose return signal is proportional to the vertical gradient of air density. As such, the SODAR is capable of detecting the base of the inversion, which defines the top of the stratus deck.

92 Performance Estimates The combination of SODAR and ceilometer data can be used to validate the fog depth product. fog depth

93 Performance Estimates (fog depth) Initial performance estimates indicate that the 500 m accuracy will be readily achieved (bias < 32 m). The strong correlations indicate that the spatial and temporal patterns are informative. DaytimeNighttime

94 Performance Estimates: Summary  The validation of the fog/low stratus products show that: »The fog depth algorithm should easily meet the 500 m accuracy requirement. »The IFR probability product should easily meet the 70% accuracy requirement

95 References Bendix, J., B. Thies, T. Nauss, and J. Cermak, 2006: A Feasibility Study of Daytime Fog and Low Stratus Detection with TERRA/AQUA-MODIS Over Land. Meteor. Appl., 13, Bendix, J., B. Thies, J. Cermak, and T. Nauss, 2005: Ground Fog Detection from Space Based on MODIS Daytime Data - A Feasibility Study. Weather and Forecasting. 20, Bendix, J., J. Cermak, and B. Thies, 2004: New Perspectives in Remote Sensing of Fog and Low Stratus - TERRA/AQUA-MODIS and MSG. Proceedings 3rd Int. Conf. on Fog, Fog Collection and Dew, Oct. 2004, Cape Town, South Africa., G2.1-G2.4. Bendix, J., 2002: A Satellite-Based Climatology of Fog and Low-Level Stratus in Germany and Adjacent Areas. Atmos. Res., 64, Cermak, J., and J. Bendix, 2008: A Novel Approach to Fog/Low Stratus Using Meteosat 8 Data. Atm. Res., 87, Cermak, J., and J. Bendix, 2007: Dynamical Nighttime Fog/Low Stratus Detection Based on Meteosat SEVIRI Data: A Feasibility Study. Pure appl. geophys., 164, Cermak, J., and J. Bendix, 2006: Satellite-Based Nowcasting of Fog and Low Stratus. Proceedings of the WWRP Symposium on Nowcasting and Very Short Range Forecasting, Toulouse, France. Cermak, J., B. Thies, and J. Bendix, 2004: A New Approach to Fog Detection Using SEVIRI and MODIS Data. Proceeedings 2004 EUMETSAT Met. Sat. Conf. Prague, Czech Rep., Ellrod, G.P., 2002: Estimation of Low Cloud Base Heights at Night from Satellite Infrared and Surface Temperature Data. National Weather Digest., 26, Ellrod, G.P., 1995: Advances in the Detection and Analysis of Fog at Night Using GOES Multispectral Infrared Imagery. Weather and Forecasting., 10, Eyre, J.R., J.L. Brownscomb, and R.J. Allam, 1984: Detection of Fog at Night Using Advanced Very High Resolution Radiometer (AVHRR) Imagery. Meteor. Mag., 113, Hess, M., P. Koepke and I. Schult, 1998: Optical Properties of Aerosols and Clouds. Bull. Amer. Meteor. Soc., 79, Lee, T.F., F.J. Turk, and K. Richardson, 1997: Stratus and Fog Products Using GOES µm Data. Weather and Forecasting., 12, Underwood, S.J., G.P. Ellrod, A.L. Kuhnert, 2004: A Multiple-Case Analysis of Nocturnal Radiation-Fog Development in the Central Valley of California Utilizing the GOES Nighttime Fog Product. J. Appl. Meteor. 43,

96 Backup Material