GOES-R AIT: Updating the Data Processing System with data from the Himawari-8 Geostationary Satellite Jonathan Wrotny1, A. Li1, A. Ken1, H. Xie1, M. Fan1,

Slides:



Advertisements
Similar presentations
Title: Applications of the AWG Cloud Height Algorithm (ACHA) Authors and AffiliationsAndrew Heidinger, NOAA/NESDIS/STAR Steve Wanzong, UW/CIMSS Topics:
Advertisements

SNPP VIIRS green vegetation fraction products and application in numerical weather prediction Zhangyan Jiang 1,2, Weizhong Zheng 3,4, Junchang Ju 1,2,
SAFNWC/GEO package: An overview
1 1. FY09 GOES-R3 Project Proposal Title Page Title: Trace Gas and Aerosol Emissions from GOES-R ABI Project Type: GOES-R algorithm development project.
Processing Himawari-8 Geostationary Satellite Data Using GOES-R Algorithms for Algorithm Continuity in Operations Jonathan Wrotny1, A. Li1, H. Xie1, M.
Introduction Land surface temperature (LST) measurement is important for understanding climate change, modeling the hydrological and biogeochemical cycles,
September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
1 Algorithm Integration Presented by Walter Wolf AWG Integration Team Lead NOAA/NESDIS/STAR.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 MAP (Maximum A Posteriori) x is reduced state vector [SST(x), TCWV(w)]
1 CIMSS Participation in the Development of a GOES-R Proving Ground Timothy J. Schmit NOAA/NESDIS/Satellite Applications and Research Advanced Satellite.
GOES Users’ Conference IV May 1-3, 2006 Broomfield, CO Prepared by Integrated Work Strategies, LLC 1 GOES USERS’ CONFERENCE IV: Discussion Highlights Algorithm.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 Precipitation and Flash Flood.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Current Status  Framework is in place and algorithms are being integrated.
1 Center for S a t ellite A pplications and R esearch (STAR) Applicability of GOES-R AWG Cloud Algorithms for JPSS/VIIRS AMS Annual Meeting Future Operational.
Algorithm and Software Development of Atmospheric Motion Vector Products for the GOES-R ABI Jaime M. Daniels 1, Wayne Bresky 2, Chris Velden 3, Iliana.
Preparations for Assimilating Land Surface Observations from GOES-R, NPP/VIIRS and AMSR2 in NCEP NWP Models from GOES-R, NPP/VIIRS and AMSR2 in NCEP NWP.
1 Geostationary Cloud Algorithm Testbed (GEOCAT) Processing Mike Pavolonis and Andy Heidinger (NOAA/NESDIS/STAR) Corey Calvert and William Straka III (UW-CIMSS)
COPC Meeting, May 27 – 28 th 2015 NDE Operational Status and PDA Update Prepared by: Chris Sisko, NDE Operational Status.
Himawari‐8 Operational Data Processing and Access
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Image: MODIS Land Group, NASA GSFC March 2000 Infrared Temperature and.
Near-Real-Time Simulated ABI Imagery for User Readiness, Retrieval Algorithm Evaluation and Model Verification Tom Greenwald, Brad Pierce*, Jason Otkin,
The Joint Polar Satellite System (JPSS) is the next generation polar-orbiting operational environmental satellite system. The first satellite in the JPSS.
Hyperspectral Infrared Alone Cloudy Sounding Algorithm Development Objective and Summary To prepare for the synergistic use of data from the high-temporal.
January 7, 2015 Walter Wolf, Jaime Daniels, and Lihang Zhou NOAA/NESDIS, Center for Satellite Applications and Research (STAR) Shanna Sampson, Tom King,
GOES-R Recommendations from past GOES Users’ Conference: Jim Gurka Tim Schmit Tom Renkevens NOAA/ NESDIS Tony Mostek NOAA/ NWS Dick Reynolds Short and.
Framework Details  All products may be run from one program  Coordination of input data:  Model Forecast data  Emissivity Data  Instrument Data 
VALIDATION AND IMPROVEMENT OF THE GOES-R RAINFALL RATE ALGORITHM Background Robert J. Kuligowski, Center for Satellite Applications and Research, NOAA/NESDIS,
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Using CALIPSO to Explore the Sensitivity to Cirrus Height in the Infrared.
High impact weather studies with advanced IR sounder data Jun Li Cooperative Institute for Meteorological Satellite Studies (CIMSS),
Transitioning research data to the operational weather community Overview of GOES-R Proving Ground Activities at the Short-term Prediction Research and.
A system for satellite LST product monitoring and retrieval algorithm evaluation Peng Yu 12, Yunyue Yu 2, Zhuo Wang 12, and Yuling Liu 12 1 ESSIC/CICS,
Introduction GOES-R ABI will be the first GOES imaging instrument providing observations in both the visible and the near infrared spectral bands. Therefore.
Prepared by Ken Knapp, NOAA/NCDC 3/19/2015.  ISCCP Background  Activities in 2014  Plans for 2015  Potential interactions with other SCOPE-CM projects.
 Establishing state-of-the-art coding, documentation, configuration management standards for the AWG.  Software development process comparable with CMMI.
16-17 September 2015 Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
Retrieval Algorithms The derivations for each satellite consist of two steps: 1) cloud detection using a Bayesian Probabilistic Cloud Mask; and 2) application.
Purpose of project: Reduction of project risks related to quality of cloud detection / masking for multiple applications over land and sea. Will provide.
Real-time Display of Simulated GOES-R (ABI) Experimental Products Donald W. Hillger NOAA/NESDIS, SaTellite Applications and Research (STAR) Regional And.
Joint Polar Satellite System (JPSS) John Furgerson, NOAA User Liaison Joint Polar Satellite System.
Cirrus Cloud Boundaries from the Moisture Profile Hyperspectral (i.e., Ultraspectral) IR Sounders W. L. Smith 1,2, Jun-Li 2, and E, Weisz 2 1 Hampton University.
McIDAS-X Software Development and Demonstration Dave Santek and Jay Heinzelman 2 June 2009 PDA Animated Weather (PAW) Status by Russ Dengel.
Overview of Climate Observational Requirements for GOES-R Herbert Jacobowitz Short & Associates, Inc.
Center for Satellite Applications and Research (STAR) Review 09 – 11 March 2010 Combining GOES Observations with Other Data to Improve Severe Weather Forecasts.
Japan Meteorological Agency, May 2014 Coordination Group for Meteorological Satellites - CGMS Volcanic ash algorithm testbed by JMA for validation and.
Data Distribution/dissemination Method
Overview of JPSS and GOES-R Data Assimilation in Global Numerical Weather Prediction Models Presented by Jim Yoe NWS National Centers for Environmental.
NOAA Near Real-Time AIRS Processing and Distribution System Walter Wolf Mitch Goldberg Lihang Zhou NESDIS/ORA/CRAD.
Agency xxx, version xx, Date xx 2016 [update in the slide master] Coordination Group for Meteorological Satellites - CGMS Introduction to GSICS Presented.
Japan Meteorological Agency, June 2016 Coordination Group for Meteorological Satellites - CGMS JMA Testbed for Satellite-based Volcanic Ash Products Presented.
Band 14 (11um) Winds Low-Level >700 mb Mid-Level mb High-Level mb   NPP VIIRS Polar Winds Products The GOES-R AWG Derived Motion Winds.
Visible vicarious calibration using RTM
JMA GPRC report Arata OKUYAMA Meteorological Satellite Center,
JMA GPRC Report GDWG/GRWG Joint Meeting at Daejeon in March 2011
A. Lattanzio, R. Roebeling (EUMETSAT)
True-Color Imagery for GOES-R: Creating a Green Band for ABI
NOAA Report on Ocean Parameters - SST Presented to CGMS-43 Working Group 2 session, agenda item 9 Author: Sasha Ignatov.
Progress Report I: Simulation of GOES Radiances for OSSE
McIDAS-X Software Development and Demonstration
NESDIS-JMA AHI Collaboration
JMA’s GSICS and SCOPE-CM activities Presented to CGMS-43 Working Group II session, agenda item 3 (from MTSAT-2) Japan Meteorological Agency.
USING GOES-R TO HELP MONITOR UPPER LEVEL SO2
ABI Visible/Near-IR Bands
RECENT INNOVATIONS IN DERIVING ATMOSPHERIC MOTION VECTORS AT CIMSS
Hyperspectral Wind Retrievals Dave Santek Chris Velden CIMSS Madison, Wisconsin 5th Workshop on Hyperspectral Science 8 June 2005.
Reprocessing of Atmospheric Motion Vector for JRA-3Q at JMA/MSC
Ninghai Sun1, Lihang Zhou2, Mitch Goldberg3
Himawari-8 Launch and its calibration approaches
Generation of Cloud Products from NOAA’s Operational Satellite Imagers
McIDAS-X Software Development and Demonstration
Generation of Simulated GIFTS Datasets
Presentation transcript:

GOES-R AIT: Updating the Data Processing System with data from the Himawari-8 Geostationary Satellite Jonathan Wrotny1, A. Li1, A. Ken1, H. Xie1, M. Fan1, M. Walters1, R. Chen1, T. Yu1, V. Jose1, S. Sampson1, and W Wolf2 1IMSG, College Park, MD 20740, USA 2NOAA/NESDIS/STAR, College Park, MD 20740, USA Adapting the AWG Framework for AHI Data AWG Science Team Input Update algorithm to ingest AHI data. Determine algorithm-specific coefficients/thresholds which optimize outputs when processing AHI data. Update Look-Up Tables (LUTs), if necessary, which supply additional physical coefficients to the algorithm specific to AHI. If necessary, update algorithm to handle AHI spectral channel 0.51 µm but not a channel at 1.38 µm (unlike the GOES-R ABI instrument). Other Inputs Obtain AHI algorithm code from AWG science team. Obtain AHI-specific spectral and absorption coefficients required for CRTM. Obtain AHI native data format reader from JMA. Modify reader for navigation and Framework data format compatibility. Integration by AIT Integrate algorithm code into AWG Framework. Overview The GOES-R Algorithm Working Group (AWG) Algorithm Integration Team (AIT) maintains and updates a data processing framework for GOES-R algorithm processing. This system provides an environment for algorithm development and testing along with the ability to process multiple algorithms in sequence with product precedence. Most of the algorithms are able to process on multiple satellite datasets. With the launch of the Japanese Himawari-8 satellite in October 2014, a new next-generation geostationary dataset is available for use, and the AIT Framework is currently being updated to utilize these data. This poster describes updates made to the GOES-R Framework to process AHI data for algorithm use. The majority of the AWG Level 2 geophysical algorithms were originally developed and tested with a primary source of satellite data, typically AQUA/MODIS, TERRA/MODIS, or MSG/SEVIRI. Additional datasets supported the development in some cases, for example, AVHRR. As preparation for the upcoming GOES-R, the algorithms were expanded for use with ABI-simulated data. These data are simulations from the WRF model. Approximately half of the 20 AWG algorithms were adapted to read and process on VIIRS data from the S-NPP mission. This work has occurred under the ‘JPSS Risk Reduction Project.’ Now, with the launch of the Japanese Himawari-8 satellite, data is available from the Advanced Himawari Instrument (AHI). AHI is a close proxy of the GOES-R Advanced Baseline Imager (ABI). In time, all of the AWG Level 2 algorithms will be modified to run on AHI data. The process to update the AWG algorithms for use with AHI data involves multiple groups of people and a step-by-step process before an updated algorithm is baselined in the AIT processing system. The figure to the right describes this process. Figure 1. Description of the process taken to update the AWG retrieval algorithms to use Himawari/AHI data. Major steps and sub-tasks are shown. Winds AHI Derived Motion Winds Project AHI Winds Product System Operational Design Cloud and DMW Algorithm Inputs Table 2. The following table lists the inputs for the three Cloud algorithms (that are run prior to running the DMW algorithm) and the DMW algorithm itself. The first algorithm to be updated for use with Himawari/AHI data is the Derived Motion Winds (DMW) algorithm as part of the ‘AHI Derived Motion Winds Project.’ The development of an AHI Product Processing System will help continue algorithm continuity of operations for the MTSAT satellite (which is approaching end-of-life in 2015) and bridge the gap from S-NPP to the first JPSS satellite (J1) launched in 2017. The AHI Winds Project will exploit the Himawari-8/9 AHI data with an advanced geophysical algorithm while processing on high resolution AHI data. The project is a demonstration of NOAA’s goal of ‘Enterprise Solutions,’ namely using similar algorithms for geostationary and polar orbiting satellites. The project will also provide an operational test of the GOES-R DMW algorithm before GOES-R launch. The DMW algorithm source code is being updated for use with AHI data by the AWG DMW science team. The Cloud Mask, Cloud Height, and Cloud Phase algorithms are also adapted by their respective science teams for AHI data since these algorithms are needed as inputs to the DMW algorithm. The most current versions of the DMW and cloud algorithms are being used in the Winds project. For the cloud algorithms, these versions are those that have been adapted to read and process on either NPP VIIRS and Himawari/AHI data. The DMW algorithm used in the Winds project will likely be quite similar to the GOES-R ABI version of the algorithm. The AHI Product Processing System is being developed by various partners: Scientific algorithm development for the Cloud and Wind algorithms is performed by the Algorithm Working Group (AWG) science teams at NOAA/NESDIS/STAR. The software processing system is developed by the Algorithm Integration Team (AIT) at NOAA/NESDIS/STAR. The processing system is being developed as an operational demonstration (pre-operational) running in near real-time as data is obtained from the Japan Meteorological Agency (JMA). Algorithm software is written in Fortran 90 that conforms to strict coding standards. Upon completion, the system will be transitioned to NOAA/OPSO for further development and testing. Operational processing of the system will occur at NOAA/ESPC. Operational Winds (at 6 visible to IR wavelengths), Cloud (Cloud Mask, Cloud Top Phase, Cloud Type, Cloud Top Temperature, Cloud Top Pressure, Cloud Top Height), Cloud and Moisture Imagery (at 16 visible to IR wavelengths), and Radiance (at 16 visible IR wavelengths) data products will be sent to the National Weather Service (NWS). Data products will be available at the NOAA Distribution Environment (DDS). Unit/Sub-Unit Cloud Mask Cloud Phase/Type Cloud Height AHI Winds AHI L1B  NWP – GFS OISST Snow Mask Land Mask Desert Mask Coast Mask Surface Type Surface Elevation Surface Emissivity Pseudo Emissivity Surface Albedo CRTM AHI Cloud Mask AHI Cloud Phase/Type AHI Cloud Top Height, CTP & CTT Expected Error Coefficient File Clear Sky Coefficient File Future Work Table 1. Current status of Winds project. Key required elements are listed and an indication if these elements have been completed. Complete integration and testing of AHI data reader and CRTM outputs. Obtain AHI versions of the Cloud Mask, Cloud Phase, Cloud Height, and DMW algorithm code from AWG science teams and integrate/test these codes in the AWG Framework system. Generate AHI Product System outputs in a near-real time operational demonstration. Prepare the Algorithm Package (DAP) for the AHI Product System and deliver to NOAA/OSPO. Obtain AHI versions of the remaining Level 2 processing algorithms from AWG science teams and integrate these in the AWG Framework system. Perform routine regression testing and near-real time processing for AHI versions of the Level 2 algorithms. Wind Project Element Received from AWG team? Integrated into AIT Framework? Tested? Updates, if necessary, based on testing? AHI data reader code* Yes No N/A AHI-specific coefficients for CRTM Cloud Mask Algorithm code Cloud Mask Algorithm Look-Up Tables Cloud Phase Algorithm code Cloud Phase Algorithm Look-Up Tables Cloud Height Algorithm code Cloud Height Algorithm Look-Up Tables Winds Algorithm code Winds Algorithm Look-Up Tables Figure 2. System-level diagram of the AHI Winds Product System. References AHI Winds Data Users 1 GOES-R Algorithm Theoretical Basis Documents (http://www.star.nesdis.noaa.gov/goesr/docs_reports_ATBD.php) AHI Radiances wills be used by the NWS for data assimilation and Imagery product creation. DMW will be used by the NWS field offices. The DOD will use the AHI radiances in model forecasts. Acknowledgments Thanks to William Straka (Univ. Wisc./CIMMS) for software used in the AWG Framework for AHI data navigation calculations. Thanks to the JMA for sample source codes to read the Himawari standard data. * AHI data reader code: code from JMA to read AHI L1b files (radiances, BTs); ‘geos_transform.c’ from William Straka (CIMMS) for latitude/longitude calculations; AIT updates to code to make AHI data compatible with Framework data structures.