Integrating Changes to JPSS Cross-Track Infrared Sounder (CrIS) SDR Algorithm using the Algorithm Development Library (ADL) Vipuli Dharmawardane 1, Bigyani.

Slides:



Advertisements
Similar presentations
Figure 2 – ADL Concept of Usage Kerry Grant, JPSS CGS Chief Scientist Raytheon Intelligence and Information Systems, Aurora CO Gary Metz, IDPS ING/PRO.
Advertisements

Sentinel-4 and -5 Status and Level-2 Products
NASA DRL Support for S-NPP Direct Broadcast Users
Community Satellite Processing Package NOAA Satellite Conference, 8-12 April 2013 Liam Gumley CIMSS/SSEC, UW-Madison Hurricane Sandy 2012/10/28 06:25 UTC.
Characterization of ATMS Bias Using GPSRO Observations Lin Lin 1,2, Fuzhong Weng 2 and Xiaolei Zou 3 1 Earth Resources Technology, Inc.
Likun Wang 1, Yong Han 2, Xin Jin 3, Yong Chen 1, Xiaozhen Xiao 3 and Denis Tremblay 4 1. UMD/ESSIC/CICS, College Park, MD
NGAS CrIS SDR Cal/Val Activity and Highlights Oct 23, 2012 Lihong Wang, Chunming Wang, Denise Hagan and Degui Gu.
Chapter 6: An Introduction to System Software and Virtual Machines
Suomi National Polar-orbiting Partnership (SNPP) Data Access NOAA Satellite Conference April 8-12, 2013 Kevin Berberich NESDIS/OSD NDE Project Photographs.
How does Inter-calibration support Crosstrack Infrared Sounder (CrIS) post-launch calibration? Likun Wang Ph.D., Research Scientist ESSIC NOAA/NESDIS/STAR.
1 Validated Stage 1 Science Maturity Review for {JPSS Algorithm} Presented by Date.
Kerry Grant, Wael Ibrahim, Paula Smit, JPSS CGS Raytheon Intelligence, Information, and Services, Aurora, CO Kurt Brueske, JPSS CGS Raytheon Intelligence,
JPSS CGS IDPS Product Generation
Testing. Definition From the dictionary- the means by which the presence, quality, or genuineness of anything is determined; a means of trial. For software.
CrIS Full Spectral Resolution Test Results 1 Mark Esplin 1, L. Larrabee Strow 2, Gail Bingham 1, Deron Scott 1, and Chad Fish 1 1 Space Dynamics Laboratory.
Inter-Comparison of Suomi NPP CrIS with AIRS and IASI toward Infrared Hyperspectral Benchmark Radiance Measurements Likun Wang1*, Yong Han2, Yong Chen1,
1 12 Systems Analysis and Design in a Changing World, 2 nd Edition, Satzinger, Jackson, & Burd Chapter 12 Designing Systems Interfaces, Controls, and Security.
1 Next Generation of Operational Earth Observations From the National Polar-Orbiting Operational Environmental Satellite System (NPOESS): Program Overview.
AIRS: Grating spectrometer; IASI and CrIS: Interferometer Likun Wang 1, Yong Han 2, Fuzhong Weng 2, Mitch Goldberg 3 1. UMD/ESSIC/CICS, College Park, MD.
Yimin Ji - Page 1 October 5, 2010 Global Precipitation Measurement (GPM) mission Precipitation Processing System (PPS) Yimin Ji NASA/GSFC,
Interface Data Processing Segment ArchitectureFigure David Smith, JPSS CGS Chief Architect Kerry Grant, JPSS CGS Chief Engineer Raytheon Intelligence.
COST 723 Training School - Cargese October 2005 OBS 3 Radiative transfer for thermal radiation. Instruments Bruno Carli.
University of Wisconsin - Madison Space Science and Engineering Center (SSEC) High Spectral Resolution IR Observing & Instruments Hank Revercomb (Part.
Suomi NPP CrIS SDR Task Overview Yong Han, CrIS SDR Team Lead Suomi NPP SDR Product Review NOAA Center for Weather and Climate Prediction (NCWCP) 5830.
Diane E. Wickland NPP Program Scientist NPP Science: HQ Perspective on VIIRS May 18, 2011.
The Joint Polar Satellite System (JPSS) is the next generation polar-orbiting operational environmental satellite system. The first satellite in the JPSS.
January 7, 2015 Walter Wolf, Jaime Daniels, and Lihang Zhou NOAA/NESDIS, Center for Satellite Applications and Research (STAR) Shanna Sampson, Tom King,
Framework Details  All products may be run from one program  Coordination of input data:  Model Forecast data  Emissivity Data  Instrument Data 
SDR Algorithms, ITSC-12, Lorne, Australia, 27 Feb. - 5 Mar ITT INDUSTRIES - AER - ABB BOMEM - BALL - BOEING CrIS NPOESS CrIS Raw Data (Level 0) to.
All rights reserved © Altec ExoMars 2018 Rover Operations Control Centre Science instruments data pipeline G. Martucci.
UW status/report: 1. Impact of new FIR filter 2. IDPS/ADL comparisons CrIS SDR Cal/Val Telecon 25-Apr-2012.
Robert Wolfe NASA Goddard Space Flight Center Code 614.5, Greenbelt, MD Robert Wolfe NASA Goddard Space Flight Center Code 614.5,
VIIRS Product Evaluation at the Ocean PEATE Frederick S. Patt Gene C. Feldman IGARSS 2010 July 27, 2010.
COS PIPELINE CDR Jim Rose July 23, 2001OPUS Science Data Processing Space Telescope Science Institute 1 of 12 Science Data Processing
CrIS SDR Provisional Readiness Review Lawrence Suwinski Joe Predina Laura Jairam This document is not subject to the controls of the International.
 Programming - the process of creating computer programs.
Xin Jin 1, Yong Han 2, Ninghai Sun 1, Fuzhong Weng 2, Denis Tremblay 3, Yong Chen 4, Likun Wang 4, Xiaozhen Xiong 1 1 ERT, Inc., 2 NOAA/NESDIS/STAR, 3.
Analysis of Nonlinearity Correction for CrIS SDR April 25, 2012 Chunming Wang NGAS Comparisons Between V32 and V33 Engineering Packets.
Suomi NPP CrIS SDR Provisional Product Highlight Yong Han, CrIS SDR Team Lead Suomi NPP SDR Product Review NOAA Center for Weather and Climate Prediction.
Page 1 Land PEATE support for CERES processing Ed Masuoka Gang Ye August 26, 2008 CERES Delta Design Review.
 Establishing state-of-the-art coding, documentation, configuration management standards for the AWG.  Software development process comparable with CMMI.
Xin Jin 1, Yong Han 2, Denis Tremblay 3, Likun Wang 4 1 I. M. System Groups, Inc., 2 NOAA/NESDIS/STAR, 3 Science Data Processing, Inc., 4 UMCP Contact:
Unit 17: SDLC. Systems Development Life Cycle Five Major Phases Plus Documentation throughout Plus Evaluation…
Joint Polar Satellite System (JPSS) Common Ground System (CGS) Rapid Algorithm Updates Kerry Grant, JPSS CGS Chief Engineer Raytheon Intelligence and Information.
Evolution of the JPSS Ground Project Calibration and Validation System Patrick Purcell, Gyanesh Chander and Peyush Jain JPSS Ground Project NASA, GSFC.
GOES-12 (Channel Radiometer) Channels are typically independent of each other Need to know each channel’s – Spectral response function – Noise characteristics.
Page 1 Rapid Algorithm Integration in the Joint Polar Satellite System (JPSS) Common Ground System (CGS) Kerry Grant, Raytheon JPSS CGS Chief Scientist,
NGAS ATMS Cal/Val Activities and Findings Degui Gu, Alex Foo and Chunming Wang Jan 13, 2012.
SDL CrIS Provisional SDR Status Review October 23, 2012 Mark Esplin, Vladimir Zavyalov, Mark Greenman, Ben Esplin, Deron Scott, Kevin Grant, Brandon Graham,
Zou Ziming 1 Ma Wenzhen Li Lei Zhao Hua Wang Chi 1: Center for Space Science and Applied Research Chinese Academy of Sciences Moscow ·
Review of the 2012 Suomi NPP Applications Workshop: Outcomes, Results, Progress Forrest Melton November 18, 2014 Suomi NPP Applications.
Mathew M. Gunshor* 1, Scott Lindstrom 2, Timothy J. Schmit 3, David C. Tobin 1, W. Paul Menzel 1 1 Cooperative Institute for Meteorological Satellite Studies.
Inter-Sensor Comparison for Soumi NPP CrIS Likun Wang 1, Yong Han 2*, Denis Tremblay 3, Fuzhong Weng 2, and Mitch Goldberg 4 1. CICS/ESSIC/University of.
Denis Tremblay 1, Yong Han 2, Yong Chen 3, Likun Wang 3, Xin Jin 2, Xiaozhen Xiong 2, Lihang Zhou 2 1 Science Data Processing Inc., 2 NOAA/NESDIS/STAR,
Inter-Sensor Comparison for Soumi NPP CrIS Likun Wang 1, Yong Han 2*, Denis Tremblay 3, Fuzhong Weng 2, and Mitch Goldberg 4 1. CICS/ESSIC/University of.
Fast and Accurate Collocation of CrIS and VIIRS
Participating SDR Team Members Cross-track Infrared Sounder
Pre-launch Characteristics and Calibration
NOAA VIIRS Team GIRO Implementation Updates
Chapter 11 Designing Inputs, Outputs, and Controls.
GOES-R AIT: Updating the Data Processing System with data from the Himawari-8 Geostationary Satellite Jonathan Wrotny1, A. Li1, A. Ken1, H. Xie1, M. Fan1,
UNIT-4 BLACKBOX AND WHITEBOX TESTING
NOAA-20 and Suomi NPP ATMS On-orbit Performance
15 November 2018 Best Practice for Hyperspectral IR Sounder SDR Ground Processing - Lessons learned from CrIS Likun Wang & Hank Revercomb University.
Inter-Sensor Comparison for Soumi NPP CrIS
Hui Xu, Yong Chen, and Likun Wang
S-NPP Visible Infrared Imaging Radiometer Suite (VIIRS) Lunar Calibration using GSICS Implementation of the ROLO model (GIRO) for Reflective Solar Bands.
Early calibration results of FY-4A/GIIRS during in-orbit testing
FY-3D/HIRAS On-orbit performance and validation
UNIT-4 BLACKBOX AND WHITEBOX TESTING
Presentation transcript:

Integrating Changes to JPSS Cross-Track Infrared Sounder (CrIS) SDR Algorithm using the Algorithm Development Library (ADL) Vipuli Dharmawardane 1, Bigyani Das 1, Valerie Mikles 1, Walter Wolf 2 1 I. M. Systems Group, 2 NOAA/NESDIS/STAR Abstract The Cross-Track Infrared Sounder (CrIS) is a Fourier transform spectrometer on board Suomi National Polar-Orbiting Operational Environmental Satellite System Preparatory Project satellite (S-NPP). CrIS provides measurements of Earth view interferograms with 1305 spectral channels in three infrared spectral bands at 30 cross-track positions, each with a 3 x 3 array of field of views. Joint Polar Satellite System 1 (J1) is the second generation spacecraft within NOAA’s next generation polar-orbiting satellites that is planned to be launched in Having a similar instrument suite to S-NPP, J1 will utilize algorithms developed for S-NPP. The Interface Data Processing Segment (IDPS) has produced calibrated and geolocated truncated resolution spectra in the form of Sensor Data Records (SDR) in the S-NPP era, and currently revisions to the CrIS SDR algorithm are underway to support production of the full resolution J-1 SDRs within the IDPS. ADL is the test system that mimics IDPS and is used for testing, troubleshooting and integrating algorithm updates. In this poster we discuss the process that we use for testing the pre-operational full spectral resolution algorithm for product accuracy in the ADL environment before it is submitted to the ground project Data Products Engineering Services (DPES) for the unit testing. The testing, integration and the change request package preparation steps will be presented. CrIS Overview ADL is developed by Raytheon ADL environment is used to develop and debug the algorithm code items on computing platforms outside of IDPS ADL framework mimics the IDPS processing system and when an algorithm code item is linked to the ADL framework it executes as if it were inside the IDPS When same inputs are given the algorithm code in the ADL environment produces a result equivalent (except for differences due to round off errors, different compilers etc.) to a result produced by the code running in the IDPS environment ADL Framework IO Software development File System and testing Based IDPS Operational Framework IO Integrated Relational Algorithm DB Based Algorithm DB Based Input → Algorithm Processing software → Output CrIS SDR Algorithm ADL and IDPS Framework References Full Resolution/Normal Resolution RDRs Common Inputs Resolution dependent Inputs Binary Outputs Resolution Dependent executable HDF5 outputs Resolution dependent outputs Data Flow for CrIS Algorithm Testing the Algorithm and Discussion of Results J1 software changes STAR AIT Role in the Algorithm Change Procedure JPSS-1 (J1) is the second spacecraft within NOAA’s next generation polar-orbiting satellites, succeeding S-NPP. CrIS has used nominal resolution data packets during the S-NPP era and currently revisions to the CrIS sensor data records (SDR) algorithm are underway to support production of the full resolution J1 SDRs. The S-NPP instrument has already transitioned from normal spectral resolution mode to the full spectral resolution mode and continue to produce normal resolution SDRs by truncating the Mid-Wave and Short –Wave band data into normal resolution interferograms. The J1 code is developed and designed to produce both normal and full resolution SDRs concurrently if required. Under the Input (“I”) - Processing(“P”) - Output(“O”) model of ADL and IDPS, the I/O data structures, including the array sizes, are specified with XML files. This design feature is employed to produce two different executables using the same source code but different XML files, that produce normal and full resolution SDRs. Summary of the different input RDRs that can be processed, and the corresponding output files produced by the two J1 executables, is given in the block diagram below. Pre-operational full spectral resolution algorithm is tested by the STAR Algorithm Integration Team (AIT) for product accuracy in the ADL environment before it is submitted to the ground project Data Products Engineering Services (DPES) for the unit testing. Additionally STAR AIT group works with Algorithm team, DPES, and Raytheon on algorithm implementation into ADL and leads reviews to ensure project meets requirements and remain on schedule. NOAA Satellite Conference: Preparing for the Future of Environmental Satellites: April 27-May 1, 2015, Greenbelt, MD Corresponding Author: Main objectives of the SDR algorithm Pre-process incoming data packets  Load and sort data  Convert interferograms to spectra Convert scene measurements into calibrated spectra Evaluate the associated error CrIS SDR processing flow Normal Resolution Executable Full Resolution Executable Normal Resolution RDR Full Resolution RDR Full Resolution SDR Normal Resolution SDR Calibration Updates for J1 Following calibration algorithm modules were updated  Interferogram to raw spectra conversion  Self-apodization correction  Spectral resampling  Post-calibration filter  Radiometric calibration  NEdN calculation New algorithm was tested in the ADL framework In addition to performing a functional test output files are examined to verify results Typically results are compared against outputs produced using a version of the software compiled using the original code (baseline) Results are compared to determine if the changes are as expected Different calibration orders and coefficients are used for the two resolutions via a resolution dependent input Processing Coefficient Table (PCT) Geo- location Pre-Process IGM to Spectrum FFT FCE Handling Spectral Resample Post Calibration BPF Radiometric Calibration Nonlinearity Correction ILS Correction Science RDR SDR Spectral Calibration BandIFGM number of bins User Grid Range (cm -1 ) Spectral Resolution (cm -1 ) Maximum Optical Path Difference (cm) Number of SDR Channels LWIR866 (866) (0.625)0.8 (0.8)713 (713) MWIR530 (1052) (0.625)0.4 (0.8)433 (865) SW202 (799) (0.625)0.2 (0.8)159 (633) A typical cross-track scan sequence consists of 34 interferometer sweeps or Field of Regards (FOR), including 30 Earth Scenes (ES), 2 Deep Space (DS) and 2 Internal Calibration Target (ICT) measurements. Sweeps are performed in both forward and reverse directions. CrIS collects interferograms from 9 field of views (FOV) in a 3x3 array configuration at each position on field of regard. One scan of the CrIS will take about 8 seconds. CrIS Measurement Sequence CrIS is a Michelson interferometer. It provides measurements of earth view interferograms with 1305 spectral channels in three infrared spectral bands. CrIS S-NPP (J1) Spectral Characteristics A typical Interferometer measurement for the Long Wave band slew1234… slew31 slew …. FOR index…. 8-second scan DS ICT next scan F R F R F R R F R F Figure above is a comparison of radiance for normal resolution and full resolution spectra for long-wave band produced using the new J1 software and the baseline code Calibration software was improved for full resolution processing Different calibration orders and coefficients are used for the two resolutions via a resolution dependent input Processing Coefficient Table (PCT) Comparison of full resolution and baseline (normal) resolution results for all 9 FOVs for FOR =1 for the mid wave band 1.Joint polar satellite system (JPSS) common ground system (CGS) IDPS ADL Software users manual, Raytheon Company 2.Joint Polar Sattelite System (JPSS) Cross Track Infraread Sounder (CrIS) Sensor Data Records (SDR) Algorithm Theoretical Basis Document (ATBD) NOAA/STAR CrIS SDR Team 3.Yong Han et al, Suomi NPP CrIS measuremets, sensor data record algorithm, calibration and validation activities and record data quality, Journal of geophysical research: Atmospheres, Vol 118, 12, , 748 Full Resolution Baseline