Near-Real-Time HIRDLS Processing for START08 Vince Dean HIRDLS Science Team Meeting January 30, 2008 Boulder, CO.

Slides:

Advertisements

Similar presentations

1 NASA CEOP Status & Demo CEOS WGISS-25 Sanya, China February 27, 2008 Yonsook Enloe.

Advertisements

1 MODAPS - Land Processing Status Robert Wolfe and Ed Masuoka Code 619, NASA GSFC Sadashiva Devadiga Sigma Space MODIS Science Team Meeting April 15-17,

Status of MODIS Production (C4/C5 Testing) Mike Teague 1/5/06.

G. Alonso, D. Kossmann Systems Group

16 October th International Workshop on Laser Ranging 1 Implementing the Consolidated laser Ranging Data (CRD) Format throughout the ILRS Network.

All rights reserved © Altec ExoMars 2018 Rover Operations Control Centre Decision making process, Communications and Planning.

Navigation and Ancillary Information Facility NIF Non-Toolkit Applications April 2012.

World Renewable Energy Forum May 15-17, 2012 Dr. James Hall.

STEREO Science Center SWG – Dec 2004 William Thompson NASA Goddard SFC Code Greenbelt, MD

STEREO Science Center SWG – May 2005 William Thompson NASA Goddard SFC Code Greenbelt, MD

Obtaining MISR Data and Information Jeff Walter Atmospheric Science Data Center April 17, 2009.

M. Taimoor Khan * Java Server Pages (JSP) is a server-side programming technology that enables the creation of dynamic,

NASA/ESA Interoperability Efforts CEOS Subgroup - CINTEX Alexandria, Sept 12, 2002 Ananth Rao Yonsook Enloe SGT, Inc.

AERONET Web Data Access and Relational Database David Giles Science Systems and Applications, Inc. NASA Goddard Space Flight Center.

Erich Franz Stocker * and Yimin Ji + * NASA Goddard Space Flight Center, + Wyle Inc/PPS The Global Precipitation Measurement (GPM) Mission: GPM Near-realtime.

Important ESDIS 2009 tasks review Kent Yang, Mike Folk The HDF Group April 1st, /1/20151Annual briefing to ESDIS.

At A Glance VOLT is a freeware, platform independent tool set that coordinates cross-mission observation planning and scheduling among one or more space.

TEMPLATE DESIGN © Assessing the Potential of the AIRS Retrieved Surface Temperature for 6-Hour Average Temperature Forecast.

The Utilization of the Graphic Forecast Generator (GFE) to Locally Apply CPC’s Week Two Forecast.

Jasmine S. Nahorniak Mark R. Abbott Ricardo M. Letelier Curt Vandetta Bridges to the Community NASA grant NNG05GA73G International EOS/NPP Direct Broadcast.

Z. P. Szewczyk GIST 25, Oct Recent Field Campaigns with CERES Instruments Z. Peter Szewczyk Kory J. Priestley Lou Smith Remote Sensing of Clouds.

Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.

PDS Geosciences Node Page 1 Archiving Mars Mission Data Sets with the Planetary Data System Report to MEPAG Edward A. Guinness Dept. of Earth and Planetary.

STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG April 2008 Meudon, France.

EagleSat Flight Operations

Update on NASA’s Sensor Web Experiments Using Simulated Doppler Wind Lidar Data S. Wood, D. Emmitt, S. Greco Simpson Weather Associates, Inc. Working Group.

Solar Shield project - lessons learned and advances made Pulkkinen, A., M. Hesse, S. Habib, F. Policelli, B. Damsky, L. Van der Zel, D. Fugate, W. Jacobs,

RECENT ENHANCEMENTS TO THE CDDIS IGS Network Systems Workshop November 2-5, 1998 Annapolis, MD Carey E. Noll Manager, CDDIS NASA GSFC Greenbelt, MD.

2015 GLM Annual Science Team Meeting: Cal/Val Tools Developers Forum 9-11 September, 2015 DATA MANAGEMENT For GLM Cal/Val Activities Helen Conover Information.

Presented to: By: Date: Federal Aviation Administration Basic Information About the XASDI Feed A Telcon with Vendors ASDI Vendors and Users FAA 18 May.

R. Suresh (NASA/MTECH) Ben Burford (JAXA) Bernhard Buckl (DLR) Contact: - CEOS WGISS Meeting, Beijing, China, September 2004 A RSS.

Presented at AMSR Science Team Meeting September 23-24, 2014 AMSR2 NRT Land, Atmosphere Near real-time Capability for EOS (LANCE) Helen Conover Information.

DDM Monitoring David Cameron Pedro Salgado Ricardo Rocha.

AMSR-E SIPS Processing Status Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville

March 2004 At A Glance autoProducts is an automated flight dynamics product generation system. It provides a mission flight operations team with the capability.

AIRS Radiance and Geophysical Products: Methodology and Validation Mitch Goldberg, Larry McMillin NOAA/NESDIS Walter Wolf, Lihang Zhou, Yanni Qu and M.

SPICE Production at ESTEC April SPICE Production at ESTEC 2 Overview SPK/CK production SCLK production FK and IKs production Other Kernels.

Goddard Space Flight Center High Earth Orbit GPS Flight Experiment AMSAT-OSCAR 40 (AO-40) Frank H. Bauer NASA Goddard Space Flight Center November 1, 2001.

STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG March 27-28, 2007.

Central Region Snowfall Analysis Brian P. Walawender NWS Central Region Headquarters Matt W. Davis NWS WFO La Crosse, WI 5/26/2011.

Robert Wolfe NASA Goddard Space Flight Center Code 614.5, Greenbelt, MD Robert Wolfe NASA Goddard Space Flight Center Code 614.5,

Status of the Development of a Tropospheric Ozone Product from OMI Measurements Jack Fishman 1, Jerald R. Ziemke 2,3, Sushil Chandra 2,3, Amy E. Wozniak.

Aquarius Mission Simulation A realistic simulation is essential for mission readiness preparations This requires the ability to produce realistic data,

Aura HDF-EOS File Format Guidelines: Overview and Status Cheryl Craig.

18 th GIST Meeting 14 th –16 th May 2003 Ground Segment (GGSPS) Report 1 GERB Ground Segment B.C.Stewart RAL.

System Maintenance Modifications or corrections made to an information system after it has been released to its customers Changing an information system.

LANCE Processing at the AMSR-E SIPS Presented by Kathryn Regner Information Technology and Systems Center at the University of Alabama in Huntsville Joint.

STEREO Science Center Status Report William Thompson NASA Goddard Space Flight Center STEREO SWG November 2007 Pasadena, California.

MODIS SDST, STTG and SDDT MODIS Science Team Meeting (Land Discipline Breakout Session) July 13, 2004 Robert Wolfe Raytheon NASA GSFC Code 922.

SSC Support for Sim #3 Archived MOC Data Products, and distributed via web. –Level-0 telemetry files organized by year and month –SPICE orbit and attitude.

Ozone PEATE 2/20/20161 OMPS LP Release 2 - Status Matt DeLand (for the PEATE team) SSAI 5 December 2013.

1 LANCE-AIRS LANCE-MLS Status Bruce Vollmer Mike Theobald LANCE User Working Group Meeting November.

AIRS/AMSU-A/HSB Data Subsetting and Visualization Services at GES DAAC Sunmi Cho, Jason Li, Donglian Sun, Jianchun Qin and Carrie Phelps, Code 902, NASA.

SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.

The Land, Atmosphere Near-real-time Capability for EOS (LANCE) GES DISC UWG May 10-11, 2011 Karen Michael EOSDIS System Manager

Aura Data System Working Group Meeting Fall 2007 Aura Microwave Limb Sounder David T. Cuddy Jet Propulsion Laboratory California Institute of Technology.

Aura Science Meeting Data Systems Working Group HIRDLS SIPS Status October 1, 2007 Vince Dean, Brendan Torpy, Greg Young Univ. of Colorado, Boulder Cheryl.

PDS4 Project Report PDS MC F2F UCLA Dan Crichton November 28,

The Development of Flight Operations: Improvement of ERAU Cube-Sat’s Ground System Interface and Research of the Satellite’s Orbital Decay Presented by.

Cluster Active Archive Status of DWP Data Activities Simon Walker, Keith Yearby, Michael Balikhin Automatic Control and Systems Engineering, University.

NOAA Near Real-Time AIRS Processing and Distribution System Walter Wolf Mitch Goldberg Lihang Zhou NESDIS/ORA/CRAD.

NASA, CGMS-43, May 2015 Coordination Group for Meteorological Satellites - CGMS Update of the NASA GPM and Precipitation Products and their Availability.

DWL Operations within a Sensor Web Modeling and Data Assimilation System:Recent Results M. Seabloom, S. Talabac, G. McConaughy, J. Ardizzone, G. Brin,

The road to the first E2E tests

Embedded Systems Software Engineering

Zhong Liu George Mason University and NASA GES DISC

Simulink Interface Layer (SIL)

Cluster Active Archive – Wideband data BM2 mode

MODIS SST Processing and Support for GHRSST at OBPG

University of Colorado and NCAR START08/Pre HIPPO Workshop

Presentation transcript:

Near-Real-Time HIRDLS Processing for START08 Vince Dean HIRDLS Science Team Meeting January 30, 2008 Boulder, CO

START08 Timeline Near Real Time Retrievals to support flight planning for START08. Forecast exercises Feb 29, 2008 Mar 21, 2008 Flight Windows – spring 2008 April 21.. May 16 (maybe earlier) June

Observation Times START08 based in Jeffco. Covers Western US. Approximate times of passes of interest Morning 06: :00 GMT 23: :00 MST Evening 20: :00 GMT 13: :00 MST Flight Planning Meetings 14:00 MST

Descending Passes 22: :00 MST

Ascending Passes: 13: :30 MST

START08 – timing requirements 23:30 MST02:00 MST Descending HIRDLS passes over western US START08 Flight planning meeting 14:00 MST 12 hours for data processing, delivery to START08 Field Catalog, and analysis

Plots

Level 0 Science Attitude Ephemeris L1PP L1X GEOS-5 Product: Temperature L1C L2PP L2CLD L2 HIRDLS2 Processing Flow

HIRDLS2 Plotting and Delivery Plotting Code Plot Files (.png) EOL Field Catalog Rename and deliver

Rate- Buffered Science Data Standard Level 0 Science Data L1PP File Conversion at Goddard DISC HIRDLS Science Data

Attitude Ephemeris L1X Rate- Buffered GBAD “Direct Readout” Software at Goddard DISC Aura Attitude/Ephemeris

Geolocation Test L1X Standard vs. sample attitude/ephemeris One 2-hour contact session Differences: MinMaxMeanStd Dev Altitude (m) Latitude (deg) , e-51.2E-4 Longitude (deg) E-53.1E-4

L2CLD Yesterday: 24-hour production job. Today: 20 minute near- real-time job. HIRRAD HIRRADNC L2CLD HIRRAD HIRRADNC Daily Average Radiance

L2 HIRDLS2 GEOS-5 Forecast Forecast Runs: Once or twice daily, up to five days in advance. GEOS-5 Temperature for Line of sight gradient GEOS-5 analysis product D5HIRDL1

Strategy Outsource software development to DISC where possible: Rate-buffered to PDS conversion Attitude/ephemeris file conversion Relatively low risk: Goddard’s plans seem attainable. They seem confident. But “best effort”

Tasks Enhancements to science code L2CLD L2 Software development at Goddard Attitude/ephemeris Rate-buffered to PDS conversion Data management SIPS software enhancements Validation of approximations Test runs needed

Extra Slides

Sources of HIRDLS science data Standard PDS files from Goddard – Typically arrives 3 hours after last date (quite variable!) Expedited PDS files from Goddard – Somewhat faster Rate buffered data from EDOS – Typically arrives ½ hour after last data (quite variable!) New shorter PDS files from Goddard

Level 0 Science Data Sources Aura Ground Station EDOS Goddard DISC HIRDLS SIPS Rate-buffered data. PDS data Expedited PDS data PDS data RBD?

PDS data HIRDLS Science Packets In order No duplicates Normally delivered in regular 2-hour files. Additional latency to fill out complete 2-hour chunk—maybe wait for next pass.

Rate-Buffered Data HIRDLS science packets with additional headers Typically covers one contact session About one orbit (100 min) Size and timing are irregular Packets may be out of order or duplicated We understand file format, and we receive the data, but no production experience.

RBD processing at HIRDLS L1PP (modified) Rate-buffered data Standard HIRDLS Science file (HIR0SCI_FIXED ) We already receive RBD data routinely. L1PP already sorts packets, part of fixing clock problem. Includes library code to read RBD files. Relatively small change to extend for RBD processing. Unknown operational issues—we have not used RBD routinely.

Goddard DISC to process rate-buffered data? Goddard DISC is planning to process rate-buffered data for a quick-delivery PDS product For MLS For HIRDLS? 15 minutes granules instead of 2 hours Same collecting and sorting as done by EDOS. EDO S RBD Goddard DISC 15-minute PDS science granules

Attitude/Ephemeris We require files in Toolkit format Normal delivery takes about 1 day Other sources of forecasts/approximations: Use files from 16 days ago, advancing timestamps Get a forecast from Flight Dynamics and convert file format Use GBAD files and convert file format Use orbsim program to generate forecasts

16-day old attitude & ephemeris Rewrite times in files “Forecast” attitude and ephemeris Small custom program. Not complex. File formats are well documented. Attitude/Ephemeris 16-day cycle

Attitude/Ephemeris Flight Dynamics Forecast Forecasts of attitude/ephemeris from Flight Dynamics ? Forecasts of attitude/ephemeris in Toolkit Format Custom code to convert file formats. Unknown complexity.

Attitude/Ephemeris GBAD to Toolkit Aura GBAD file(s) DirectReadou t code Attitude & Ephemeris in Toolkit format MLS has provided leads to code which performs this conversion from NASA “DirectReadout” project. This code has been used for AIRS and Goddard DISC is installing it.

What is GBAD data? (Ground-Based Attitude Determination) Forecasts of attitude/ephemeris (Flight Dynamics?) Aura Converted to GBAD format and delivered to HIRDLS SIPS, via EDOS and DISC. GBAD files contain forecasts of attitude and ephemeris, delivered to the spacecraft and then back to earth. There is said to be software which will convert those files to toolkit format.

Attitude/Ephemeris Orbsim Attitude/Ephemeris in Toolkit Format Orbsim Testing tool provided with Toolkit. Intended only for software testing, not for production forecasts. Orbital Parameters

GEOS-5 D5HIRDL1 subset GMAO Assimilation Goddard DISC HIRDLS SIPS Files created 4 times daily. Delivered on regular 6-hour intervals? Can they create forecasts as a special product?

Plots (Bill Hall’s IDL) IDL Plot code Rename and deliver to Field Catalog EOL Field Catalog (Web site) Plots HIRDLS2

End to end test (Prototype) Early prototype of processing steps and data products. Explore: Client requirements System and configuration issues Test bed for refinement of processing steps.