1. Near-Real-Time HIRDLS Processing for START08 Vince Dean HIRDLS Science Team Meeting January 30, 2008 Boulder, CO

2. START08 Timeline Near Real Time Retrievals to support flight planning for START08. Forecast exercises Feb 29, 2008 Mar 21, 2008 Flight Windows – spring 2008 April 21.. May 16 (maybe earlier) June 16.. 28

3. Observation Times START08 based in Jeffco. Covers Western US. Approximate times of passes of interest Morning 06:30.. 09:00 GMT 23:30.. 02:00 MST Evening 20:45.. 23:00 GMT 13:45.. 16:00 MST Flight Planning Meetings 14:00 MST

4. Descending Passes 22:00... 02:00 MST

5. Ascending Passes: 13:00... 16:30 MST

6. START08 – timing requirements 23:30 MST02:00 MST Descending HIRDLS passes over western US START08 Flight planning meeting 14:00 MST 12 hours for data processing, delivery to START08 Field Catalog, and analysis

8. Plots

9. Level 0 Science Attitude Ephemeris L1PP L1X GEOS-5 Product: Temperature L1C L2PP L2CLD L2 HIRDLS2 Processing Flow

10. HIRDLS2 Plotting and Delivery Plotting Code Plot Files (.png) EOL Field Catalog Rename and deliver http://catalog.eol.ucar.edu/trex/index.html

11. Rate- Buffered Science Data Standard Level 0 Science Data L1PP File Conversion at Goddard DISC HIRDLS Science Data

12. Attitude Ephemeris L1X Rate- Buffered GBAD “Direct Readout” Software at Goddard DISC Aura Attitude/Ephemeris

13. Geolocation Test L1X 7.4.1 Standard vs. sample attitude/ephemeris One 2-hour contact session Differences: MinMaxMeanStd Dev Altitude (m) 720123 Latitude (deg) -0.0020,001-2.3e-51.2E-4 Longitude (deg) -0.0020.005-5.4E-53.1E-4

14. L2CLD Yesterday: 24-hour production job. Today: 20 minute near- real-time job. HIRRAD HIRRADNC L2CLD HIRRAD HIRRADNC Daily Average Radiance

15. L2 HIRDLS2 GEOS-5 Forecast Forecast Runs: Once or twice daily, up to five days in advance. GEOS-5 Temperature for Line of sight gradient GEOS-5 analysis product D5HIRDL1

16. Strategy Outsource software development to DISC where possible: Rate-buffered to PDS conversion Attitude/ephemeris file conversion Relatively low risk: Goddard’s plans seem attainable. They seem confident. But “best effort”

17. Tasks Enhancements to science code L2CLD L2 Software development at Goddard Attitude/ephemeris Rate-buffered to PDS conversion Data management SIPS software enhancements Validation of approximations Test runs needed

18. Extra Slides

19. Sources of HIRDLS science data Standard PDS files from Goddard – Typically arrives 3 hours after last date (quite variable!) Expedited PDS files from Goddard – Somewhat faster Rate buffered data from EDOS – Typically arrives ½ hour after last data (quite variable!) New shorter PDS files from Goddard

20. Level 0 Science Data Sources Aura Ground Station EDOS Goddard DISC HIRDLS SIPS Rate-buffered data. PDS data Expedited PDS data PDS data RBD?

21. PDS data HIRDLS Science Packets In order No duplicates Normally delivered in regular 2-hour files. Additional latency to fill out complete 2-hour chunk—maybe wait for next pass.

22. Rate-Buffered Data HIRDLS science packets with additional headers Typically covers one contact session About one orbit (100 min) Size and timing are irregular Packets may be out of order or duplicated We understand file format, and we receive the data, but no production experience.

23. RBD processing at HIRDLS L1PP (modified) Rate-buffered data Standard HIRDLS Science file (HIR0SCI_FIXED ) We already receive RBD data routinely. L1PP already sorts packets, part of fixing clock problem. Includes library code to read RBD files. Relatively small change to extend for RBD processing. Unknown operational issues—we have not used RBD routinely.

24. Goddard DISC to process rate-buffered data? Goddard DISC is planning to process rate-buffered data for a quick-delivery PDS product For MLS For HIRDLS? 15 minutes granules instead of 2 hours Same collecting and sorting as done by EDOS. EDO S RBD Goddard DISC 15-minute PDS science granules

25. Attitude/Ephemeris We require files in Toolkit format Normal delivery takes about 1 day Other sources of forecasts/approximations: Use files from 16 days ago, advancing timestamps Get a forecast from Flight Dynamics and convert file format Use GBAD files and convert file format Use orbsim program to generate forecasts

26. 16-day old attitude & ephemeris Rewrite times in files “Forecast” attitude and ephemeris Small custom program. Not complex. File formats are well documented. Attitude/Ephemeris 16-day cycle

27. Attitude/Ephemeris Flight Dynamics Forecast Forecasts of attitude/ephemeris from Flight Dynamics ? Forecasts of attitude/ephemeris in Toolkit Format Custom code to convert file formats. Unknown complexity.

28. Attitude/Ephemeris GBAD to Toolkit Aura GBAD file(s) DirectReadou t code Attitude & Ephemeris in Toolkit format MLS has provided leads to code which performs this conversion from NASA “DirectReadout” project. This code has been used for AIRS and Goddard DISC is installing it.

29. What is GBAD data? (Ground-Based Attitude Determination) Forecasts of attitude/ephemeris (Flight Dynamics?) Aura Converted to GBAD format and delivered to HIRDLS SIPS, via EDOS and DISC. GBAD files contain forecasts of attitude and ephemeris, delivered to the spacecraft and then back to earth. There is said to be software which will convert those files to toolkit format.

30. Attitude/Ephemeris Orbsim Attitude/Ephemeris in Toolkit Format Orbsim Testing tool provided with Toolkit. Intended only for software testing, not for production forecasts. Orbital Parameters

31. GEOS-5 D5HIRDL1 subset GMAO Assimilation Goddard DISC HIRDLS SIPS Files created 4 times daily. Delivered on regular 6-hour intervals? Can they create forecasts as a special product?

32. Plots (Bill Hall’s IDL) IDL Plot code Rename and deliver to Field Catalog EOL Field Catalog (Web site) Plots HIRDLS2

33. End to end test (Prototype) Early prototype of processing steps and data products. Explore: Client requirements System and configuration issues Test bed for refinement of processing steps.