1. OMI ST meeting 11 20-22 June 2006 Calibration & 0-1b data processing Marcel Dobber (KNMI)

2. OMI ST Meeting 11, 20-22 June 2006Slide 2 Marcel Dobber, KNMI Contents Radiometric + irradiance. Status CCD detectors GDPS status. OPF status Processing in ps0002. Reprocessing end 2006. TMCF + PGE status. Future plans. Conclusions.

3. OMI ST Meeting 11, 20-22 June 2006Slide 3 Marcel Dobber, KNMI Calibration team Robert Voors (KNM) Quintus Kleipool (KNMI) Marcel Dobber (KNMI) Glen Jaross (SSAI / NASA) Ruud Dirksen (KNMI / SRON), will leave calibration team per 1 July 2006 to work on NO 2 with Henk Eskes Werner Dierssen (KNMI / TriopSys), left per 1 May 2006 Johan de Vries (DS), left per 1 January 2006

4. OMI ST Meeting 11, 20-22 June 2006Slide 4 Marcel Dobber, KNMI Irradiance Old situation, OPF 7, ps0001. 31 DEC 2004

5. OMI ST Meeting 11, 20-22 June 2006Slide 5 Marcel Dobber, KNMI Irradiance Old situation, OPF 8-20, ps0002. These radiometric keydata were still exclusively based on on- ground measurements. 31 DEC 2004

6. OMI ST Meeting 11, 20-22 June 2006Slide 6 Marcel Dobber, KNMI Irradiance Current situation, OPF 21-31, ps0002. In these radiometric keydata corrections obtained from in-flight comparisons have been used.

7. OMI ST Meeting 11, 20-22 June 2006Slide 7 Marcel Dobber, KNMI Status CCD detectors: Pixels with permanently increased dark current as function of time 6 February 2006 (571 days after launch)  UV: 17.0% of all unbinned pixels (image area)  VIS: 17.6% of all unbinned pixels (image area)

8. OMI ST Meeting 11, 20-22 June 2006Slide 8 Marcel Dobber, KNMI GDPS status (1) v0.9.12 (26 August 2005), not used in ps0002:  Same version as 0.9.13, but with a bug: the flagged transient pixels were not excluded in the calculation of the irradiance average. v0.9.13 (31 August 2005):  Added possibility for fill values OPF.  New DEM saturation flagging algorithm.  New transient pixel flagging algorithm replaces old one.  Fixed bug in calculation global products from spatial zoom-in products.

9. OMI ST Meeting 11, 20-22 June 2006Slide 9 Marcel Dobber, KNMI GDPS status (2) v0.9.14 (1 March 2006):  New algorithm for irradiance goniometry (dIRRAD) replaces the old one. See TN-OMIE-KNMI-754, issue 3, 1 February 2006. Wavelength dependence is now also dependent on azimuth and elevation angles and row. Maximum 2 nd order polynomial for wavelength dependence. Row dependence not fitted, but stored per row in OPF. Wavelength dependence not per subchannel.  Possibility to bypass the dIRRAD algorithm in the algorithm bypass list.  Intended LUT change (LED linearity measurements). v0.9.15 (3 March 2006), not used in ps0002. See also v0.9.14:  LUT change (LED linearity measurements) was not updated. v0.9.14 was never used, but immediately replaced by v0.9.15.

10. OMI ST Meeting 11, 20-22 June 2006Slide 10 Marcel Dobber, KNMI GDPS status (3) v0.9.16 (7 June 2006, TBC):  New algorithm for USA / LSA stray light correction replaces the old one. See TN-OMIE-KNMI-792, issue 2, 30 March 2006. See TN-OMIE-KNMI-814, issue 1, 30 May 2006. Predefined shapes as function of column in OPF for LSA and USA for earth, sun, WLS. Row dependence with linear interpolation between LSA and USA.  New algorithm for spectral stray light correction replaces old one. See TN-OMIE-KNMI-802, issue 1, 27 March 2006. Row dependence with preset (OPF) windows for stray light source and target regions.

11. OMI ST Meeting 11, 20-22 June 2006Slide 11 Marcel Dobber, KNMI Changes to OPF’s OPF sets:  OPFs 21-30 (GDPS 0.9.13) OPF Entries Changes: New entries for new transient pixel flagging algorithm. New entries for DEM saturation flagging algorithm. Added spectral slit function parameterisation data. Changed OPF cross-sections used for spectral calibration. Changed (slightly) spectral calibration parameters. Changed radiometric keydata without changing BSDF. Changed fallback dark images. Changed BDPM. Changed electronic non-linearity parameters. Changed threshold indicator non-linearity Changed dark current temperature correction parameters.

12. OMI ST Meeting 11, 20-22 June 2006Slide 12 Marcel Dobber, KNMI Changes to OPF’s  OPF 31 (GDPS 0.9.15) New entries for new irradiance goniometry algorithm (see TN- OMIE-KNMI-818, issue 1, 18 April 2006).  OPF ?? (GDPS 0.9.16) New entries for LSA / USA stray light algorithm. New entries for spectral stray light algorithm. Updated radiometric calibration keydata.  Central row BSDF may also be changed (TBD) Updated swath angle dependent radiometric keydata  BSDF swath angle dependence will not be changed New dark image data. Possibly new BDPM (RTS, see TN-OMIE-KNMI-791, issue 1, 30 January 2006). Possibly new non-linearity.

13. OMI ST Meeting 11, 20-22 June 2006Slide 13 Marcel Dobber, KNMI Reprocessing in ps0002

14. OMI ST Meeting 11, 20-22 June 2006Slide 14 Marcel Dobber, KNMI Reprocessing end 2006 Required for reprocessing end 2006, as far as calibration is concerned (i.e. list may not be complete!):  GDPS 0.9.16, delivered 19-23 June 2006.  OPF for GDPS 0.9.16 (see one of previous slides).  TDOPF software + system.  TDOPF software + system tuned and optimised for reprocessing.  Integrated TMCF PGE’s (see next slide). Stray light parameters will be optimised as good as possible, but further changes in the future can not be excluded. Time-dependent functions will be set constant in TDOPF, except for:  Background images.  BDPM (which includes RTS).

15. OMI ST Meeting 11, 20-22 June 2006Slide 15 Marcel Dobber, KNMI TMCF and TMCF PGE’s TMCF and ODPS very stable:  upgrade operating system.  new storage facility. Open work list on TMCF completed. TMCF PGE’s:  Splitter for Instrument Configueration ID’s.  Averager for Instrument Configuration ID’s.  Automated Analysis PGE (basic analyses).  Dark signal median calculation (this one will be used for the reprocessing of end 2006).  Irradiance azimuth and elevation angle dependence.

16. OMI ST Meeting 11, 20-22 June 2006Slide 16 Marcel Dobber, KNMI TMCF and TMCF PGE’s TMCF PGE’s (continued):  Dark current as function of orbit phase.  Dark current.  RTS.  BDPM.  Spectral calibration (using correlation method).  False-RGB image calculation.  False-RGB image visualisation.  Quality Flag summary.  Visualisation (produces some 500 plots). Colours: PGE integrated in TMCF and running PGE integrated in TMCF and running, but a new version is ready for integration. PGE ready and waiting for integration in TMCF.

17. OMI ST Meeting 11, 20-22 June 2006Slide 17 Marcel Dobber, KNMI Background images used in reprocessing The OPF background images will be updated with a frequency of once per day using a median calculation algorithm. Once per day is a compromise between:  Large vs smaller data amounts for TDOPF system.  Number of background images available to reduce measurement noise sufficiently. Per earth ICID 5+5 images per orbit, provided no passage through SAA, for sun measurements 77 images per orbit. Per earth ICID (5+5)*14=140 images per day (minus SAA), for sun measurements 77 images per day.  Once per week is not sufficient, given the rate at which the CCD is hit by high-energetic protons. Median to exclude pixels with large deviations.

18. OMI ST Meeting 11, 20-22 June 2006Slide 18 Marcel Dobber, KNMI Plan for OPF for GDPS 0.9.16 Optimise LSA / USA and spectral stray light parameters. Adapt radiometric calibration parameters. GDPS 0.9.16 + OPF in ps9999 (8 weeks Sept-Oct. 2006):  L1 and L2 to provide feedback. After this GDPS 0.9.16 + OPF are ready for reprocessing.

19. OMI ST Meeting 11, 20-22 June 2006Slide 19 Marcel Dobber, KNMI Future plans Stripes in L1 and L2 data after reprocessing: situation will be considerably better. Continue to monitor potential optical degradation behaviour using WLS and solar spectra. Continue to monitor CCD detector degradation behaviour. Further optimise convoluted high-resolution solar reference spectrum w.r.t. measured solar irradiance. Continue validation Earth reflectances (including swath angle dependence), BSDF structures, BSDF interchannel jumps (especially after stray light changes).

20. OMI ST Meeting 11, 20-22 June 2006Slide 20 Marcel Dobber, KNMI Conclusions OMI performance and calibration are in good shape.  Calibration data gap March-May 2006 due to FMM anomaly investigation.  Stray light parameters must be optimised, plans for this are in place. Working towards reprocessing end 2006:  GDPS 0.9.16 + OPF.  TDOPF, including dynamic background correction and dynamic RTS identification (which will flow into BDPM).  TMCF + PGE’s.

21. OMI ST Meeting 11, 20-22 June 2006Slide 21 Marcel Dobber, KNMI Recent documents See CTB website, calibration (https://omiwww.gsfc.nasa.gov/ctbweb/OMICTB_Configuration_Tracking_ Board.md).https://omiwww.gsfc.nasa.gov/ctbweb/OMICTB_Configuration_Tracking_ Board.md Ozone Monitoring Instrument Calibration, IEEE Transactions on Geoscience and Remote Sensing, vol. 44, no. 5, May 2006, 1209-1238. Prelaunch characterization of the Ozone Monitoring Instrument transfer function in the spectral domain, Applied Optics, vol. 45, no. 17, 10 June 2006, 3972-3981. Method of calibration to correct for cloud-induced wavelength shifts in the Aura satellite’s Ozone Monitoring Instrument, Applied Optics, vol. 45, no. 15, 20 May 2006, 3652-3658.

22. OMI ST Meeting 11, 20-22 June 2006Slide 22 Marcel Dobber, KNMI

23. OMI ST Meeting 11, 20-22 June 2006Slide 23 Marcel Dobber, KNMI UV part