Data Release Requirements, decisions and plans. What we need New machine Implement (and test) all proposed changes from current Provide data quality summary,

Slides:



Advertisements
Similar presentations
Understanding Fossil Butte
Advertisements

GERB-2 GEO 22/11/05 J. Hanafin Using IDL coastline information as independent check on L15 and L2 Geolocations Only SW and SWF day time radiances used.
GERB SW fluxes: an update (Clear ocean SW radiances and fluxes in the reprocessed V999 June 04 data) Cédric Bertrand GIST th December, Imperial.
Performing an educational supervisor report. Step by Step guide By Dr Kim Emerson January 2013.
CERES-GERB meeting, Boulder, 3/2004 Validation of GERB unfiltered radiances S. Dewitte Royal Meteorological Institute of Belgium.
GIST 19: GGSPS Planning GGSPS Development & Review Planning Andy Smith GGSPS software project manager.
Clouds and the Earth’s Radiant Energy System NASA Langley Research Center / Atmospheric Sciences Methodology to compare GERB- CERES filtered radiances.
Software Delivery. Software Delivery Management  Managing Requirements and Changes  Managing Resources  Managing Configuration  Managing Defects 
1 st post launch SCIAMACHY calibration & Verification Meeting L1b Astrium Friedrichshafen – Germany 24 July 2002 First Level 1b General Product Quality.
Diurnal asymmetry in the GERB(-like) fluxes: an update Cédric Bertrand Royal Meteorological Institute of Belgium, Brussels, Belgium.
NRL09/21/2004_Davis.1 GOES-R HES-CW Atmospheric Correction Curtiss O. Davis Code 7203 Naval Research Laboratory Washington, DC 20375
The Project AH Computing. Functional Requirements  What the product must do!  Examples attractive welcome screen all options available as clickable.
CaDSR Software Development Update Denise Warzel Semantic Infrastructure Operations Team Presented to caDSR Content team November 2012.
Plans for interim data release J E Russell (Imperial)
September 23-24, 2014Dawn Conway, AMSR-E / AMSR2 TLSCF Lead Software Engineer AMSR-E / AMSR2 Team Lead Science Computing Facility TLSCF at UAH Dr. Roy.
GERB2-GERB 1 transition: discussion item J E Russell Imperial College, London
MG 1/10/01 1 PCS SMOV-3B Review Objectives Overview Activity Descriptions Requirements.
EUMETSAT METEOROLOGICAL SATELLITE CONFERENCE 15/09/2013 – 20/09/2013, VIENNA EUMETSAT METEOROLOGICAL SATELLITE CONFERENCE 15/09/2013 – 20/09/2013, VIENNA.
Level 1.5 Processing Issues Martin Bates RAL. Level 1.5 Processing Issues Geolocation –Current Status –TSOL Jitter (CSOL-TSOL) correction –Longterm TSOL.
Level 1.5 Processing Updates Martin Bates, RAL GIST th December, 2005.
Overview of the “Geostationary Earth Radiation Budget (GERB)” Experience. Nicolas Clerbaux Royal Meteorological Institute of Belgium (RMIB) In collaboration.
On the application of CERES SW ADMs Cédric Bertrand.
RGP geolocation analysis. The geolocation problem We don’t have all the necessary information: –Optical model needs tuning Can prob. do this now but not.
MODIS OCEAN QA Browse Imagery (MQABI Browse Tool) NASA Goddard Space Flight Center Sept 4, 2003
GERB-2 V999 Unfiltering Nicolas Clerbaux & RMIB GERB Team. GIST 24, Imperial College, London 15 december 2005.
Direct LW radiative forcing of Saharan dust aerosols Vincent Gimbert, H.E. Brindley, J.E. Harries Imperial College London GIST 25, 24 Oct 2006, UK Met.
GIST 23 DWD, 27-29th Apr 2005 GGSPS development and operations Andy Smith RAL.
NCHRP Project Development of Verification and Validation Procedures for Computer Simulation use in Roadside Safety Applications SURVEY OF PRACTITIONERS.
Changes to the Youth Re-offending Measure. YJB position statement The YJB supports the concept of the new measure and the advantages it presents for aligning.
MSG, GERB calibration and data status May ‘07 J E Russell Imperial College, London
GIST th -16 th Dec B.Stewart RAL Mirror Anomaly Review Board Update.
Dust Longwave Forcing from GERB and SEVIRI Vincent Gimbert, H.E. Brindley, J.E. Harries Imperial College London GIST 26, 03 May 2007, RAL, Abingdon Thanks.
© Imperial College LondonPage 1 Cloud Forcing Studies using CERES and GERB(-like) data Joanna Futyan, Jacqui Russell and John Harries GIST 22 RMIB, Brussels,
Intercomparison of SEVIRI data from MSG1 and MSG2 and implications for the GERB data processing Nicolas Clerbaux & RMIB GERB Team. GIST 26, RAL 3 and 4.
GIST 19: GGSPS status Status of GGSPS development and operations Andy Smith GGSPS software project manager.
Cloud Mask: Results, Frequency, Bit Mapping, and Validation UW Cloud Mask Working Group.
Investigations of Artifacts in the ISCCP Datasets William B. Rossow July 2006.
© Imperial College LondonPage 1 Estimating the radiative effect of mineral dust over ocean The radiance to flux problem Dust retrieval quality Applying.
RMIB involvement in the Geostationary Earth Radiation Budget (GERB) and Climate Monitoring SAF projects Nicolas Clerbaux Remote sensing from Space Division.
Level 1.5 Geolocation Martin Bates, RAL GIST th December, 2005.
Product status and timeline Andy Smith RAL. User products The GGSPS provides user access to the following products: Level 1.5 NANRG, ARG Level 2 ARG (and.
18 th GIST Meeting 14 th –16 th May 2003 Ground Segment (GGSPS) Report 1 GERB Ground Segment B.C.Stewart RAL.
HDF-EOS Workshop IV September 19-21, 2000 Richard E. Ullman ESDIS Information Architect NASA/ GSFC, Code 423.
2004/11/10GIST 22, Brussels, LMD, M. Viollier1 POLDER, CERES, GERB flux comparisons and information on AMMA and MeghaTropiques Michel Viollier Laboratoire.
Retrieval Algorithms The derivations for each satellite consist of two steps: 1) cloud detection using a Bayesian Probabilistic Cloud Mask; and 2) application.
CM-SAF Board Meeting, Helsinki, September 2006 CM-SAF TOA radiation status report D. Caprion Royal Meteorological Institute of Belgium.
© Imperial College LondonPage 1 Inter-comparisons of monthly mean (and monthly time-step mean) GERB clear sky fluxes Joanna Futyan, Richard Allan and Jacqui.
Generation of TOA Radiative Fluxes from the GERB Instrument Data. Part II: First Results Nicolas Clerbaux and GERB team Royal Meteorological Institute.
© Imperial College LondonPage 1 Deriving clear-sky fluxes for GERB Jo Futyan Gist 21, CERES-GERB meeting 02/04/04 Boulder, Colorado.
1 Validated Stage 1 Science Maturity Review for Surface Reflectance Eric Vermote Sept 04, 2014.
GIST, Boulder, 31/03/2004 RMIB GERB Processing: overview and status S. Dewitte Royal Meteorological Institute of Belgium.
Level 1.5 Processing Updates Martin Bates, RAL GIST th April, 2005.
MODIS Atmosphere Level-3 Product & Web Site Review Paul A. Hubanks Science Systems and Applications, Inc.
GIST, Abingdon, 5/2007 GERB 1/GERB 2 and GERB/CERES comparisons S. Dewitte Royal Meteorological Institute of Belgium.
1 MODIS Land C6 Robert Wolfe NASA GSFC Code MODIS &VIIRS Science Team Meeting May 14, 2008.
NASA Langley Research Center / Atmospheric Sciences CERES Instantaneous Clear-sky and Monthly Averaged Radiance and Flux Product Overview David Young NASA.
GRWG Agenda Item Towards Operational GSICS Corrections for Meteosat/SEVIRI IR Channels Tim Hewison EUMETSAT 1.
WEC meeting TED status and WEC timing.
Validation status overivew
Validation status overivew
Status of ACVE-3/pre-validation recommendationss 21. 6
Vicarious calibration by liquid cloud target
Eumetsat conference 2004, Praha
A Discussion on TEMPO Draft CH2O Validation Plan
Updating IPR "Guidance" April 2017 European Commission DG ENV C.3
Dorothee Coppens.
Development of the MTSAT1 visible footprint point spread function
Andrew Heidinger JPSS Cloud Team Lead
Defining the Products: ‘GSICS Correction’
Earth Radiation Budget: Insights from GERB and future perspectives
Presentation transcript:

Data Release Requirements, decisions and plans

What we need New machine Implement (and test) all proposed changes from current Provide data quality summary, up to date documentation of processing steps and userguides

Products and contents Flags and QA Calibration parameters (gains spectral response) Radiances and fluxes all products Geolocation Radiances, scene id and fluxes Unfiltering SW and LW Radiances (LEVEL 2) LW fluxes LW Fluxes (LEVEL 2) Cloud id SW fluxes (LEVEL 2) SW fluxes SW fluxes (LEVEL 2)

Products and contents for edition 1 release LEVEL 1.5 NANRG + geo correction? LEVEL 2 ARG –Shi and barg produced now but won’t be officially released till validated Rename all as edition 1 –Remove v??? Only edition? In name, rev etc identify in lit only Move to HDF new version? –yes

Flags : level 1.5 QF flag (1-2 weeks) yes SOL jitter flag or could remove product later (1 week) only if time otherwise must remove data maually Flag counting data (3 days) yes Fix sun glint flag as byte shift (3 days) only if time

Flags : level 2.0 REMOVE all invlaid level 1.5 data from level 2 processing –Need to decide what is invalid data SW fluxes in sunglint region (flag or remove?) – possibly decrease sunglint region –Remove clearsky ocean data in sunglint region and decrease angle Flag data near terminator –Note in summary problem at low SZA ADD MPEF cloud flag –Experiment non fixed – copying of SEVIRI value to be inlcuded 24hours in lw product Add aerosol flag / optical depth? –Included as an experimental thing

Calibration Keep recovered (V999) response B factor – ground value? + LaRc summary on pixel variation Gain – outlier removal –Need to note POSSIBLE magnitude of effect

Geolocation New geolocation to be implemented –One month to improve then FREEZE no matter what

Unfiltering LOS non-repeatability flag implemented Further updates to the unfiltering tables –add sand surfaces. Other? –Not vital only done if time Direct or as V999 dedicated clear sky ocean SW unfiltering –As V999 Diurnal cycle in the unfiltering error over dark surfaces – note in document further check to see if anything further needed? –Not vital only if time

SEVIRI processing & GERB-like Keep record of ALL changes to SEVIRI data –Contanct EUMETSAT to obtain Improve NB to BB using dubrovnik –YES AS A PRIORITY Further sun glint angle improvement –Yes

Cloud flags No updates in time for release? –If time may try to improve cloud mask at terminator

SW fluxes Return to pre-V999 calculation? –Not but new dubrok must be in play Issue health warning (seen as diurnal asym) on clear sky and broken cloud over ocean SW fluxes definitely and poss. Present over land also as source unknown Flag fluxes in sun glint regions (possibly decrease sun glint angle) – flag only or remove

LW fluxes Remove correction for release and provide note on how users may post-correct

Things to check LW comparison with ES8 (30km reference level correction) Proposed geolocation

Release Philosophy CALIBRATION-VALIDATION- PROCESSING Traceability Consistency Supportability

Contents of data quality summary Qualitative statement –Overview of known issues –Range of validity etc Results from inter-comparisons –All actual numbers and plots need to come from the edition 1 processing Theoretical uncertainty estimates on radiances and fluxes: –Calibration, unfiltering, etc

Supporting documentation Current user guides updated and renamed product description Existing processing and algorithm documents updated and incorperated into a user guide detailing the processing steps (and input info) –Make available prior to going public to gist for comment (also for quality summary)

Action plan for edition 1 release RMIB/RAL/IMPERIAL to provide single page (or less) note ‘detailing’ the changes to be made to V999 for release. DATE: 22/12/05 RMIB to order new machine DATE: 04/01/06 RMIB: provide example of new geo results (geo FROZEN) ALL: implement processing changes ALL: re-run limited portion of the June-July 2004 and Dec 2004 with all the processing changes FROZEN ALL: update documentation, data summary except for final figures ALL: analysis of limited reprocessing results to provide final figures in data summary – POINT OF RELASE ALL: re-run full June-July 2004 and Dec 2004 with release version ALL: detailed analysis of release version for these 3 months provided in liturature

Action plan Whilst processing changes are implemented and new computer ordered … B –factor : (impacts on all SW products) JER to provide representative Pam and Lou with V999 and proposed new B values for post aplication to pixel comparison results DATE: 21/12/05 Geo: FREEZE PROPOSED GEO (impacts on all products) – RMIB provide representative dataset of new geo values to team DATE: SUGGEST: 3 days to one week of new geo values from each month of the June-July 2004 / Dec RAL to devise method to provide corrected level 1.5 geo

Action plan All processing changes implemented and FROZEN DATE: /02/06 STEP 1: limited reprocessing of June-July 2004 and Dec 2004 data end to end as intended for relase SUGGEST 1 week summer (june) one winter? Must be sufficient to provide enough info to put numbers in the release statement Whilst this processing is taking place – UPDATE documentation with all changes and additions, release statement and quality summary (awaiting final numbers and figures)

Action plan Limited reprocessing of June-July 2004 and Dec 2004 data end to as intended for relase SUGGEST 1 week from each month? Must be sufficient to provide enough info to put numbers in the release statement Whilst this processing is taking place – UPDATE documentation with all changes and additions, release statement and quality summary (awaiting final numbers and figures) DATA MEETING to ease this process

Action plan Limited reprocessing finished results to be analysed to provide numbers and figures to go into the release statement. This release document will be circulated to GIST DATE: - RELEASE, i.e. data and documentation SHOULD BEGIN AT THIS POINT the example data will be provided immediately, further data will become available as processed. Complete processing with release software of the June July 2004 and Dec 2004 (NOTE ERNESTO asks to add Feb data (4 days)) - Complete analysis on the release version data, using these months, provide these results in the form of papers to the community and make the data available to all