WP3: ‘Rapid data delivery at 4 NDACC stations’ Partners: BIRA-IASB INTA Universitaet Bern Karlsruher Institut fuer Technologie CNRS Universitaet Bremen.

Slides:

Advertisements

Similar presentations

Software for Engineers EG1003: Introduction to Engineering and Design.

Advertisements

Institute of Environmental Physics and Remote Sensing IUP/IFE-UB Physics/Electrical Engineering Department 1 NORS/NDACC.

Page 1GlobColour CDR Meeting – July 10-11, 2006, ESRIN All rights reserved © 2006, ACRI-ST Resulting Technical Specification.

Eurostat The ESS.VIP Validation and its implementation in waste statistics Q2014 – Session 13 4 June 2014 Hartmut Schrör, Eurostat.

EG1003: Introduction to Engineering and Design Software for Engineers.

OPTIRAIL WORKSHOP · OCTOBER 23, 2014 · BRUSSELS WP5: “Integration and Usability validation of models”

Evaluation of Satellite NO2 Stratospheric Columns with the SAOZ/NDACC UV-Vis Network J.-P. Pommereau 1, F. Goutail 1, A. Pazmino 1, D. Ionov 1,3, F. Hendrick.

Harmonisation of stratospheric NO 2 /O 3 column data products NORS/NDACC UV-VIS meeting, Brussels, 3-4 July F. Hendrick and M. Van Roozendael Belgian.

M. De Mazière et al., HYMN, May 2007 Status of WP4: FTIR measurements M. De Mazière (BIRA-IASB) K. Petersen, T. Warneke, J. Notholt (U. Bremen)

ISSI WG on H 2 O Bern, Switzerland Feb , 2008 Information Content from Satellites 1/24 Collocation Error budget Vertical Horizontal Perspectives.

Accent-troposat 2 final workshop, 30 Sept Oct. 2008, FMI Helsinki, Finland Atmospheric bromine monoxide retrieval from space and ground-based UV-visible.

NASA Trace Gas Products for Air Quality Applications NASA Remote Sensing Training September 2014 ARSET Applied Remote SEnsing Training A project of NASA.

Financial Information System Running Reports in FIS.

ORM 9, Geneva, May , 2014 Evolution of Measurement Capabilities + cooperating networks.

WP2: Data products generation in Mediterranean Sea EMODNET Chemistry Data Products, Experts Workshop Split (Croatia), June 2014 Sissy Iona, HCMR-HNODC.

M. De Mazière et al. NDACC Steering Committee, 15-19/10/2012 Progress in the first year of NORS De Mazière Martine, Hocke Klemens, Richter Andreas, Godin-Beekmann.

M. De Mazière MACCII KO, Reading, 1/3/2012 Project full title: " Demonstration Network Of ground-based Remote Sensing Observations in support of the GMES.

Introduction A new methodology is developed for integrating complementary ground-based data sources to provide consistent ozone vertical distribution time.

M. De Mazière NDACC SC 2011, Nov. 11, 2011 NORS Demonstration Network Of ground-based Remote Sensing observations in support of the GMES Atmospheric Service.

NORS project (Network Of ground-based Remote Sensing Observation ) Contribution of the CNRS LIDAR team  Maud Pastel, Sophie Godin-Beekmann Latmos CNRS.

CC&E Best Data Management Practices, April 19, 2015 Please take the Workshop Survey 1.

GCE Data Toolbox -- metadata-based tools for automated data processing and analysis Wade Sheldon University of Georgia GCE-LTER.

UV-vis data and NORS validation server NORS/NDACC UV-VIS meeting, Brussels, 3-4 July F. Hendrick, B. Langerock, M. Van Roozendael, and M. De Mazière.

Planetary Science Archive PSA User Group Meeting #1 PSA UG #1  July 2 - 3, 2013  ESAC PSA Archiving Standards.

Tropospheric NO2 Ronald van der A, Michel Van Roozendael, Isabelle De Smedt, Ruud Dirksen, Folkert Boersma KNMI and BIRA-IASB Beijing, October 2008.

NORS/NDACC UV-VIS Working Group Meeting 3-4 July 2012 Belgian Institute for Space Aeronomy (BIRA-IASB), Brussels, Belgium Maud Pastel, Andrea Pazmino,

S5P Ozone Profile (including Troposphere) verification: RAL Algorithm R.Siddans, G.Miles, B.Latter S5P Verification Workshop, MPIC, Mainz th May.

M. De Mazière GEO-AQCOP, Dublin, 5-7/9/2012 Need for metadata in NORS - adoption of GEOMS Martine De Mazière Belgian Institute for Space Aeronomy

CEOS ACC-8, Columbia, MD, April 18-19, th Atmospheric Composition Constellation Meeting (ACC-8), April 2012, Columbia, MD Smoothing and Sampling.

HLANDATA PROJECT: FIRST RESULTS AND SYNERGIES Isabel Goñi, TRACASA.

View_hdf Kam-Pui Lee Science Applications International Corporation CERES Data Management Team Linda Hunt Computer Sciences Corporation Atmospheric Sciences.

Sciamachy features and usage with respect to end-users The typical fate of retrieval people dealing with large datasets… C. Frankenberg, SRON team, IUP.

Work package 4 OBSERVATIONS FROM GROUND NETWORKS.

R. Suresh (NASA/MTECH) Ben Burford (JAXA) Bernhard Buckl (DLR) Contact: - CEOS WGISS Meeting, Beijing, China, September 2004 A RSS.

JERICO KICK OFF MEETINGPARIS – Maison de la recherche - 24 & 25 May 2011 WP 7 SERVICES AND DATA ACCESS.

20 Sept nd GALION WS WMO, Geneva 1 Optimisation of Instruments Arnoud Apituley Volker Freudenthaler Adolfo Comeron.

Page 1 Envisat Validation Workshop, Campaign Database, 12/12/2002 Envisat Validation Workshop Atmospheric Chemistry Validation Team Ground-Based Measurements.

Validation Tool (VTool) PDS Management Council Meeting Washington, D.C. November 2006

ENEON first workshop Observing Europe: Networking the Earth Observation Networks in Europe September, Paris Belgian Institute for Space Aeronomy.

Validation of OMI NO 2 data using ground-based spectrometric NO 2 measurements at Zvenigorod, Russia A.N. Gruzdev and A.S. Elokhov A.M. Obukhov Institute.

University of Liège (ULg) activities based on long-term FTIR observations performed at the Jungfraujoch station Jungfraujoch, 46.5°N, 8.0°E, 3580m alt.

Project full title: " Demonstration Network Of ground-based Remote Sensing Observations in support of the GMES Atmospheric Service "

National Aeronautics and Space Administration Aquarius Validation Data System Overview and Status Algorithm Workshop March 21-22, 2007 John Gunn Earth.

HDF and HDF-EOS Workshop November 30, 2006 The Homogenization and Reporting of Groundbased Atmospheric Datasets for the Validation.

Open Planets Foundation Hackathon Database Archiving Event Implementation of SIARD at the Danish National Archives.

10 th Argo data management 2009 Toulouse What is new at GDACs ?

A.Gsella, J.Targa | 5 th of October 2015 | 20 th EIONET Workshop, Ljubljana, Slovenia Air Quality e-Reporting: state of play.

Global Change Master Directory (GCMD) Mission “To assist the scientific community in the discovery of Earth science data, related services, and ancillary.

1 SUZAKU HUG 12-13April, 2006 Suzaku archive Lorella Angelini/HEASARC.

HYMN 2nd annual meeting FTIR Introduction/Overview A.K. Petersen, J. Notholt, T. Warneke Hydrogen, Methane and Nitrous oxide: Trend variability, budgets.

Validation of OMI and SCIAMACHY tropospheric NO 2 columns using DANDELIONS ground-based data J. Hains 1, H. Volten 2, F. Boersma 1, F. Wittrock 3, A. Richter.

François Hendrick and the NDACC/NORS UVVIS Working Group Demonstration Network Of ground-based Remote Sensing observations in support of the GMES Atmospheric.

HYMN FTIR-WG meeting J. Notholt, M. De Mazière, K. Petersen Hydrogen, Methane and Nitrous oxide: Trend variability, budgets and interactions with the biosphere.

BELGISCH INSTITUUT VOOR RUIMTE-AERONOMIE INSTITUT D’AERONOMIE SPATIALE DE BELGIQUE BELGIAN INSTITUTE OF SPACE AERONOMY BELGISCH INSTITUUT VOOR RUIMTE-AERONOMIE.

Student Financial Assistance. Session 21-2 Session 21 Quality Analysis Tool: The Sharpest Tool in the Shed.

ESA :DRAGON/ EU :AMFIC Air quality Monitoring and Forecasting In China Ronald van der A, KNMI Bas Mijling, KNMI Hennie Kelder KNMI, TUE DRAGON /AMFIC project.

Scenario use cases Szymon Mueller PSNC. Agenda 1.General description of experiment use case. 2.Detailed description of use cases: 1.Preparation for observation.

SADDU1/13 SCIAVALIG status report: Product website & Quality assessment status Annelise du Piesanie, Ankie Piters.

1 Černikovský, Krejčí, Volná (ETC/ACM): Air pollution by ozone in Europe during the summer 2012 & comparison with previous years 17th EIONET Workshop on.

ATom data management plan: Data products and submission requirements Observed data and model products will be submitted in NetCDF or ICARTT format www-air.larc.nasa.gov/missions/etc/ESDS-RFC-019-v1.1_0.pdf.

WP4: Observations from ground networks. Work package 4 OBSERVATIONS FROM GROUND NETWORKS.

Frank Schipplick Work Package Coordinator WP1 - eSignatures.

WHO The World Health Survey Data Entry

Data aggregation and products generation in the Mediterranean Sea

Tuning the retrieval: treat or cheat Klemens Hocke, Simone Studer

SDMX: A brief introduction

April May April May June July July June August Sept August

WISE Distributed Architecture

New Round of Regional data collections Deltares

Data compilation and pre-validation

Presentation transcript:

WP3: ‘Rapid data delivery at 4 NDACC stations’ Partners: BIRA-IASB INTA Universitaet Bern Karlsruher Institut fuer Technologie CNRS Universitaet Bremen Université de Liège Science and Technology B.V. NORS/NDACC UV-VIS meeting, Brussels, 3-4 July

WP3 objectives To implement procedures for operational delivery of NDACC data to the NORS data server with a delay of maximum 1 month after data acquisition Use of a common HDF format compliant with GEOMS (Generic Earth Observation Metadata Standard) guidelines Data and stations: NORS/NDACC UV-VIS meeting, Brussels, 3-4 July

WP3 tasks NORS/NDACC UV-VIS meeting, Brussels, 3-4 July For all WP3 participants: Task 3.1: Development of software routines to save data in the defined HDF format compliant with GEOMS Task 3.2: Implementation of automatic data processing systems generating the data products, including a QA/QC validation step Task 3.3: Set up of data delivery systems providing the data products within 1 month to the NORS data center (MS3, Month 6: April 2012) Task 3.4: Test runs and demonstration of operational data delivery system Task 3.5: Optimisation of data delivery system Task 3.6: Routine data delivery to the NORS data center (D3.1, Month 21: July 2013)

Rapid data delivery system NORS/NDACC UV-VIS meeting, Brussels, 3-4 July IASB-BIRA rapid data delivery system (UV-VIS data): Absorption spectra at station ftp Absorption spectra on BIRA-IASB server QDOAS analysis DSCDs OEM profiling Vertical profile +information content +error budget Vertical columns +information content +error budget column retrieval AMF LUTs AVK LUTs HDF files ftp HDF files on NORS data server QA/QC

HDF/GEOMS data format NORS/NDACC UV-VIS meeting, Brussels, 3-4 July Format description and tools for HDF files creation are available on AVDC at: Important for the NDACC UV-vis WG to move to this data format

Quality Assurance/Quality Control Regarding the HDF files content and format, verifications are performed by the idlcr8hdf.sav IDL program, e.g.: −Variable values outside the specified range −Uncorrect fill-in values −Inconsistencies in the time variable (DATETIME) …. Additional quality checks to implement (to be discussed): −Profile retrievals based on OEM: remove retrievals with low DOFS and/or large residuals −For stratospheric NO 2 columns, remove data contaminated by tropospheric pollution (Langley- plot technique) …. NORS/NDACC UV-VIS meeting, Brussels, 3-4 July

Planning of rapid data delivery Month 6 (April 2012): for each partner, set up and demonstration of their rapid data delivery system Months 7-20 (May 2012-June 2013): Optimisation of data delivery systems Month 21 (July 2013): Operational data delivery Month 22 (August 2013): Preliminary documentation of data delivery systems Month 33 (July 2014): Final documentation of data delivery systems NORS/NDACC UV-VIS meeting, Brussels, 3-4 July After NORS, implementation of a similar data delivery system for all the NDACC UV-vis stations ?