1 © Crown copyright 2003 GRAS SAF User Workshop Helsingør, Denmark, 11-13 June 2003 WMO BUFR Format for NRT Dissemination of RO Data Dave Offiler.

Slides:



Advertisements
Similar presentations
Efficient XML Interchange What is it? Why is it? How does it fit in?
Advertisements

Interfacing BUFR to NMC Systems Jeff Ator NOAA National Weather Service United States of America WORLD METEOROLOGICAL ORGANIZATION RA.
WORLD METEOROLOGICAL ORGANIZATION RA-II/VI Regional Training on Table Driven Codes Muscat, Oman, December, 2005 An Introduction to GRIB2 Simon.
Page 1 © Crown copyright 2005 Workshop on Metadata Beijing27-29 September Report on Metadata Gil Ross (Met Office UK) WIS Working Group Geneva.
The GEONETCast Alert Channel and CAP over GTS
BUFR decoding Dominique Lucas – Milan Dragosavac
FM 94 BUFR and FM 95 CREX Table Driven Code Forms (or “Self-descriptive” Code Forms). The term "self-descriptive" means that the form and content of the.
23-24 March 2006PMO-III workshop Hamburg BUFR… How it affects the PMO.
GTS MetaData Generation data GTS data bases GTS Switch Volume C1 Central Support Office Information Classes white-list Metadata Synchronization.
Page 1 © Crown copyright 2005 Workshop on Metadata Beijing27-29 September WMO Interoperability – the vision Gil Ross (Met Office UK) Metadata workshop;
New Resources in the Research Data Archive Doug Schuster.
The Lossless JPEG standard y=(a+b)/2 = 145 r= =-35 Category (r) = 6, Magnitude (r) = ’s complement of cat (r) = Rep(35)={6,011100}
Groom-gliders data-management workshop Brest, December 2012 Groom gliders data management n In 2012 : vertical profiles from 26 platforms.
GRIB2 and its implementation in INT2LM and the COSMO-Model
Slide: 1 ROSA GRAS Meeting February 2009 Matera, Italy User Services EUMETSAT EUMETSAT Data Access & User Support.
GPSRO Data Processing and Redistribution at NESDIS Jim Yoe NESDIS/ORA 2 nd GPSRO Data Users Workshop Lansdowne, VA August 22-24, 2005.
Page 1© Crown copyright 2005 The Radio Occultation Processing Package GRAS-SAF Team (Axel von Engeln), August 2005 GPSRO2, Lansdowne, Virginia.
7 +/- 2 Maybe Good Ideas John Caron June (1) NetCDF-Java (aka CDM) has lots of functionality, but only available in Java – NcML Aggregation – Access.
METS Dr. Heike Neuroth EMANI – Project Meeting February 14 th - 16 th, 2002 Springer-Verlag Heidelberg Göttingen State and University Library (SUB)
Chapter 30 Electronic Mail Representation & Transfer
UPDATING TABLE DRIVEN CODE FORMS 18 April 2006 (Joël Martellet, WMO, World Weather Watch, Data Processing and Forecasting Systems)
Proposed plan for developing a Mexico AMDAR Program David R. Helms Office of Science and Technology NOAA Naitonal Weather Service AMDAR Regional Workshop.
WMO 4.1 A critique of the existing data models for weather radar data exchange as presented in item 3.1 docs CBS/OPAG-IOS Workshop on Radar Data Exchange.
WHY TABLE DRIVEN CODE FORMS?
BUFR Information Model Gil Ross CAeM Met Office. BUFR Most BUFR Documentation is not easily understood –It treats it as a Decoding process Note – not.
WMO BUFR &CREX Gil Ross, UK Met Office
Training on Meteorological Telecommunications Alanya, Turkey, September 2010 General Philosophy of Table Driven Code Forms Simon Elliott, EUMETSAT.
Access Primer Africamuseum 5 June MS Access  Relational Database Management System Data/information resides in series of related tables Principle.
CGMS-40, November 2012, Lugano, Switzerland Coordination Group for Meteorological Satellites - CGMS IROWG - Overview of and Plans for the Newest CGMS Working.
Ground Support Network operations for the GRAS Radio Occultation Mission R. Zandbergen, the GRAS GSN team (ESOC) and the Metop GRAS team (EUMETSAT) 09/09/2011.
June, 2003EUMETSAT GRAS SAF 2nd User Workshop. 2 The EPS/METOP Satellite.
1 © Crown copyright 2003 GRAS SAF User Workshop Helsingør, Denmark, June 2003 User Requirements for GRAS SAF RO Products Dave Offiler.
Page 1 Pacific THORPEX Predictability, 6-7 June 2005© Crown copyright 2005 The THORPEX Interactive Grand Global Ensemble David Richardson Met Office, Exeter.
IPET-DRMM WMO; Name of Department (ND). IPET-DRMM  Inter-Programme Expert Team on Data Representation Maintenance and Monitoring  looks after  traditional.
Data Quality Control and Quality Monitoring Jitze van der Meulen,  WMO AMDAR PANEL.
WELCOME to the QSNY Portal Public School Self-Study 1.
Status of the assimilation of GPS RO observations: the COSMIC Mission L. Cucurull JCSDA/UCAR J.C. Derber, R. Treadon, and R.J. Purser.
Managing the Impacts of Change on Archiving Research Data A Presentation for “International Workshop on Strategies for Preservation of and Open Access.
Slide 1 WMO BUFR training course Langen April 2007 Slide 1 CREX software Milan Dragosavac.
GRAS SAF AND RADIO OCCULTATION DATA K. B. Lauritsen 1, H. Gleisner 1, M. E. Gorbunov 2, F. Rubek 1, S. Syndergaard 1, H. Wilhelmsen 1 (1) Danish Meteorological.
11 GRAS SAF Status & Next Steps Kent B. Lauritsen Danish Meteorological Institute Copenhagen, Denmark Contents - Short introduction to the GRAS SAF.
Slide 1 Second GPS/RO Users Workshop, August , The EUMETSAT Polar System GRAS SAF and Data Products Martin B. Sorensen GRAS SAF Project Atmosphere.
CAP Implementation Workshop WMO, Geneva December 2008 CAP over the GTS (WMO's Global Telecommunication System) Simon Elliott EUMETSAT
GRAS SAF User Workshop June GRAS Level 1 Processing and Products Juha-Pekka Luntama and Julian Wilson EUMETSAT Am Kavalleriesand 31, D
© Crown copyright Met Office WAFC CAT verification Objective verification of GRIB CAT forecasts Dr Philip G Gill, WAFS Workshop on the use and visualisation.
2 nd GRAS-SAF USER WORKSHOP Assimilation of GPS radio occultation measurements at DAO (soon GMAO) P. Poli 1,2 and J. Joiner 3 Data Assimilation Office.
Applications of BUFR (Why, when and how to use BUFR) Jeff Ator NOAA National Weather Service United States of America WORLD METEOROLOGICAL.
Introduction to BUFR TRAINING ON METEOROLOGICAL TELECOMMUNICATIONS WMO RTC-Turkey facilities, Alanya, Turkey September 2010.
1 © Crown copyright 2003 GRAS SAF User Workshop Helsingør, Denmark, June 2003 GRAS SAF Software Deliverables Sean Healy Dave Offiler Christian Marquardt.
WORLD METEOROLOGICAL ORGANIZATION RA-VI Regional Training on BUFR and Migration to Table Driven Code Forms Langen, Germany, April, 2007 General.
US-Europe Data Exchange Meeting May Page 1 EUMETSAT Status Report Simon Elliott EUMETSAT Operations Department
Briefing on Results from Annual Meeting of WMO Expert Team on Data Representation and Codes (ET-DRC) Jeff Ator WG/MC Chair October 16, 2008.
Slide 1 WMO BUFR training course Langen April 2007 Slide 1 Ecmwf observations data handling Milan Dragosavac.
NOAA/NESDIS support of ESA’s ADM/Aeolus mission Lars Peter Riishojgaard Joint Center for Satellite Data Assimilation.
Doc.: IEEE /250r0 Submission, Slide 1 Project: IEEE P Working Group for Wireless Personal Area Networks (WPANs) Submission Title: IEEE :
LonWorks Introduction Hwayoung Chae.
Reflections on the theme of classifying, documenting and exchanging meteorological data, and some additional comments on agro meteorological and biological.
WMO GRIB Edition 3 Enrico Fucile Inter-Program Expert Team on Data Representation Maintenance and Monitoring IPET-DRMM Geneva, 30 May – 3 June 2016.
© Crown copyright Met Office Report of the Chair Stuart Goldstraw, UK Met Office, Chair ET-SBO-1, July 2013.
Radio Occultation and IROWG Matters Presented to CGMS-42 WGII session, agenda item 7 Co-Chairs: Axel von Engeln (EUMETSAT), Dave Ector (UCAR)
MPEG-4 Binary Information for Scenes (BIFS)
SRNWP Interoperability Workshop
Binary Universal Form Representation (BUFR) Paul Hamer November, 2009
WMO, World Weather Watch, Data Processing and Forecasting Systems)
Agenda item 3.3 Manual on Codes
Coding issues BUFR Binary Universal code Form for the Representation of meteorological data Binary Table driven code form (BUFR, CREX) Efficient compression.
WIS Project Office WMO WIS Data Exchange WIS Project Office WMO
File Compression Even though disks have gotten bigger, we are still running short on disk space A common technique is to compress files so that they take.
The GRAS SAF Project and Aim of the User Workshop
OCBs Faculty Approved Content
Presentation transcript:

1 © Crown copyright 2003 GRAS SAF User Workshop Helsingør, Denmark, June 2003 WMO BUFR Format for NRT Dissemination of RO Data Dave Offiler

GRAS SAF User Workshop Helsingør, Denmark, June © Crown copyright 2003 What’s BUFR?? Binary Universal Format for the Representation of data (aka WMO FM-94) WMO standard (binary) format for observational data (like GRIB is for 2-d fields) For transmission on GTS/RMDCN Often used for archiving and interface to NWP assimilation systems Self-defining data stream by use of common tables

GRAS SAF User Workshop Helsingør, Denmark, June © Crown copyright 2003 BUFR Bits (1) A BUFR message consists of 6 sections: 0) “BUFR” 1) Header - IDs, Date/Time etc 2) Optional data (not often used) 3) List of descriptors 4) User data (bit stream) 5) “7777”

GRAS SAF User Workshop Helsingør, Denmark, June © Crown copyright 2003 BUFR Bits (2) BUFR is table-driven by descriptors Descriptors types: Element (observation parameters) - Table ‘B’ Repetition (repeated sequences) Operator (change scale, reference values…) Sequence (common sequences) - Table ‘D’ Can give modest compression (typically 2:1) when several like observations are encoded together.

GRAS SAF User Workshop Helsingør, Denmark, June © Crown copyright 2003 RO in BUFR Guiding Principles BUFR format is for NRT users - principally NWP KISS Minimise number of new Table entries Re-use existing entries where-ever possible Only encode parameters useful to the target user-base (sub-set of ‘Level 2’ data) Generic (mission-independent) RO Full data still available by other means

GRAS SAF User Workshop Helsingør, Denmark, June © Crown copyright 2003 Result? Working prototype at Met Office (see draft doc) Satellite Ids, Date/Time, RoC, SSV (1 per occ.) 200 samples for profiles of Impact Parameter and Bending Angle 150 samples of profiles of Refractivity, P,T,q (incl. B/g T) Total number of elements:3088 Total expanded descriptors:3496 Each occultation (uncompressed):6144 bytes

GRAS SAF User Workshop Helsingør, Denmark, June © Crown copyright 2003 What Next? Feedback from this forum Use ‘delayed’ instead of ‘fixed’ replication - more complex to encode & decode, but more flexible. (Fixed is limited to max. 254 replications). Will we ever need >250? Remove B/g T & associated meta-data? Add Q/C information (per sample) Update & test BUFR; one more round; submit to WMO for formal approval; use on GTS/RMDCN

GRAS SAF User Workshop Helsingør, Denmark, June © Crown copyright 2003 Over to you! But remember Guiding Principle No.1: It’s for NRT dissemination over GTS/RMDCN It’s targeted specifically for NWP users An intermediate, generic file content and format is also in development, which could provide an interface between mission-specific files and BUFR or other applications. Feedback on this also welcome. Ultimately, users will continue have access to the mission- (and processing centre-) specific full-content files from EUMETSAT (CGS & GRAS SAF), UCAR, JPL, GFZ….