Training on Meteorological Telecommunications Alanya, Turkey, 22-30 September 2010 General Philosophy of Table Driven Code Forms Simon Elliott, EUMETSAT.

Slides:



Advertisements
Similar presentations
Interfacing BUFR to NMC Systems Jeff Ator NOAA National Weather Service United States of America WORLD METEOROLOGICAL ORGANIZATION RA.
Advertisements

1 Often asked questions Eva Červená CZECH HYDROMETEOROLOGICAL INSTITUTE WORLD METEOROLOGICAL ORGANIZATION RA VI Training Workshop on BUFR and Migration.
CREX CREX Code Form Examples of CREX messages Sections of a CREX message Section 0 – Indicator Section CREX Beginning of a CREX message.
WORLD METEOROLOGICAL ORGANIZATION RA-II/VI Regional Training on Table Driven Codes Muscat, Oman, December, 2005 An Introduction to GRIB2 Simon.
Templates and Regulations
Chair, Inter-Programme Expert Team on Metadata Implementation
BUFR decoding Dominique Lucas – Milan Dragosavac
Be a weather presenter Activity 4. Extreme weather images Cyclone Yasi – 3 February 2011 Category 5 cyclone Source: BOM.
Information Retrieval in Practice
Application of XSLT Stylesheet to XML Atsushi Shimazaki Japan Meteorological Agency - WMO Workshop on Metadata - September 2005, Beijing, China.
FM 94 BUFR and FM 95 CREX Table Driven Code Forms (or “Self-descriptive” Code Forms). The term "self-descriptive" means that the form and content of the.
FM 94 BUFR and FM 95 CREX Table Driven Code Forms (or “Self-descriptive” Code Forms). The term "self-descriptive" means that the form and content of the.
Information Representation
Watermarking 3D Objects for Verification Boon-Lock Yeo Minerva M. Yeung.
1 © Crown copyright 2003 GRAS SAF User Workshop Helsingør, Denmark, June 2003 WMO BUFR Format for NRT Dissemination of RO Data Dave Offiler.
WMO Core Profile of the ISO Metadata Standard Steve Foreman Chair IPET-Metadata Implementation.
Chapter 2 Digital data Ola A. Younis. Elements of digital media Symbols : representation for something else. Example: a group of letters often serve as.
3. Technical and administrative metadata standards Metadata Standards and Applications.
1 XML: Document Type Definitions 2 Road Map  Introduction to DTDs  What’s a DTD?  Why are they important?  What will we cover?  Our First DTD 
Is ASCII the only way? For computers to do anything (besides sit on a desk and collect dust) they need two things: 1. PROGRAMS 2. DATA A program is a.
Chapter 7 Data Management. Agenda Database concept Import data Input and edit data Sort data Function Filter data Create range name Calculate subtotal.
Copyright © Cengage Learning. All rights reserved.
UPDATING TABLE DRIVEN CODE FORMS 18 April 2006 (Joël Martellet, WMO, World Weather Watch, Data Processing and Forecasting Systems)
Higher Computing Data Representation.
WHY TABLE DRIVEN CODE FORMS?
BUFR Information Model Gil Ross CAeM Met Office. BUFR Most BUFR Documentation is not easily understood –It treats it as a Decoding process Note – not.
WMO BUFR &CREX Gil Ross, UK Met Office
Higher Computing Computer Systems S. McCrossan 1 Higher Grade Computing Studies 1. Data Representation Data Representation – Why do we use binary? simplicity,
Digital Logic Design Lecture 3 Complements, Number Codes and Registers.
1 Problem Solving using computers Data.. Representation & storage Representation of Numeric data The Binary System.
CountryData Technologies for Data Exchange SDMX Information Model: An Introduction.
Copyright © 2009, Open Geospatial Consortium, Inc. Time issue : Meteo Domain needs and WMS present means Meteorology DWG Frédéric Guillaud, Marie-Françoise.
Uses of Telecommunications & ICT Weather Forecasting.
Software Project Planning Defining the Project Writing the Software Specification Planning the Development Stages Testing the Software.
1 Often asked questions Eva Červená CZECH HYDROMETEOROLOGICAL INSTITUTE TRAINING ON METEOROLOGICAL TELECOMMUNICATIONS WMO RTC-Turkey facilities, Alanya,
Climate Data Formats Deniz Bozkurt
Page 1 Data Structures in C for Non-Computer Science Majors Kirs and Pflughoeft Basic Data Types Characters vs. Numbers Adding in Binary: There are only.
UNIT 2 LESSON 3 CS PRINCIPLES. OBJECTIVES Students will be able to: Construct a binary communication protocol for playing Battleship using the Internet.
Chapter 1 Background 1. In this lecture, you will find answers to these questions Computers store and transmit information using digital data. What exactly.
Dominic Lowe, British Atmospheric Data Centre, STFC OGC TC, Boulder.
Applications of BUFR (Why, when and how to use BUFR) Jeff Ator NOAA National Weather Service United States of America WORLD METEOROLOGICAL.
Introduction to BUFR TRAINING ON METEOROLOGICAL TELECOMMUNICATIONS WMO RTC-Turkey facilities, Alanya, Turkey September 2010.
WMO RTC-Turkey facilities, Alanya, Turkey Templates and Regulations
Characters CS240.
WORLD METEOROLOGICAL ORGANIZATION RA-VI Regional Training on BUFR and Migration to Table Driven Code Forms Langen, Germany, April, 2007 General.
Briefing on Results from Annual Meeting of WMO Expert Team on Data Representation and Codes (ET-DRC) Jeff Ator WG/MC Chair October 16, 2008.
Reflections on the theme of classifying, documenting and exchanging meteorological data, and some additional comments on agro meteorological and biological.
WMO GRIB Edition 3 Enrico Fucile Inter-Program Expert Team on Data Representation Maintenance and Monitoring IPET-DRMM Geneva, 30 May – 3 June 2016.
Backgrounder: Binary Math
Topic: Binary Encoding – Part 1
Storing Graphics Nat 5 Data Representation Lesson 4a: Storing Graphics
3.3 Fundamentals of data representation
Everything is a number Everything in a computer memory and on storages is a number. Number  Number Characters  Number by ASCII code Sounds  Number.
SRNWP Interoperability Workshop
Binary Universal Form Representation (BUFR) Paul Hamer November, 2009
# of Bits is powers of 2 - not conversions
What is FITS? FITS = Flexible Image Transport System
Data Encoding Characters.
WMO, World Weather Watch, Data Processing and Forecasting Systems)
Representing Images 2.6 – Data Representation.
Advanced Algorithms Analysis and Design
Why use Binary? It is a two state system (on/off) which makes it simple to operate Even if degradation of current occurs (ie a slight drop in voltage)
Digital Encodings.
SDMX Information Model: An Introduction
Coding issues BUFR Binary Universal code Form for the Representation of meteorological data Binary Table driven code form (BUFR, CREX) Efficient compression.
Copyright © Cengage Learning. All rights reserved.
Developing a Data Model
WIS Project Office WMO WIS Data Exchange WIS Project Office WMO
Often asked questions Eva Červená CZECH HYDROMETEOROLOGICAL INSTITUTE
Huffman Coding Greedy Algorithm
Presentation transcript:

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 General Philosophy of Table Driven Code Forms Simon Elliott, EUMETSAT Eva Červená, CHMI

Training on Meteorological Telecommunications Alanya, Turkey, September 2010  Code Structures  BUFR and CREX Tables  Features Common to BUFR and CREX  Differences Between BUFR and CREX

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 Table driven codes GRIB - Processed data in the form of grid- point values expressed in binary form. –Forecast, analysis, climatology, satellite images and products BUFR - Binary universal form for the representation of meteorological data. –Observations, satellite products CREX - Character form for the representation and exchange of data. –Like simple BUFR but human readable ASCII

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 General structure Indicator section: GRIB/BUFR/CREX Identification section: Date, time, originator, table versions... Optional section: Metadata (potentially XML), private data … Data description: What sort of data follows Data section: actual data here Closure: “7777” Table driven codes generally have this structure 

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 Some features Data are self defining: type, content, edition, section lengths, etc. Data identification is at fixed offsets for quick access without decoding Binary data (GRIB and BUFR) are not really human readable Optional section can contain anything

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 Consider BUFR Table B - Element descriptors –Start with ‘0’, temperature, pressure, etc. Table C - Operator descriptors –Start with ‘2’, change of scale, qc follows, etc. Table D - Sequence descriptors –Start with ‘3’, wind sequence, high accuracy location sequence, etc. Code and flag tables - –Type of cloud, vertical sounding significance, etc.

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 Table B Example: Cloud cover (total) % Data width (bits) Element name Element descriptor Unit Class 20, observed phenomena Reference value Scale Entry in class

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 Scale, reference value and data width Encoding: value = (obs x [10^”scale”]) - “reference” e.g.: Let scale=1, reference=-50, width=7 then, if obs=-1.5, encoded value is 35 allows obs from -5.0 to +7.6, steps of 0.1 Decoding: obs = (value + “reference”) ÷ [10^”scale”] e.g.: Let scale=-2, reference=5, width=4 then, if value=14, decoded value is 1900 allows obs from 500 to 1900, steps of 100

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 Table C Operator descriptors for more complex tasks, e.g. –Change width –Change scale –Change reference –Quality control information –First order statistics follow –Define “data present” bit map –Re-use “data present” bit map –Cancel “data present” bit map

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 Table D Not strictly required Saves space in Section 3 (list of descriptors) One table D entry represents an agreed list of table B and/or C and/or D descriptors = Year Month Day

Training on Meteorological Telecommunications Alanya, Turkey, September 2010 Differences between BUFR and CREX BUFR is binary, better for computers BUFR has a compression scheme Encoded values are non- negative in BUFR Wide range of operators is available in BUFR BUFR mostly uses SI units (for OPMET data, kt, ft, ˚C are allowed) CREX is ASCII, easier for humans to read CREX has no explicit compression scheme Encoded values may be negative in CREX Only a subset of BUFR operators is used in CREX CREX allows other units (temperature can be Celsius or Kelvin) In general, BUFR and CREX are quite similar. CREX may be used as an interim solution if computers are not available or telecoms are inadequate...