CBS Ext(2014) / RA III-16 TECO / RECO WIGOS Metadata Steve Foreman, WIGOS Secretariat For TT-WMD WMO; CBS Ext(2014) / RA III-16

WIGOS metadata  Context  High level contents  Next step CBS Ext(2014) / RA III-16 2

Context

WMO Integrated Observing System - Metadata  Aims to support  Use of observations  Planning observation networks  Constraints  Applicable to all types of observations  Acceptable to governments of all countries WIGOS metadata

Principles for WIGOS Metadata  Include the information that enables users to make adequate use of observational data [also for climate applications]  Every piece of metadata shall have date/time information associated with it  All metadata associated with internationally exchanged data shall be made available  Metadata shall be updated in a timely manner to support adequate interpretation of data  Standard should be applicable to all disciplines  Standard should be forward-looking but also respect legacy (e.g., Vol. A)  Standard should be acceptable to all Members  Standard should be applicable for all Members WIGOS metadata

Principles for WIGOS Metadata  Include the information that enables users to make adequate use of observational data [also for climate applications]  Every piece of metadata shall have date/time information associated with it  All metadata associated with internationally exchanged data shall be made available  Metadata shall be updated in a timely manner to support adequate interpretation of data  Standard should be applicable to all disciplines  Standard should be forward-looking but also respect legacy (e.g., Vol. A)  Standard should be acceptable to all Members  Standard should be applicable for all Members WIGOS metadata Explain observations Over time For all exchanged observations In time to be useful For all types of observation Expand what we record Achievable Relevant

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact Observed quantity Atmospheric: Temperature (F) Humidity (%) Wind (mph) Rainfall (inches) Visibility (miles) Observed quantity Atmospheric: Temperature (F) Humidity (%) Wind (mph) Rainfall (inches) Visibility (miles) High level content

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content Purpose Urban meteorology US domestic stations Purpose Urban meteorology US domestic stations

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content Data quality Quality flags Data quality Quality flags

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content Environment In a screen On a rooftop platform Environment In a screen On a rooftop platform

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content Data processing Hourly reporting Pressure tendency derived from manual interpretation of barograph trace. Hand written logs Data processing Hourly reporting Pressure tendency derived from manual interpretation of barograph trace. Hand written logs

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content Sampling and analysis Winds averaged over ten minutes Sampling and analysis Winds averaged over ten minutes

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content Station platform Region: IV Country: USA Name: New York Roof 10 Type: Land station Id: int.wmo.wigos Location: 40°44′54.36″N 73°59′08.36″W Data comms: Telephone Station platform Region: IV Country: USA Name: New York Roof 10 Type: Land station Id: int.wmo.wigos Location: 40°44′54.36″N 73°59′08.36″W Data comms: Telephone

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content Purpose Urban meteorology US domestic stations Purpose Urban meteorology US domestic stations Environment In a screen On a rooftop platform Environment In a screen On a rooftop platform Data quality Quality flags Data quality Quality flags Method (visibility) Visual Standard reference landmarks Obs Range: not available Method (visibility) Visual Standard reference landmarks Obs Range: not available

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content Ownership Responsible: NWS Data policy: WMO Essential Ownership Responsible: NWS Data policy: WMO Essential

1. Observed Quantity 2. Purpose of Observation 3. Data Quality 4. Environment 5. Data Processing and Reporting 6. Sampling and Analysis 7. Station/Platform 8. Method of Observation 9. Ownership and Data Policy 10. Contact High level content Contact USA Focal Point for Observations Contact USA Focal Point for Observations

Tailoring the standard Each element marked as:  Mandatory  Required for all WIGOS metadata records  Conditional  Required only in specified circumstances  instrument calibration makes little sense for a human observer  Optional  Extremely useful, but too challenging to make compulsory CBS Ext(2014) / RA III-16 18

Next step

Considerations for WIGOS Metadata  Creating metadata  Levels of detail  Transmission  Various intervals for (incremental) update  Access and use  By humans (researchers, managers, the public)  By machines (services) Rather invariant Very dynamic intermediate WIGOS metadata

Next steps  Task Team on WIGOS Metadata Development  Develop data representations  Members  Review systems  To capture metadata  To retain existing metadata  WMO  Co-ordinate sharing mechanisms CBS Ext(2014) / RA III-16 21

Phased implementation Mandatory and straightforward Conditional and straightforward Optional and straightforward Likely to need more data gathering or to need changes to procedures All remaining elements CBS Ext(2014) / RA III See Doc 3.3(1) – Recommendation 3, Appendix 24 (in the file -Annex-2-…) All WMO-No 9 Vol A elements are required in 2016

Summary

WIGOS Metadata - summary CBS Ext(2014) / RA III Explain observations Over time For all exchanged observations In time to be useful For all types of observation Expand what we record Achievable Relevant

Thank you for your attention CBS Ext(2014) / RA III-1625