1. Russian Research Institute of Hydrometeorological Information
Challenges to address quality of the data in oceanography and meteorology Vasily Kopylov Director, RRIHMI 07 Nov 2016, St.-Petersburg
Russian Research Institute of Hydrometeorological Information
(RRIHMI)

2. World Data Centers “Meteorology” and “Oceanography”
World Data Center “Meteorology” is acting at RRIHMI under WDS ICSU to provide data related to surface meteorology and upper-air meteorology for World Meteorological Centers and for different categories of customers. The collections are based on national observations and international data exchanges for many years.
World Data Center "Oceanography" is acting at the National Oceanographic Data Centre of RRIHMI and provides storage and maintenance of data on physical and chemical parameters of the World ocean, which were obtained as a result of national observations , international exchange from different countries, participation in international projects.

3. COLLECTION AND ACCUMULATION
Roshydromet Data collection and accumulation system and Russian Unified State Fund of Environmental Data (RusFED): main sources of accumulated data for WDCs
RusFED
Meteorological information primary processing systems
Coastal information processing system
PC WKS ”Hydrologist”
PC WKS “Oceanography”
OMEGA
COLLECTION AND ACCUMULATION
Observational networks

4. Composition of RusFED as of 01.01.2016
1718 Tb of digital data for ;
2 625 860 storage units of documents on paper with information for ;
865 393 storage units of photo-documents and microfilms with information for

5. Problems for WDC “Meteorology”: data gaps and missing data in archives
The amount of acting meteorological stations in Russian Federation. Closing down of stations interrupts historical data series.
Percentage of missing data in meteorological data archives caused by mistakes and technical problems at observational stations

6. WDC Meteorology problem: changes of data observation schedules by periods
Data set
Period
Sub-Daily observations, manual preparation
TM0_SR (3 times/day)
TM1_SR (4 times/day)
ВОСХОД (8 times/day)
ВОСХОД-77 (8 times/day)
Daily summaries, manual preparation
TM1_SU
СУТ-66
СУТ-77
Outputs of automated systems for primary processing
ТММ1
ТМС
ТМСС (Суточные)
ТМСМ ( Месячные)
Period
Amount of observations per day and obs times
Format
Three (7, 13, 21 Local time) A
Four (1, 7, 13, 19 Local time) B
Eight (3, 6, 9…Moscow time) C D E
now
Eight (3, 6, 9…Greenwich)

7. Example of the WDC Meteorology problem: systematic changes in precipitation observing network over Russia – cause of inhomogeneity

8. WDC Oceanography Information
WDC has metadata for:
Information on Data sets (information recourses) – ISO-1915 (more than 100 descriptions of oceanographic data sets);
Cruise summary reports (data base of cruises);
Information on Research vessels ( Russian RVs and RVs of other countries);
Information on Observing projects (more than 200 projects);
Information on Organizations (more than 1000 Russian marine organizations)/

9. Purpose of WDCs “Meteorology” and “Oceanography”:
To facilitate and promote the discovery, exchange and access to meteorological and oceanographic data and information including metadata, products and information in real-time, near real time and delayed mode through the use of international standards and in compliance with the WDS Policy for the climate and ocean research observation community and other stakeholders +
1990–2016
2017
1957–1973
1974–1990
1990–2000

10. Standardized classifiers
WDCs use about 400 classifiers for metadata and data:
International:
Metadata - ISO 19115, ISO 19139;
Countries - ISO 3166;
Date - ISO 8601;
Geographical coordinates - ISO 19111;
Thematic international:
Code of platforms - IOC UNESCO;
Geographical regions - International hydrographic bureau;
Meteorological codes for visibility, wind, precipitations, etc. -WMO;
Parameters – BODC;
Code of research vessels – ICES;
Code organizations, projects – SeaDataNet;
National Russian standards: organizations - ОКПО, ОК ; region codes for Russia
Roshydromet standards – status coastal stations, type stations

11. Methods of Quality Control
The methods, recommended by the WMO and Roshydromet for meteorological data quality control:
WMO Guide for Climatological Practices/ third edition
Complex Upper-Air Data control
Guide to meteorological observation practices
The methods, recommended by the IOC of UNESCO, the EC (Sea Data Net and EMOD net projects) for ocean data quality control:
IOC Manuals and guides No Manual of Quality Control Procedures for Validation of Oceanographic Data.
DATA QUALITY CONTROL PROCEDURES. EC Sea Data Net project
QC and QA basic guidelines. EC EMODnet Chemistry project
Guideline on Quality Assurance and Quality Control of Chemical Oceanographic Data Collections. Black Sea Regional Procedure for QA/QC. Alexander Korshenko, Yury Denga, Violeta Velikhova – 33 pp.
Methodology for data QA/QC and DIVA products. EC EMOD net Chemistry project

12. Archive raw data vs specialized data products
Principles of creating archive data sets (data of RusFED) restrict to a large extent the posibilities to use these data sets directly for provision of services to users or for research.
This makes it necessary to develop specific technologies for creating specialized data sets intended for climate research and various applied tasks including provision of services to users.
Basic requirements to specialized data sets:
1. Availability of observations data series during the entire period of observations.
2. Assurance of data quality (homogeneity of data).
3. Availability of metadata.
4. Regular updating of databases.
5. Accessibility of data.

13. Remote open access to data
In terms of an open access to specialized climate data sets through the Internet, 17 specialized data sets of basic meteorological elements from 518 meteorological stations of Russia are available on the RRIHMI Web-site:
The following data sets are available: air temperature (monthly data); air temperature and precipitation (daily); soil temperature at the depths down to 320 cm (daily); precipitation totals (monthly); atmospheric pressure at a station level (monthly); sunshine duration (monthly); characteristics of snow cover (daily); radiosonde observations (3-hourly); upper air observations (monthly); atmospheric phenomena (3-hourly), etc.

14. APPLIED-SCIENTIFIC ELECTRONIC REFERENCE BOOK «CLIMATE OF RUSSIA»
The reference book contains data from stations of Russia through In addition to traditional climate characteristics the reference book presents statistical characteristics needed for design and efficient use of climate resources in various sectors of economy. The Web-based version containing data from 239 stations of Russia, is freely available on RRIHMI Web-site: .
Number of data requests from Web-site users
Year
2015
Quarter 1 2 3 4
Number of users (increasing)
7752
(7260 in 2014)
8200
8553
9013
Number of sessions
5441
3173
1216
2799
Number of requests
4679
2491
1305
2028
Amount of data (Gb) 13 42 12 44
In addition to national users, users from 45 countries (9,5%) have been registered

15. Access to oceanographic Data by WDC “Oceanography” WEB interface (http://meteo.ru/mcd/ewdcoce.html )
The WDC-"Oceanography" data fund accumulated data on the state of the marine environment over a long period of time ( ) for 5 thousand Russian expeditions
Data download

16. Thank you !