Russian Research Institute of Hydrometeorological Information Challenges to address quality of the data in oceanography and meteorology Vasily Kopylov Director, RRIHMI 07 Nov 2016, St.-Petersburg Russian Research Institute of Hydrometeorological Information (RRIHMI)

World Data Centers “Meteorology” and “Oceanography” World Data Center “Meteorology” is acting at RRIHMI under WDS ICSU to provide data related to surface meteorology and upper-air meteorology for World Meteorological Centers and for different categories of customers. The collections are based on national observations and international data exchanges for many years. World Data Center "Oceanography" is acting at the National Oceanographic Data Centre of RRIHMI and provides storage and maintenance of data on physical and chemical parameters of the World ocean, which were obtained as a result of national observations , international exchange from different countries, participation in international projects.

COLLECTION AND ACCUMULATION Roshydromet Data collection and accumulation system and Russian Unified State Fund of Environmental Data (RusFED): main sources of accumulated data for WDCs RusFED Meteorological information primary processing systems Coastal information processing system PC WKS ”Hydrologist” PC WKS “Oceanography” OMEGA COLLECTION AND ACCUMULATION Observational networks

Composition of RusFED as of 01.01.2016 1718 Tb of digital data for 1874-2015; 2 625 860 storage units of documents on paper with information for 1734-2015; 865 393 storage units of photo-documents and microfilms with information for 1881-2015.

Problems for WDC “Meteorology”: data gaps and missing data in archives The amount of acting meteorological stations in Russian Federation. Closing down of stations interrupts historical data series. Percentage of missing data in meteorological data archives caused by mistakes and technical problems at observational stations

WDC Meteorology problem: changes of data observation schedules by periods Data set Period Sub-Daily observations, manual preparation TM0_SR (3 times/day) 1878-1935 TM1_SR (4 times/day) 1936-1965 ВОСХОД (8 times/day) 1966-1976 ВОСХОД-77 (8 times/day) 1977-1983 Daily summaries, manual preparation TM1_SU 1878-1965 СУТ-66 СУТ-77 Outputs of automated systems for primary processing ТММ1 1977-1984 ТМС 1984-2007 ТМСС (Суточные) ТМСМ ( Месячные) Period Amount of observations per day and obs times Format 1891 - 1935 Three (7, 13, 21 Local time) A 1936 - 1965 Four (1, 7, 13, 19 Local time) B 1966 - 1976 Eight (3, 6, 9…Moscow time) C 1977 - 1984 D 1985 - 1992 E 1993 - now Eight (3, 6, 9…Greenwich)

Example of the WDC Meteorology problem: systematic changes in precipitation observing network over Russia – cause of inhomogeneity

WDC Oceanography Information WDC has metadata for: Information on Data sets (information recourses) – ISO-1915 (more than 100 descriptions of oceanographic data sets); Cruise summary reports (data base of 34 000 cruises); Information on Research vessels (10 000 Russian RVs and RVs of other countries); Information on Observing projects (more than 200 projects); Information on Organizations (more than 1000 Russian marine organizations)/

Purpose of WDCs “Meteorology” and “Oceanography”: To facilitate and promote the discovery, exchange and access to meteorological and oceanographic data and information including metadata, products and information in real-time, near real time and delayed mode through the use of international standards and in compliance with the WDS Policy for the climate and ocean research observation community and other stakeholders + 1990–2016 2017 1957–1973 1974–1990 1990–2000

Standardized classifiers WDCs use about 400 classifiers for metadata and data: International: Metadata - ISO 19115, ISO 19139; Countries - ISO 3166; Date - ISO 8601; Geographical coordinates - ISO 19111; Thematic international: Code of platforms - IOC UNESCO; Geographical regions - International hydrographic bureau; Meteorological codes for visibility, wind, precipitations, etc. -WMO; Parameters – BODC; Code of research vessels – ICES; Code organizations, projects – SeaDataNet; National Russian standards: organizations - ОКПО, ОК 007-93; region codes for Russia Roshydromet standards – status coastal stations, type stations

Methods of Quality Control The methods, recommended by the WMO and Roshydromet for meteorological data quality control: WMO Guide for Climatological Practices/ third edition Complex Upper-Air Data control Guide to meteorological observation practices The methods, recommended by the IOC of UNESCO, the EC (Sea Data Net and EMOD net projects) for ocean data quality control: IOC Manuals and guides No. 26. 1993. Manual of Quality Control Procedures for Validation of Oceanographic Data. DATA QUALITY CONTROL PROCEDURES. EC Sea Data Net project. 2010. QC and QA basic guidelines. EC EMODnet Chemistry project. 2010. Guideline on Quality Assurance and Quality Control of Chemical Oceanographic Data Collections. Black Sea Regional Procedure for QA/QC. Alexander Korshenko, Yury Denga, Violeta Velikhova. 2012. – 33 pp. Methodology for data QA/QC and DIVA products. EC EMOD net Chemistry project. 2015.

Archive raw data vs specialized data products Principles of creating archive data sets (data of RusFED) restrict to a large extent the posibilities to use these data sets directly for provision of services to users or for research. This makes it necessary to develop specific technologies for creating specialized data sets intended for climate research and various applied tasks including provision of services to users. Basic requirements to specialized data sets: 1. Availability of observations data series during the entire period of observations. 2. Assurance of data quality (homogeneity of data). 3. Availability of metadata. 4. Regular updating of databases. 5. Accessibility of data.

Remote open access to data In terms of an open access to specialized climate data sets through the Internet, 17 specialized data sets of basic meteorological elements from 518 meteorological stations of Russia are available on the RRIHMI Web-site: www.meteo.ru. The following data sets are available: air temperature (monthly data); air temperature and precipitation (daily); soil temperature at the depths down to 320 cm (daily); precipitation totals (monthly); atmospheric pressure at a station level (monthly); sunshine duration (monthly); characteristics of snow cover (daily); radiosonde observations (3-hourly); upper air observations (monthly); atmospheric phenomena (3-hourly), etc.

APPLIED-SCIENTIFIC ELECTRONIC REFERENCE BOOK «CLIMATE OF RUSSIA» The reference book contains data from stations of Russia through 2015. In addition to traditional climate characteristics the reference book presents statistical characteristics needed for design and efficient use of climate resources in various sectors of economy. The Web-based version containing data from 239 stations of Russia, is freely available on RRIHMI Web-site: www.meteo.ru . Number of data requests from Web-site users Year 2015 Quarter 1 2 3 4 Number of users (increasing) 7752 (7260 in 2014) 8200 8553 9013 Number of sessions 5441 3173 1216 2799 Number of requests 4679 2491 1305 2028 Amount of data (Gb) 13 42 12 44 In addition to national users, users from 45 countries (9,5%) have been registered

Access to oceanographic Data by WDC “Oceanography” WEB interface (http://meteo.ru/mcd/ewdcoce.html ) The WDC-"Oceanography" data fund accumulated data on the state of the marine environment over a long period of time (1900-2015) for 5 thousand Russian expeditions Data download

Thank you !