Documentation of statistics ESTP: Disseminations and Communication-Introductory course Celia Santos Sánchez INE-Spain THE CONTRACTOR IS ACTING UNDER A FRAMEWORK CONTRACT CONCLUDED WITH THE COMMISSION
INDEX Metadata: standards and classifications Documenting for all type of users: different users, different needs. Pros and cons of extensive documentation ESMS: better quality in the information presented-INE Spain case
European Statistics are presented in a clear and understandable form, released in a suitable and convenient manner, available and accessible on an impartial basis with supporting metadata and guidance. Indicators 15.1:Statistics and the corresponding metadata are presented, and archived, in a form that facilitates proper interpretation and meaningful comparisons. 15.2:Dissemination services use modern information and communication technology and, if appropriate, traditional hard copy. 15.3:Custom-designed analyses are provided when feasible and the public is informed. 15.4:Access to microdata is allowed for research purposes and is subject to specific rules or protocols. 15.5:Metadata are documented according to standardised metadata systems. 15.6:Users are kept informed about the methodology of statistical processes including the use of administrative data. 15.7:Users are kept informed about the quality of statistical outputs with respect to the quality criteria for European Statistics.
1. What is metadata, why we need it?
1. What is metadata? Metadata are systematic, descriptive information about data content and organisation Provide information on the concepts, sources, and methods underlying the data, and therefore, help users to understand and assess the characteristics of the data. Statistical compliers should provide metadata to their users because metadata are a integral part of the publication of statistics (IMF, Balance of payments)
1, What is STATISTICAL METADATA Data about statistical data Comprise data and other documentation that describe objects in a formalised way (economic Commission for Europe of the United Nations (UNECE), “terminology on Statistical Metadata) They provide information on data, and about processes of producing and using data. Statistical metadata describe statistical data and-to some extent-processes and tools involved in the production and usage of statistical data (UNECE, “ Guidelines for the modelling of Statistical Data and Metadata”, 1995)
1. Types of Metadata Metadata needed to search for and display data: Structural metadata Metadata that give more information on definitions, methodologies, processes and quality Reference Metadata
1. Metadata: standards and classifications
Metadata: standards and classifications
2. Documenting for all type of users
2. ESAC proposal
2. ESAC proposal
3. Reference metadata It shall be understood as the information that accompanies statistical operations and allows knowing the contents, methodologies and aspects of quality associated with each statistical operation in a systematic, homogeneous and structured way
3. Standardised methodologies project ES: 1st normalised reference metadata system the Inventory of Statistical Operations of the State Administration (ISO). (http://www.ine.es/ss/Satellite?c=Page&p=1254735033477&pagename=IOEhist%2FIOEhistLayout&cid=1254735033477&L=1)
3. ESMS: Reference metadata 2009: the European Commission approved the recommendation regarding Euro-SDMX Metadata Structure (ESMS). Annex includes the structure of the reference metadata: 21 main concepts that are collected using 61 sub-concepts. These 21 concepts can be grouped into 5 large theme groups; presentation of the data, governance, quality, dissemination and statistical production process. (http://eurlex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2009:168:0050:0055:EN:PDF)
3. Standardised methodologies project 2010: Metadata system integrated and convergent with the European ESMS project Standardised Methodological Report Implementation project: 2013
Relevant aspects: Quality ESMS 1 Contact 2 Metadata update 3 Statistical presentation 4 Unit of measure 5 Reference period 6 Institutional mandate 7 Confidentiality 8 Release policy 9 Frecuency of dissemination 10 Dissemination format 11 Accessibility of documentation 12 Quality management 13 Relevance 14 Accuracy and raliability 15 Timelliness and punctuality 16 Comparability 17 Coherence 18 Cost and burden 19 Data revision 20 Statistical processing 21 Comments Quality report
Relevant aspects: Governance ESMS 1 Contact 2 Metadata update 3 Statistical presentation 4 Unit of measure 5 Reference period 6 Institutional mandate 7 Confidentiality 8 Release policy 9 Frecuency of dissemination 10 Dissemination format 11 Accessibility of documentation 12 Quality management 13 Relevance 14 Accuracy and raliability 15 Timelliness and punctuality 16 Comparability 17 Coherence 18 Cost and burden 19 Data revision 20 Statistical processing 21 Comments Governance
Relevant aspects: Information Production process ESMS 1 Contact 2 Metadata update 3 Statistical presentation 4 Unit of measure 5 Reference period 6 Institutional mandate 7 Confidentiality 8 Release policy 9 Frecuency of dissemination 10 Dissemination format 11 Accessibility of documentation 12 Quality management 13 Relevance 14 Accuracy and raliability 15 Timelliness and punctuality 16 Comparability 17 Coherence 18 Cost and burden 19 Data revision 20 Statistical processing 21 Comments GSBPM
Relevant aspects: Normalisation ESMS Variables Concepts Units 1 Contact 2 Metadata update 3 Statistical presentation 4 Unit of measure 5 Reference period 6 Institutional mandate 7 Confidentiality 8 Release policy 9 Frecuency of dissemination 10 Dissemination format 11 Accessibility of documentation 12 Quality management 13 Relevance 14 Accuracy and raliability 15 Timelliness and punctuality 16 Comparability 17 Coherence 18 Cost and burden 19 Data revision 20 Statistical processing 21 Comments Process: Seasonal adjustment … …
Disseminating the ESMS
Has your NSI implement the ESMS?
Thank you!