1. Defining Criteria for Compliance Levels in SMIS+ Şennur ONUR Head of Foreign Relations Department Meeting of the Policy Group on Statistical Cooperation Sarajevo, October 2010

2. Content Purpose of the Presentation Reasons for Defining Criteria
Examples of Major Differences
Compliance Levels in SMIS+
Suggestions for Compliance Levels in SMIS+
Suggested Criteria for a Checklist
Discussion

3. Purpose of My Presentation
To avoid the differences between compliance levels made by countries responsible for SMIS+ and compliance evaluations made by Eurostat
To discuss the criteria for compliance levels in SMIS+

4. Reasons for Defining Criteria
To avoid subjective evaluations made by “country assessment providers”
To guide “country assessment providers” working on SMIS+
To avoid the differences between compliance levels made by countries and compliance evaluations of Eurostat

5. Examples of Major Differences for 2009 (1)
THEME / MODULE
Compliance Level (TurkStat)
Compliance Evaluation (Eurostat)
Theme Population
Highly compliant
Low compliant
Module Demography, Census and Projections
Module Income, Social Inclusion and Living Conditions
Fully compliant
Theme Distribution of Incomes and Living Conditions
Theme Agricultural Structures
Module Agricultural Structure

6. Examples of Major Differences for 2009 (2)
THEME / MODULE
Compliance Level (TurkStat)
Compliance Evaluation (Eurostat)
Theme Social Protection
Medium compliant
Highly compliant
Module Social Protection (ESSPPROS)
Module Management of the NUTS Classification
Fully compliant
Module Classifications for Trade in Goods Statistics

7. Compliance Levels in SMIS+
Fully Compliant
Highly Compliant
Medium Compliant
Low Compliant
Not at All Compliant

8. Suggestions for Compliance Levels in SMIS+
Fully compliant means that the requirements are fully observed with respect to all essential criteria.
Highly compliant means that there are only minor shortcomings, with a large majority of the requirements being fully met.
Medium compliant means that some substantive action has been taken and complies with some of the requirements.

9. Suggestions for Compliance Levels in SMIS+
Low compliant means that there are major shortcomings, with a large majority of the requirements not being met.
Not at all compliant means that requirements are definitely noncompliant with the criteria.
Not set means that modules/themes/datasets are not evaluated.

10. Suggested Criteria for a Checklist
Coverage of Variables and Sectors
Transmission of Complete Datasets to Eurostat through eDAMIS
Transmission of Qualitative Information (Metadata, etc.) together with Datasets
Periodicity, Timeliness and Punctuality
Classifications, Definitions and Methods

11. Suggested Criteria for a Checklist
Use of weighted percentages, for example:
Coverage of Variables and Sectors  % 30
Periodicity, Timeliness and Punctuality  % 20
Classifications, Definitions and Methods  % 10
Etc.
Determination of intervals regarding the compliance levels, for example:
% % 90  Fully compliant
% 90 - % 70  Highly compliant
% 70 - % 50  Medium compliant
% 50 - % 20  Low compliant
% 20 - %  Not at all compliant

12. Discussion May we determine objective criteria for compliance levels?
May we determine a “checklist”?

13. Thank you...