1. Quality Assurance Plans of Turkey for 2021PHC
United Nations Regional Workshop on the World Programme on Population and Housing Censuses
Quality Assurance Plans of Turkey for 2021PHC
Tbilisi, Georgia
24-27 April 2018
Sebnem BESE CANPOLAT
TurkStat

2. Contents Introduction to 2011 PHC Quality assurance in 2011 PHC
2021 PHC: Registers based census
Quality assurance plans for 2021 PHC
Some examples of Turkstat quality assurance framework

3. Introduction to 2011 PHC
After a history of 14 traditional censuses, Turkey decided to carry out the round census as a register assisted sampling survey (combined method).
2010 Census round, we used two type of questionnaires and data collection methodologies :
Short Form Questionnaire for Complete enumeration
Long Form Questionnaire for Sampling method
2011 Population and Housing Census (PHC);Turkey ;
All variable related with the Short Form Questionnaire were obtained from the Population Register (PR) (the population size and to derive basic characteristics of population such as age, sex, household size.).
All variable related with Long Form Questionnaire were obtained from the field by using the one stage cluster sampling method with 12% sampling rate.
Population in the institutional places was covered by complete enumeration .

4. Registers Used in the 2011 PHC
In 2011 PHC, the registers were used for two main purposes:
Adress Register(AR) and Population Register(PR) were used as a sampling frame
Following register were used for missing data imputation
Population Register
National Education Statistics Database
Social Security Records
Unemployment Agency Records
Building Permits

5. Quality Assurance in 2011 PHC
In 2011 PHC, like all other surveys of TurkStat, all dimensions of quality that recommended by UNECE were taken into consideration:
Relevance: In order to meet the needs of users, we had following tools in last census :
Official Statistics Programme,
Statistical Council of Turkey,
Steering Committee and working groups of 2011 PHC.

6. Quality Assurance in 2011 PHC (continue)
Accuracy was described in terms of some major sources of errors such as :
Over coverage was calculated
Reasons of non-response and the non-response rate were calculated
Item non-response: Imputed with admin data.
Variance and confidence interval were calculated
Above mentioned all items were calculated for only sampling part of the census
These results were shared with quality report of the census via our web page.

7. Quality Assurance in 2021 PHC
Primary issue:
ACCURACY!

8. Next Census (2021 PHC) Target: Register-based census
Main registers to be used by domain
Population:
Population Register
Address:
Address Register
Education:
National Education Statistics Database,
Registers of MoE and Higher Education Council
Employment and Unemployment:
Registers of Social Security Institution,
Turkish Unemployment Agency,
Building and Dwelling: Recent challange! New registration system requirement ….

9. Supplementary registers:
Next Census (2021 PHC)
Supplementary registers:
Records of foreigners (including refugees and asylum seekers),
Turkish citizens living abroad,
Tax,
Reason for mortality,
Social assistance,
Title deeds,
Insurance and
Other related subscription records

10. Quality Assurance in 2021 PHC
Quality assessments will be done in 3 steps :
In the first step, TurkStat will receive the raw data from all related registers and the following control will be done for each administrative register :
Control of Data Source (administrative register)
Content control ; to identify availability of the main characteristics
Target population control; to identify the register coverage
Up-to-dateness, updating periods and mechanisms/procedures
Definitions of variables (comparability)
Inclusion of unique ID (integrability)
Availability of data history
Metadata control; to clarify the above mentioned items
Missing data control; to get the idea about the data accuracy

11. Quality Assurance in 2021 PHC
Quality assessments will be done in 3 steps (continued):
In the second step, TurkStat will combine these different registrations by using the unique key IDs. At this stage, necessary imputation and accuracy control will be done. Following items will be checked :
Over coverage (Checks for ineligible records, duplications etc. i.e. to determine and remove a deceased person still alive in records by using death certificate records)
Under coverage (possibility to not cover newborns)
Plausibility (logical checks)
Missing values etc.
Then the supplementary registers will be checked and their coverage errors will be corrected.

12. Quality Assurance in 2021 PHC
Some actions to eliminate over coverage problems :
Foreigners: Check the PR with the residence permit records
Deaths: Check the PR with the causes of death records of Ministry of Health
All deaths that occurred in Turkey and their death certificates are filled out by physicians are covered, whether their residences are in Turkey or not.
To check the PR with the records of students who went abroad for education, held by Higher Education Council
To check the PR with the records of Ministry of Labour and Social Security for the people who went abroad to work

13. Quality Assurance in 2021 PHC
Some legal obligations and measures to eliminate possible under coverage problems :
According to the Turkish Health Care System (reform after 2007), anyone who wants to get health care should be registered to the PR.
For school enrollment, it is required to be registered in the PR.
Elections are conducted based on PR. No right to vote without registration to the PR.
For any official social assistance (government, municipalities), registration to the PR is a must.
For subscription to any municipal service (tap water, natural gas, electricity etc.), persons need to be registered in PR.

14. Quality Assurance in 2021 PHC
Some legal obligations and measures to eliminate possible under coverage problems (cont.) :
To make any bank transaction or similar operation, there is a requirement to be registered in PR. The registered addresses of the individuals in the PR are based on official notices such like court decisions, official calls etc.
Late registration of newborns is decreasing in Turkey. 98% of the childbearing are attended by official health personnel . There is a new improvement in the system, health personnel will began to register the newborn baby to the PR and give an ID in 2018.

15. Quality Assurance in 2021 PHC
Quality assessments will be done in 3 steps (continued):
In the third step, we’ll combine the LFS data with related registers by using some statistical methodologies in order to produce estimations of labour force statistics.
Then all these data will be combined in a single database on an ID basis.
Cross checks will be done at this stage and the previous steps will be rechecked for each improper condition.
A quality-focused controls will be taken as a base at every stage, so it is predicted that the basic quality components will be provided finally in the third stage for next census.

16. TURKSTAT QUALITY ASSURANCE FRAMEWORK
Some Examples …

17. TurkStat Quality Assurance in General
Relevance
According to Turkish Statistical Law, Official Statistics Programme (OSP) is prepared by asking the opinions of the related organizations in line with the comments of the Statistical Council.
for a 5-year-period in order to determine the basic principles and standards dealing with the production and dissemination of official statistics and to produce reliable, timely, transparent and impartial data required at national and international level.
The third phase OSP ( term) is focusing on using admin data for producing statistics and prepared by broad participation as mentioned above.

18. There are 314 subjects
Subject
Responsible institution
Data collection frequency
Dissemination frequency
Dissemination period
Data collection methodology
What type of classification used
Estimation level

19. TurkStat Quality Assurance in General
Relevance
TurkStat applies «user satisfaction survey» continuously via its web site.
In the questionnaire, satisfaction of the users related to different aspects of statistical products, as well as their opinions and comments are compiled. TurkStat evaluates these information and takes them into account.

20. Quality Assurance in General
Accuracy, Interpretability and Coherence
TurkStat prepares «metadata» and «quality reports» for all survey and register based statistics, and publish them in its web site.
These reports include information about the survey and quality indicators such like coherence of the definitions and classifications, coverage, non-response rates, and also standard error, confidence intervals and CV values for the variables.

21. Quality Assurance in General
Accuracy
Quality check activities via Computer Assisted Telephone Interviewing (CATI)
The process of quality check operations of field surveys via CATI is simply based on the control of whether the data collected from field by field interviewer are the same with the data collected via check operations on the phone by operator for the same reference respondent and time.
Main purpose of quality control is to monitor, to measure and to raise the quality level of field interviewers by using CATI technology. These operations contribute to both supporting to produce higher quality data and presenting more reliable information to users.

22. Quality Assurance in General
TurkStat has a revision policy that direcly relevant with the transparency policies and clearness in accordance with Code of Practice .
Any revision are made according to the related directive and «revision information form» is published with the statistics which is a part of metadata at the same time.

23. Quality Assurance in General
Timeliness, Punctuality and Accessibility
National Data Release Calendar indicates the period, publication date, time and responsible institution of each statistics. Thus decision makers and users are informed about official statistics timely.

24. Quality Assurance in General
Timeliness and Punctuality
Time sheduling of each step of survey and data producing administrative sources; defines all steps of production process of each statistics. It includes planned dates and responsible departments.
Defining all steps, their durations and responsible units causes the increase in the quality of the data due to dicipline the production process, decrease in burden on the interviwer and preventing the overlap in the field..
Accessibility
TurkStat provides the users most of the statistics via web site. In addition to this, users can apply to take microdata of the surveys for their research.

25. Thank you...