1. MICS Survey Design Workshop Multiple Indicator Cluster Surveys Survey Design Workshop Interpreting Field Check Tables

2. Introduction MICS surveys are tools to collect high-quality data on a range of globally agreed-upon indicators and national priorities MICS surveys typically use various systematic checks before, during and after survey implementation to ensure that data quality is high

3. Introduction Simultaneous data entry should begin about 1 week after fieldwork begins Simultaneous data entry provides a suitable platform for –Data quality checks during field work –Providing recommendations to field staff during implementing phase to improve fieldwork

4. Introduction Set of tables covering: –Completion and Response rates –Age reporting –Birth date reporting –Question responses –Quantity of observations – vaccination cards, birth registration cards, height & weight –Completeness of responses – age of death

5. Introduction Tables provide totals for each indicator and disaggregate information by the field team This information allows field supervisors to identify which specific teams have implementation issues and where these issues are most common

6. Introduction Field Check Tables are generated by standard MICS programmes Produced every 1-2 weeks by data processing staff Revised by the survey coordinator from the implementation agency in collaboration with UNICEF Suitable recommendations can then be made to field staff for immediate implementation

7. FC-1: Household response rate This is the first indication of how well teams are able to successfully locate, identify and complete household interviews Expected to be from 90 to 95 per cent Below 90 per cent require immediate action to increase rates

8. Reading Field Check Tables FC-1: Household response rate Team Result of household interview TOTALN Househol d response rate (%)* Completed No household member or no competent respondent at home at time of visit Entire household absent for extended period of timeRefused Dwelling vacant / Address not a dwelling Dwelling destroye d Dwelling not foundOther (1)(2)(3)(4)(5)(6)(7)(96) Total 90.90.72.93.61.20.1 0.5100.012,43395.4 Team 1 88.20.73.35.61.10.20.10.8100.02,48893.2 Team 2 93.60.22.71.90.90.0 0.6100.02,49797.7 Team 3 90.50.84.02.61.50.10.00.5100.02,49596.4 Team 4 95.20.41.21.70.70.20.00.5100.02,46197.8 Team 5 86.91.43.06.31.70.2 0.3100.02,49291.7

9. FC-1: Household response rate In this example, the household response rate is high (95.4 per cent) Teams 2, 3 and 4 all have response rates higher than 95 per cent (see last column) Teams 1 and 5 have rates that are below this and would need to have specific attention from the survey coordinator to improve the quality of their performance

10. FC-2C: Eligible children under 5 per household Based on information from other sources (national census and other surveys), MICS survey coordinators are able to predict: –how many women, children and men there are in the households interviewed –determine if field teams are adequately capturing this population during field work

11. FC-2C: Eligible children under 5 per household FC-2W, FC-2C and FC-2M examine the mean number of eligible women, children and men that is expected in a household As household size varies by place of residence of respondents, figures in these tables are disaggregated by urban/rural

12. FC-2C: Eligible children under 5 per household The target is the minimum mean number of eligible children under 5 years of age per HH that we hope to find It should be > 80% of what was expected at the time of sample design Thus, if we expected to find 1.2 children under 5 years of age per HH at the time of sample design, teams should be finding a minimum of 0.96 children under 5 years of age per HH

13. Reading Field Check Tables FC-2C: Eligible children under 5 per household Team UrbanRural Number of completed households Number of eligible children in those HHs Mean number of eligible children per HH Target not met Number of completed households Number of eligible children in those HHs Mean number of eligible children per HH Target not met Total7,3222,7800.38 3,9771,6140.41 Team 11,5685320.34 6272290.37- Team 21,1594820.42-1,1795140.44 Team 31,1974500.38 1,0604180.39- Team 41,9757530.38 3691480.40 Team 51,4235630.40-7423050.41

14. FC-2C: Eligible children under 5 per household Only two teams were able to meet the target (for both urban and rural areas) The supervisors and editors should revise the household questionnaires for teams that didn’t meet the target to ensure that the ages of children are correctly recorded and calculated by the interviewers

15. FC-4W: Age displacement: women Age displacement is an especially critical issue as the eligibility for interview in MICS is age- dependent Ages may be displaced to make an eligible respondent older or younger which may affect the eligibility of the respondent

16. FC-4W: Age displacement: women FC-4W, FC-4C, and FC-4M show the ages of women, children and men by team Survey coordinators should examine the overall smoothness of the ages of women, children and men in these tables and the ratio of ages specified in the tables

17. Reading Field Check Tables FC-4W: Age displacement: women Team Women's age (12 - 18 years) TOTAL Age ratio (women 15/ women 14) Target not met 12131415161718 Total150155 1201401121199510.77 Team 1233337241624211780.65 Team 2423330395136 2671.30- Team 3373032213222161900.66 Team 4192425153019201520.60 Team 52935312111 261640.68

18. FC-4W: Age displacement: women The totals do not appear to be smooth From age 14 to age 15 there is a steep decline in the number of women interviewed, producing a ratio of 0.77 This indicates that many women were displaced from age 15 to age 14

19. FC-4W: Age displacement: women In cases where the age displacement ratios are lower than 0.8, field supervisors and editors should review questionnaires first to ensure that age calculations are correctly made In cases where specific teams have excess age displacement, supervisors may decide to observe interviews while they are in progress

20. FC-7: Birth date reporting Completeness of birth reporting refers to the amount of data that an interviewer is able to get from a respondent regarding age Age is composed of the year of birth, month of birth and age of the respondent, according to the respondent Role of the interviewer is to gather a complete set of information on age i.e. year of birth and month of birth

21. FC-7: Birth date reporting Team Completeness of reporting TOTALN Target not met Year and month of birth Year of birth and age Year of birth onlyAge only Other/No data (1)(2)(3)(4)(5) Total95.12.50.02.40.0100.04,37195.1 Team 183.28.10.08.70.0100.074983.2 Team 2100.00.0 100.0991- Team 3100.00.0 100.0866- Team 490.05.20.04.80.0100.089890.0 Team 5100.00.0 100.0867-

22. FC-7: Birth date reporting In the case of teams 1 and 4, there were many respondents who only provided year of birth only (column 3) or year of birth and age (column 2) For these teams, it is recommended that interviewers probe respondents more to determine the missing information before further proceeding with the interview

23. FC-8: Question responses by team For many questions in MICS, there is already an expected level of certain indicators From past recent surveys, we may already know, for example, the percentage of women who are currently pregnant or who have had a live birth in the previous two years Tables FC8 verify that levels of selected indicators in the MICS are similar to expected levels

24. FC-8: Question responses by team These tables also show the variation in the levels of these indicators by team Overall, the variation in levels should be small When different teams show widely differing levels on the survey coordinators and field supervisors should also review these tables to ensure that teams show a deviation in the overall pattern of responses

25. FC-8: Question responses by team Team Completeness of reporting Mean number of "Yes" to child discipline Number of children age 1-14 with a completed child discipline module Percentage of women with a live birth in the last 2 years Percentage of women currently pregnant Number of women age 15-49 (1)(2)(3) Total1.34153.32.47992 Team 11.3873.72.81453 Team 21.4753.82.81915 Team 31.5483.42.31539 Team 41.11023.02.11691 Team 51.41032.61.81394

26. FC-8: Question responses by team Table shows that 3.3 per cent of women had live birth in the last two years We may know from a previous MICS survey that this level was 5.6 per cent One possible interpretation of this finding is that interviewers may record some women as “no live birth in the last two years which effectively reduces the workload of interviewers Field supervisors should look out for unusual levels of these indicators and verify that results are accurate with revisits to households if necessary

27. FC-9: Birth registration This table shows the proportion of birth certificates seen by interviewers for children under five As a measure of data quality, interviewers ask to see the birth certificates (or equivalents in the country) of children under five to ensure that these documents exist In MICS, at least 90 per cent of birth certificates should be seen

28. FC-9: Birth registration Team Percent of children reported to have a birth certificate Percent of children whose birth certificate was seen by interviewer Percent of children whose birth was registered but does not have a birth certificate Percent of all births with a birth certificate or registered Number of children Proportion of birth certificates seen (%) Target not met (1)(2)(3)(4)(5)(6)=(2)/(1) Total99.647.30.399.94,37147.5 Team 199.745.80.3100.074945.9 Team 299.660.00.4100.099160.3 Team 399.336.10.599.886636.4 Team 499.454.70.499.989855.0 Team 599.937.40.099.986737.4

29. FC-9: Birth registration Overall, no team surpassed the 90 per cent requirement Supervisors should observe if interviewers request to see the birth certificates from mothers/caretakers at the beginning of the interview Supervisors should ensure that interviewers probe respondents for the birth certificates and explain why it is important to see them

30. FC-9: Birth registration Interviewers should note that birth registration may carry a legal burden in some countries and may be a sensitive issue Therefore, interviewers should re-affirm to respondents that the information that the respondent gives is confidential

31. Thank you