1. Roma Settlements: Multiple Indicator Cluster Surveys (MICS)
Teuta Halimi, UNICEF Regional Office
TransMonEE Meeting
October 24/25, Athens

2. WHAT IS MICS?
Household survey program that provides statistically sound and internationally comparable data, essential for developing evidence-based policies and programmes, and for monitoring programs toward the national goals and global commitments.
Since the inception of MICS in the 1990s, over 300 surveys have been carried out in more than 100 countries. As part of the global effort to further develop national capacities to generate and analyse high quality and disaggregated data, UNICEF launched the sixth round of MICS in October 2016 – specifically designed to meet policy-makers’ needs in the Sustainable Development Goal (SDG) era.
Over the last 20 years, MICS has progressively improved its ability to highlight inequalities and identify the most vulnerable. The results have been critical in monitoring the national goals and global commitments.
MICS is conducted by National Statistical Institutes (NSI). With the technical support provided by UNICEF, countries, themselves, collect, analyse and disseminate data.
Each MICS survey is a snapshot in time. When combined they produce a clear picture of how people’s lives changed over time.
Particularly with relevant, disaggregate and robust data on child focused indicators, MICS data are open and transparent, for greater access and greater accountability.

3. Approximately 50 per cent of the European Roma population
WHO ARE THE ROMA?
Roma is a term which encompasses diverse groups including Roma, Gypsies, Travellers, Manouches, Ashkali, Sinti and Boyash.
The Roma population constitutes one of the largest ethnic minorities in Europe, estimated at 10–12 million.
Approximately 50 per cent of the European Roma population
are estimated to be under 18 years of age - significantly younger than that of Europe overall.
The Roma population is spread throughout Europe, but is highly concentrated in Central and Eastern Europe.

4. WHY A ROMA MICS?
To track progress on Roma inclusion as a global and European commitment.
As Roma are a small proportion of the total population and the majority live in identifiable communities/settlements, specific surveys rather than over-sampling is the preferred approach.
To better monitor equity and inclusion for ethnic minorities, separate MICS surveys are conducted in the Roma Settlements in parallel to the country-wide surveys.
The MICS surveys implemented proved to be sensitive enough to measure disparities and bring a wealth of data about groups that are hard to reach and have remained to be the only source that reveal the situation of Roma children and families in the country.
After seeing the results, it is easy to understand why there was such a need to conduct a separate MICS just for the Roma settlements. In all the countries where a Roma Settlements MICS was conducted, Roma people underperformed in almost all indicators. The gap between them and the national average would not be explained if there was no two separate surveys.

5. ROMA SETTLEMENT SURVEYS 2018-2020
Montenegro
Serbia
The former Yugoslav Republic of Macedonia
Bosnia and Herzegovina
Kosovo (UNSCR 1244)
All countries that have conducted MICS in Roma Settlements previously (MICS4 and/or MICS5) are planning to conduct MICS in Roma Settlements in 2018.

6. Areas with greater concentration of Roma population
SAMPLE DESIGN
Areas with greater concentration of Roma population
Census frames are used to identify the cluster with Roma concentration
Uses a stratified, two-stage selection approach for the selection of the Roma survey sample
Roma Settlements MICS surveys are conducted in the areas with greater concentration of the Roma population. The census frames are used to identify the cluster with Roma concentration. A minimum number of Roma household specific to each country is defined as a threshold for the selection of the enumeration area.
A clear definition of who is exactly considered ‘A Roma Household’ was necessary – essentially, a Roma Household was defined as a household with at least one Roma person.
MICS uses a stratified, two-stage selection approach for the selection of the Roma survey sample.
1st stage – the sample selection of EAs from the frame of EAs with the minimum defined number of Roma HHs per country
2nd stage – following the new listing of the selected EAs a random selection of the defined number of Roma households was selected for interview.
Introducing UNICEF

7. SAMPLE SIZE
Statistically reliable estimates allow for a number of disaggregations of outcomes for women and children, including but not limited to gender, wealth, education and urban/rural area.
The average sample size for MICS surveys in the region is 1,400 households.
While generating reliable estimates for Roma minority is the primary objective, other drivers of inequity may also be in play. Consistent with national MICS surveys, MICS Roma Settlements surveys seek to explore differences in outcomes for children related to gender, wealth, urban/rural residence, etc.
The average sample size for MICS Roma Settlements Survey is 1,400 households.
n = the required sample size (number of households)
4 = a factor to achieve the 95 percent level of confidence
r = the predicted or estimated value of the indicator for the target population
deff = design effect
RME = the relative margin of error to be tolerated at the 95% level of confidence;
currently, the target for the RME is generally 12%, so the margin of error e is
equal to 0.12r
pb = the proportion of the target subpopulation in total population (upon which the
indicator, r, is based)
AveSize = average household size (that is, average number of persons per
household)
RR = expected response rate (or ideally the completion rate)
Introducing UNICEF

8. HOUSEHOLD LISTING Update the selected EAs from the sampling frame
Update the maps
Collect data: name of head of the household; address and identify households with Roma
A household listing activity is undertaken to update the selected enumeration areas with Roma concentration from the census frame and maps. Detailed information are collected by the enumerators during the household listing activities including and not limited to, name of the head of household, exact address, number of children under the age of 5 years etc.
Oversampling of children under 5 years, as necessary.
Introducing UNICEF

9. QUESTIONNAIRES Same questionnaires for national and Roma surveys
Enables for comparison with the national estimates
Allows for a systematic, rigorous analysis of equity gaps.
The same MICS questionnaires used for the MICS with general population are used for MICS surveys in Roma Settlements. Four sets of MICS questionnaires adapted to the country needs have been used for MICS surveys in Roma settlements for MICS4 and MICS5.
A household which was used to collect information on all de jure household members
A women’s questionnaire carried out in each household on all women age years
A men’s questionnaire carried out on all men age years in half of the selected sample
An under 5s’ questionnaire, carried out on mothers and caretakers of all children under 5 living in the household.
Additional questionnaires will be used for MICS6 which include:
Questionnaire for children age 5-17 years
Water quality testing
The questionnaire for GPS data collection
Introducing UNICEF

10. FIELDWORK Extensive training of the fieldwork staff
Data collection in parallel with the national MICS
Data collection through “computer assisted personal interviewing” (CAPI)
Involvement of interviewers from Roma communities
Roma MICS and MICS survey with the general population are implemented in parallel following the same methodology. In addition to the pre-test and pilot, extensive training of fieldwork staff is provided before the actual data collection process starts. The data collection is undertaken in parallel and recruitment and involvement of fieldwork staff coming from the Roma population is seen as a good practice to easy access Roma population, hinder the language barriers in some cases etc. 0125
Introducing UNICEF

11. SOME KEY FINDINGS FROM THE LAST ROUND
OF ROMA SURVEYS
The Roma population constitutes one of the largest ethnic minorities in Europe, estimated at 10–12 million. The population is spread throughout Europe, but is highly concentrated in Central and Eastern Europe. Approximately 50 per cent of the European Roma population are estimated to be under 18 years of age, and based on available evidence,17 the population is significantly younger than that of Europe overall.
To better monitor equity and inclusion for ethnic minorities, separate MICS surveys are conducted in the Roma Settlements in parallel to the country-wide surveys.
The MICS surveys implemented proved to be sensitive enough to measure disparities and bring a wealth of data about groups that are hard to reach and have remained to be the only source that reveal the situation of Roma children and families in the country.

12. Former Yugoslav Republic of Macedonia

13. Former Yugoslav Republic of Macedonia
Full immunisation coverage among children living in Roma settlement is notably lower compared to the national average among all countries who have conducted a MICS in Roma settlements.
In all five countries, portion of Roma children who are fully vaccinated is significantly less than of the national average. In Bosnia and Herzegovina, only 4.3% of the Roma children are fully vaccinated, while 68% is nationally. Similarly in Serbia, the portion for Roma settlements remains at 12.7% whilst the national is 70.5%.

14. Former Yugoslav Republic of Macedonia

15. The arrows represent the differences from the national figures.
Differences: immunization MMR and DTP3, Improved sanitation facility

16. MICS IN ROMA SETTLEMENTS: A COMPARATIVE REVIEW
A regional comparative review and further analysis of findings from MICS surveys in Roma settlements in the three countries (Bosna and Herzegovina, the former Yugoslav Republic of Macedonia and Serbia)
MICS provides statistically sound and internationally comparable estimates for a number of indicator. To better understand the situation of Roma children and women and how they fair in comparison to the national averages (non-Roma children and women), UNICEF Regional Office for CEE/CIS has undertaken a study using the MICS data from three countries, namely, Bosnia and Herzegovina, the former Yugoslav Republic of Macedonia, and Serbia. The study filled a major gap in available research and disaggregated data on Roma children, young people and women.
UNICEF – for every child

17. Conclusion: Despite the progress made, in countries for which data is available, ethnic minorities such as Roma children remain marginalized with less access to services.
Collecting representative data on ethnic minorities and monitoring inclusion remains a policy priority.
Introducing UNICEF