1. Governance indicators for pro-poor and gender-sensitive policies The NHDRs as frameworks for analysis with a focus on vulnerable groups Andrey Ivanov Human Development Adviser, Bratislava RSC

2. Main issues in this presentation Measuring what? Measuring what? Measuring how? Measuring how? The role of quantitative data The role of quantitative data The case of NHDRs and RHDRs The case of NHDRs and RHDRs Links to vulnerability assessment Links to vulnerability assessment

3. Some terminological clarity Three distinct (but often confused) concepts: Three distinct (but often confused) concepts: Monitoring Monitoring Evaluation Evaluation Impact assessment Impact assessment All are building on data and indicators but of different sort and from different source

4. What do we mean by: Monitoring – primarily related to progress. Relatively easy if major components are clear and traceable with indicators imbedded in the design of the project Monitoring – primarily related to progress. Relatively easy if major components are clear and traceable with indicators imbedded in the design of the project Evaluation – primarily related to process but also outputs and outcomes. Feasible if these elements are replicable and provide grounds for comparability Evaluation – primarily related to process but also outputs and outcomes. Feasible if these elements are replicable and provide grounds for comparability Impact assessment – long-term changes in development situation. Difficult because of correlations and mutual influences Impact assessment – long-term changes in development situation. Difficult because of correlations and mutual influences

5. Measuring what? The quality of the process of policy making (inclusive and participatory)? The quality of the process of policy making (inclusive and participatory)? The quality of policies developed (reflecting the needs of vulnerable groups)? The quality of policies developed (reflecting the needs of vulnerable groups)? The outcomes (the direct result of policies implemented – how the status of the beneficiaries has changed)? The outcomes (the direct result of policies implemented – how the status of the beneficiaries has changed)? Policies impact (in a broader and long-term perspective) Policies impact (in a broader and long-term perspective)

6. Example: Employment generation projects Outputs: number of people with re- qualification course passed Outputs: number of people with re- qualification course passed Outcome: number of former unemployed who found jobs Outcome: number of former unemployed who found jobs Sustainability: duration of the job found after the project Sustainability: duration of the job found after the project Impact: HH incomes increased, poverty indicators improved Impact: HH incomes increased, poverty indicators improved Positive externalities: reduced drop-our tares, reduced societal fragmentation Positive externalities: reduced drop-our tares, reduced societal fragmentation

7. Employment generation – possible data sources Targeted small-sample surveys Targeted small-sample surveys Community level data collection (not sample- based) Community level data collection (not sample- based) Interviews the beneficiaries on the specific involvement and how did it influenced them Interviews the beneficiaries on the specific involvement and how did it influenced them Interviewing the other actors involved Interviewing the other actors involved Comparing the trends within the group with the overall trends Comparing the trends within the group with the overall trends At the end the data should allow building alternative scenarios to compare with and measure the efficiency of the specific project

8. NHDRs and governance Analytical documents Analytical documents Advocacy tool Advocacy tool Policy recommendations Policy recommendations –All these aspects are related to data on status, process and implementation –In the case of NHDRs focusing on governance – focus on “democratic governance”

9. HDI and governance indicators HD and HDI HD and HDI –HDI is a proxy –Reflects outcomes and not the quality of the process –Different role of national level and disaggregated HDIs The problem with correlated factors The problem with correlated factors Problem of international comparability Problem of international comparability

10. Regional HDRs and governance HIV/AIDS in Eastern Europe and CIS: Reversing the Epidemic. Facts and policy options Roma in CEE: Avoiding the dependency trap

11. Explicit focus on policies Explicit focus on policies Based on quantitative indicators Based on quantitative indicators Representative for a major vulnerable group in CEE Representative for a major vulnerable group in CEE Reflecting gender differences Reflecting gender differences

12. Examples Who is the head of the household? Who is the head of the household? Who is managing the money of the household? Who is managing the money of the household? Do you know the name of your mayor? Do you know the name of your mayor? Do you have an NGO you trust? Do you have an NGO you trust? Have you voted in the last elections? Have you voted in the last elections? All these may reflect individual participation (quality of the process) and to a limited extent – quality of policies

13. Next step: VGS survey First step: clearly define the issue First step: clearly define the issue Integrated household survey containing household and individual modules Integrated household survey containing household and individual modules “Status” data and not “attitudes” information “Status” data and not “attitudes” information Two separate questionnaires (status of the household and of each individual member) Two separate questionnaires (status of the household and of each individual member) Universe studied – households in areas with compact Roma population, adjacent majorities and IDPs/refugees where relevant Universe studied – households in areas with compact Roma population, adjacent majorities and IDPs/refugees where relevant Provides basis for comparisons to national averages Provides basis for comparisons to national averages

14. Levels of comparability Between different groups (Roma and majority living in close proximity to Roma; Roma and IDPs/refugees etc.) Between different groups (Roma and majority living in close proximity to Roma; Roma and IDPs/refugees etc.) Between Roma and status of the average population (reflected in HBS, LFS) Between Roma and status of the average population (reflected in HBS, LFS) Between Roma populations in different countries with similar socioeconomic conditions Between Roma populations in different countries with similar socioeconomic conditions

15. Clearly distinguish between Data and Indicators The survey provides data on the status (both of individuals and of the households). Example of data: levels of HH incomes or educational status or age of respondents The survey provides data on the status (both of individuals and of the households). Example of data: levels of HH incomes or educational status or age of respondents Based on the data indicators are computed using individual records (poverty rates based on income or expenditure data or enrollment rates based on educational status and age of respondents) Based on the data indicators are computed using individual records (poverty rates based on income or expenditure data or enrollment rates based on educational status and age of respondents)