1. How to measure governance: Principles, frameworks, data collection techniques and challenges for Iraq Shipra Narang Suri International Consultant, OGC Stakeholders’ Consultative Workshop Amman 6-8 July 2010

2. Principles and frameworks for governance assessments

3. The concept of Governance: What are we talking about? Focuses on the relationships between the State, civil society and private sector Focuses on the relationships between the State, civil society and private sector Key aspects: Key aspects: Governance is not government, a crucial distinction between the two being the notion of civil societyGovernance is not government, a crucial distinction between the two being the notion of civil society Governance emphasises the processes of decision-making, as much as, or even more than, the decisions themselves or their outcomesGovernance emphasises the processes of decision-making, as much as, or even more than, the decisions themselves or their outcomes

4. UNDP definition of Governance Governance is the system of values, policies and institutions by which a society manages its economic political and social affairs through interactions within and among the state, civil society and private sector. - UNDP Strategy Note on Governance for Human Development, 2000

5. The normative debate: What characterises “good” or “democratic” governance? Participation Participation Representation Representation Rule of law Rule of law Transparency and accountability Transparency and accountability Effectiveness and efficiency Effectiveness and efficiency Responsiveness Responsiveness Equity…. Equity….

6. Some global governance assessment frameworks UNDP/IDEA: Framework of Democratic Governance UN-HABITAT: Urban Governance Index Transparency International: National Integrity System (NIS) World Bank: Governance Matters index ODI: World Governance Assessment

7. Some regional examples… [1] Some regional examples… [1] State of Local Democracy (SoLD) in the Arab World Based on International IDEA’s State of Democracy Approach Implemented in 4 countries - Egypt, Jordan, Morocco and Yemen Themes - Representative democracy (electoral processes, political institutions), Participatory democracy (participatory processes, civil society)

8. Some regional examples… [2] Some regional examples… [2] Palestinian Governance Survey Main themes – Rule of law; Public sector employment; Elections; Performance of the parliament; Performance of the government; CSO performance; Access to information; Political parties; Women rights; Education, Health, Labour and Housing Data collection – Household questionnaire Sample – 2544 households Users – Government, parliament, CSOs, international agencies

9. Some regional examples… [3] Some regional examples… [3] Arab Democracy Index Conducted twice in ten Arab countries, latest results 2010 Conducted twice in ten Arab countries, latest results 2010 The study measures forty indicators to gauge four major values and principles: The study measures forty indicators to gauge four major values and principles: strong and accountable public institutionsstrong and accountable public institutions respect for rights and freedomsrespect for rights and freedoms the rule of lawthe rule of law equality and social justiceequality and social justice Data gathered for the Arab Democracy Index cover three different dimensions: Data gathered for the Arab Democracy Index cover three different dimensions: the legal aspectthe legal aspect public opinionpublic opinion practices of regimespractices of regimes Data sources include administrative data and sample population survey Data sources include administrative data and sample population survey

10. Data collection techniques

11. Data collection strategies for governance indicators Mix of qualitative and quantitative, de facto and de jure data Mix of qualitative and quantitative, de facto and de jure data A variety of approaches: A variety of approaches: Comprehensive governance assessment approaches based on multiple stakeholder perspectivesComprehensive governance assessment approaches based on multiple stakeholder perspectives Governance assessments based on citizen (or single stakeholder) perspectivesGovernance assessments based on citizen (or single stakeholder) perspectives Self-assessments by government institutionsSelf-assessments by government institutions

12. Primary data collection Primary data Household/ Individual Surveys Face to face Mail Telephone Internet Focus Group Discussions Thematic Stakeholders Key informant interviews

13. Secondary/ published data collection Secondary data Governmental sources National ministries/ departments States Local governments Non- governmental sources International Organisations, Donors International NGOs Local NGOs Private sector

14. Advantages and constraints of primary data collection Advantages Direct stakeholder involvement Captures opinions, perceptions, experience Can help in mobilising stakeholders for actionConstraints Expensive Expensive Time-consuming Time-consuming Requires significant local capacity in survey design, sampling, execution and analysis Requires significant local capacity in survey design, sampling, execution and analysis

15. Advantages and constraints of secondary data collection Advantages Published data may be more easily available Cost-effective Can be collected in a limited time through desk studyConstraints Mostly de jure data Mostly de jure data May not reflect actual situation or multiple perspectives May not reflect actual situation or multiple perspectives Needs verification, triangulation for meaningful results Needs verification, triangulation for meaningful results

16. Some examples…Vietnam Public Administration Performance Index – Examined six different dimensions of public administration and public services Based on views of ordinary citizens as primary users of public administration services Other stakeholders such as private enterprises or civil servants excluded Civil society organizations also excluded Data obtained from a representative selection of ordinary citizens, rather than from household-heads, in an effort to know about the perception from across the population, including gender and age-differentiated groups.

17. Some examples… Uganda National Service Delivery Surveys (NSDS) – conducted (2001, 2004, 2008) Mainly collected information from a sample of 10,000 households Also included a module for service providers Supplemented by data on National Integrity Surveys (1998,2003, 2008) Key role for national statistical organisation

18. Some examples… Sri Lanka Urban Governance Index (UGI), conducted 2004-05 in six cities 25 indicators in 4 categories – equity, effectiveness, participation, accountability Information gathered mainly from published data Verified through consultative workshop with active participation of governmental and non-governmental stakeholders

19. Challenges in post-conflict environments Poor governance often the root of the conflict (finding the right entry points) Poor governance often the root of the conflict (finding the right entry points) Social fragmentation and lack of trust Social fragmentation and lack of trust Need for skilled facilitation and negotiation (finding the right partners) Need for skilled facilitation and negotiation (finding the right partners) Lack of political will and commitment (finding committed interlocutors) Lack of political will and commitment (finding committed interlocutors) Low interest and capacity within government or statistical agency Low interest and capacity within government or statistical agency Low interest and capacity within civil society Low interest and capacity within civil society

20. Challenges in post-conflict environments …[2] Limited availability of data and information Limited availability of data and information Limited financial resources for “soft” issues Limited financial resources for “soft” issues Indicator/assessment fatigue (especially those driven by external actors) Indicator/assessment fatigue (especially those driven by external actors) Issues of sustainability and replicability Issues of sustainability and replicability

21. Challenges in post-conflict environments …[3] Consulting the community…. Consulting the community…. What community?What community? Why engage the community?Why engage the community? Who represents the community?Who represents the community? Who NOT to consult?Who NOT to consult? How to consult? How to consult? How to we avoid legitimising particular ethnic/nationalistic/communal agendas? How to we avoid legitimising particular ethnic/nationalistic/communal agendas?

22. Thinking strategically in post- conflict situations Be selective, rather than comprehensive Be selective, rather than comprehensive Focus on priorities, spatial and sectoral Focus on priorities, spatial and sectoral Be flexible and responsive to changing needs Be flexible and responsive to changing needs Emphasise both process and product, be participatory and inclusive Emphasise both process and product, be participatory and inclusive Incorporate concerns of environmental sustainability, gender, poverty and exclusion, formal and informal sectors Incorporate concerns of environmental sustainability, gender, poverty and exclusion, formal and informal sectors

23. Thank you for your attention