1. An overview of what seems to work and what to do from now to final evaluation Fletcher Tembo, Mwananchi Programme Director 10 th May, 2012, Lusaka, Zambia

2. Order of Presentation Definitions – important ones Mwananchi by design 11 Issues/ characteristics of Mwananchi results Tools we have developed Next steps (2012/13) 2

3. Defining governance Governance refers to the formation and stewardship of the formal and informal rules that regulate the public realm, the arena in which state as well as economic and societal actors interact to make decisions.” Hyden, G. et al 2007) Emphasis on ‘rules of the game’ 3

4. Some definitions (b) Institutions : rules of the game which “structure incentives in human exchange, whether political, social, or economic” (North, 1990, p.3). Incentives : “rewards and punishments that individuals perceive to be related to their actions and those of others” (Gibson et al, 2005, p. 8) 4

5. GTF Background Open call for proposals for organisations to work on the selected issues in each country Maximum of ten projects for each country in order to enable deeper action learning and plan to scale-up through Three funding phases for the same organisations – with different learning emphases Phase 1 (2009/10): Building consensus on the broad theory of change and issues, designing funding/ capacity development mechanisms/ looking at innovations Phase 2 (2010/11): Identifying game changers (interlocutors) and learning to connect – building coalitions Phase 3 (2012/13): Exploring supply vs demand side intervention links (examining quality of citizen engagement and state responses) 5

6. Mwananchi Theory of Change (in part) Governments in 6 African countries are more responsive and accountable to citizens Enhanced institutional role clarity and play by interlocutors Synergetic actions among interlocutors – drawing on comparative advantages Enhanced effectiveness in policy influence through use of research-based evidence Increased ability of game changers (civil society, media and elected representatives) to enable citizens to effectively express their views and hold governments to account 6

7. Characterising results and how they come about Some lessons from projects implemented across the Six Mwananchi countries 7

8. 1. Context matters Multi-party democracy – politics based more on informal than formal rules Culture – role of women and youths Demographic shifts – increasing youth engagement Globalisation and the ‘iphone’/ ‘G’ networking 8

9. 2. Theories of change The question ‘how did we get here?’ informs many more of the answers to the question ‘how do we get from here to there?’ 9

10. Basic Needs Ghana as an example 10 2002 BN is established 2004 20062008 2010 2011 2012 1983 1996 1 st Mental Health Policy 2 nd mental health policy Draft Mental Health Bill 1 st Reading MPs visit to UK 2 nd Reading Bill passed though yet to be signed by President Photo Book Published Funding + CB support from Mwananchi Ghana Chief Psychiatrist SNP government includes in manifesto

11. 3. Interlocutors of CV &A change What can change rules of the game in this context?’ and, by implication, ‘who is a game changer on this issue?’ 11

12. Working with various interlocutors Media Traditional authorities Civil society Elected representatives – (MPs) – Councillors But these are not the only ones: - 12

13. 4. From interlocutors to interlocution What interlocutors do in a particular governance dynamic is more important than the label that they are associated with The interlocution process is complex Our analysis needs to follow this complexity around different issues and contexts 13

14. 5. Local politics matters Embedding politics back into the socio-cultural roots of societies 14

15. 15

16. 16

17. 17

18. A woman of Luwero district humbly question the duty bearers kneeling in a culturally accepted manner

19. 6. Dealing with hanging policies Dealing with hanging, over- generalised or otherwise ambiguous policy frameworks that often create room for corruption 19

20. 7. Marginality and voice We need to unpack ‘marginality and voice’ 20

21. Engaging school children in Masindi, Uganda 21

22. 8. Creating dialogue mechanisms Creating mechanisms where dialogue can take place – generating new relationships, partnerships for change, new rules that work Wherefore the formal local governance institutions? 22

23. 9. Role of Research-based Evidence Evidence creates a basis for negotiation – moving away from personalising/ over politicising engagement However evidence uptake is also linked to -Politics of debates (Emma’s work) -Credibility of organisations – how do we build it? -Research skills – which can take care of threats to validity (e.g. through triangulation) -Communication skills -Etc – to be revealed further through governance experts work 23

24. 10. Capacity building It seems training as capacity building plays a role but what works much more are the mentoring/ ‘accompainment’ methods The greatest capacity is in learning to network with others that have capacities in areas where we do not have 24

25. 11. A lot of work has gone into relationship building A lot of good work is around relationship building and creating opportunities for engagement – less so higher up the results chain This might be a good thing –depending on how one looks at it 25

26. Voice and Accountability Results 26

27. Narrative SummaryVerifiable Indicators 2 BASELINE 2009/10 MILESTONE 2011 MILESTONE 2012 TARGET 2013/14 Assumptions PURPOSE Increased ability of civil society, media and elected representatives to enable citizens to effectively express their views and hold governments to account for their actions 1) # of CSOs, media, elected reps and traditional leaders take citizens views into account e.g. Data collection/ regular hearings/ surgeries etc 8 out of 12 cases reflect evidence of citizen views being taken effectively into account A minimum of 60 case studies in all countries A minimum of 90 for all the countries A minimum sum of 120 case studies in all countries i) Constitutiona l and legal provisions promote citizen rights to be respected and voices of the poor to be heard on governance issues Source(s) of verificationCollected when and by whom Pilot grantee reportsMwananchi Country Coordinator: Quarterly, biannually and annually NCO reports 2) # of pro-poor policies/ documents that are formed and implemented based on evidence from CSOs, media and elected reps On average 3 policies per organisation per year in each country At least 5 policy documents per organisation per year At least 8 policy documents per local organisation per year At least 10 policy documents per organisation per year Source(s) of verificationCollected when and by whom Government documents and reports Mwananchi Country Coordinaotr: Quarterly, biannually and annually 3) Evidence of CSOs, media, elected reps and traditional leaders' engagement with state actors, some resulting in improved government actions (e.g. change in public officials' behaviour or better public services) NilEvidence of increase in effective engagement strategies, and of state actor behavioural change for each of the grantee organisations ii) Prevailing formal and informal rules of engagement continue to promote space for civil society, media and elected rep engagement for government actors Source(s) of verificationCollected when and by whom Grantees Outcome Mapping reports, and most significant change stories Mwananchi Country Coordinator: Quarterly and annually 27

28. Tools that we have generated Outcome Mapping LFA + OM + PEA 28

29. Status of Outcome Mapping “Outcome Mapping focuses on one type of result: outcomes as behavioural change. Outcomes are defined as changes in behaviour, relationships, or actions of the people, groups and organisations with whom a program works directly” Earl et al, 2001) OM Manual. All country programmes are using OM in various forms, and emerge with results in their quarterly reports Rating and consolidation of results still a challenge Consultants (Kevin and Donna) are helping with this but delayed 29

30. Political Economy Analysis (PEA) “Political economy analysis is concerned with the interaction of political and economic processes in a society: the distribution of power and wealth between different groups and individuals, and the processes that create, sustain and transform these relationships over time” DFID (2009, p.5) 30

31. PEA is concerned with... The interests and incentives facing different groups in society (and particularly political elites), and how these generate particular policy outcomes that may encourage or hinder development. The role that formal institutions (e.g. rule of law, elections) and informal social, political and cultural norms play in shaping human interaction and political and economic competition. The impact of values and ideas, including political ideologies, religion and cultural beliefs, on political behaviour and public policy. DFID, 2009, p.5 31

32. Log Frame + OM + PEA 32

33. Research within action research: Governance Experts work CSOsMediaTAsMPs A What kinds/ nature/ types of Citizen Voice & Accountability (CV & A) results do these interlocutors (each looked at separately and then alongside others) achieve? B What exactly seems to be happening for these interlocutors to achieve or be associated with these results (what do they tend to do, how do they tend to do it)? C What are some of the specific and broader circumstances under which these results seem to be occurring? Are they completely coincidental or part of the wider impact of the results of interlocutor’s initiatives? D Out of the many strategies being used by the different interlocutors, which ones seem to be useful for sustaining positive changes and scaling them up? EHow effective are these interlocutors using research-based evidence to influence policy processes and engage citizens? Which specific aspects, types, forms and representations of research-based evidence seem to work well, under what circumstances? 33

34. Questions around marginality: governance experts work – How is marginality understood in this context (using the general categories of youths, women and people living with disability)? – How does marginality affect the expression of citizenship in these contexts (how do the marginalised try to make their way to the centre of decision making and resource access/ distribution, and how do those at the centre respond to these attempts by the marginalised)? – Are there specific strategies that interlocutors are using in order to change rules of the game towards empowered citizenship for the marginalised? Which interlocutors make this to happen and how do they do it? 34

35. Looking to the future: 2012-13 Consolidate on results – move up the chain to purpose/ impact levels (attribution will be tricky as we go up the chain) Improve quality of OM frameworks, especially documentation and reporting – linked to evidence gathering Critically examine demand-supply linkages (citizen- state relations/ transformations Improve on the PEA +OM+ LFA framework Active sharing of lessons learnt – understand sustainability Manage final evaluation 35

36. Thank you! 36