1. ASSESSING IMPACT OF ATWAAMBE GOVERNANCE INTERVENTIONS Pryd Chitah Kingfisher Lodge July 26,2012 Lusaka

2. ASSESSING IMPACT OF GOVERNANCE AND DIALOGUE INTERVENTIONS Assessing impact involves looking for changes in people’s lives as a result of an intervention. Soft impact versus hard impact: Where do Governance interventions fit in this in terms of direct attribution? What should we be promising to change with information/communication/evidence-should it be attitudes, perceptions, opinions, relationships (soft impact) or service delivery(hard impact)? Eventually,soft impact can lead to hard impact!

3. ASSESSING IMPACT Impact assessment helps us make strategic choices about governance/information or communication projects/products/services and assess whether or not they are having impact on behaviour,lives and livelihoods. In essence impact assessment=an evaluation focusing primarily on changes brought by a project/programme

4. ASSESSING IMPACT Not easy to prove that governance/ information or communication intervention has demonstrable impact, but we can make assumptions that there is direct link between changes observed and the project or programme,on condition that link is credible.

5. Why assess impact? Accountability purposes Convince stakeholders that project/intervention relevant to intended changes Improves understanding of the effects(+ or - )on target groups Creates basis for reformulating strategies(at both project and organisational level)

6. Methods for impact assessment Depends on key information needs of stakeholders Can also depend on purpose and scope of assessment. Data generated is often combination of quantitative(e.g., statistics)and qualitative(e.g., perceptions, narratives)

7. ASSESSING IMPACT NOTE: Its important to make impact assessments participatory because the only perspective from which to see impact is that of the target group itself. The impact that the target group sees is the impact that matters!

8. DATA COLLECTION TOOLS 1.RADIO Audience Market research: It is costly to undertaken a thorough audience research. Options include research through a partner(sponsoring questions of interest)for large NGO studies, partnering with universities to use data from research undertaken by students undertaking research on related issues or targeted small sample audience survey

9. DATA COLLECTION TOOLS TO ASSESS IMPACT Radio continued…. Internal Interviews: interview radio station staff including volunteers about programmes(aids buy- in and ownership). Listener feedback analysis: Document # of calls for IRPs,Gets some detail about callers-where they live and age category. Record all other feedback station receives. Vox pops: Systematic on the street interviews to gauge public opinion/feedback on programmes or an issue.

10. DATA COLLECTION TOOLS TO ASSESS IMPACT 2.RLCs Listener Club feedback through Listener Diaries: RLC members document views on programmes aired, what information they thought was most/least useful and whether they are putting into practice what they hear and general impact of programmes. Time consuming and may require modest incentives e.g competition. Testimonies/Case studies Discussion Report Books

11. ASSESSING IMPACT 2.TELEVISION AND VIDEO At different levels-for different target groups Written submissions from Parliamentarians Send and request for Feedback Feedback contact meetings Film/Documentary reviews in liaison with the Media

12. ASSESSING IMPACT 3.CONTACT DISSEMINATION Evaluation form at end of meeting Evaluation interviews captured(visual,audio)

13. ASSESSING IMPACT 4.PUBLICATIONS Publication feedback form Contact dissemination

14. ASSESSING IMPACT 5.POLICY DIALOGUE Media content analysis Policy brief

15. ASSESSING IMPACT 6.POLICY BRIEFS Media content analysis Partner reports Focus Group Discussions

16. ASSESSING IMPACT 7.RESEARCH STUDIES Media content analysis Partner reports Focused Group Discussions

17. ASSESSING IMPACT 8.ICT/WEB BASED PLATFORMS No.of hits/visitors report Feedback/comments

18. ASSESSING IMPACT 9.OTs Contact dissemination/OT exhibition FGD/Policy dialogue Meeting

19. ASSESSING IMPACT 10.TRAINING COURSES/WORKSHOPS Media content analysis TNA-before and after Capacity self assessment