Tactics for improving evidence base
TACTICS OF ALL TACTICS FOR IMPROVING EVIDENCE BASE: YOU, ME, OUR COLLEAGUES If we understand the needs for evidence If we have the will to do it If we have the time If we have the resources
TACTICS OF ALL TACTICS: YOU, ME, OUR COLLEAGUES If we understand the needs for evidence If we have the will to do it If we have the time If we have the resources <- INCREDIBLY, over the next 2 years, resources are not necessarily the limiting factor
Why do we need evidence? Track progress Foster adaptive management Ensure accountability Catalyse learning If we are serious about results, evidence is key.
What evidence? Monitoring and evaluation rely on different methodological approaches to generate specific type of evidence DimensionMonitoringEvaluation FrequencyPeriodic, occurs regularlyEpisodic FunctionTracking / oversightAssessment Purpose Improve efficiency, provide information for reprogramming to improve outcomes Improve effectiveness, impact, value for money, future programming, strategy and policymaking FocusInputs, outputs, processes, workplans (operational implementation) effectiveness, relevance, impact, cost- effectiveness Methods routine review of reports, registers, administrative databases, field observations More rigorous research design (e.g. scientific), complex and intensive Information source routine or surveillance system, field observation, reports, progress reports, rapid assessment, program review meetings Same sources used for monitoring, plus additional surveys and/or analysis, special studies Cost Consistent, recurrent costs spread across implementation period Episodic but need to be budgeted for
What tools? Tactic 1: ask your peers Tactic 2: use existing resources
What tools? Tactic 3: use Google
Is the evidence good enough? Tactic 4 self-assessment: for example use analytical frameworks like the BOND tool (that we have referred to in the Annexes to the PPA extension) Tactic 5: use your peers to review… Tactic 6: If peers/ yourself not available or do not have the right amount of knowledge use external support
Subliminal message: use NING
Do we have the time? Tactic 7: Identifying, collecting, managing, analysing evidence takes time. Ask for more time/ allocate more time towards this?
Do we have the time? Tactic 8: do we need to learn about time management? Available in most airports
Do we have the time? Tactic 9: consider hiring a consultant to support and relieve the pressure, especially for the more complex analysis
TACTICS OF ALL TACTICS: YOU, ME, OUR COLLEAGUES If we understand the needs for evidence If we have the will to do it If we have the time If we have the resources <- INCREDIBLY, over the next 2 years, resources are not necessarily the limiting factor
Some further points to consider in developing your tactics Analysis: I have the data but do not know what to do with it How do you deal with time-lag issues to observe results? – example see Tuesday’s presentation Staff turnover will happen – how do you deal with that? How do you change things when a programme is already being implemented (with partners?) and the wrong type of evidence is being gathered How do you work in an environment where gathering evidence is not a priority?
Thank you