Framework for Monitoring Learning & Evaluation Presentation at Project Review and Planning and Steering Committee Meeting 17 March 2014
What we need? Evidence to assess whether we’re on track, in a timely manner, in a cost effective way Data useful for project clients: farmers, hubs, BDS providers, project, donor What we can afford? In terms of budget In terms of time for staff, farmers and other stakeholders What we need to avoid? Too many indicators of little relevance to the goal M&E seen as ‘beans counting’ Biased data or evidence Data and analysis ready too late or not targeted to the right people
Suggested MLE Framework principles ‘Usual monitoring‘ Monitoring of activities and outputs For fund accountability purpose (direct relationship between fund use and activities) An input into the other components (learning and evaluation) Strong emphasis on ‘learning’ Regular and systematic collection and analysis of evidence on key outcomes and some impact indicators At various levels of the value chain: farmers, hubs, VC actors Both qualitative and quantitative Will allow evidence based and timely feedback loops into project and hub activities An input into the other component (monitoring and evaluation) Less on ‘evaluation’ Mainly qualitative to understand the ‘why’ (why do things happen this way) Use evidence from M&L, Done externally for objectivity purpose Mid term evaluation is an input into the other component (monitoring and learning)
Learning Cycle Project interventions Project Activities and outputs Farmer and community change in behaviour Outcomes at household and hub levels Analysis and reflections
MLE framework- snapshot Value chain assessment, to identify constraints and 1st ‘best bet’ interventions Baseline survey, to measure level of outcome and impact indicators at project start Monitoring of activities, outputs and outcomes- see next slide Mid term evaluation: mostly qualitative, since quantitative data are available from monitoring activities Final evaluation: quantitative
MLE framework- outputs and outcomes Monitoring of outputs To assess how the activities delivered the expected results At farmers, groups and business providers levels Monitoring of outcomes at farm level To assess farmers uptake of technologies, milk productivity and dairy income To assess farmers use of hub services Monitoring of outcomes at hub and community levels To assess DMH status in terms of organization, business entity and providers of inputs & services Monitoring of outcomes at regional/ country level To assess change in policy and mindsets of key decision maker
Suggested indicators Farm/ household level DMH level Dairy technologies and practices uptake: feed, AH, management, breeding Use of purchased inputs and services: milk marketing; purchase of feed; etc… Use of hub purchased services, whether on check off or not; Cow productivity Price of milk, inputs and services Dairy income, controlled by men and women Highest and lowest milk production levels (for seasonality) DMH level Relationship between farmers groups and BDS providers Type of services provided to members: milk bulking, transport, feed store, extension, etc.. Extent of use of check off system (value and frequency of transactions, by type of inputs& services) Governance: timey and fairly conducted elections; attendance to meetings; gender and youth minimum requirements in leadership positions
Suggested indicators (cont.) Regional/ country level District platforms emerge and meet to deliberate on priority issues New/ strengthened business solutions emerge Emergence of actors associations, e.g traders associations and increased and more inclusive membership and participation (# of members, type (e.g. small scale/ medium etc), level of participation in meetings and decision making forums, etc..)
Group work Working groups representing: farmers/farmer groups inputs & service providers traders & processors researchers & development partners ministry & government Recall the objectives of “More milkiT” & “Maziwa zaidi” and address the following questions:
What can I collect on my own? I need help on what data and from whom? Group work Assignments What are my data needs? How will I use the data? What can I collect on my own? I need help on what data and from whom?