1. Network of Networks on Impact Evaluation Impact evaluation design for: PADYP Benin Jocelyne Delarue - AFD NONIE design clinic 1 Cairo April, 2009 1 Original format and presentation developed by the World Bank SIEF

2. Network of Networks on Impact Evaluation Section A: Presentation of project

3. Network of Networks on Impact Evaluation Project background & context Objective : Develop agricultural productivity through farming system management Second phase of the project : scaling up –Expansion from 3 000 to 18 000 members –Expansion in new communes, new zones and new farming systems (12000 cotton farmers, 3000 non cotton farmers) Activities (2009 – 2013) : –training of 75 new advisers and 525 key farmers (KF) –Every adviser supports 60 members and 140 more through KF (20 m/KF) –Prepare sustainability (participation of farmers to service payment) Counterfactual situation : classical extension services recently extended by Benin government The project is financed by AFD (10 M. €), cotton cooperatives (3.4 M.€) and Benin State (1.4 M.€)

4. Network of Networks on Impact Evaluation RESULTS CHAIN Xxx Impact indicator

5. Network of Networks on Impact Evaluation Key research questions Is the farming system management (FSM) service more efficient than top-down extension service to enhance agricultural productivity ? (cf. the causal chain) Who are the members ? Are there spill over effects on non members ? (networks effects) What are the effects at a more aggregated level (village, value chain)? Operational questions –How to succeed the scaling up –How to involve durably the farmers cooperatives in this service provision

6. Network of Networks on Impact Evaluation Outcome indicators Number of farms which use farming system management tools/methods –Activity planning –Stock management –Cash management –Credit management Number of farms who apply new cropping techniques Number of farms who adopt new crops and activities Impact Indicators Yields, Costs, Productivity for each crop Prices obtained for crops sold Food security in the family Income

7. Network of Networks on Impact Evaluation Identification strategy/method Use the expansion of the program (pipeline method ? Instrumental variable ?) Comparison with a counterfactual situation : top-down extension services, currently extended also Combination of qualitative and quantitative methods

8. Network of Networks on Impact Evaluation Sample and data (1) Value ChainDepartementsNb communes CottonAlibori6 CottonBorgou6 CottonAtacora3 CottonDonga1 Mixed farmingCollines3 Mixed farmingZou3 Mixed farmingPlateau3 Mixed farmingOuémé3 Mixed farmingCouffo2 PineappleAtlantique5 VegetablesAtlantique1 VegetablesOuémé1 VegetablesMono3 VegetablesLittoral1 Total1240

9. Network of Networks on Impact Evaluation Sample and data (2) 200820092010201120122013Total Advisers03525150075 Total0356075 Key Farmers 024517510500525 Total0245420525 Members010000500030000018000 Total010000150001800000

10. Network of Networks on Impact Evaluation Sample and data (3) Monitoring system of the project (activities, number of advisers, key farmers, members, method use…) Members’ farming systems caracteristics and economic results Secondary data : census, market prices, … Probably : Available data on crop productivity without farming system management

11. Network of Networks on Impact Evaluation Time frame/work plan Impact evaluation : 2009 - 2012

12. Network of Networks on Impact Evaluation Sources and finances AFD CIRAD

13. Network of Networks on Impact Evaluation Section B: Impact evaluation of project

14. Network of Networks on Impact Evaluation Evaluation framework and context [Insert text on framework and context here]

15. Network of Networks on Impact Evaluation Evaluation questions Farmers Villages – spillover effects Qualitative : pathways

16. Network of Networks on Impact Evaluation Evaluation audience and policy it is trying to influence (if appl.) [Insert text on audience and policy here]

17. Network of Networks on Impact Evaluation Evaluation design Intensity of the treatment Full baseline full final, and follow ups Contamination of gates project (productivity can lower prices) Looking demand side on markets

18. Network of Networks on Impact Evaluation Challenges and risks Key unit of analysis : the community – need a large number of communities Stratify farmers Rate of adhesion : if too weak, pb of sample Pipeline : how much the people at the end of the pipeline can be good counterfactual – key criteria of how pipeline is implemented (equitable, transparent, accountable) on community Pipeline on HH : the first to register will tend to be future key farmers, more dynamic…

19. Network of Networks on Impact Evaluation Methodology Pipeline ? Quantifiable criteria for HH selection

20. Network of Networks on Impact Evaluation Evaluation implementation Use agricultural census

21. Network of Networks on Impact Evaluation Management [Insert text on evaluation management here]

22. Network of Networks on Impact Evaluation Expected results [Insert text on expected evaluation results here]

23. Network of Networks on Impact Evaluation Expected conclusions [Insert text on expected evaluation conclusions here]