1. An Overview of CLP-2’s M&E System

2. What was our baseline?

3. IML’s Role 1. Activity/output monitoring 4. Outcome monitoring 2. Quality/ leakage control 3. Research

4. What was our baseline? 2 x monthly progress reporting Limited number of indicators Flow of information: IMO- District Staff- Operations Unit- IML Outsourced Monthly report Random sample

5. What was our baseline? Focus on quantitative Drivers (LF, Operational demands, annual reviews) XYZ

6. What was our baseline? Cohort 1.1 Cohort 1.2 Cohort 1.3 Cohort 1.4 Jan. ’06- June ‘07 Oct. ’06- July ‘08 Oct. ’07- Sept. ‘09 Sept. ’08- Mar. ‘10

7. What was our baseline? Relatively straight forward No ethical concerns Support Matching and follow ups required Rolling Baselines

8. How did the system evolve?

9. Structural change Communications ‘Unit’ established Focus has been on: – Briefs, ‘glossies’, website and social media Useful to have M&E + Comms together Challenges – Capacity – Understanding our audience

10. Output monitoring & QC One report Many indicators- too many? Progress against targets Verification cont’d Additional spot checks (high cost items, district checklist) Incident register

11. Outcome monitoring Rolling baseline continued, but: – Outsourced – Follow-up surveys – Samples (panel) Additional control group – Cohort 2.3, 500 households from 20 villages

12. Monthly monitoring – VfM issues (bi- monthly) – Sample basis – Maximum use?

13. Increased scope Thematic Areas

14. Lessons learnt

15. What would we do differently? More resources for analysis Give DEMOs greater independence (de- link them from IMOs) Theory of change + themes

16. The key lessons? Track a range of indicators/ graduation Develop a set of themes Involve community in setting indicators Outsource QC Integrate M&E + Comms Develop activity/ output monitoring but don’t overdo

17. Thank you www.clp-bangladesh.org Event Schedule Registration 09.30 – 09.45 Welcome & CLP Overview 09.45 – 10.30 CLP’s Approach to M&E 10.30 – 11.15 - Q&A Tea 11.15 – 11.45 Market Lessons 11.45 – 13.00 - Graduation + Q&A - Women’s Empowerment + Q&A Lunch 13.00

18. Quality control (data) Data collection –Training (5 days including 1 day field test) –Same contractor/ enumerators –DEMOs oversight –Enumerators + supervisors (checking approx. 5%) Data entry/ cleaning –Double entry (10% questionnaires) –Cleaning Data analysis –Extreme values –Inconsistencies

19. MPR (CLP-1)

20. MPR (CLP-2)

21. The core indicators Livelihoods –Mean income pppd –% of income by source –Mean expenditure pppd –Mean cash savings –Mean value assets (productive and total) Women’s empowerment –Mean empowerment score –Number of women empowered Graduation –Number of CPHHs graduating Food security –Number of meals + 5 food groups –Food consumption score –% of income spent on food (>70%) –CSI –FCS –WASH Nutrition –Stunting –Wasting –BMI –Haemoglobin Water, sanitation & hygiene –Access to sanitary (and non sanitary) latrine –OD –Water/ soap near water point –Access to water point (up to CLP standards)

22. Quality control (data) Data collection –Training (5 days including 1 day field test) –Same contractor/ enumerators –DEMOs oversight –Enumerators + supervisors (checking approx. 5%) Data entry/ cleaning –Double entry (10% questionnaires) –Cleaning Data analysis –Extreme values –Inconsistencies

23. Value for Money DFID’s approach to VfM (maximising impact of each pound) 3 E’s framework –Economy: appropriate inputs at the right price? –Efficiency: how well do we convert inputs into outputs? –Effectiveness: how well are outputs achieving desired outcomes? Collaboration required between IMLC, Finance and Operations Where/ how do we get involved: –Economy: N.A. –Efficiency: Monthly progress reports (Unit Costs) –Effectiveness: Outcome data (CBA, IA)

24. Thank you www.clp-bangladesh.org Event Schedule Registration 09.30 – 09.45 Welcome & CLP Overview 09.45 – 10.30 CLP’s Approach to M&E 10.30 – 11.15 - Q&A Tea 11.15 – 11.45 Market Lessons 11.45 – 13.00 - Graduation + Q&A - Women’s Empowerment + Q&A Lunch 13.00