1. Integrating IE into Project Design Felipe Alexander Dunsch June 22, 2015 ieConnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015

2. Overview 4 Group Sessions - Project teams work on their impact evaluation, facilitated by TTL & researchers

3. Overview 4 Group Sessions - Project teams work on their impact evaluation, facilitated by TTL & researchers -Session 1: Establish a results chain & determine the research questions for the project

4. Overview 4 Group Sessions - Project teams work on their impact evaluation, facilitated by TTL & researchers -Session 1: Establish a results chain & determine the research questions for the project -Session 2: Finalize research questions, identification strategy, outcome indicators, data

5. Overview 4 Group Sessions - Project teams work on their impact evaluation, facilitated by TTL & researchers -Session 1: Establish a results chain & determine the research questions for the project -Session 2: Finalize research questions, identification strategy, outcome indicators, data -Session 3: Finalize identification strategy, practical implementation plan (budget, staffing, timeline)

6. Overview 4 Group Sessions - Project teams work on their impact evaluation, facilitated by TTL & researchers -Session 1: Establish a results chain & determine the research questions for the project -Session 2: Finalize research questions, identification strategy, outcome indicators, data -Session 3: Finalize identification strategy, practical implementation plan (budget, staffing, timeline) -Session 4: Finalize design & PowerPoint for Thursday

7. Workshop output A short PowerPoint presentation on Thursday (4-5 slides maximum) providing a roadmap for the IE: Intervention description Evaluation question(s) Evaluation design Sample and data Timeline To cover, but not to present: Staffing, Budget

8. Session 1 Understanding the project Causal/results chain Identify research questions

9. Session 1: Understanding the project What questions: project activities/interventions Why questions: program rationale How: Work down from big picture to specifics to understand project assumptions and constraints > what is the theory of change: How do we expect to move from the intervention to impact?

10. Session 1: Thinking about the causal chain What is impact of high speed internet access on 1.Business growth? 2.Employment opportunities? 3.Health and education, etc…?

11. Session 1: Thinking about the causal chain What is impact of high speed internet access on 1.Business growth 2.Employment opportunities 3.Health and education, etc…

12. Session 1: Thinking about the causal chain High speed internet infrastructure What is impact of high speed internet access on 1.Business growth 2.Employment opportunities 3.Health and education, etc…

13. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth What is impact of high speed internet access on 1.Business growth 2.Employment opportunities 3.Health and education, etc…

14. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth

15. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth Providers connect to the main grid

16. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers

17. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills

18. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills How to use the internet?

19. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills Reliable service How to use the internet?

20. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills Reliable service How to use the internet? Cluster effects

21. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills Reliable service How to use the internet? Cluster effects

22. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills Reliable service How to use the internet? Cluster effects

23. Session 1: Thinking about the causal chain High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills Reliable service How to use the internet? Cluster effects

24. Session 1: Thinking about the causal chain What if supply is intermittent?

25. Session 1: Thinking about the causal chain What if supply is intermittent? What if people don’t pay their bills?

26. Session 1: Thinking about the causal chain What if supply is intermittent? What if people don’t pay their bills? What impacts will my project have if nobody connects?

27. Session 1: Thinking about the causal chain What if supply is intermittent? What if people don’t pay their bills? What impacts will my project have if nobody connects? Why are people not connecting?

28. Session 1: Thinking about the causal chain What if supply is intermittent? What if people don’t pay their bills? What impacts will my project have if nobody connects? Why are people not connecting? How do we get people to connect?

29. Session 1: Thinking about the causal chain What if supply is intermittent? What if people don’t pay their bills? What impacts will my project have if nobody connects? Why are people not connecting? How do we get people to connect? Are we interested in proof of concept or program effect?

30. Session 1: Thinking about the causal chain What if supply is intermittent? What if people don’t pay their bills? What impacts will my project have if nobody connects? Why are people not connecting? How do we get people to connect? Are we interested in proof of concept or program effect? Addressing the last mile issue to maximize impact

31. Session 1: Thinking about the causal chain What if supply is intermittent? What if people don’t pay their bills? What impacts will my project have if nobody connects? Why are people not connecting? How do we get people to connect? Are we interested in proof of concept or program effect? Addressing the last mile issue to maximize impact

32. Session 1: Research questions High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills Reliable service How to use the internet? Cluster effects

33. Session 1: Research questions High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills Reliable service How to use the internet? Cluster effects

34. Session 1: Research questions High speed internet infrastructure Business growth Providers connect to the main grid Businesses make contracts with providers Businesses pay their bills Reliable service How to use the internet? Cluster effects

35. Session 2: Identification strategy, outcomes & data -Finalize research questions -Identification strategy -Establish valid counterfactual (control group) -Experimental or quasi-experimental? -Phase-in design? -Discontinuities? (spatial or temporal)

36. Session 2: Identification strategy, outcomes & data -Outcome indicators -Intermediate outcomes -Final outcomes -Measurable? -Data sources -Surveys -Administrative data -Census data

37. Session 2: Identification strategy, outcomes & data -Outcome indicators -Intermediate outcomes -Final outcomes -Measurable? -Data sources -Surveys -Administrative data -Census data Research questions need to be submitted after session 2! (by the facilitator)

38. Session 3: Implementation plan -Timeline -Budget: Sources of funding -Staffing

39. Session 4: Finalize PPT A short PowerPoint presentation on Thursday (4-5 slides maximum) providing a roadmap for the IE: Intervention description Evaluation question(s) Evaluation design Sample and data Timeline To cover, but not to present: Staffing, Budget Presenter should be a government representative

40. Have a great week!