INTEGRATING IE INTO YOUR PROJECT DESIGN Aidan Coville, DIME DIME Istanbul IE Workshop, May 2015

how do we get there…? Let’s do an IE Some magic happens I have an IE design

workshop output A PowerPoint presentation on Thursday providing a roadmap for the IE: Intervention description Evaluation question(s) Evaluations design Sample and data Timeline To cover, but not to present: Staffing Budget Presentation should be 5 mins to allow time for Q&A

day 1: understand the project Lot’s of what questions: project activities/interventions Even more why questions: program rationale (warning: we’ll probably get existential on you) Then the how: Work down from big picture to specifics to understand project assumptions and constraints > what is the theory of change of explains how we move from the intervention to impact?

investment retention Simplification / streamlining procedures Alternative dispute resolution Fiscal incentive

day 2: identify IE questions Policy <country-specific> Research <global knowledge agenda> Operations <project-specific>

day 2: identify IE questions Initial plan: what is the impact of my program on Business investment Firm growth Employment… But what about the challenges identified? What if people don’t understand how ADR works? What if there is no information for foreign investors on where to identify promising local investment opportunities ? What if grant applications are too complicated? Are we interested in proof of concept or program effect?

Now what’s the question…? What impact will my program have if nobody applies for financing? Why are people not applying? How do we get the right incentive package? Generate a hypothesis

Leads to hypotheses to test Is the incentive too small? Is the process too stringent/complex? Do valuable investment opportunities exist / do businesses know about them?

DAY 2 OUTPUT: Send IE questions for group review on day 3

day 3 and 4: evaluation design and sample Fundamental concern is how to answer the identified IE questions accurately This hinges on the quality of your control group

TA support for application Foreign-domestic firm matching Investors Larger subsidy TA support for application Foreign-domestic firm matching Business as usual

Why is sample size important

Investors (n= 1500) T1: n= 500 T2: n= 500 C: n = 500

Day 4: think about budget and staffing Who is in a position to decide on moving forward with the design? Who will be responsible for following up? What will data collection cost and how will it be covered? What about analytical services (design, implementation, analysis, dissemination)?

Day 4: output DAY 4 OUTPUT: Country team presents IE design (2 hours per presentation) 5 mins

day 5: the journey begins…