Title Team Members.

Slides:

Advertisements

Similar presentations

Designing an impact evaluation: Randomization, statistical power, and some more fun…

Advertisements

Principles of Project Design and Management Moving from Program to Project in 4 Easy Chapters.

Explanation of slide: Logos, to show while the audience arrive.

Knowing if the RBF mechanism is working Incorporating Rigorous Impact Evaluation into your HRBF program Sebastian Martinez World Bank.

A Guide to Education Research in the Era of NCLB Brian Jacob University of Michigan December 5, 2007.

T EN QUESTIONS TO CONSIDER IN DESIGNING AN IMPACT EVALUATION.

Integrating IE into Project Design Felipe Alexander Dunsch June 22, 2015 ieConnect Impact Evaluation Workshop Rio de Janeiro, Brazil June 22-25, 2015.

How to Write Goals and Objectives

Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.

OVE’s Experience with Impact Evaluations Paris June, 2005.

INTRODUCTION TO OPERATIONS RESEARCH Niranjan Saggurti, PhD Senior Researcher Scientific Development Workshop Operations Research on GBV/HIV AIDS 2014,

ISTEP: Technology Field Research in Developing Communities Instructor: M. Bernardine Dias CAs: Sarah Belousov and Ermine Teves Spring 2009.

Skunk Works Evaluation Tools: How do we know if we are having an impact?

Measuring Impact: Experiments

Quasi Experimental Methods I Nethra Palaniswamy Development Strategy and Governance International Food Policy Research Institute.

Designing a Random Assignment Social Experiment In the U.K.; The Employment Retention and Advancement Demonstration (ERA)

Introduction to Evaluation. Objectives Introduce the five categories of evaluation that can be used to plan and assess ACSM activities. Demonstrate how.

“Working to ensure children, birth to 5, are prepared for success in school and life.” Wake County SmartStart Logic Model Training May 2013.

Impact Evaluation in Education Introduction to Monitoring and Evaluation Andrew Jenkins 23/03/14.

European Commission Joint Evaluation Unit common to EuropeAid, Relex and Development Methodology for Evaluation of Budget support operations at Country.

Begin at the Beginning introduction to evaluation Begin at the Beginning introduction to evaluation.

Conditional Cash Transfer (CCT) Programme Kano State Nigeria.

Applying impact evaluation tools A hypothetical fertilizer project.

Non-experimental methods Markus Goldstein The World Bank DECRG & AFTPM.

S Ethiopia Sustainable Land Management Project Impact Evaluation CROSS-COUNTRY WORKSHOP FOR IMPACT EVALUATIONS IN AGRICULTURE AND COMMUNITY DRIVEN DEVELOPMENT.

What is randomization and how does it solve the causality problem? 2.3.

Reduction of Mercury in Products Action Plans. 2 Action Plan  describes the activities to be carried out and the related implementation strategies for.

Principles of Project Design and Management Moving from Program to Project in 3 Easy Chapters.

1 General Elements in Evaluation Research. 2 Types of Evaluations.

Randomized Assignment Difference-in-Differences

Effectiveness of Selected Supplemental Reading Comprehension Interventions: Impacts on a First Cohort of Fifth-Grade Students June 8, 2009 IES Annual Research.

Quantitative research Meeting 7. Research method is the most concrete and specific part of the proposal.

Local HWTS Monitoring Eva Manzano, CAWST Technical Advisor Laos Vientiane, Lao PDR November 11, 2014.

What is Impact Evaluation … and How Do We Use It? Deon Filmer Development Research Group, The World Bank Evidence-Based Decision-Making in Education Workshop.

Session 2: Developing a Comprehensive M&E Work Plan.

Impact of School Grants in Primary Schools In The Gambia Impact Evaluation Team The Gambian Team AFRICA IMPACT EVALUATION INITIATIVE, AFTRL Africa Program.

Cross-Country Workshop for Impact Evaluations in Agriculture and Community Driven Development Addis Ababa, April 13-16, Causal Inference Nandini.

Developing a Monitoring & Evaluation Plan MEASURE Evaluation.

STEPS IN RESEARCH PROCESS 1. Identification of Research Problems This involves Identifying existing problems in an area of study (e.g. Home Economics),

Session VII: Formulation of Monitoring and Evaluation Plan

The Visual Storyteller:

Commercial Agriculture Development Project Impact Evaluation

INTEGRATING IE INTO YOUR PROJECT DESIGN

Food and Agriculture Organization of the United Nations

Right-sized Evaluation

Fundamentals of Monitoring and Evaluation

<Project Name> <Name> SOLUTIONS / COUNTERMEASURES

Measuring Outcomes of GEO and GEOSS: A Proposed Framework for Performance Measurement and Evaluation Ed Washburn, US EPA.

Quasi-Experimental Methods

College of Public Health and Human Sciences

Title List your Team Members

Project Name: Country:

Building a Strong Outcome Portfolio

Kenya Agricultural Productivity Project

Healthcare Planning Osama A Samarkandi, PhD, RN

Assignment 2 The final assignment requires you to develop a hypothetical health promotion intervention in the format of a grant proposal. This will involve:

Title List your Team Members

Introduction to M&E Frameworks

EVALUATION RESEARCH These are those types of research that evaluate the impact of social interventions. Motivated by the desire of social scientist to.

III. Practical Considerations in preparing a CIE

Project collaborators’ names

Format for an Action Plan

Sampling for Impact Evaluation -theory and application-

Positive analysis in public finance

Title List your Team Members

An Introduction to Evaluating Federal Title Funding

Integrating Gender M&E Capacity Strengthening Workshop, Addis Ababa

Misc Internal Validity Scenarios External Validity Construct Validity

Data for PRS Monitoring: Institutional and Technical Challenges

Quality and Impact AIM PRIMARY DRIVERS SECONDARY DRIVERS INTERVENTIONS

Presentation transcript:

Title Team Members

Program Components What is the program trying to accomplish? Who/what is the target population? What is the need or gap that the program meets? What does the program provide?

Causal Chain What is the model for expected change?

Evaluation Questions Hypotheses or policy questions to be answered through evaluation How the knowledge generated will be used

Intervention What is the intervention, for the purposes of the evaluation? Target unit/unit of intervention Unit(s) of observation

Evaluation Design/ Identification Strategy How will you define “treatment” and “comparison” groups? Or, what is the counterfactual? What is the level of the treatment assignment? And of the analysis? How will you confirm that both groups are similar in the absence of the intervention?

Outcome Indicators What will you measure? How? What is the expected effect size? (expected change in outcomes?) How long do you think it will take for change in outcomes to appear? Remember SMART: Specific, Measurable, Attributable, Realistic, Targeted

Sampling and Data What is the sample for the study? And from where/whom will you collect data? At what time intervals will you make measurements? What do you think will affect your power to detect a significant change in outcomes? (e.g. number of clusters, cluster size, time required for change to appear, expected size of effect, intra-cluster correlation) Do you expect any spillovers?

Timeline for Impact Evaluation When will you start and end? What needs to be accomplished before you can implement? What are the steps in implementation of the evaluation? When do you need to implement the intervention, collect data, etc? What is your plan for dissemination?

Impact Evaluation Team: Staffing Who are the stakeholders in the evaluation? Who will manage the evaluation? Who will provide implementation support? Who will provide data collection and quality assurance services? Do you need design/statistical support from technicians? Is training required?

Budget What will drive the cost of the evaluation? What categories of spending do you expect?

Anticipated Challenges Operational, political, research challenges