Input Evaluation the origins of the intervention

Slides:



Advertisements
Similar presentations
Program Evaluation Alternative Approaches and Practical Guidelines
Advertisements

REGIONAL CONFERENCES Planning, Doing, and Using Evaluation.
Anonymous Services, Hard to Reach Participants, and Issues around Outcome Evaluation Centre for Community Based Research United Way of Peel Region Roundtable.
For Classroom Use Only © 2003 University of Texas Houston Health Science Center L. Kay Bartholomew, Guy S. Parcel, Gerjo Kok, and Nell H. Gottlieb Intervention.
The World Bank Human Development Network Spanish Impact Evaluation Fund.
Evaluation at The Prince’s Trust Fire Service Prince's Trust Association meeting 18 th February 2010 Subtitle.
Project Monitoring Evaluation and Assessment
Program Evaluation. Lecture Overview  Program evaluation and program development  Logic of program evaluation (Program theory)  Four-Step Model  Comprehensive.
Action Logic Modelling Logic Models communicate a vision for an intervention as a solution to a public health nutrition (PHN) problem to:  funding agencies,
Action Implementation and Evaluation Planning Whist the intervention plan describes how the population nutrition problem for a particular target group.
CIPPI introduction to the model
EDU555 CURRICULUM & INSTRUCTION ENCIK MUHAMAD FURKAN MAT SALLEH WEEK 4 CURRICULUM EVALUATION.
Building Strong Library Associations | Regional Convenings DAY 2 Session 7 How will I get support for my proposal?
DC Home visiting Implementation and impact evaluation
Product Evaluation the outcome phase. Do the magic bullets work? How do you know when an innovative educational program has “worked”? How do you know.
Evaluation methods and tools (Focus on delivery mechanism) Jela Tvrdonova, 2014.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
Reflections on the Independent Strategic Review of the Performance-Based Research Fund by Jonathan Adams Presentation to Forum on “ Measuring Research.
1 Designing Effective Programs: –Introduction to Program Design Steps –Organizational Strategic Planning –Approaches and Models –Evaluation, scheduling,
Model Name Transition Project Learning Network Workshop 3 IYF Transition Project.
Intel ® Teach to the Future Pre Service Evaluation across Asia - Gaining the Country Perspective - Deakin University Faculty of Education Consultancy and.
Begin at the Beginning introduction to evaluation Begin at the Beginning introduction to evaluation.
Strategic Plan Review Drawing a Picture & Sharing a Story.
Context Evaluation knowing the setting Context Evaluation knowing the setting.
Management Plan Describe the adequacy of the management plan to achieve the objectives of the proposed project: On time and within budget Include clearly.
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
Considering the Roles of Research and Evaluation in DR K-12 Projects December 3, 2010.
TIA Consulting, Inc. Starting an Evaluation Program: Challenges and Lessons Learned Technology Program Evaluation: Methodologies from the Advanced Technology.
Children’s Educational Potential Facilitated by: Advocates for Occupational Therapy (Study Group 3)
Logical Framework Approach An Evaluation Toolbox Presentation
Selection Criteria and Invitational Priorities School Leadership Program U.S. Department of Education 2005.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
1 West African Refugee Assistance Program Lanfia T.S. Waritay, M.Sc, M.B.A Tamaa Team Leader Tamaa West African Refugee Assistance Program Children’s Crisis.
SPDG Competition FY 2011 Management Plan. (f) Quality of the management plan. (20 points) (1) The Secretary considers the quality of the management plan.
Social return on investments (SROI)
ROLE OF INTERNAL AUDIT IN STRATEGY MONITORING AND EVALUATION
Developing Trade Unions Advocacy, Campaigns and Communication Strategy
Research Into Practice
Monitoring & Evaluation Processes A A walkthrough of the whole process
Module 1: Introducing Development Evaluation
Identify stakeholders:
INITIAL CONSIDERATIONS
Building the foundations for innovation
Using Logic Models in Program Planning and Grant Proposals
Community program evaluation school
Introduction to Program Evaluation
Research in Social Work Practice Salem State University
HCS 455 EDU Lessons in Excellence-- hcs455edu.com.
Program Budgeting and Marginal Analysis
إستراتيجيات ونماذج التقويم
Program Planning and Evaluation Essentials
Program Planning and Evaluation Methods
Employment Social Impact Bonds
Designing and Implementing Career Planning Services
Assignment 2 The final assignment requires you to develop a hypothetical health promotion intervention in the format of a grant proposal. This will involve:
Accountability Issues in Proposal Writing
EVALUATION RESEARCH These are those types of research that evaluate the impact of social interventions. Motivated by the desire of social scientist to.
Strategic Prevention Framework - Introduction
Increased Access to Care Logic Model
III. Practical Considerations in preparing a CIE
A Focus on Outcomes and Impact
Recruitment External consultants – look beyond traditional networks
Project Management Training
Evaluative Research Key Terms Evaluative Research Key Terms.
Identify stakeholders:
Process Evaluation the implementation phase
TITLE Business Case YOUR LOGO BUSINESS CASE PRESENTATION 00/00/0000
Program Planning: Models and Theories
Reading Paper discussion – Week 4
IDENTIFY PROBLEM EVALUATE PLAN ACTION ACT.
Presentation transcript:

Input Evaluation the origins of the intervention

Where do magic bullets come from? What factors do you consider when judging new educational programs and their potential fit for your school?

Where do magic bullets come from? Research / theoretical base Credibility of the developers Past experience of like schools with the magic bullet Cultural sensitivity / match to school population Does the magic bullet meet the need?

CIPPI Model Context Input Process Product Impact The goal is to make INFORMED judgments about Program merit or value.

The Nature of Evaluation Tasks The goal is to make INFORMED judgments about Program merit or value. Making judgments requires a thorough understanding of the treatment itself. Assumptions, conditions, claims

Input Evaluation The central task in an Input evaluation is to develop an understanding of the Program’s service delivery plan, from the origins of the intervention to the plans for implementation.

Evaluation Strategies Key Informant Interviews Background Research Measurable Objectives Worksheets Logic Model

Initial Questions Where did the treatment come from? Why does the Program think it will meet the needs of the target population?

Origins of the Treatment What is the existing evidence to support the effectiveness of the Program? Has the Program considered alternative models for delivering the services it provides?

Program Quality Standards Does the Program have a plan for quality improvement? What Program Quality Standards, specific to the field in which the Program operates, are available to the program?

Program Quality Standards Which Programs would be considered the model programs in the field? Have the personnel of the Program visited or consulted with these model programs?

Program Quality Standards Does the Program have an Advisory Board, or other source of ongoing input from stakeholders?

Implementation Plans Does the Program have a plan for implementation of the services they will be providing?

Implementation Plans Does the plan contain phases of implementation? Are there specific checkpoints, milestones, benchmarks, or indicators that signify the end of one phase and the beginning of another?

Measurable Objectives Complete the Measurable Objectives Worksheet with the Program for each of its goals. The worksheet is designed to facilitate a rich discussion with Program staff about how to operationally define each Program outcome in the context of the specific Program objectives.

Measurable Objectives

Other Considerations Does the Program have a plan to seek additional sources of funding in the future? If so, what kinds of evaluation and effectiveness evidence do these funding sources value?

Conclusion Evaluate the entire service delivery plan for the Program. Based on all of the information you have gained from the Input Evaluation Phase, does the Program have a reasonable chance to DELIVER the proposed services to the target population?