Planning for Evaluation

Slides:

Advertisements

Similar presentations

PhD Research Seminar Series: Valid Research Designs

Advertisements

Accra, Ghana October 19-23, Extending Health Insurance: How to Make It Work DESIGN ELEMENT 8: MONITORING AND EVALUATION OF HEALTH INSURANCE SCHEMES.

Muskie School of Public ServiceInstitute for Public Sector Innovation Where we are trying to go? Common outcome measures Quality data collection for outcomes.

For Classroom Use Only © 2003 University of Texas Houston Health Science Center L. Kay Bartholomew, Guy S. Parcel, Gerjo Kok, and Nell H. Gottlieb Intervention.

Mediation Analysis of an Effective Sexual Risk Reduction Intervention for Women Ann O’Leary, PhD Centers for Disease Control and Prevention Loretta S Jemmott,

Unmet need for family planning and low rates of dual method protection among men and women attending HIV care and treatment services in Kenya, Namibia.

ROAD SAFETY ETP EVALUATION TRAINING

Monitoring and Evaluation Frameworks Kyiv, Ukraine May 23, 2006 MEASURE Evaluation.

Developing a Logic Model

Incorporating HIV Prevention into the Medical Care of Persons Living with HIV Ask ∙ Screen ∙ Intervene Developed by: The National Network of STD/HIV Prevention.

Types of Group Designs ____________ group design. The experiment compares groups that receive or _______________ the IV (control group) e.g., behavior.

Monitoring and Evaluation Frameworks   What is an M&E Framework?   Why do we use M&E Frameworks?   How do we develop M&E Frameworks? MEASURE Evaluation.

Office of Medical Education

Planning, Implementing, and Evaluating Your Health Promotion Programs A 6-Week Public Health Course Week 5: Best Practices Discussion/Applying Theories,

Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.

Outputs and Outcomes Building Better Opportunities Neil King - Director – CERT Ltd.

Program Evaluation Using qualitative & qualitative methods.

Evaluating Grandparent (And Other Relatives) Raising Grandchildren Programs Brookdale Foundation Web Chat, May 2007 Presenter: Kevin Brabazon

Impact Evaluation in the Real World One non-experimental design for evaluating behavioral HIV prevention campaigns.

DELIA A. ARCISO Researcher The Effect of Using Multimedia and Team Teaching on the Science Achievement Level of Fourth Year Students of Libertad National.

Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,

Impact Evaluation in Education Introduction to Monitoring and Evaluation Andrew Jenkins 23/03/14.

What is design? Blueprints of the instructional experience Outlining how to reach the instructional goals determined during the Analysis phase The outputs.

21/4/2008 Evaluation of control measures 1. 21/4/2008 Evaluation of control measures 2 Family and Community Medicine Department.

EXPERIMENTAL EPIDEMIOLOGY

Heppner et al. Chap 12, 18 Hogg & Deffenbacher (1988)

Quasi Experimental and single case experimental designs

1 Module 3 Designs. 2 Family Health Project: Exercise Review Discuss the Family Health Case and these questions. Consider how gender issues influence.

Welcome to Program Evaluation Overview of Evaluation Concepts Copyright 2006, The Johns Hopkins University and Jane Bertrand. All rights reserved. This.

Street Smart Implementation Webinar September 10, 2009 Cicatelli Associates Inc. Public Health Solutions.

What IE is not and is not Male Circumcision Impact Evaluation Meeting Johannesburg, South Africa January 18-23, 2010 Nancy Padian UC Berkeley.

Session 7: Planning for Evaluation. Session Overview Key definitions:  monitoring  evaluation Process monitoring and process evaluation Outcome monitoring.

Andrea Moore Information Specialist MANILA Consulting Group, Inc. American Evaluation Association Annual Meeting November 11, 2010 The Community-based.

Comprehensive Evaluation Concept & Design Analysis Process Evaluation Outcome Assessment.

OUTCOME MONITORING A Short Review Nidal Karim. What is Outcome Monitoring? WhatHowWhyWhen The routine process of monitoring whether or not service recipients.

Solving Problems Together. OBJECTIVES At the end of this Lecture the student will be able to 1. Discuss the use of face work and politeness theory in.

Logic Models How to Integrate Data Collection into your Everyday Work.

Overview of Intervention Mapping

How to show your social value – reporting outcomes & impact

Measurement and Evaluation in Your Personal and Professional Life

Training on Infection Prevention and Control

Program Evaluation ED 740 Study Team Project Program Evaluation

Designing Effective Evaluation Strategies for Outreach Programs

Monitoring and Evaluation: A Review of Terms

Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 9. Periodic data collection methods.

Module 2 Basic Concepts.

Monitoring and Evaluation Frameworks

Session 13: Monitoring and Evaluation

Right-sized Evaluation

A brief, trauma-informed intervention is feasible and acceptable, increases safety behaviour, and reduces HIV risk among drug-involved women who trade.

MOAD0103 Empowering Sex Workers in Muslim communities: Some Evidence from a Community-level HIV Prevention Programme in Northern Nigeria N.M.Ibrahim,

Understanding Results

Sherry Deren, Sung-Yeon Kang, Milton Mino & Honoria Guarino

Research in Social Work Practice Salem State University

بسم الله الرحمن الرحيم.

Assessing a Combined Theories Approach to Climate Change Communication

Bell Ringer Open your student workbook to page 57.

Chapter Eight: Quantitative Methods

Actionable communications and interventions to change HABITS

Logic Models and Theory of Change Models: Defining and Telling Apart

Monitoring vs Evaluation

Monitoring and Evaluation of Postharvest Training Projects

Quasi-Experimental Design

Monitoring and Evaluation

monitoring & evaluation THD Unit, Stop TB department WHO Geneva

Non-Experimental designs: Correlational & Quasi-experimental designs

Monitoring and Evaluation: A Review of Terms

Nancy Padian UC Berkeley

How will you know what you’re proposing is successful?

Presentation transcript:

Planning for Evaluation Gerjo Kok Summer Course 2016

Planning QoL, Health: Behavior: Environment: Determinants of behavior: Determinants of environment: Evaluation: ?

Planning QoL, Health: HIV (prevention) Behavior: condom use Environment: availability Determinants of behavior: skills Determinants of environment: costs Evaluation: condom use

Planning QoL, Health: HIV (treatment) Behavior: HIV-drugs adherence Environment: availability, costs Determinants of behavior: costs Determinants of environment: politics Evaluation: easy access to HIV-drugs

Program Evaluation Starts with planning Important Threatening

Effect Evaluation Does the program make a difference? Quality of life Health indicators Behaviors Environmental conditions Program objectives Intervention groups vs control group

Process Evaluation Was the program delivered as planned? Why was it delivered as it was? Was the program well-designed? Intervention group only Evaluation of IM Steps 3, 4 and 5

Efficiency Evaluation Are the effects worth the money? Cost-benefit, Cost-effectiveness Input and output in terms of money (Including costs of implementation)

Evaluation Map Effect evaluation Process evaluation Implemen- tation Program strategies Change objectives Behavior Health & Quality of Life Step 5 Step3-4 Step 2 Step 1-2 Step 1 Theories for methods Environment

Write Evaluation Questions Process Who are the program participants? Does program implementation match implementation planning? Effect What changes were achieved?

Develop Indicators and Measures Define constructs Look for measurable indicators for the constructs Quantify indicators into measurement device

Indicators and Measures: Program Goals Goal: increase in safe(r) sex Indicators: condom use, reduction of new STD/HIV infections Measures: self-reports (short-term), STD clinic monitoring (long term)

Indicators and Measures: Behavior Performance objectives for behavior change as indicator for behavior Carry condoms Discuss condom use Measures: Self-report, checks Questionaire items regarding actual or intended communicative behavior

Indicators and Measures: Determinants Program objectives are blueprints for measurement “After the program students can identify places where to buy condoms” “After the program students express confidence in being able to negotiate condom use”

Indicators and Measures: Environment Performance objectives for environmental change as indicator for environment School management installs condom vending machines Measures Questionaire items Observation Sales figures

Specify Evaluation Design Effect evaluation: How do indicators compare before and after the program?  pretest and posttest Can we attribute changes to the program?  random assignment, control group

Experimental group Post-test

Intervention group Pre-test Post-test

Intervention group Pre-test Post-test

Experimental group Control group Pre-test Post-test

Experimental group Control group Pre-test Post-test

Experimental group Control group Pre-test Post-test

Experimental group R Control group Pre-test Post-test

Evaluation Plan Evaluation questions, design, indicators, measurement, timing Statistical analyses and presentation of results Description of how the evaluation will be caried out