Group Work on Indicators Objective: To develop a list of priority indicators (both results and process) for each intervention point for further refinement.

Slides:



Advertisements
Similar presentations
X4L Prog Mtg – March 05 Evaluation – What works best - when and why? Prof Mark Stiles Project Director: SURF X4L, SURF WBL, SUNIWE and ICIER Projects Head.
Advertisements

1 Drafting a Standard n Establish the requirements n Agree the process n Draft the Standard n Test the Standard n Implement the Standard.
Goal Attainment Scales Definitions Examples Scoring.
Multiple Indicator Cluster Surveys Data Interpretation, Further Analysis and Dissemination Workshop Basic Concepts of Further Analysis.
An anthropologist’s view of surveys 1. Surveys are overused. It is better to get general information on a site or population from existing data sets and.
Data Collection and Analysis. Objectives of Phase II Building relationships with data staff at district and state levelsBuilding relationships with data.
Designing and Developing Decision Support Systems Chapter 4.
 Interviewing individuals  Interviewing groups  Observing workers  Studying business documents 1.
Survey Design Steps in Conducting a survey.  There are two basic steps for conducting a survey  Design and Planning  Data Collection.
Collecting Quantitative Data
Selecting Your Evaluation Tools Chapter Five. Introduction  Collecting information  Program considerations  Feasibility  Acceptability  Credibility.
Background: The Tobacco Control Evaluation Center (TCEC) is a statewide evaluation technical assistance center funded by the California Department of Public.
Chapter 12 Collecting Qualitative Data. NARRATIVE INTERVIEWING Establishing Data Collection Procedures for Narrative Interviewing Establishing Data Collection.
Project evaluations a framework for your own project.
Chapter 10 Collecting Quantitative Data. SURVEY QUESTIONNAIRES Establishing Procedures to Collect Survey Data Recording Survey Data Establishing the Reliability.
Participants should expect to understand: Concept of M&E Importance of gender in M&E Different steps in the M&E process Integrating gender into program/project.
Chapter Three Chapter Three.
Copyright © 2014 by The University of Kansas Choosing Questions and Planning the Evaluation.
Chapter 33 Conducting Marketing Research. The Marketing Research Process 1. Define the Problem 2. Obtaining Data 3. Analyze Data 4. Rec. Solutions 5.
The Vocabulary of Research. What is Credibility? A researcher’s ability to demonstrate that the study is accurate based on the way the study was conducted.
Secondary and Primary Data AMA Collegiate Marketing Research Certificate Program.
Nine steps of a good project planning
Edward M. Haugh Jr. ESC Consultant. III. Recommendations for Applying Outcomes Planning to ESC  I. Introduction to Outcomes Planning II. A Sample ESC.
Program Evaluation Using qualitative & qualitative methods.
MAST: the organisational aspects Lise Kvistgaard Odense University Hospital Denmark Berlin, May 2010.
Step 6: Implementing Change. Implementing Change Our Roadmap.
INTRODUCTION TDHS is a nationally representative household-based survey designed to provide data for measuring measure levels, patterns, and trends in.
Chapter 13 Data Sources, Sampling, and Data Collection.
Evaluation of the Indianapolis, Indiana September 2002 – August 2003 Stamp Out Syphilis Coalition.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
1 What are Monitoring and Evaluation? How do we think about M&E in the context of the LAM Project?
MARKETING RESEARCH CHAPTERS
Chapter 8 Marketing Research. The Information Pyramid Info Advantage Information Parity Information Deficit.
SUB-MODULE 5. MEANS OF VERIFICATION RESULTS BASED LOGICAL FRAMEWORK TRAINING Quality Assurance and Results Department (ORQR.2)
Question Formulation Technique
Stop the Madness: Use Quality Targets Laurie Reedman.
Chapter 9 Survey Research. Chapter Outline Topics Appropriate to Survey Research Guidelines for Asking Questions Questionnaire Construction Self-administered.
Needs Assessment. Process for identifying the knowledge and skills necessary for achieving organizational goals Tool for identifying the problem and selecting.
GROUP 2 Practical C. Question 1 Cut off will depend on the country situation : 1 pig may be significant Frequency distribution – take the lower 10 – 20%
Evaluation To consider evaluation theory and apply it to the Welcome to Your Library project plans and begin to determine steps projects needs to take.
Program Evaluation.
Aim: Review Session 1 for Final Exploratory Data Analysis & Types of Studies HW: complete worksheet.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 24, 2009.
Focused Review of Improvement Indicators A Self-Assessment Process SPP Stakeholder Meeting December 16, 2009.
Chart Organization KNR Types of Documentation  Program management KNR 278 WPO, specific program plans, policy & procedures, risk management plan,
November 20, 2008Global Health Group University of California, San Francisco Franchise Evaluation Study priorities.
Situation Analysis. 2 Policy and planning Key messages Situation analysis is more than burden of disease (BoD) Also include SDH, population expectations.
Making it Count! Program Evaluation For Youth-Led Initiatives.
Program Evaluation for Nonprofit Professionals Unit 3: Collecting the Data.
Deeping Skill in Working with Logical Frameworks Examples.
Patrick Kent Watson Sir Arthur Lewis Institute of Social and Economic Studies The University of the West Indies St. Augustine.
SESSION 3: SETTING PRIORITIES – COMPARATIVE ADVANTAGE AND OPTIONS ANALYSIS.
Monitoring Activities Answer the Following Questions: What is being done? Scope How well is it being done? Quality Are we doing it on a large enough scale?
Produce Your Questions Four essential rules for producing your own questions: Ask as many questions as you can. Do not stop to discuss, judge, or answer.
 Statistics is the collection, analysis, interpretation, presentation, and organization of data.
Medical Certification on Cause of Death Session V: Verbal Autopsy.
Logic Model, Monitoring, Tracking and Evaluation Evaluation (Section T4-2)
EVALUATION RESEARCH To know if Social programs, training programs, medical treatments, or other interventions work, we have to evaluate the outcomes systematically.
Choosing Questions and Planning the Evaluation. What do we mean by choosing questions? Evaluation questions are the questions your evaluation is meant.
Chapter 3: Needs Assessment. Needs Assessment, defined: The measure against which program implementation and outcome will be compared. “A needs assessment.
Chapter 29 Conducting Market Research. Objectives  Explain the steps in designing and conducting market research  Compare primary and secondary data.
Chapter 2 Research Methods Please fill in your slides as we proceed.
Available measurement tools and methods Current efforts, priorities Available measurement tools and methods Current efforts, priorities.
Prioritizing Online Course Preparedness Using PACE Matrix
Market Research.
THE QUESTION FORMULATION TECHNIQUE
The Question Formulation Technique (QFT)
The Question Formulation Technique (QFT)
THE QUESTION FORMULATION TECHNIQUE™
Short user guide to educational expenditure data and indicators
Presentation transcript:

Group Work on Indicators Objective: To develop a list of priority indicators (both results and process) for each intervention point for further refinement

Step One For your outcomes and outputs, ask how one might measure progress? Consider both program-based measurment level: information from program sources (client records, service statistics, client and provider interviews, etc.) and Population based surveys (DHS, etc.)

Group Work on indicators Develop a list of indicators and their data sources or means of verification (MOV) Determine in each case if the data exists (in service statistics, surveys programs records etc.) OR if it would be necessary to collect new data (interviews with staff, clients, focus groups, household surveys etc.)

Group work on indicators -Once you have listed indicators and MOV, Prioritize the indicators by importance and ease of obtaining data Give high priority to those that are important AND can be (relatively) easily measured Give lower priority to those that are judged to be less important AND difficult to measure Discuss the advantages and disadvantages as well as the practicality of the remaining indicators

Matrix for prioritization EASYFEASIBLE REQUIRES EFFORT DIFFICULT HIGH IMPORTA NCE HIGH PRIORITY WORTH COLLECTING IF POSSIBLE LOW IMPORTA NCE WORTH COLLECTING ONLY IF PART OF INSTRUMENT FOR IMPORTANT INDICATOR WORTH COLLECTING ONLY IF NECESSARY FOR IMPORTANT INDICATOR LOW PRIORITY

Group work on indicators