1 A proposed approach to developing indicators Use the Strategic Targets document as the basis –Recent; explicitly addresses outcomes; relatively concise.

Slides:



Advertisements
Similar presentations
Program Evaluation: What is it?
Advertisements

Results Based Monitoring (RBM)
Introduction to Monitoring and Evaluation
Protocol Development.
Global Compact Reporting Torbjörn Westman & Jenny Fransson November 4, 2014.
CTE Committee Meeting Improving our internal Perkins allocation process Friday, August 29, 2014.
Chapter 2 Flashcards.
EMS Auditing Definitions
PPA 502 – Program Evaluation
How to Write Goals and Objectives
WRITING A RESEARCH PROPOSAL
RESEARCH QUESTIONS, AIMS AND OBJECTIVES
Continuous Quality Improvement (CQI)
Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)
Indicator Baseline Target Milestones PERFORMANCE MEASUREMENTS.
SUMMARY NOTES BY REED EARLY FORMERLY OF BC OFFICE OF THE AUDITOR GENERAL Guide to Developing Key Performance Indicators for Public Sector Reporting.
PDHPE K-6 Using the syllabus for consistency of assessment © 2006 Curriculum K-12 Directorate, NSW Department of Education and Training.
Results-Based Management
National Disability Advocacy Program Reform: Measurable Performance Outcomes Thank you for your invitation, time and attention.
Evaluation methods and tools (Focus on delivery mechanism) Jela Tvrdonova, 2014.
Lecture 8A Designing and Conducting Formative Evaluations English Study Program FKIP _ UNSRI
The Audit Process Tahera Chaudry March Clinical audit A quality improvement process that seeks to improve patient care and outcomes through systematic.
1 ECGD3110 Systems Engineering & Economy. 2 Lecture 1 Introduction to Engineering Economics.
Institutionalizing Sustainability Performance Metrics Smart & Sustainable Campuses Conference 2013 Presented by Keri Enright-Kato Yale Office of Sustainability.
Course on Data Analysis and Interpretation P Presented by B. Unmar Sponsored by GGSU PART 2 Date: 5 July
The aim / learning outcome of this module is to understand how to gather and use data effectively to plan the development of recycling and composting.
Presented by Madhuriya Kumar Dutta Trade and Investment Facilitation Department Mekong Institute, Thailand 16 May 2012.
1 Designing Effective Programs: –Introduction to Program Design Steps –Organizational Strategic Planning –Approaches and Models –Evaluation, scheduling,
 Read through problems  Identify problems you think your team has the capacity and interest to solve  Prioritize the problems and indicate the.
UNESCO Institute for Statistics Monitoring and Improving Learning in the 2030 Agenda Simple Road Map to a cross-national scale Silvia Montoya, PhD Director.
Indicators to Measure Progress and Performance IWRM Training Course for the Mekong July 20-31, 2009.
Evaluation Proposal Defense Observations and Suggestions Yibeltal Kiflie August 2009.
1 Part 4 Self-review and certification Your progress as a curriculum developer Part 4 Self-review and certification Your progress as a curriculum developer.
12/10/15.  It is a Cross Life Cycle Activity (CLCA) that may be performed at any stage ◦ In fact, some part of it (e.g. risk analysis and management)
1 The Good, the Bad, and the Ugly: Collecting and Reporting Quality Performance Data.
Project Management Learning Program 23 Mar – 3 Aprl 2009, Mekong Institute, Khon Kaen, Thailand Managing for Development Results Results-Oriented Monitoring.
Project Proposal. What is Project Proposal?  A project proposal is written, to make an offer and to try to convince a supervisor or a future customer.
1 Results-based Monitoring, Training Workshop, Windhoek, Results-based Monitoring Purpose and tasks Steps 1 to 5 of establishing a RbM.
St. John’s, Antigua May What is STAP? In 1994, the GEF Instrument sets up STAP – “UNEP shall establish, in consultation with UNDP and the World.
CRITICAL THINKING AND THE NURSING PROCESS Entry Into Professional Nursing NRS 101.
Quality Assessment of MFA’s evaluations Rita Tesselaar Policy and operations Evaluation Department Netherlands Ministry of Foreign Affairs.
Interventions Identifying and Implementing. What is the purpose of providing interventions? To verify that the students difficulties are not due to a.
Performance Improvement Project Validation Process Outcome Focused Scoring Methodology and Critical Analysis Presenter: Christi Melendez, RN, CPHQ Associate.
UNDP Guidance for National Communication Project Proposals UNFCCC Workshop on the Preparation of National Communications from non-Annex I Parties Manila,
Performance Monitoring COURTNEY MILLS SCPCSD DIRECTOR OF ACADEMIC PROGRAMS.
School Development Goal Development “Building a Learning Community”
Defining Clear Goals and ObjectivesDefining Clear Goals and Objectives Barbara A. Howell, M.A. PAD 5850.
1 Governance strategy for the Washington City Group Comments on draft proposal by Howard Meltzer (UK) February Brussels.
Aspect 1 Defining the problem - Problem: The design context will normally offer a variety of potential problems to solve. A focused problem and need is.
ABRA Week 3 research design, methods… SS. Research Design and Method.
1 Classroom Assessment Compiled by Linda Blocker.
1 DEMONSTRATION PROJECTS TO ENSURE STUDENTS WITH DISABILITIES RECEIVE A QUALITY HIGHER EDUCATION PROGRAM Performance Measurement, Program and Project Evaluation.
OED Perspective on ICR Quality Soniya Carvalho, OED Quality At Entry Course on SFs/CDD April 13, 2005 * Contributions from OED’s ICR Review Panel members.
How to Write a Project Proposal Specialization Introductory Module Thursday, May 9, 2013 Barbados.
Lies, Damned Lies & KPIs Part Deux Improving quality: Developing KPIs for Stage 0 & beyond 20 th September 2011 National Improvement Leads NHS Improvement.
 Community Health Status Assessment MAPP Phase 3 California Gaining Ground Coalition Small County Learning Community August 13, 2015 Tamara Maciel Bannan,
Mitigation, Enhancement and Monitoring Session 9 Health in SEA.
Performance Improvement Project Validation Process Outcome Focused Scoring Methodology and Critical Analysis Presenter: Christi Melendez, RN, CPHQ Associate.
Capital Project / Infrastructure Renewal – Making the Business Case
Environmental Health Management (EN481)
Session 1 – Study Objectives
The Systems Engineering Context
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 2. Session 6. Developing indicators.
Performance Improvement Project Validation Process Outcome Focused Scoring Methodology and Critical Analysis Presenter: Christi Melendez, RN, CPHQ Associate.
Courtney Mills Principal, Midlands Middle College
Dr. Olivier Thunus UNECE Task Force Vice-Chair
School of Dentistry Education Research Fund (SDERF)
Discussing Targets and Benchmarks
Presenter: Kate Bell, MA PIP Reviewer
What is a CA document? Date: Authors: March 2005 March 2005
Presentation transcript:

1 A proposed approach to developing indicators Use the Strategic Targets document as the basis –Recent; explicitly addresses outcomes; relatively concise Steps: 1.Categorize all outcome statements in terms of their measurability in principle. 2.Brainstorm potential indicators for each outcome considered measurable in principle. 3.Assess lists of potential indicators against a set of criteria to focus on strongest candidates. 4.Seek information from others to test feasibility. 5.Proposal to ExCom (test relevance). 6.Develop a measurement strategy.

2 Step 1: Possible categories A: Likely measurable; can readily think of potential indicators. B: Possibly measurable; outcome is not entirely clear or there are questions that need to be answered before measurability can be decided. C: Determinable but not measurable; it is possible to determine objectively though qualitatively whether the outcome has been met, but it does not readily support quantification. C1:Not measurable but examples of progress may be identified. D: Not measurable; difficult to see how the outcome could be measured, even in principle. E: Not an outcome.

3 Step 3: Possible criteria for assessing/ranking indicators Validity – does the indicator really measure what it purports to measure? Feasibility – will measurement data for this indicator be technically and practically possible to obtain? Objectivity – is the indicator based on data collected by an independent source and/or using methods that are potentially verifiable? Value for money – is the cost of measuring the indicator reasonable in the context of the information it provides? Relevance – is the information relevant to decisions that may be taken? Comparability – will the measurements yield meaningful comparisons (e.g. time periods, geographic regions)? Clarity – will the meaning of the indicator value and trends be readily understood by its intended audience?

4 Step 6: Contents of a measurement strategy Description of the performance indicators Data sources Definitions and methodology Known limitations of the indicator Data collection responsibility Frequency of data collection Reporting methods and frequency Target level and date to achieve target Baseline level and date of baseline measurement