This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European Union within.

Slides:



Advertisements
Similar presentations
Implementing NICE guidance
Advertisements

Matthias Wentzlaff-Eggebert, BZgA, Cologne, Germany This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which.
Decision Making Tools for Strategic Planning 2014 Nonprofit Capacity Conference Margo Bailey, PhD April 21, 2014 Clarify your strategic plan hierarchy.
Program Evaluation. Lecture Overview  Program evaluation and program development  Logic of program evaluation (Program theory)  Four-Step Model  Comprehensive.
Does It Work? Evaluating Your Program
ECVET WORKSHOP 2 22/23/24 November The European Quality Assurance Reference Framework.
1 Why is the Core important? To set high expectations – for all students – for educators To attend to the learning needs of students To break through the.
Comprehensive M&E Systems
Project Cycle Management (PCM)
Objectives and Indicators for MCH Programs MCH in Developing Countries January 25, 2011.
Challenge Questions How good is our strategic leadership?
Evaluation. Practical Evaluation Michael Quinn Patton.
How to Write Goals and Objectives
Evaluating Physical Activity Intervention Programs Thomas Schmid, PhD Physical Activity and Health Branch CDC Atlanta, Georgia, USA.
Community Planning Training 1-1. Community Plan Implementation Training 1- Community Planning Training 1-3.
SMART GOALS As Related to APPR.
How to Develop the Right Research Questions for Program Evaluation
FORMATIVE EVALUATION Intermediate Injury Prevention Course August 23-26, 2011, Billings, MT.
Monitoring Evaluation Impact Assessment Objectives Be able to n explain basic monitoring and evaluation theory in relation to accountability n Identify.
Gender Analyze in Project cycle. The pre-planning stage of a project is the stage when you or your partner organisation start to draw up ideas for a project.
Standardizing Success: Evidence-Based Guidelines for Youth Peer Education Robyn Dayton, MPH FHI Photographer unknown, USAID Photo Gallery.
1. 2 Why is the Core important? To set high expectations –for all students –for educators To attend to the learning needs of students To break through.
Striving for Quality Using continuous improvement strategies to increase program quality, implementation fidelity and durability Steve Goodman Director.
1 Framework Programme 7 Guide for Applicants
Impact assessment framework
Competency Area A: Communicating with Paraprofessionals.
INTERNATIONAL LABOUR ORGANIZATION Conditions of Work and Employment Programme (TRAVAIL) 2012 Module 15: Capacity development and training on Maternity.
Fundamentals of Evaluation for Public Health Programs ROBERT FOLEY, M.ED. NIHB TRIBAL PUBLIC HEALTH SUMMIT MARCH 31,
KEY ASPECTS AND RECOMMENDATIONS IN EARLY CHILDHOOD INTERVENTION STEFANIJA ALIŠAUSKIENĖ 2009Budapest.
Developing Indicators
Evelyn Gonzalez Program Evaluation. AR Cancer Coalition Summit XIV March 12, 2013 MAKING A DIFFERENCE Evaluating Programmatic Efforts.
Workshop 6 - How do you measure Outcomes?
1 Analysing the contributions of fellowships to industrial development November 2010 Johannes Dobinger, UNIDO Evaluation Group.
Monitoring & Evaluation Presentation for Technical Assistance Unit, National Treasury 19 August 2004 Fia van Rensburg.
Model Name Transition Project Learning Network Workshop 3 IYF Transition Project.
1. Housekeeping Items June 8 th and 9 th put on calendar for 2 nd round of Iowa Core ***Shenandoah participants*** Module 6 training on March 24 th will.
EDPQS in 10 minutes: Overview of European Drug Prevention Quality Standards (EDPQS) With financial support from the Drug Prevention and Information Programme.
CONDUCTING A PUBLIC OUTREACH CAMPAIGN IMPLEMENTING LEAPS IN CENTRAL AND EASTERN EUROPE: TRAINERS’ HANDBOOK Conducting a Public Outreach Campaign.
HUMAN RIGHS BASED APPROACH TO PROGRAMMING 22 November 2011 Barbro Svedberg.
1 Direction scientifique Networks of Excellence objectives  Reinforce or strengthen scientific and technological excellence on a given research topic.
Screen 1 of 22 Food Security Policies – Formulation and Implementation Policy Monitoring and Evaluation LEARNING OBJECTIVES Define the purpose of a monitoring.
School Improvement Partnership Programme: Summary of interim findings March 2014.
Name Speaker This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European.
A Collaborative Community Based Approach to Disaster Management
The P Process Strategic Design
Community Planning 101 Disability Preparedness Summit Nebraska Volunteer Service Commission Laurie Barger Sutter November 5, 2007.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Developing a Framework In Support of a Community of Practice in ABI Jason Newberry, Research Director Tanya Darisi, Senior Researcher
Name Speaker This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European.
Swedish Rural Network Self assessment Nordic Baltic Rural Network meeting
1 The project is financed from the European Union funds within the framework of Erasmus+, Key Action 2: Cooperation for innovation and the exchange of.
Monitoring Afghanistan, 2015 Food Security and Agriculture Working Group – 9 December 2015.
Office of Service Quality
Carolin Vierneisel This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European.
Evaluating Engagement Judging the outcome above the noise of squeaky wheels Heather Shaw, Department of Sustainability & Environment Jessica Dart, Clear.
Session 2: Developing a Comprehensive M&E Work Plan.
Childhood Neglect: Improving Outcomes for Children Presentation P21 Childhood Neglect: Improving Outcomes for Children Presentation Measuring outcomes.
European Social Fund Promoting improvement 15 th March 2016 Nigel Finch.
Development of Gender Sensitive M&E: Tools and Strategies.
Assessment/Evaluation Make evaluation a central part of planning – not an afterthought 1) Determine Needs 2) Determine Desired Outcomes 3) Determine Activities.
Evaluation Planning Checklist (1 of 2) Planning Checklist Planning is a crucial part of the evaluation process. The following checklist (based on the original.
Improved socio-economic services for a more social microfinance.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
Wisconsin Personnel Development System Grant Click on the speaker to listen to each slide. You may wish to follow along in your WPDM Guide.
Module 9: Transition and Exit Strategy ASEAN Training of Trainers (TOT) on Disaster Recovery.
Logic Models How to Integrate Data Collection into your Everyday Work.
What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.
Civil Society Facility and Media Programme Call for proposals: EuropeAid/162473/DH/ACT/Multi Webinar no. 3: Preparing effective Concept Note.
What is a Logic Model? A depiction of a program showing what the program will do and what it is to accomplish. A series of “if-then” relationships that.
Presentation transcript:

This work is part of the Joint Action on Improving Quality in HIV Prevention (Quality Action), which has received funding from the European Union within the framework of the Health Programme. Succeed Training Presentation Präsentationsinhalte ©Viveca Urwitz

TITLE Background information on Succeed How to use Succeed How to make use of the results The content of the presentation

TITLE What can you gain by using Succeed?

Succeed can help you Direct interventions to focus on impact and sustainability Define your good practice Identify your gaps Involve the people who are doing the work in the change process Involve important stakeholders and representatives of key populations

Succeed can also help you Clarify roles Redefine and improve areas that have become habitual Document your work and report on progress in a systematic way

Complications when using Succeed Understanding the difference between QI and evaluation Resistance to change in general Using Succeed, some serious deficiencies in the project might become evident. People involved might feel attacked and become defensive.

Succeed: Background Succeed is modelled on general ideas about QA and QI Succeed is based on a scientific review of success factors in Health Promotion. Succeed is a questionnaire developed from 13 general success factors found in the review

Background continued: The questionnaire was adapted for HIV-prevention including SRHR in 2011 by IQhiv. The original QI tool called ”How to Succeed in Health Promotion Projects” was published in a scientific paper, Health Promotion International, 2001 The original QI tool was evaluated and recommended by the Swedish Health Authority

Succeed parts and materials - who should use them ? MaterialsParticipantFacilitator/LeaderOrganiser 1.QuestionnaireXXX 2. Case studyXXXXX 3. User guideXXXXX 4. Succed a knowledge- based tool XXX

The Succeed questionnaire – an overview 3 main categories: Structure Process Results 13 success factors used as key indicators, a set of questions for each indicator

Three interdependent categories commonly used in QA and QI Process How is the the work carried out ? Results Intermediate or end outcomes and results Structure How is the work organised

CategoryIndicators Structure  Goals  Key Population(s)  Approach  Responsibility  Organization  Resources Process  Support and Participation  Networks  Reach & Response Results  Measuring Effects  Environmental, Operational & Social Changes  Sustainability

Quality Assessment The more indicators are fulfilled, the better the quality. Questions answered YES or with a positive answer supporting the existence of the indicator point to good quality and achievements. Questions answered NO or with a negative answer stating the lack of the indicator in question often indicate a gap and need for improvement.

Quality improvement At the end of each set of questions : 1.Make a small summary for the indicator 2.Note the achievements 3.Consider the needs for improvement. Are changes important, meaningful, cost effective? 4.Discuss briefly what to do, who will do it and by when

The ”to do, by who and by when” can be summarised into an action plan to improve the project

Structure - Indicators How a project or program is organized  Goals  Key Population(s)  Approach  Responsibility  Organization  Resources

GOALS There is often a hierarchy of goals overall goals, intermediate goals, often called subgoals or objectives. Sometimes there are precise targets Goals can change Learn how to set SMART goals Complicated projects might need ’Project Logic’, for instance a Logical Framework Approach ( LFA) for a hierarchy of goals.

SMART GOALS SPECIFIC : Exactly what should have changed at the end of the project MEASURABLE : Possible to measure or clearly describe ACHIEVABLE/ATTAINABLE : Possible to reach RELEVANT : Relevant to the problem/ key population TIME BOUND: By when should the goals be attained

KEY POPULATIONS Why did you choose the key population? What was your rationale ? Are you targeting them directly? What do need to know about your key population? Which type of data do you have already? What more do you need? Is there Second Generation Surveillance in the country or useful local studies? Are you aiming at intermediaries? What do you know/need to know about them?

APPROACH Do you have a written or visual model of how the project should work ? Is the model based on scientific theory? Do the methods you use have evidence or are they regarded as ”good practice” ? Can the project have negative effects for anyone? Perhaps one of the improvements is to visualise the model and consider if it is working /realistic ?

Group Work 1 (45-60 min) Form groups of maximum 4 people. If possible with similar projects. Keep the group for the Succeed training. Group members should pick one of the projects represented in the group to practice on. Preferably an ongoing project. The person who knows the project answers the questions on goals, key population and approach, in discussion with the other group memebers.

RESPONSIBILITY Who initiated the project ? Who decided on the project ? Is it actively backed by key stakeholders including representatives of the key population? Is it backed by the key stakeholders for funding?

ORGANISATION Are there clear roles and responsibilities within the project team, including volunteers Is there a clear leadership in the team? Is the project seen as an delineated activity with relative independence by the parent organisation? Are time plans realistic? Is there a risk management strategy, a plan B?

RESOURCES Is there enough funding? How is the balance betwen resources and level of ambition? Do staff and volunteers have enough skills? Are there adequate facilities?

Group Work 2 (45 min.) The already established groups continue, in the same fashion as in Group Work 1, to answer the questions on Responsibility, Organisation and Resources

Process How the work Is carried out  Support and Participation  Networks  Reach & Response Process indicators

SUPPORT AND PARTICIPATION How well do key stakeholders and collaborating partners in the project support the project and the approach? Are there clear roles and agreements/contracts? Is there an analysis of lack of support and obstacles on different levels? Is there an analysis of participation by target groups/key populations and collaborating partners in the work?

NETWORKS Defined group of people who are important for the implementation and where you need contact/communication for a defined purpose. It can be existing groups or created groups. Roles have to be considered. Multipliers are a very important group Are there possibilities for these groups to develop understanding and capacity How do you support ‘committed enthusiasts’?

REACH AND RESPONSE Extent and intensity of reach of communication and measures for key populations/ special target groups Can you follow to what degree the target groups/key populations receive and absorb whatever is intended? Are there feedback systems/KAB studies/ focus groups etc.? What is good enough ?

Groupwork 3 (60 min) Use the same group work method for Support and Participation, Networks and Reach and Response

Results: Intermediate or end outcomes and results  Knowledge, attitude and behavioural change  Environmental, Operational & Social Changes  Sustainability Results indicators

WHAT IS POSSIBLE TO ACHIEVE? ”Results” is a challenging issue What can prevention affect? The end points of a project are those that the project was set up to directly affect. Decide yourselves what should be your results! Goals and objectives are important platforms for the monitoring of results.

THE IMPORTANT QUESTION Is it at all possible for your project to answer this question : ARE WE PROGRESSING TOWARDS OUR GOALS?

KNOWLEDGE, ATTITUDE AND BEHAVIORAL CHANGE Are there baseline studies and follow-ups? Pick a few questions from the national surveillance and add a few of your own. Use the help of experts and include this cost in funding applications. A few simple measurements are better than none. Having a rough plan is better than none!

ENVIRONMENTAL, OPERATIONAL AND SOCIAL CHANGES Changes in services and operations in own or other organisation or service provider Changes in the social situation of the key population/target group Changes in policy or legal framework Structural changes in funding sitaution Etc.

SUSTAINABILITY Does the project show promise and need more time? If so, are there planned actions on this? Pilot projects will often not have long-term effects despite good results. Plans on how to incorporate work into long- term and regular activities or make the project into a long-term activity are therefore important.

Groupwork 4 (30-45 min.) Group work on changes (behavioural, environmental, operational and social) and sustainability. Would it be possible for the project to answer the „important question“? What about the other participants, could they answer it for their own projects ?