OGB Partner Advocacy Workshop 18 th & 19 th March 2010 Indicators

2 Indicators can be process or impact Indicators can be direct or indirect (proxy), quantitative or qualitative Provide the basis for monitoring, reviews and evaluation A specific measure that, when tracked systematically over time, indicates successful implementation, and progress (or not) towards an outcome or impact.

Targets and indicators Indicators tell us what we want to measure Targets have specific values attached to show what has to be achieved by when Targets need to be achievable and realistic and are usually set against the baseline data A good indicator is a combination of indicator and target

Types of Indicators Process Indicators / Milestones Typically track “Activities” or “Outputs” Help to manage implementation Examples could be: Number of community events held Number of research papers developed Outcome and Impact Indicators Track specific measurable features of the changes the intervention is aiming to bring about Help to monitor performance Examples could be: Number of issue mentions in policymaker speeches Regulation formally established Equitable access to healthcare

Types of Indicators cont.’ Direct Indicators Used for objectives that relate to directly observable change Usually a more precise, comprehensive and operational restatement of the respective objective Indirect (proxy) indicators Used when: The achievement of the objective is not directly observable (quality of life) Measurement will incur high costs or resources for measurement are not available The achievement is measurable only after long periods beyond the life of the activity

Why develop outcome indicators? Helps us answer the question: “How will we know success when we see it” Allow us to track progress and test out our theory of change Can help to ensure alignment among different intervention activities “What gets measured, gets done” Drives all subsequent data collection, analysis, and reporting

7 Developing good outcome indicators Clear: precise and unambiguous Relevant: appropriate for the subject at hand Economic: available at a reasonable cost Adequate: able to provide sufficient basis to assess performance Monitorable (reliable) : amendable to independent validation Gender Sensitive: reflecting the different interests of and effects on women and men

Developing good outcome indicators Avoid vague/ambiguous terms like… –To increase awareness –Appropriate use –Beneficiary involvement –Increased participation –Good understanding You may know what you mean, others may not!!

9 Developing good outcome indicators Consider what would indicate to you that the outcome or impact has been achieved. What would success look like? You can’t measure everything – For each outcome you want the minimum number of indicators that helps you to answers the question: “Has this outcome been achieved?” Identifying good indicators is an iterative process – they should not be thought of as cast in stone – expect to add new one, and drop old ones Involve key stakeholders

Safe sex education Develop and deliver training on safe sex to teenagers in Sandton Teenagers in Sandton know how HIV is transmitted; the effects of HIV/Aids & how safe sex protects them from transmission Sandton teenagers believe that safe sex is important Teenagers in Sandton practice safe sex Sandton teenagers know how to have safe sex Assumptions Lack of knowledge/ skills is the underlying root problem Group training is an effective means of imparting knowledge/ skills Increase in knowledge leads to a chain in behaviours

Developing indicators Choose an interim outcome, and identify your ‘so that’ (20 min) Identify assumptions/ critical success factors (15 min) Brainstorm ideas for indicators (30 min) This should be real brainstorming. Don't worry about how feasible an idea is, or whether it is possible to measure, or whether any data exists. The point is to get as many ideas on the table as possible. Review indicators (30 min) Are they CREAM – y? Are they process/output indicators? Or outcome indicators? Are they quantitative (ie/ numbers) or are they qualitative (measuring subjective experiences). What ‘population of interest’ are they measuring? Ie/ a system or structure? Or an individual, family or community? Select one or two indicators to present to the larger group.

Develop and deliver training on safe sex Teenagers in Sandton know how HIV is transmitted; the effects of HIV/Aids & how safe sex protects them from transmission Sandton teenagers believe that safe sex is important Teenagers in Sandton practice safe sex Sandton teenagers know how to have safe sex Sandton teenagers knowledge of…

Examples – Process Indicators New website developed Number of press releases developed & distributed Number of rallies or marches held (and attendance) Number of meetings held with decision maker Number of policy papers distributed Funding secured Number of outreach attempts to reporters

Example: Measuring Empowerment Societal Behavior Individual and Collective Agency Opportunity Structure Enabling Environment

Example: Measuring Empowerment AgencyOpportunity Structure Societal Behavior Youth, especially girls are increasingly aware of, and willing to use, the social resources available to them in the face of violence. New municipal initiatives passed and resourced to create safer spaces for women, and new police task forces devoted to gender violence. Greater municipal budget expenditures on gender violence prevention. Basic principles of interpretation of the Domestic Violence Law are more consistently carried out by judicial actors, such as public action, accessibility, secrecy and cost- free service.

Examples – Interim Outcome Indicators Awareness Percentage of target population with knowledge of an issue Website activity for portions of website dealing with advocacy-related information Number of followers on social media websites

Examples – Interim Outcome Indicators Organisational Capacity Increased knowledge about strategic advocacy planning & implementation Improved media skills Increased ability to get and use M&E data Political Will Number of issue mentions in policymaker speeches Number of votes for or against specific legislation Increased decision- maker inquiries

Examples – Outcome Indicators Policy Goals New proposals or guiding principles developed Policy formally introduced Policy formally established Policy implemented in accordance with requirements Funding levels established/ sustained for policy implementation

Examples – Impact Indicators Improved services and systems Affordable access to services More services Better quality services Positive social and physical conditions Decreased maternal mortality Reduced greenhouse gas emissions