Using iSIKHNAS for Budget Advocacy 2.2 Using iSIKHNAS data to estimate and compare performance indicators

Objectives for this session At the end of this session you should be able to: – Calculate simple performance indicators using iSIKHNAS data – Compare performance indicators against a goal or between districts

Performance indicators in iSIKHNAS iSIKHNAS includes data that can be used to monitor performance in disease response – For example: time to respond to priority disease reports Type of response (telephone or visit) Others Can be used to support budget advocacy – – We need more resources to do our job better and to provide better animal health in district

Comparing performance indicators Use performance indicators for measuring performance: – Within a single district or province – Monitoring over time or against targets Comparisons between districts/provinces can be unfair: – Different characteristics between districts: staff levels numbers and types of farmers geography and infrastructure Resources and funding

Need to consider: If you need to compare performance indicators: – Compare only districts that are similar – Need to consider other factors, such as: the number of famers the number of animals (by species) the number of animal health workers (relative to the number of farmers or animals) numbers of reports being received geography of the area – is it easy or hard to get around? size of the area and infrastructure (roads, phone service and so on) resources (availability of vehicles, equipment, phones and so on)

Other important factors that can affect performance indicators include – Staff leave – Other priorities, for example priority disease outbreaks – Vehicle or communication breakdowns – District or provincial policies and budgets

What to do about poor performance? If performance indicators not meeting targets: – Don’t blame people – Investigate objectively why this is happening What are the underlying reasons? – Recommend changes (including extra budget) to fix situation

Example The table below shows data for response to priority disease reports for 2 Kabupaten (A and B) – Kabupaten A has a response rate of 100% compared to 89% for Kabupaten B at 89% – Discuss briefly: How do these Kabupaten compare? Is one doing “better” than the other? What other data would help understand this? KabupatenReportsResponse% response A24 100% B544889%

Example continued Other data shows: – Kabupaten A has 5 animal health workers active compared to 3 animal health workers for Kabupaten B – Kabupaten A responded to 23/24 by telephone and only 1 by a visit, Kabupaten 34/48 (71%) by phone and 14 (29%) by visit. – See Performance indicator example 1.xlsx for the example data and calculations – Does this change your view of their performance? Which do you think is doing better?

Investigate reasons for poor performance Don’t forget: There may be good reasons why a district is not meeting performance indicators or is not performing as well. It is important to investigate, identify and correct the underlying reasons, rather than just blaming someone for not doing their job.

Discussion and questions?

Exercise Exercise will be done on laptops using Excel and pivot tables The data is real data taken from iSIKHNAS Can work individually but discuss among yourselves if you wish or ask facilitator if you need help Is there anyone who doesn’t have a laptop? – Pair up with someone who has Is there anyone who hasn’t used pivot tables? – pair up with someone who has used pivot tables

Exercise (continued) Open Performance indicator example 2.xlsx spreadsheet See Instructions sheet and use Pivot Tables to answer the following questions 1.How many reports for each district and response rate (%)? 2.% response in < 24 hours (Days to respond = 0) for each district 3.What % of responses were by visit and what were by phone? 4.What was the maximum time to respond? 5.What was the average time to respond? 6.How do the districts compare?

Discussion Present results and discuss the findings Select a participant to present results Discuss: – What do these results show? – Assuming a goal of 80% response in <24 hours, or 95% overall, how many districts are meeting these goals? – Can you compare the districts? – What might be possible reasons for poor performance in Kabuparten B, compared to the others? See Performance indicator example 2 results.xlsx for worked example results

Final discussion Any final comments or questions?

Session summary Some performance indicators can be calculated from iSIKHNAS data using excel Performance indicators should be: – monitored for performance over time or – Compared against targets or goals Take care if comparing performance between districts – Performance can be affected by many factors – Aim is to identify causes for poor performance and fix, rather than blaming someone