Sub-group "Indicators" Grange November, 2012
Response to Questions Do we need indicators? Yes. Helps in focusing on objectives, to make self- assessments, measure changes/trends (assuming that we continue with same objectives/indicators) Do we need to define "indicator"? Answer: yes. – Other concepts around indicator should also be clarified as well as the relations between them e.g. next question: indicator, data, information, analysis etc. etc.
Characteristics of good indicators? Should be: –Linked to the objectives of legislation, guidance or any other standards –Linked to strategic objectives –Reflect efficiency, effectiveness, impact –Describe achievement towards targets/goals –Valid, unambiguous adequate, reliable, specific, sensitive, relevant and easily obtainable
Input process output Initial situation Outcome Consumer Goals Process indicators Impact indicators Relevance Adequacy
Types of indicators Different indicators may measure different things, like: –Process (compliance with plan) –Effectiveness (output vs. goals) –Efficiency (output-input ratio) –Impact (initial situation vs. final) –National, regional, local level –Producing relevant and meaningful indicators at national level is a challenge: requires a lot of coordination, cooperation and communication Might need to be a (relatively) independent, objective process
More questions/topics Examples of indicators (explaining the boxes in the diagram How to measure? Could we find a "common set" of indicators, measures, metrics? Principles for designing performance indicators Criteria for good indicators? How to: Strategic objectives SMART objectives, operational targets metrics/measures indicators? Communication with stakeholders? (understood, accepted) – Sometimes controversial e.g. enforcement indicators Continuous or periodic measurement?
Examples (positive) Compliance – compound indicator using: – Number of inspections – Level of risk-based targeting – Grading of non-compliances Contaminant monitoring programme: proportion of positive samples, outcome of follow-up, timeliness – Depends on a number of factors… (e.g. proficiency testing) Animal health – incidence, out-breaks in the context of eradication programmes e.g. – BSE, salmonella
Examples (bad) Number of controls carried out – Not sufficient alone