(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Emmanuel JAECK Prefecture of the Midi-Pyrénées region / France Warsaw 2009 EJ\Warsaw-2009.ppt Sixth European Conference on Evaluation of Cohesion Policy New Methods for Cohesion Policy Evaluation: Promoting Accountability and Learning

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Emmanuel JAECK Head of the Evaluation Unit Prefecture of the Midi-Pyrénées region (Managing Authority) FRANCE

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Midi-Pyrénées? Source :

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ A consciously instrumental approach => Looking for causal links

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ – Multi-Level System

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Single Programming Document Midi-Pyrénées 7 Priorities –23 measures 75 actions On 31 December 2006On 31 December operations entered operations entered operations planned operations planned

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ But in reality we have: 128 individual actions like Example of a heterogeneous action (territorial approach) Axe 2 ………..…….= Promouvoir les territoires de projets Measure 2.7….....= Accompagner le développement concerté et durable Action 2.7.2…….. = Soutien aux projets intégrés => Support to –Actions culturelles –Patrimoine rural –Insertion pas léconomie –Fiche industrielle et urbaine

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ For 11,800 planned operations 202 output and result indicators 18 indicators for performance reserve 6 impact indicators And on 30 th October % of indicators not correctly registered (incomplete or incoherent)

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Key factors of: 1. 2.Collection System 3.Management of indicator data

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ – Collection system A network of officers trained An information system A collection tool A procedure + A practical guide

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ – Management of Indicator Data Contact with the promoter Control by examining department Quality control

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Sensitive points: System Design Implementation Use of Indicators

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Sensitive points : System Design The system cannot reflect everything. Striking the balance between monitoring and evaluation is a must. Un système qui répond à tous les enjeux de pilotage et aussi de gestion. The objectives of the actions are sometimes vague and choosing the indicators often follows later Higher level indicators to be precisely defined very early

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Sensitive points : Implementation Bear in mind that the system cannot quickly answer to questions on effects Train and support the persons responsible for the management of indicator data throughout the period Keep track of changes of reference documents (PO et Domo)

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Sensitive points : Use of Indicators Indicators should not become final objectives Integrate the natural dynamics of each action in target setting Take into account the internal factors influencing the progress of indicator values Communiquer avec rigueur et prudence à laide dindicateurs notamment si les précautions méthodologique ne sont pas entendables

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Pragmatic System under Control Legitimate Real Obligation Control from Supervising Authority Potential Sanctions

(C) Emmanuel JAECK Warsaw 2009 Key factors of a quantitative indicator system EJ Thank you for your attention