Monitoring and Evaluation Second International Seville Seminar on Future-Oriented Technology Analysis (FTA): Impacts on policy and decision making 28th- 29th September 2006 Workshop 3B Monitoring and Evaluation

Proposals Futures for Universities Convince relevant stakeholders of the need for evaluations Learn from the evaluation community Establish mechanisms for interaction and learning between the FTA and evaluation communities Adopt good practices Understand the rationale for evaluation Establish relevant evaluation issues Articulate verifiable objectives for different stakeholder groups Identify relevant variables, indicators and measurement strategies Prepare the ground for benchmarking Go beyond customised, stand-alone evaluations Compare similar and dissimilar FTA initiatives

Proposals Futures for Universities Convince relevant stakeholders of the need for evaluations Establish FTA notification scheme Identify generic groups of stakeholders and develop arguments likely to persuade them of the merits of evaluation exercises and dispel their fears Accountability Value-for money Learning Process improvement Cost reduction Identification of opportunities and threats etc. Devise mechanisms to ensure easy access to these arguments Urge convinced stakeholders to promote/insist upon the evaluation of all FTA activities

Proposals Futures for Universities Learn from the evaluation community Produce idiot’s guides to evaluation and FTA to improve the communication and sharing of basic terminology, concepts, practices etc. Launch initiatives designed to bring both communities together On-line discussion fora Workshops Working Groups etc. Exploit the fact that there are already some overlaps between these communities by asking experts with established roles in both communities to play leading roles in these initiatives Take advantage of a COST 22 window to invite evaluators and FDA specialists to discuss the evaluation of FDAs in Athens next year

Proposals Futures for Universities Adopt good practices Identify good practices in the evaluation community and develop into generic guidelines Set up working groups to identify context specific needs of FTA evaluations Convince FTA commissioners to discuss evaluation and monitoring needs at the design stage Include evaluation experts in strategy development teams