The EVA Barometer Signe Ploug Hansen Special Adviser at the unit for methodology and IQA The Danish Evaluation Institute (EVA)

Slides:

Advertisements

Similar presentations

METHODS FOR THE VALIDATION OF COMPETENCIES Training Unit 9.1 National and European policies for the validation of placement experiences.

Advertisements

Implications for Think Tanks Need to be able to: –Understand the political context –Do credible research –Communicate effectively –Work with others Need.

Develop and Validate Minimum Core Criteria and Competencies for AgrAbility Program Staff Bill Field, Ed.D., Professor National AgrAbility Project Director.

URUGUAY’s efforts to address synergies among the Conventions Workshop on synergies and cooperation with other conventions 2-4 July 2003 Espoo, Finland.

FORESTUR: “Tailored training for professionals in the rural tourist sector” ES/06/B/F/PP QUALITY MANAGEMENT PLAN Valencia, November 2006.

Brian A. Harris-Kojetin, Ph.D. Statistical and Science Policy

In Europe, When you ask the VET stakeholders : What does Quality Assurance mean for VET system? You can get the following answer: Quality is not an absolute.

Performance Assessment Process: The Employee’s Perspective May 2014.

Lecture 2b: Software Project Management CSCI102 - Introduction to Information Technology B ITCS905 - Fundamentals of Information Technology.

Quality evaluation and improvement for Internal Audit

Unit 1 Assignment 4 P4.

4 4 By: A. Shukr, M. Alnouri. Many new project managers have trouble looking at the “big picture” and want to focus on too many details. Project managers.

- Objective of the Program Evaluation - The process of the Program Evaluation.

CONTRIBUTION TO WP3 (Catalogue of Skills and Competences) TOP+ FINAL MEETING BRUSSELS

 The objective was to provide the World Bank, the League of Arab States and CAWTAR with a better understanding of your needs and interests, and of how.

The Knowledge Resources Guide The SUVOT Project Sustainable and Vocational Tourism Rimini, 20 October 2005.

FLCC knows a lot about assessment – J will send examples

Version 1 | Internal Use Only© Ipsos MORI 1 Version 1| Internal Use Only Sheffield CCG CCG 360 o stakeholder survey 2014 Summary report.

Case study Title: To measure quality of life and social participation Specific theme: To measure quality of life and social participation among HI and.

THE „ABC” OF KNOWLEDGE AND POLICY RELATIONS The Hungarian National Assessment of Basic Competences ESZTER BERÉNYI „KNOWANDPOL” PROJECT ELTE UNIVERSITY.

Participative Methods on Cultural Value Management in Rural Areas György Fekete Central Transdanubian Regional Innovation Agency Nonprofit Ltd. Budapest,

TEMPUS IV- THIRD CALL FOR PROPOSALS Recommendation on how to make a good proposal TEMPUS INFORMATION DAYS Podgorica, MONTENEGRO 18 th December 2009.

SAR as Formative Assessment By Rev. Bro. Dr. Bancha Saenghiran February 9, 2008.

CCLVET Cross Cultural Learning and Teaching in Vocational Education and Training Overview LEONARDO DA VINCI Transfer of Innovation AGREEMENT NUMBER – LLP-LDV-TOI-08-AT-0021.

Investors in People Champions. Interpretation of the Standard Purpose To give a brief overview with the necessary background information on the Investors.

The use of indicators for quality development in Denmark 1.The Quality Approach in Denmark 2.Indicators: concept and criteria 3.Use of indicators: example.

Project design & Planning The Logical Framework Approach An Over View Icelandic International Development Agency (ICEIDA) Iceland United Nations University.

3.08 b Determine venture’s information technology.

National Dissemination Seminar, Dublin.

UNFCCC secretariat, Financial and Technical Support Programme Daisuke Maeda, Junior Professional Officer Compilation of survey responses relating to decision.

 Introduction Introduction  Contents of the report Contents of the report  Assessment : Objectives OutcomesObjectivesOutcomes  The data :

MAINSTREAMING MONITORING AND EVALUATION IN EDUCATION Can education be effectively managed without an M & E system in place?

Pan-Canadian Quality Standards in International Credential Evaluation Keith Johnson - January 23, 2009 Prepared for: NARTRB Assessment Project - Learning.

Workshop 4 Monitoring by Statistical Indicators Goal setting & formulation of operational objectives as a key challenge of monitoring systems Case 1: The.

EDU 385 CLASSROOM ASSESSMENT Week 1 Introduction and Syllabus.

4T – Through Theatre to Talents Topic 5: analyses aimed at highlighting the training and educational needs of the actors and of the different professional.

UNESCO Institute for Statistics Monitoring and Improving Learning in the 2030 Agenda Simple Road Map to a cross-national scale Silvia Montoya, PhD Director.

Summary of Local Seminars & Focus Groups 20/06/ Athens WP8 – TESTING II coordinated by IFI.

1 Commissioned by PAMSA and German Technical Co-Operation National Certificate in Paper & Pulp Manufacturing NQF Level 2 Communicate at work.

1 REVIMP From review to improvement Dr. Adrie Visscher Faculty of Behavioural Sciences The Netherlands.

SANREM TOP Framework GECAFS Interpretation. SEE Conditions (Social, Economic, Environmental) Assessed Practices Changed KASAC (Knowledge, Attitudes, Skills,

Office of Special Education Programs U.S. Department of Education GRANT PERFORMANCE REPORT FOR CONTINUATION FUNDING.

For a better built environment 1 Driving Relevance of Built Environment Professions in the context of Africa’s Developmental Agenda By Bheki Zulu CEO –

1 Ch. 4 Outline Introduction to Planning 1.Planning Fundamentals 2.Levels of Planning 3.Strategic Planning.

Kerry Cleary An evaluation of the impact of Values Based Interviewing at the OUH Values Based Conversations and wider engagement strategies.

Working in Partnership

1 Tempus Tempus Workshop Sarajevo 7 June 2006 « Good practice in Preparing an Application » Anne Collette European Training Foundation Tempus Department.

Kathy Corbiere Service Delivery and Performance Commission

QILT May Webinar1. Just before we get started… Who are we? How questions will be handled Resources available after the webinar QILT May Webinar 2.

Internal Auditing Effectiveness

Workshop For Reviewers Operating the Developmental Engagements Prof. Dr. Hala SalahProf. Dr. Hoda ELTalawy.

ASSESSMENT DO THIS, NOT THAT! UNIVERSITY AT BUFFALO ASSESSMENT DAY

PHE portal update Anne Brice Mahesh Patel. PHE portal Progress so far Relationship between AKM and Online Services workstreams Engaging with content users.

EVALUATION OF THE SEE SARMa Project. Content Project management structure Internal evaluation External evaluation Evaluation report.

Towards a European Qualifications Framework Relevance beyond Europe? Moscow 18 April 2006 Jens Bjornavold European centre for development of vocational.

2009 Annual Employee Survey U.S. Department of Housing and Urban Development December 29,2009 (updated January 8, 2010)

Ministry of Education, Denmark, 2006 Guidance in Denmark - A new guidance system in the educational sector Marianne Kragh Jørgen.

ACF Office of Community Services (OCS) Community Services Block Grant (CSBG) Survey of Grantees Satisfaction with OCS Survey of Eligible Entities Satisfaction.

Citizenship and Human Rights Education Assessing progress with the help of the Council of Europe Charter.

“To begin with the end in mind means to start with a clear understanding of your destination. It means to know where you’re going so that you better understand.

Chairman, Danish Council for Research Policy

Thursday 2nd of February 2017 College Development Network

Self Directed learning

ابزار گرد آوری داده ها 1- پرسشنامه 2- مشاهده 3- مصاحبه

Kirsi Hiltunen 16 December 2015 Baku, Azerbaijan

Academic Development Survey By School Spring 2007

Valvira The National Supervisory Authority for Welfare and Health

MONITORING AND EVALUATION IN THE GEF

MONITORING AND EVALUATION IN THE GEF

Presentation transcript:

The EVA Barometer Signe Ploug Hansen Special Adviser at the unit for methodology and IQA The Danish Evaluation Institute (EVA)

Overview of the presentation What is a barometer good for? Why did EVA go for a barometer? What is the content of the EVA Barometer? What kind of information does a barometer provide? What does it take to use the barometer concept? How to get started?

What is a barometer good for? Can summarise external (as well as internal) feedback by providing performance indicators Provides you with overall expressions of the performance of your agency Represents a strong communicative tool for informing external stakeholders about the performance Validates the information you get from individual surveys

Why did EVA go for a barometer? Reduce information overload created by a growing number of internal and external feedback surveys Benefit from the fact that many isolated surveys had much overlapping in terms of themes Achieve an overall view of EVA s performance in terms of these common themes Be able to provide clear and simple information about the performance of the agency

The content of the EVA barometer 1/2 The seven themes: The quality of information provided by EVA EVAs abilities in terms of cooperation EVAs abilities in terms of process management EVAs knowledge & abilities in terms of evaluation methods EVAs sector specific knowledge and understanding The usefulness of the quality assurance process The quality of the final evaluation report.

The content of the EVA barometer 2/2 Questions of the theme information (translated versions): How satisfied or dissatisfied were you with EVAs information about: 1.the process of the project? 2.the content of the project? 3.the method(s) applied? 4.your workload? Possible answers: Satisfied, Largely satisfied, Largely dissatisfied, Dissatisfied

What kind of information does a barometer provide? The information theme as an example: External experts Quality assured institutions/programs Givers of assignments Receivers of EVAs quality assurance surveys % 83 % 87 % Information. Barometer: 83% Identical questions regarding information Percentage of positive answer (satisfied + largely satisfied) (ex) Barometer

What does it take to use the barometer concept? A number of equally relevant surveys focusing on the same themes related to the performance of the agency Several questions related to each theme in each of the surveys Identical questions in each of the surveys Some years of stability concerning the content of the surveys and thus the activities of the agency Methodological and technical competencies to construct valid surveys and analyse the data

How to get started? Identify relevant surveys for the barometer Identify relevant themes Formulate a minimum of four questions related to each theme. Ensure that the questions make sense in all the surveys by testing them among potential respondents Start using the new questions in all the relevant surveys at the same time