Quality assurance : state of progress

Slides:



Advertisements
Similar presentations
Debriefing/brainstorming meeting for the training of experts for agency reviews Decision making process on the reviews: experiences from the ENQA Board.
Advertisements

The EMCDDA and the Reitox network: towards quality achievement Sandrine Sleiman, Scientific Committee, Palmela, February 2008.
Quality feedback: Validation of TDI Standard Table submitted in 2005 (2004 data) Sandrine Sleiman, Xavier Poos September 2006.
Strenghtening collaboration with Serbia - IPA4 Project expected outcomes Frédéric Denecker, Programme Management Officer Reitox and International Cooperation.
Quality evaluation and improvement for Internal Audit
Sub-regional Workshop for the Gulf Countries to Launch the Education for All National Assessments Sharjah, June, 2013 National EFA 2015 Review Technical.
2 nd Steering Committee Meeting October 2008, Athens and Aegina.
Quality Assurance at the European Monitoring Centre for Drugs and Drug Addiction Sandrine Sleiman European Conference on Quality in Official Statistics,
TEMPUS IV- THIRD CALL FOR PROPOSALS Recommendation on how to make a good proposal TEMPUS INFORMATION DAYS Podgorica, MONTENEGRO 18 th December 2009.
APRE Agency for the Promotion of European Research Lifecycle of an FP 7 project Caterina Buonocore Riga, 13th September, 2007.
PILOT PROJECT: External audit of quality assurance system on HEIs Agency for Science and Higher Education Zagreb, October 2007.
1 Framework Programme 7 Guide for Applicants
Work Package 4 Learning Process for Reflective Policy Making 3rd TECHNICAL AND SCIENTIFIC COMMITTEE AND STEERING COMMITTEE MEETING 18 Sept – Thessaloniki.
18 March th meeting of the Evaluation Expert Committie 1 Thematic Working Group „Ex post Evaluation Guidelines” State of play Jela Tvrdonova.
Marina Signore Head of Service “Audit for Quality Istat Assessing Quality through Auditing and Self-Assessment Signore M., Carbini R., D’Orazio M., Brancato.
Second expert group meeting on Draft fiche on delegated act on the European code of conduct on partnership (ECCP) Cohesion Policy
Audit of predetermined objectives Presentation: Portfolio Committee on Economic Development March 2013.
The FP7 Inputs for building a project proposal AN INFORMATION POINT FOR FP7 IN PALESTINE: Training Seminar of experts Nicosia, Cyprus November.
ELDD Reflection – past, present and future 29th Meeting of the Scientific Committee, 18 Nov 2008.
United Nations Statistics Division Work Programme on Economic Census Vladimir Markhonko, Chief Trade Statistics Branch, UNSD Youlia Antonova, Senior Statistician,
SEA in the Czech Republic Prague, 24 September 2008.
1 Information by the Managing Authority on EU funds evaluation Monitoring Committee meeting October 15, 2009.
The FDES revision process: progress so far, state of the art, the way forward United Nations Statistics Division.
EVALUATION OF THE SEE SARMa Project. Content Project management structure Internal evaluation External evaluation Evaluation report.
Methodology of RIA for European integration purposes and practical examples Outsourcing RIA preparation to external consultants: project management issues.
Developing National Capability for Integrated Border Management (IBM) in Lebanon Project Funded by the European Union Implemented by the International.
1 Presentation of the second External evaluation of the University of Luxembourg ( ) Luxembourg, February 17 nd 2011.
1 Recent developments in quality related matters in the ESS High level seminar for Eastern Europe, Caucasus and Central Asia countries Claudia Junker,
Evaluation Expert Committee 2nd meeting SYNTHESIS OF THE ANNUAL PROGRESS REPORTS FOR 2007 CONCERNING ONGOING EVALUATION Irina RAMNICEANU Helpdesk Evaluation.
BENCH-CAN Internal evaluation 2nd semester
Global Coordination Platform
Audit of predetermined objectives
Template Contents of the Low Carbon Development Strategy (LCDS)
RCA Project on Establishing a Benchmark for Assessing the Radiological Impact of Nuclear Power Activities on the Marine Environment in the Asia and Pacific.
Predetermined Objectives – 2013/14
The revised Periodic Reporting Questionnaires: general features Alessandra Borchi Policy and Statutory Meetings Section UNESCO World Heritage Centre.
Sectoral Qualification Framework
Report by the VICH Steering Committee on issues raised by Forum members during the 1st Outreach Forum meeting Hervé Marion, DVM VICH Secretariat.
REPORT OF THE ELECTRONIC WORKING GROUP UNEP(DEC)/CAR WG.29/INF.12
Guidelines and template for A vital statistics report
Seminar on ESA 2010 Metadata
Draft OECD Best Practices for Performance Budgeting
Draft Article 8 MSFD assessment guidance
Presentation ESF performance report AIR 2016 ESF Technical Working Group 9 February 2018 Brussels Costanza Pagnini.
WORKSHOP 17th Sept 2008 EUROPEAN COMMISSION
16 May 2018 Briefing to the Portfolio Committee of the Department of Sport and Recreation portfolio on the review of the draft APP.
Internal Quality Assurance in Higher Education in Europe
Rolling Review of Education Statistics
Presentation title Integrated template for the NC7 in-depth review report and the BR3 technical review report 5th Lead Reviewers Meeting Bonn, 28 February-1.
Employee Performance Management System
ENQA Agency Reviews – main changes from the old review process
OECD Work on material flows and resource productivity
Introduction to the training
Helene Skikos DG Education and Culture
Education and Training in the Area of Safety Assessment Irina Sanda
Item 11 – Conclusions – ETS 2018 WG meeting
Education and Training Statistics Working Group – 2-3 June 2016
Conclusions of the seminar
DG Environment, Unit D.2 Marine Environment and Water Industry
2012 Annual Call Steps of the evaluation of proposals, role of the experts TEN-T Experts Briefing, March 2013.
The study... Study on Stakeholders´ Involvement in the Implementation of the OMC in Social Protection and Social Inclusion.
Quality Reporting in CBS
Main recommendations & conclusions (1)
DG Environment, Unit D.2 Marine Environment and Water Industry
ESTP course on 'Advanced issues in International Trade in Goods Statistics' 2-4 April 2014 QUALITY HANDBOOK.
DG Environment, Unit D.2 Marine Environment and Water Industry
… Two-step approach Conceptual Framework Annex I Annex II Annex III
Role of Evaluation coordination group and Capacity Building Projects in Lithuania Vilija Šemetienė Head of Economic Analysis and Evaluation Division.
ESS conceptual standards for quality reporting
Presentation transcript:

Quality assurance : state of progress Sandrine Sleiman, Scientific Committee, Lisbon, 16 June 2009

1. Quality assurance : latest developments New guidelines for national reporting for 2009 New criteria for the assessment of the implementation of the 5 KI - Updated quality reports

2. National reports : overview of Quality Reports accessibility of data timeliness relevance of information accuracy, coherence, comparability

I) Accessibility of data : Punctuality

I) Accessibility of data : Punctuality ST+SQ** Deadline By 30/09/2008 615 reports By 31/10/2008 913 reports **not counting: EDDRA, FAR, test country reports, draft reports (not submitted), deleted reports

I) Accessibility of data NR 2008 : 3535 pages ** The shortest report was 58 pages in length and the longest 221 ** No report from EL and MT Data flows increase, validation work also ….

II) Timeliness (reporting year 2007-2008) NR contains in general most recent data available at the FP, although few exceptions Time lag between study is carried out and results published = constraint When no new data available many countries mention when new figures will be published

III) Relevance of information Many interesting information reported Level of details varying from sections and from countries to others A few countries doing “cumulative” reporting : → difficult to find changes → risk to loose an important new information “hidden” in old text (e.g. one number only changed)

IV) Accuracy Methodologies of studies are usually well described BUT with some exceptions such as for DRD definitions, more details are needed, this is adressed in QR without much effect so far … Few cases of information not reported in the NR although existing-available data (legal and institutional framework)

IV) Coherence Few discrepencies between figures in STs and NR Data reported in ST not analysed in the NR and data reported in NR not reported in STs e.g. cohort studies in DRD, drug-related crime, ST 12 on prisons…→ complementarity of NR and other tools could be improved

IV) Comparability Reasonable level of adherence to guidelines Overall trends by gender, over time and geographical areas are described In some countries, it is still too early to have many information on trends

Situation getting better ?

More and more countries are taking into account EMCDDA recommendations content wise !

After all, which changes ? Comments included in the QR are more detailed QR becoming more consistent Criteria for qualitative sections were adapted Became more interactive tool, more feedback on the feedback…

Challenges New structure, new guidelines → new QR Increase complementarity with other QA tools, e.g. 5KI assessment Better integration of Fonte feedbacks for more consistency Further improvement of Fonte QR as an opportunity for improvement, useful tool at national level

3. Capacity development 4 Pillars: 1- EU RTX Academies: participation of all the NFPs and interested experts on topics of EU interest. 2- National RTX Academies: national trainings and/or conferences for specific interest for the host NFP 3- Direct Financial contribution: upon request within the framework or developing the implementation of the 5 key Indicators. 4- Main tool for technical assistance for candidate and and potentail candidate countries

3. Capacity development EU RTX Academies: 1st Academy of the year is always linked to the mandatory Selected Issue To define the other topics: input from the scientific units taking into account the EMCDDA 3 YWP input from RTX unit after having analysed and drafted all the Quality reports Input from the NFPs CONSTRAINT: BUDGET

Username: ReitoxAcademy Please find all PP and related documents on the RTX Academy web page http://academy.emcdda.europa.eu Username: ReitoxAcademy Password: qwe123 xavier.poos@emcdda.europa.eu

THANK YOU FOR YOUR ATTENTION