The Assessment of COST Actions PHOENIX Workshop in Kyrgyzstan, 21-22 May 2007 “Road to excellence: Research evaluation in SSH“

Slides:



Advertisements
Similar presentations
European Commission DG Research Co-operative Research Training Session on Ifigeneia Pottaki Research & SMEs DG Research - European Commission Training.
Advertisements

Tüzin BAYCAN-LEVENT ERC Advanced Grant Evaluation.
European COoperation in the Field of Scientific and Technical Research Role and rules of procedure for Management Committee Carine Petit Science Officer.
Information and Communication Technologies (ICT) in the Seventh Framework Programme Support actions.
Page 1 Marie Curie Schemes Science is not the whole story! (How to write a successful Marie Curie RTN Proposal) Siobhan Harkin.
1 The FP7 Framework Programme “ERC (IDEAS)” Ayala Karniol ISERD.
NMP-NCP meeting - Brussels, 27 Jan 2005 Towards FP 7: Preliminary principles and orientations… Nicholas Hartley European Commission DG Research DG Research.
Malta Council for Science and Technology Seventh Framework Programme (FP7) 15 July, 2008 Anthea Frendo FP7 National Contact Point.
Cyprus Project Management Society
Introducing Trans-Domain Proposals pilot procedure Lieve VAN DAELE BELSPO - Brussels, 14 March 2014 by courtesy of COST Office TDP Science Officers.
DR MACIEJ JUNKIERT PRACOWNIA BADAŃ NAD TRADYCJĄ EUROPEJSKĄ Guide for Applicants.
Cultural Heritage related research at COST Cultural Heritage related research at COST Piotr Świątek Science Officer Physics and Materials Hanne Römich.
Capitalising the full potential of online-collaboration for SME innovation support Horizon 2020 call Innosup (Participant Portal code: H2020-INNOSUP )
Provisional draft The ICT Theme in FP7 Submission and Evaluation (preliminary information) ICT-NCP Information Day 19 th October 2006.
Regional Policy Managing Authorities of the ETC programmes Annual Meeting W Piskorz, Head of Unit Competence Centre Inclusive Growth, Urban and.
The implementation of the rural development policy and its impacts on innovation and modernisation of rural economy Christian Vincentini, European Commission.
Ministry of Education and Religious Affairs General Secretariat for Research and Technology EEA Financial Mechanism Research within Priority.
1 The FP7 Framework Programme “ERC (IDEAS)” Eva Rockman ISERD.
Culture Programme - Selection procedure Katharina Riediger Infoday Praha 10/06/2010.
SMEs "Perspectives of SME participation in FP 7“ SEE Innovation - workshop Sofia, 9th February 2006 Henrik Dam European Commission DG Research, Research.
APRE Agency for the Promotion of European Research Lifecycle of an FP 7 project Caterina Buonocore Riga, 13th September, 2007.
1 Framework Programme 7 Guide for Applicants
Research Call Information Seminars Research and Codex Division University Limerick, Thursday 11 th April DAFM Offices, Backweston, Monday 15 th.
Global Action Plan and its implementation in other regions Meeting for Discussion of the draft Plan for the Implementation of the Global Strategy to Improve.
Work Programme for the specific programme for research, technological development and demonstration "Integrating and strengthening the European Research.
Technology Strategy Board Driving Innovation Participation in Framework Programme 7 Octavio Pernas, UK NCP for Health (Industry) 11 th April 2012.
1 NEST New and emerging science and technology EUROPEAN COMMISSION - 6th Framework programme : Anticipating Scientific and Technological Needs.
Practical aspects Dr. Ir Matthijs Soede Senter/EG-Liaison “Practical Aspects of Preparation FP6 projects Poznan - 21 November 2002 Dr. Ir.
European COoperation in the field of Scientific and Technical research A New Era has begun for COST Dr.-Ing. Martin Grabert Director COST Office, Brussels.
“Thematic Priority 3” Draft Evaluation of IP + NoE.
November New Programme Projects of National Importance Lm25,000 Specific Programme still under development.
Integrated Database Management at FCT Foundation for Science and Technology - FCT Fundação para a Ciência e a Tecnologia PORTUGAL João G. Crespo Vice-President,
1 SMEs – a priority for FP6 Barend Verachtert DG Research Unit B3 - Research and SMEs.
April_2010 Partnering initiatives at country level Proposed partnering process to build a national stop tuberculosis (TB) partnership.
Participation in 7FP Anna Pikalova National Research University “Higher School of Economics” National Contact Points “Mobility” & “INCO”
DETERMINE Working document # 4 'Economic arguments for addressing social determinants of health inequalities' December 2009 Owen Metcalfe & Teresa Lavin.
María Amor Barros del Río Gender as content in research in Horizon 2020 GENDER AS CONTENT IN RESEARCH IN HORIZON 2020 CAPACITY BUILDING WORKSHOP FOR RESEARCHERS.
The Research Excellence Framework Impact: the need for evidence Professor Caroline Strange 22 June 2011.
The RDI Governance System Vasileios Pitsinigkos Head of Managing Authority of Eastern Macedonia - Thrace Region.
COMPETITIVE AND SUSTAINABLE GROWTH Research DG European Commission Expressions of interest / Dedicated call mechanism.
The partnership principle and the European Code of Conduct on Partnership.
COMPETITIVE AND SUSTAINABLE GROWTH Science, research and development European Commission Søren Bøwadt, M&T,I Workshop on Virtual Institutes 28th of Sept.
Preliminary Survey on forming an Africa-Lics network Erika Kraemer-Mbula & Watu Wamae All African Globelics Seminar on Innovation and Economic Development.
Technology Needs Assessments under GEF Enabling Activities “Top Ups” UNFCCC/UNDP Expert Meeting on Methodologies for Technology Needs Assessments
TEN-T Executive Agency and Project Management Anna LIVIERATOU-TOLL TEN-T Executive Agency Senior Programme and Policy Coordinator European Economic and.
EVALUATION OF THE SEE SARMa Project. Content Project management structure Internal evaluation External evaluation Evaluation report.
Partnership Health: Evaluation and possibilities for an adapted structure Agenda item 11 Madhavi Bajekal, ONS (UK) PH coordinator Directors of Social Statistics.
Evaluation of proposals Alan Cross European Commission.
Jörg Niehoff European Commission DG Research - Unit T4: SMEs SMEs in the.
Date: in 12 pts Marie Skłodowska-Curie Actions Award criteria Education and Culture Policy Officers DG EAC.C3 People NCPs Training on H2020, Brussels,
Horizon 2020 Ian Devine European Advisor – UK Research Office University of Manchester, 11 September 2014.
Towards Gendered Science and Research: Gender Mainstreaming in the EU Science Policies Alexandra Bitusikova 7 September 2005 Bratislava, Slovakia.
Experience from H2020 Proposals (a personal assessment)
2. The funding schemes ICT Proposer’s Day Köln, 1 February 2007 The ICT Theme in FP7 How to participate to ICT in FP 7.
ARTEMIS Industry Association Title Presentation - 1 e.g. SCALOPES e.g. SCAlable LOw Power Embedded PlatformS.
Social Protection Global Technical Team Retreat,
Formas Annual Open Call 2017
EVALUATION OF GENDER RESPONSIVE BUDGETING PROGRAMME IN NEPAL
INEA Innovation and Networks Executive Agency
Eurostat D2 – Regional Indicators and Geographical Information
The role of the ECCP (1) The involvement of all relevant stakeholders – public authorities, economic and social partners and civil society bodies – at.
…and still actual for a post-2010 strategy!
The partnership principle in the implementation of the CSF funds ___ Elements for a European Code of Conduct.
European Innovation Platform for Knowledge Intensive Services Elke Van Tendeloo DG Enterprise and Industry Brussels, 04 June 2007.
Culture Statistics: policy needs
The evaluation process
Juan Gonzalez eGovernment & CIP operations
Key steps of the evaluation process
Role of Evaluation coordination group and Capacity Building Projects in Lithuania Vilija Šemetienė Head of Economic Analysis and Evaluation Division.
Presentation transcript:

The Assessment of COST Actions PHOENIX Workshop in Kyrgyzstan, May 2007 “Road to excellence: Research evaluation in SSH“

2 COST Domain Committee (DC) main tasks: a. Quality Control Assessment of proposals for new Actions Monitoring of Actions in progress Evaluation of completed Actions b. Dissemination and exploitation of the results of a COST Action.

3 Conflict of Interest –Standard good practice in science funding schemes requires that any individual with an interest in a proposal for funding should not take part in the selection process. Assessment of new Action proposals –New Action proposals are assessed and selected from submissions to a continuous and thematically Open Call, normally with two collection dates a year. Proposals submitted after a collection date are retained for the next collection date.

4 Characteristics of a COST Action high scientific/technological quality in an innovative way (interdisciplinary topics are also welcome); contribute substantially to the coordination of research efforts across Europe and to the strengthening of Europe's scientific networking capacity (in the context of the European Research Area); contribute strongly and visibly to European society, economic growth and welfare by producing results of potential interest to important sectors such as public authorities, policy institutions, standards bodies and/or private companies and industry; be based on a) careful consideration of the level of interest and relevant research resources in the countries likely to participate in the Action; b) assessment of the added value expected from the coordination of national research efforts by the Action; be flexible enough to permit the inclusion, at the implementation stage, of disciplinary perspectives and activities not foreseen during the preparation of the proposal; identify and take into account R&D efforts supported by other national and international funding schemes; encourage capacity building and the mobility of early-career European researchers.

5 Selection Procedure: Preliminary Proposal (1) Preliminary Proposals –The initiative of preparing a new Action proposal is normally taken by a group of European researchers, Submission –the Preliminary Proposal is submitted on-line (max 10,000 characters -equivalent to about 1500 words. –The Proposer is asked to indicate the preferred Domain. –The text must be in English A pre-check is performed by the COST Office –Does the Proposal conform with the specified template? [NO = Reject] –Are 5 or more COST Member States involved in the Proposal? [NO = Reject] –Does the Proposal seek funding for research? [YES = Reject] –Is there obvious duplication with work currently or recently supported by COST or other funding schemes? [YES = Reject] The COST Office allocates the Preliminary Proposal to the relevant Domaine. Any Preliminary Proposal which cannot readily be allocated to a COST Domain, because its topic is unusually broad and inter-disciplinary, is considered as a Trans Domain Proposal

6 Selection Procedure: Preliminary Proposal (2) The DC chair, supported by the COST Office, allocates to each proposal sufficient Assessors, i.e. DC members or external experts, to ensure that a minimum of six assessments are completed for each proposal. The Assessors mark their allocated Preliminary Proposals on the basis of the criteria at Annex A by assigning between 1 and 4 marks to each criterion. Access to the marking database is password protected. Marks become visible only when at least six Assessors have entered their marks. The marks assigned by each Assessor are automatically added. If the average total of all Assessor marks for the Proposal fails to reach the threshold of 70% of the maximum achievable score, the Proposal is not considered for invitation to submit a Full Proposal. To overcome inter-Domain variation in scoring practice, a process of statistical normalisation is applied. The COST Office provides for each Domain a table with the total Assessor marks,and derived from that the average mark and the standard deviation for all proposals. In order to ensure reasonable parity across all fields of science and technology supported by COST, while maintaining the principle of open competition, invitations to submit a Full Proposal are considered within each of three Science Clusters, established in line with the Science Cluster structure in the COST Office: –Cluster “Life Sciences” (Biomedicine and Molecular Biosciences; Food and Agriculture; Forests, their Products and Services), – Cluster “Natural Sciences” (Chemistry and Molecular Sciences and Technologies; Earth System Science and Environmental Management; Materials, Physics and Nanosciences) – Cluster "Science for Society” (Information and Communication Technologies, Individuals, Societies, Cultures and Health; Transport and Urban Development).

7 Full Proposals Full Proposal format : –as Rich Text Format (.rtf) or a word (.doc) file. –in English –The proposal should consist of a title page and two parts: Part I – the draft Technical Annex (mandatory) Part II – Additional information (recommendation)

8 Part I - Draft Technical Annex (1) ABSTRACT (Max 200 words, max 5 keywords or very short phrases) BACKGROUND (max 2-3 pages – up to 2250 words) –B.1 General background –B.2 Current state of knowledge –B.3 Reasons for the Action –B.4 Complementarity with other research programmes

9 Part I - Draft Technical Annex (2) OBJECTIVES AND BENEFITS (max 2 pages – up to 1500 words) –C.1 Main/primary objectives –C.2 Secondary objectives –C.3 How will the objectives be achieved? –C.4 Benefits of the Action –C.5 Target groups/end users

10 Part I - Draft Technical Annex (3) SCIENTIFIC PROGRAMME (max 3-4 pages – up to 3000 words) –D.1 Scientific focus –D.2 Scientific work plan – methods and means ORGANISATION (Maximum 2 pages – up to 1500 words) –E.1 Coordination and organisation –E.2 Working Groups –E.3 Liaison and interaction with other research programmes –E.4 Gender balance and involvement of early-stage researchers

11 Part I - Draft Technical Annex (4) TIMETABLE (max ½ page – up to 500 words) ECONOMIC DIMENSION (max ½ page – up to 500 words) DISSEMINATION PLAN (max 2 pages – up to 1500 words) –H.1 Who? –H.2 What? –H.3 How?

12 External Expert Panel : –Five members –normally co-ordinated by the DC chair –the consensus meeting –Any Proposal recommended –the threshold is 40 points.