1. HORIZON 2020 European Commission Research and Innovation First stakeholder workshop on Horizon 2020 Implementation Brussels, 16 January 2015

2. Research and Innovation Agenda 1. Welcome and introduction 2. Responding to broader, challenge–based topics in the Work Programme 3. Two-Stage Calls 4. Participant Portal – new set-up: Live Demo 5. Proposal preparation, applicant templates and guidance 6. Evaluation process, and feedback 7. Any other issues? 8. Conclusions

3. Research and Innovation Strategic Work Programme 65 calls (12 focus areas) for 2014 embedding key features and novelties; Broader and fewer topics; Over € 15 billion funding over first two years Simplified operations Robust IT systems and Participant Portal as a single gateway for all participants; Streamlined business processes reducing red tape. Launch of Horizon 2020: A major achievement Successful launch of first calls (WP) immediately after adoption of Horizon 2020

4. Research and Innovation More than 2.1 million visits on Participant Portal in December 2013 and, just over 3 million visits per month; More than 30,000 proposals submitted; Nearly 11,000 expert evaluators contracted (more than 60,000 experts registered); Attracted newcomers and evidence of increase in industry participation; High levels of subscription reflect the popularity of Horizon 2020. Response to H2020 calls in first ten months

5. Research and Innovation Lessons Learned from first H2020 Calls Analysis of the experiences with the first calls with the objectives: Take-stock; Prepare (necessary) corrective measures; Feed into WP cycle for 2016-17. Based on: Statistical analysis of 33 concluded calls (approx. half of calls launched in 2014) Feedback from Commission services and Executive Agencies; Feedback from Member States, and discussion in Programme Committe Feedback from some NCPs, and discussion with national coordinators Observers' reports from evaluations, and Round Table (20 January); Feedback from some stakeholders, and today's meeting!

6. Research and Innovation Responding to broader, challenge-based topics Challenge based approach generally liked by R&I community The calls are attractive, with a high demand But, therefore, sometimes lower success rates: 8x available budget, 5x under FP7. –(However, picture remains diverse) Trans-disciplinarity is encouraged in Horizon 2020 but how has it worked in practice? In particular: setting up of consortia interpretation by experts during evaluations SSH and Gender: Description in WP, and coverage in proposals can be enhanced

7. Research and Innovation Responding to broader,challenge-based topics Follow-up, for discussion: Further analysis necessary Maintain the challenge-based approach, but improve clarity of topic descriptions (e.g. impact statements) Address key features and novelties (e.g. embedding SSH, gender…) more clearly – where relevant – in the work programme

8. Research and Innovation Used more frequently than FP7, but not universal Generally welcomed Concern over second-stage success rates in some areas: E.g. Health calls had 626 /1681 proposals passing to stage two Horizon 2020 and Two-Stage Calls

9. Research and Innovation Follow-up, for discussion: Determining when two-stage calls applicable? Defining content of proposals at first stage finding balance between simplicity, and requiring sufficient information for a fair and sound go/no-go judgement Proposal length – how short? Adapting call conditions for two-stage evaluations ensuring a 1:3 (budget-wise) success rate in the second phase Horizon 2020 and Two-Stage Calls

10. European Commission Research and Innovation Lunch

11. European Commission Research and Innovation Coffee & Tea Break

12. Research and Innovation Proposal preparation and applicant templates Consistent guidance and templates across the programme (with exceptions…) Strong correspondence between templates and evaluation criteria Page-limits toughened up ('watermarking') and simplified Some concerns over definition of terms; handling of cross-cutting issues (e.g. gender)

13. Research and Innovation Proposal preparation and applicant templates Follow-up, for discussion: Review templates and guidance documents Further clarify and communicate key concepts Note: FAQs already published in summer 2014 on 'innovation', gender, SSH, RRI, trans-disciplinarity, communication…

14. Research and Innovation Evaluation process Expert Questionnaire sent to 3,336 Experts for 49 calls 97% rate overall EU evaluation process as satisfactory, good or excellent good; 90% rate it good or excellent when compared with national or international systems Consistency across the programme Individual reading; consensus; panel review Exceptionally, streamlined approaches for high volume and/or low-value and/or fast track calls Strict policy of evaluation of proposals "as they're submitted", since no negotiation No recommendations for improvement, since But – identified shortcomings can be corrected. Some concerns regarding interpretation of criteria (Impact) and new concepts (e.g. innovation management).

15. Research and Innovation Evaluation Process Follow-up, for discussion : Carry out further monitoring of implementation processes (especially 'no nego'), particularly when they affect applicants. Review wording of criteria; and procedure for ex aequos etc Update briefings and guideline documents Develop a set of minimum standards on ESR feedback Continue to encourage and engage high-quality experts

16. Research and Innovation Any other issues?

17. Research and Innovation Conclusions

18. HORIZON 2020 Thank you for your attention! Find out more: www.ec.europa/research/horizon2020