IST programme 1 IST KA3: The Evaluation Introduction & Contents Principles Outline procedures Criteria and Assessment What this means for proposers

IST programme 2 IST KA3: The Evaluation Independent Anonymous Confidential Impartial Objective criteria Human fallibility Basic Principles

IST programme 3 IST KA3: The Evaluation Procedures (1): before the Evaluation Pre-registration of proposals Appointment of expert panels NDAs and notification of Interests Reading the Manuals Proposal eligibility screening

IST programme 4 IST KA3: The Evaluation Procedures (2): During the Evaluation Initial Briefing Reading, commenting and scoring Panel discussion Ranking of proposals Reporting and justification Consensus meeting of readers

IST programme 5 IST KA3: The Evaluation Procedures (3): after the Evaluation IST Committee approval Notification of Decision Contract Negotiation

IST programme 6 IST KA3: The Evaluation Assessment Criteria 1 Scientific/Technical Quality & Innovation 2 Community added value and contribution to EC policies 3 Contribution to Community Social Objectives 4 Economic Development, S&T prospects 5 Resources, Management and Partnership

IST programme 7 IST KA3: The Evaluation Scoring Numerical points scale from = Unsatisfactory, out of scope or incomplete 1 = Poor 2 = Fair 3 = Good 4 = Very Good 5 = Excellent

IST programme 8 IST KA3: The Evaluation Weighting and thresholds for RTD bids Criterion 1, threshold 3; weighting 4 Criterion 2, threshold 2; weighting 1 Criterion 3, threshold - ; weighting 1 Criterion 4, threshold 3; weighting 2 Criterion 5, threshold 2; weighting 2

IST programme 9 IST KA3: The Evaluation What evaluators look for - fast The Vision Thing - Originality - Significant innovation Credibility - Realism - Precision and clarity

IST programme 10 IST KA3: The Evaluation What the evaluators assess 1 Scientific/technological quality & innovation Does it contribute significantly to Key Action S&T issues? What is the overall quality, strengths and weaknesses? How original is it? How far does it claim to extend the ‘state of the art’? How credibly will it achieve this? How risky is it & what is the risk/benefit balance? Are the approach, methodology and workplan credible? Are there good self-assessment procedures?

IST programme 11 IST KA3: The Evaluation What the evaluators assess 2 Community added value and contribution to EC policies Does it clearly identify and address European issues? Is there clear value in doing it at the European level? What is the expected impact at the European level? What is the European added value of the Consortium? Does is give ‘critical mass,’ complementary expertise? Does it further EC policy on (e.g.) Standards and SMEs?

IST programme 12 IST KA3: The Evaluation What the evaluators assess 2 Community added value and contribution to EC policies Does it clearly identify and address European issues? Does it reinforce national and international actions? Is there clear value in doing it at the European level? Does it help solve European problems? What is the expected impact at the European level?

IST programme 13 IST KA3: The Evaluation What the evaluators assess 3 Contribution to Community Social Objectives Will it contribute to Quality of Life, Health and Safety? Will it improve employment prospects and skills? Does it help the environment or resource conservation?

IST programme 14 IST KA3: The Evaluation What the evaluators assess 4 Economic Development S&T prospects Are there good potential applications? How good is the exploitation plan? Can the partners exploit the results? Will it have a strategic impact on the market? Will it create new business for users? Will it be widely disseminated to the right people?

IST programme 15 IST KA3: The Evaluation What the evaluators assess 5 Resources, partnership and management Is there a good management plan? Are there clear milestones and monitoring? Is there a good decision process? Are the partners good? Can they do all the tasks, without duplication? Are the resources right? Is the budget reasonable?

IST programme 16 IST KA3: The Evaluation What this means for Promoters Be ‘in scope’ - get the right Action Line - discuss with the PO Be eligible Register the proposal Follow the Guide to Promoters Read the Guidelines for Evaluators

IST programme 17 IST KA3: The Evaluation What this means for Promoters (2) Stand out from the crowd - make a clear pitch, quickly - justify it precisely - no promotional hype - clear English - well illustrated

IST programme 18 IST KA3: The Evaluation What this means for Promoters (3) Part B - defined objectives - domain expertise - significant innovation - research methodology - the right work packages

IST programme 19 IST KA3: The Evaluation What this means for Promoters (4) Part C - policy contribution - avoid bullshit - tight management - strong partnership - future business model

IST programme 20 IST KA3: The Evaluation What this means for Promoters (5) Part A - reasonable budget - committed partners - summary information