Evaluating and scoring scientific papers in bibliographies and the connection to SICRIS and COBISS systems Ljubljana, 8 th October 2013 Dr. Stojan Pečlin

Sources of Quantitative Data - COBISSCOBISS

The introduction of COBISS as an evaluation tool increased the objectivity of the evaluation process, Introduction of the COBISS database as the official database for publications used in the evaluation procedures in 1997 gave a significant momentum to the change of habits in publication, It caused a shift toward publishing in international journals with high reputation, The reputation of researchers is no longer based on abstract criteria but is grounded on solid quantitative data, The criteria for evaluating publications are available and anyone is easily able to determine the significance of publications according to pre-set criteria.

On-line bibliographic data: COBISS

Typology of documents for bibliography management in COBISS – selected documents 1.01 Original scientific article (from 40 to 300 points), 1.02 Review article, 1.16 Chapter in a monograph published by an international science publishing house – 60 points, 2.01 Monograph published by an international science publishing house points, 2.24 Patent awarded at the European Patent Office, U.S. Patent Office – 200 points, 2.20 Data publication (Zaključena znanstvena zbirka podatkov) – 30 points

Sources of Quantitative Data - SICRIS

SICRIS incorporates substantial information on research and research results, provides information on all projects funded by public funds, an integral system which supplements COBISS with more substantial information.

Score for a quantitative assessment Quantitative assessment type SourceMaximum score A 1 - Sicris scoreSicris (COBISS)5 A 2 - norm number of pure citations Sicris (Web of Science)10 A 3 - funds of other usersAgency10 A 4 – exceptional achievements in scientific excellence Sicris (COBISS, WoS)2

PETER DOVČ [05098] Criteria for determining eligibility for a principal investigator of research project A1 (0-5) maximum value 1500 points Doseženo število točk:735 Note: 2,45 A2 (0-10) maximum value 600 points Doseženo število citatov: 1061 Note:10 Shows a minimum total score of scientific publications in the last five years, as cited in the last ten years and documented collaboration with other funders in the last five years and the outstanding achievements. Note (A1+A2+A3+A4): 15,47

Eligibility criteria –entry conditions The limit value of the sum A1+A2+A3+A4 which the project leaders must have in the application for each field separately – the values for 2013 are: Basic project: A1+A2+A3+A4=5.5 natural sciences A1+A2+A3+A4=5.0 technical sciences A1+A2+A3+A4=2.5 medical sciences, pharmaceutical sciences and geology A1+A2+A3+A4=3,5 biotechnology and biology A1+A2+A3+A4=2.0 social sciences and clinical medicine A1+A2+A3+A4=2.5 humanities

Use of quantitative indicators Pre-filtering focused on scientific and broader criteria is for potential applicants already done in a stage of eligibility screening. Determination of researchers who can automatically enter the second round of assessment on the basis of the sum of indicators (A1+A2+A3+A4). An important reason for introducing this was to decrease the burden of administration, at least for the majority of researchers who already have a rich bibliographic record to prove their excellence.

Thank you for your attention!