INTRODUCTION TO BIBLIOMETRICS 1

History Terminology Uses 2

History First scientometric applications were developed to improve use of bibliographic databases and to extend information services (e.g. find the best journal to read/publish/subscribe). A consequence of the growth of knowledge and the evolution of little science to big science: Need for supplementing research evaluation with quantitative methods. The application to science policy has brought a new perspective. Bibliometrics evolved from a sub-discipline of library and information science to an instrument for evaluation and benchmarking. As a consequence, new fields of applications and challenges opened to bibliometrics. Tools and data sources had to be improved and extended. Public and commercial institutes are searching for new solutions in bibliometrics. Centres for science, technology and innovation research have been founded worldwide. 3

Dr. Eugene Garfield Citation Indexing The term citation analysis refers to the analysis of data derived from several references cited in various bibliographies and/or footnotes of academic publications (Garfield, 1979; Moed, 2005; Meho, 2007) Citations measure the number of times a paper has been cited as a surrogate for its scientific utility / impact / merit The origin & evolution of Citation Analysis 4

One common way of conducting bibliometric research is to use a Citation Index Concept first developed by Dr Eugene Garfield –Science, 1955 The Science Citation Index (1963) –SCI print (1960’s) –On-line with SciSearch in the 1970’s –CD-ROM in the 1980’s –Web interface (1997) Web of Science Content enhanced: –Social Sciences Citation Index (SSCI) –Arts & Humanities Citation Index (AHCI) –Conference Proceedings Citation Index (CPCI) –Books citation Index –Regional Citation Indices (Chinese, Russian, Korean, Scielo, etc) –Patent data –Data studies –Future expansions… 5

6 The Citation Index evolution: The Web of Science Universe 1+ Billion Citation links 115 million Records 28,800 Journals 75,000 Books (10K to be added) annually 8.6 Million Conference proceedings 54+ Million Patents 5+ Million Data studies and Data sets 28,800 Journals 75,000 Books (10K to be added) annually 8.6 Million Conference proceedings 54+ Million Patents 5+ Million Data studies and Data sets

Bibliometrics Terminology Publications Journals Cited References Citations Citation index Context Normalisation Fields/Subject Categories Document types Publication Year 7 Metrics Impact Altmetrics Scientometrics Webometrics Article Level Usage Metrics

Measuring Impact and Research Performance Two methodologies for the evaluation of the quality of academic research output: Qualitative: Peer review – subjective judgements by experts Quantitative: Metrics – measuring the reactions of other academics quantitatively by their behaviour. Basic metric unit is the citation - “Peer review by the whole world”! Different levels: –A single output, e.g., a paper –An academic –A department –A journal –A university/multiversity Why is measuring research quality is important? Allocating funds e.g. public/private funding, grants University Rankings, League tables (THE, ARWU, CWTS) Jobs and promotion 8

Why bibliometric methods and citation analysis are gaining popularity? + Availability of bibliometric data e.g. online bibliometric databases + Objective, easy and low cost procedure + Positive correlation with peer review Limitations - No qualitative differentiation between citations - Technical errors - Citations measure scientific impact/ utility/ merit, not quality - Citations vary across different subject fields and time - Citation coverage depends on their sources 9

Citation Analysis Applications Journal impact measurements Performance review/reports/PR Research and publication strategies Supporting grant applications/compete for funding Promotion/Recruitment Collaboration analysis University rankings REF (Research Excellence Framework, UK) Build a better repository 10

Research Performance Evaluation using Bibliometric Analysis Trend analysis and year- by - year export of data and metrics Benchmark research performance at all organization levels Collaboration analysis of all entities Journal analysis and collection development Open Access analysis Key author metrics and identify experts Funding analysis Drill down to article level metrics Import & Export datasets (up to 50,000 records per export) Repository APIs (get connected with sophisticated KPI’s) 11

University Rankings 12

University Rankings – Innovation 13

Research Excellence Framework UK 14