Www.nifustep.no NIFU STEP Studies in Innovation, Research and Education The Norwegian model and the indicators chosen Gunnar Sivertsen Norwegian Institute.

Slides:



Advertisements
Similar presentations
NIFU STEP Studies in Innovation, Research and Education Bibliographic databases Towards a comprehensive coverage of the social sciences.
Advertisements

Appropriate coverage of scholarly publishing in the social sciences and humanities Gunnar Sivertsen Nordic Institute for Studies in Innovation, Research.
Shou Ray Information Service Co., Ltd.
E-resources for the social sciences A brief overview of general resources for the social sciences: –Bibliographic databases –Resources for news and statistics.
Håkan Carlsson Gothenburg University Library Bibliometrics – A Tool in the Evaluation of Science.
Bibliometrics overview slides. Contents of this slide set Slides 2-5 Various definitions Slide 6 The context, bibliometrics as 1 tools to assess Slides.
Aims Correlation between ISI citation counts and either Google Scholar or Google Web/URL citation counts for articles in OA journals in eight disciplines.
Norwegian research council’s Publication grants to Scholarly Journals Presentation to NSSJP meeting November 25th 2009 Rune R. Schjølberg, senior advisor.
Bibliometrics in Libraries 12 th September 2013 Alain Frey Strategic Business Manager
THE ROLE OF CITATION ANALYSIS IN RESEARCH EVALUATION Philip Purnell September 2010.
Web of Science Pros Excellent depth of coverage in the full product (from 1900-present for some journals) A large number of the records are enhanced with.
Araba Dawson-Andoh 122 A Alden Library
Journal Impact Factors and H index
New Web of Science Rachel Mangan Customer Education
Guillaume Rivalle APRIL 2014 MEASURE YOUR RESEARCH PERFORMANCE WITH INCITES.
SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE KIEV, 31 JANUARY.
ATLA Religion Database The ATLA Religion Database is the premier index to journal articles, book reviews, and collections of essays in all fields of religion.
The Norwegian bibliometric model Gjert Kristoffersen.
Biological Science Database Proquest WEDAD AL-HUSAINAN ISD/NSTIC Kuwait Institute for Scientific Research November/2012.
Orientation to Web of Science Dr.Tariq Ashraf University of Delhi South Campus
GL14 - Fourteenth International Conference on Grey Literature National Research Council Rome, Italy November 2012 Rosa Di Cesare, Marianna Nobile.
The Web of Science database bibliometrics and alternative metrics
The Latest in Information Technology for Research Universities.
Experiences with a bibliometric indicator for performance-based funding of research institutions in Norway Gunnar Sivertsen Nordic Institute for Studies.
Discovery tools and research assessment solutions APRIL 2012 Shahrooz Sharifrazy Regional Sales Manager.
1 Scopus as a Research Tool March Why Scopus?  A comprehensive abstract and citation database of peer-reviewed literature and quality web sources.
Bibliometrics for research evaluation Ulf Kronman Coordinator of OpenAccess.se The National Library of Sweden EuroCRIS, Brussels
The Web of Science, Bibliometrics and Scholarly Communication 11 December 2013
Does a green or golden route to OA make any difference to … Institutional evaluation and assessment of researchers … ? Gunnar Sivertsen Norwegian Institute.
SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE LVIV, 11 SEPTEMBER.
Results versus resources An analysis of publicly funded research in Norway Jan Fagerberg, TIK (University of Oslo), CIRCLE (University of Lund) and SPRU.
April 9, 2003Santiago, Chile The ISI Database: Reflecting the Best of International and Regional Research Keith R. MacGregor Sr. Vice President The Americas,
NIFU STEP Norwegian Institute for Studies in Innovation, Research and Education 7 th euroCRIS strategic seminar, Brussels Recording Research.
Access to electronic scientific information: policies, strategies and programmes The Brazilian experience Elenara Chaves Edler de Almeida Brazilian Federal.
Making Good Use of Research Evaluations Anneli Pauli, Vice President (Research)
An overview of main bibliometric indicators: Dag W. Aksnes Data sources, methods and applications Nordic Institute for Studies in Innovation, Research.
Important History Databases. America: History and Life Contains citations and abstracts to scholarly books and periodicals for United States and Canadian.
November 2005Anne Asserson Research Administration Department,UiB How can you assess your organisation through a CRIS? The Norwegian national CRIS, FRIDA,
Automated (meta)data collection – problems and solutions Grete Christina Lingjærde and Andora Sjøgren USIT, University of Oslo.
Bibliometrics toolkit Website: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx Further info: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx Scopus Scopus was launched by Elsevier in.
EuroCRIS Platform Meeting - Vienna 2-3 October 1998 CRIS as a source for tracking science publication patterns Fulvio Naldi - Carlo Di Mento Italian National.
African Studies Research Guide By: Kelly O’Brien Core Databases Key Journals Key Data Sources Print ReferenceSubject Headings Websites African Studies.
The Web of Science, Bibliometrics and Scholarly Communication
RESEARCH – DOING AND ANALYSING Gavin Coney Thomson Reuters May 2009.
MEASURING RESEARCHERS: FROM RESEARCH PUBLICATIONS AND COMMUNICATION TO RESEARCH EVALUATION Lucie Vavříková 1.
1 e-Resources on Social Sciences: Scopus. 2 Why Scopus?  A comprehensive abstract and citation database of peer-reviewed literature and quality web sources.
Open Access and the ESRC New directions in scholarly communications in the social sciences.
The Thomson Reuters Journal Selection Policy – Building Great Journals - Adding Value to Web of Science Maintaining and Growing Web of Science Regional.
 All the 16 Finnish universities enter publications to their own publication registers and submit the information to the Finnish Ministry of Education.
NIFU STEP studies in Innovation, Research and Education Peer review of impact? Options and challenges Liv Langfeldt RCN 14 April 2008.
Publication Pattern of CA-A Cancer Journal for Clinician Hsin Chen 1 *, Yee-Shuan Lee 2 and Yuh-Shan Ho 1# 1 School of Public Health, Taipei Medical University.
Measuring Research Impact Using Bibliometrics Constance Wiebrands Manager, Library Services.
CitEc as a source for research assessment and evaluation José Manuel Barrueco Universitat de València (SPAIN) May, й Международной научно-практической.
Agency for Higher Education and Educational Support Ministry of Science, Innovation and Higher Education 1 30 June 2016 The Bibliometric Research Indicator.
INTRODUCTION TO BIBLIOMETRICS 1. History Terminology Uses 2.
Tools for Effective Evaluation of Science InCites David Horky Country Manager – Central and Eastern Europe
The RCN’s advisory role
Bibliometrics and Current Research Information Systems (CRIS)
CRIStin, reporting and rewarding research
Bibliometrics toolkit: Thomson Reuters products
Proposal for piloting the VIRTA publication information service at the European level Janne Pölönen, Hanna-Mari Puuska and Gunnar Sivertsen.
ERIH PLUS Making the SSH visible, searchable and available
Bibliometric Analysis of Water Research
PCI Training May 2003 Charlotte Longhurst, Training Manager
Bibliometric Analysis of Process Safety and Environmental Protection
Bibliometric Analysis of Quality of Life Publication
IEEE Transactions Journals Scopus Viewpoint
Objectives, activities, and results of the database Lituanistika
Isid.research.ac.ir
Citation databases and social networks for researchers: measuring research impact and disseminating results - exercise Elisavet Koutzamani
Presentation transcript:

NIFU STEP Studies in Innovation, Research and Education The Norwegian model and the indicators chosen Gunnar Sivertsen Norwegian Institute for Studies in Innovation, Research, and Education

Overview of this presentation 1.Performance based funding 2.Bibliometric datasources 3.An overview of models 4.Definition and delimitation of data 5.Comparable measurement (the publication indicator) 6.The effects so far 7.Conclusions

Overview of this presentation 1.Performance based funding 2.Bibliometric datasources 3.An overview of models 4.Definition and delimitation of data 5.Comparable measurement (the publication indicator) 6.The effects so far 7.Conclusions

”The dual funding system” (A simplified model excluding international sources, etc.) Government Direct grants Historical, Political Strategic Performance based Higher Education Institutions Research Councils Projects and Programmes Competition Research Evaluation

Same aims, methods, and effects? Government Direct grants Historical, Political Strategic Performance based Higher Education Institutions Research Councils Projects and Programmes Competition Research Evaluation

Motivation in Norway: The need for more emphasis on research in the overall funding model for the Higher Education Sector Budget for HES Basic: 60%Education: 25%Research: 15% StrategicPerformance based Scholarly publications Dissertations External funding Since 2006: “Publication points” “Study points” since 2002

The model in Norway Panel evaluation, rankings External funding  Peer reviewed  Contract research, etc. Dissertations Metric indicators  Publication output  Citations  Patents Level of analysis:  Individuals  Groups  Programmes  Departments  Institutions  Countries

The publication indicator was developed in for the Government by the Norwegian Association of Higher Education Institutions The Norwegian Higher Education Sector: The Norwegian Government required: 17,000 researchers… 10,000 scientific and scholarly publications annually… Collect complete, standardized, verifiable and analyzable data for all publications! From theology to geology, from internal medicine to international relations, from macroeconomics to nano-technology… Weight the publications in a comparable way that at the same time stimulates research of good quality! Seven universities and forty-seven other HE institutions with different missions and subject areas… Make the sector agree on the model!

Overview of this presentation 1.Performance based funding 2.Bibliometric datasources 3.An overview of models 4.Definition and delimitation of data 5.Comparable measurement (the publication indicator) 6.The effects so far 7.Conclusions

The standard (so far) database for bibliometric studies

Another starting point: Institutional information systems

Stockholms universitets publikationer But publishing is a shared activity in shared publication channels

Göteborgs universitets publikationer This publication comes from Lund, Stockholm and Gothenburg

Another challenge: Sociologisk Forskning is indexed by ISI, but Statsvetenskaplig tidsskrift is not

Publication types in five major fields Based on (fractionalized) Norwegian publications from

Coverage of all scientific publications in Norway’s HE sector Based on (fractionalized) publications from

From ISI From Norart One shared national database for all universities. Imported references from bibliographic data sources are validated by researchers or their assistants. Missing references are added. Books

Principles behind the use of institutional data on a national level Completeness: All scholarly publications should be included Simplicity: All scholars can understand the measurement and its effects Transparency: Every institution can see and check all other institutions’ data. The national database is also online and open to society at large. Participation: The indicator is developed and maintained in collaboration between the institutions and the authorities Multiple use of the data: CV’s, applications, evaluations, annual reports, internal administration, bibliography for Open Archives, links to full text, etc.

The next step: Norwegian Science Index from 2011 An open nation-wide database of publications from  The Higher Education Sector  The Institute Sector  The Hospital Sector Co-authored publications will not be duplicated, but shown as a common publication from two or more institutions References in the database may lead on to the full texts of publications Will be used by the Research Council instead of individual publication lists in  Applications  Evaluations

The next step: Norwegian Science Index from 2011 An open nation-wide database of publications from  The Higher Education Sector  The Institute Sector  The Hospital Sector Co-authored publications will not be duplicated, but shown as a common publication from two or more institutions References in the database may lead on to the full texts of publications Will be used by the Research Council instead of individual publication lists in  Applications  Evaluations Will be part of a new national Current Research Information System in Norway (CRISTIN)

Overview of this presentation 1.Performance based funding 2.Bibliometric datasources 3.An overview of models 4.Definition and delimitation of data 5.Comparable measurement (the publication indicator) 6.The effects so far 7.Conclusions

Models for performance-based funding of research institutions Panel evaluation, ranking Bibliometric models All disciplines; all publications Selected disciplines; Citation databases N GB B DK S SF ? AUS

Overview of this presentation 1.Performance based funding 2.Bibliometric datasources 3.An overview of models 4.Definition and delimitation of data 5.Comparable measurement (the publication indicator) 6.The effects so far 7.Conclusions

The three components of the model 1:Delimitation and documentation 2: Comparable measurement 3: Incentives and funding A system of ”weigths” takes into consideration different publishing traditions and make them comparable in the same measurement of ”Publication points” at the level of institutions A definition defines, and the publication database records and validates, structured and standardized bibliographic references to different types of scholarly publications in all fields of research. Author names and addresses are at the same time connected to persons and institutions. In the overall budget each year, a certain percentage of the basic annual funding from the Government is redistributed between the institutions according to their shares in the total Publication points.

Delimitation of publication data by definition Definition A scientific or scholarly publication must: 1.present new insight 2.in a form that allows the research findings to be verified and/or used in new research activity 3.in a language and with a distribution that makes the publication accessible for a relevant audience 4.in a publication channel with peer review*) *) In addition: Publication channels with authors coming mainly from only one institution are not included.

Three main publication types Channel Type E.g. scientific article in Nature or scholarly ISBN- title on Oxford University Press. 1) Article in ISSN-title 2) Article in ISBN-title 3) ISBN-title

Dynamic records of scientific and scholarly ISSN-titles og ISBN- publishers Africa Today African Affairs African American Review African Archaeological Review African Arts African Development Review African Economic History African Entomology African Identities African Journal of Biotechnology African Journal of Crop Science African Journal of Ecology African Journal of Environmental Assessment and Management African Journal of Food, Agriculture, Nutrition African Journal of Neurological Sciences African Literature Today CABI Publishing Cambridge University Press Cappelen Akademisk Forlag Carfax Publishing Carl Heymanns Verlag Carlsson bokförlag Catholic University of America Press Central European University Press Channel View Publications Chinese University Press Christian Ejlers´s Forlag 18,000 ISSN-titles and 1,000 book publishers so far

All channels can be searched, and new channels can be suggested

Overview of this presentation 1.Performance based funding 2.Bibliometric datasources 3.An overview of models 4.Definition and delimitation of data 5.Comparable measurement (the publication indicator) 6.The effects so far 7.Conclusions

Dynamic records of scientific and scholarly ISSN-titles og ISBN- publishers Africa Today African Affairs African American Review African Archaeological Review African Arts African Development Review African Economic History African Entomology African Identities African Journal of Biotechnology African Journal of Crop Science African Journal of Ecology African Journal of Environmental Assessment and Management African Journal of Food, Agriculture, Nutrition African Journal of Neurological Sciences African Literature Today CABI Publishing Cambridge University Press Cappelen Akademisk Forlag Carfax Publishing Carl Heymanns Verlag Carlsson bokförlag Catholic University of America Press Central European University Press Channel View Publications Chinese University Press Christian Ejlers´s Forlag 18,000 ISSN-titles and 1,000 book publishers so far

Publication channels on two levels Level 2: Higher points to 20 % of the publications Level 1: Normal points to 80 % of the publications Level 2 represents the most prestigous channels and is defined in collaboration with the national councils in each field

Differentiated criteria for nomination to level 2 Physics Economics Literature Only most prestigous high-impact journals Leading journals, series and book publishers with authors from several countries

Publication points Publication typeLevel 1Level 2 Article in ISSN-title13 Article in ISBN-title0,71 ISBN-title58 Publication Author 1 Institution A Author 2 Institution B Institution C Author 3 Institution C Publication points are fractionalized if the publication originates from more than one institution

A comparison of the faculties for the Humanities and for Medicine at the University of Oslo (2005)

Institutional research profiles in three different universities (based on publication points )

Overview of this presentation 1.Performance based funding 2.Bibliometric datasources 3.An overview of models 4.Definition and delimitation of data 5.Comparable measurement (the publication indicator) 6.The effects so far 7.Conclusions

Publication points in Norway’s Higher Education Sector

Shares in the world’s scientific output (ISI ) Source: National Science Indicators (NSI), Thomson Reuters

Effects on the institutional level  The institutions have stronger incentives to facilitate research for their researchers  Research is now perceived as a common and institutional responsibility, not only as an individual task  New publications receive attention, not only from external peers, but also internally from the institution  Research management improves with the aid of complete bibliometric information about the research activities

An example of effect at department level: Poster in the toilets of The Centre of Excellence in linguistics at the University of Tromsø

Overview of this presentation 1.Performance based funding 2.Bibliometric datasources 3.An overview of models 4.Definition and delimitation of data 5.Comparable measurement (the publication indicator) 6.The effects so far 7.Conclusions

Electronic information is here to stay

Differences in publication patterns can be recognized

Incomplete representations create tensions within universities

Complete representations support transparence, visibility, and comparability