Results versus resources An analysis of publicly funded research in Norway Jan Fagerberg, TIK (University of Oslo), CIRCLE (University of Lund) and SPRU.

Slides:



Advertisements
Similar presentations
Venturing into the European Research Area – some far-reaching speculations Wolfgang Polt Institute of Technology and Regional Policy - Joanneum Research.
Advertisements

SCIENCE, TECHNOLOGY AND INNOVATION INDICATORS. 1-Industrial sector: generally the results of scientific researches are still little, and non-existent.
1 1 Capitalisation of R&D in the national accounts Ann Lisbet Brathaug Head of National accounts Statistics Norway
Wider economic impacts from R&D investments Arild HervikResearch seminar
1 Production and use of S&T&I Statistics and Indicators in Republic of Macedonia State Statistical Office Ministry of Education and Science October 2008,
Knowledge creation, knowledge exploitation and the global economy - the challenge for developing countries Jan Fagerberg, Centre for Technology, Innovation.
Appropriate coverage of scholarly publishing in the social sciences and humanities Gunnar Sivertsen Nordic Institute for Studies in Innovation, Research.
Performance-Based Funding in Higher Education Presentation by Arthur M. Hauptman Financing Reforms for Tertiary Education in the Knowledge Economy Seoul,
Tina Murray1 Erasmus Mundus II
1 Academic Rankings of Universities in the OIC Countries April 2007 April 2007.
Policies for research excellence: 2012 Eu-SPRI Conference Towards Transformative Governance, Karlsruhe 12 June 2012 A comparative study of centres of excellence.
Performance-based funding of public research in tertiary education institutions: Country experiences Presentation to the Norwegian Fagerberg Committee:
Human Resources and Innovation Workshop on Advancing Innovation: Human Resources, Education and Training 17 – 18 November 2008 Bonn, Germany Dirk Pilat.
The Dutch R&D system characteristics and trends, with a focus on government funding Jan van Steen Ministry of Education, Culture and Science, The Netherlands.
The measurement of Innovation An historical perspective The “Frascati Manual” and the “Oslo Manual” S&T indicators Innovation indicators Some evidence.
Excellence in scientific research Prof
How to organize NOVA intensive course? - Info session for teachers Janna Koivisto Sari Mikkola Maatalous-metsätieteellinen tiedekunta.
DIGEST OF KEY SCIENCE AND ENGINEERING INDICATORS 2008 Presentation Slides National Science Board.
Nordic University/HE Funding Policies Higher Education Funding Seminar ACUP, Barcelona 13 June, 2012 Peter Maassen, University of Oslo.
NIFU STEP Studies in Innovation, Research and Education The Norwegian model and the indicators chosen Gunnar Sivertsen Norwegian Institute.
Experiences with a bibliometric indicator for performance-based funding of research institutions in Norway Gunnar Sivertsen Nordic Institute for Studies.
Trends of Science & Techn ology Potential and R esource in Japan Yuko NAGANO National Institute of Science and Technology Policy JAPAN Feb. 21 th 2010.
Major Current Trends in Innovation: The OECD Science, Technology and Industry Outlook 2014 Dominique Guellec Head, Country Studies and Outlook Division.
The State University Progess in the EU SLOVAKIA Jan Svoboda.
National Innovation Strategy of the Republic of Moldova. Implementation, mechanisms and measures Ghenadie CERNEI Director, Agency for Innovation.
Bibliometrics for research evaluation Ulf Kronman Coordinator of OpenAccess.se The National Library of Sweden EuroCRIS, Brussels
The Danish Industrial PhD Programme Promoting research and innovation.
The Evolution of Innovation Policy: Theory and Practice By Jan Fagerberg, Aalborg University, University of Oslo and University of Lund
FP7 - April The European Research Area in the Age of Globalisation Henri Delanghe DG RTD, C4 (Economic and Prospective Analysis Conference on Knowledge.
NIFU STEP Norwegian Institute for Studies in Innovation, Research and Education 7 th euroCRIS strategic seminar, Brussels Recording Research.
1 Analysing the contributions of fellowships to industrial development November 2010 Johannes Dobinger, UNIDO Evaluation Group.
Welcome to Christina Abildgaard Acting Executive Director Division for Strategic Priorities.
Funding of Public RDI in Norway – A Bird’s Eye View Jan Dietz, Special Adviser OECD Symposium, Madrid, July
Entrepreneurial Research University – 16 Sep 2008 Estonian Computer Science: How to Make it Relevant? Marlon Dumas Institute of Computer Science University.
Internationalisation of Finnish Public Research Organisations Dr. Antti Pelkonen Senior Scientist, VTT Technical Research Centre of Finland
Communication of Research Results, Local Science Journals, and Evaluation of Scientific Performance: One or Three Divergent Issues? Anna María Prat Head.
1 SMEs – a priority for FP6 Barend Verachtert DG Research Unit B3 - Research and SMEs.
Norwegian Innovation, Research and Education policies and the Norwegian Research and Technology Forum in the US and Canada Remarks by State Secretary Helle.
The Experience of a Leader in Innovation. The Case of Finland Professor Reijo Vihko President and Director General The Academy of Finland.
The Hungarian Innovation System Adam Tichy-Racs CPR Hungary.
DETERMINE Working document # 4 'Economic arguments for addressing social determinants of health inequalities' December 2009 Owen Metcalfe & Teresa Lavin.
Research and Research Indicators Sources, Definitions and Empirical Comparisons.
Prof. Ömer ANLAĞAN Vice President 7 November 2008, İstanbul Turkey’s RTDI Profile “12th Monitoring Committee for Euro-Mediterranean Cooperation in RTD”
Funding and Governance of Higher Education in Norway Senior Adviser Mads Gravås Yerevan/Armenia/September
Workshop on Productivity Bern October 2006 Dominique Guellec Economic Analysis and Statistics Division Directorate for Science, Technology and Industry.
GO NORDIC! Are Straume Ministry of Science, Innovation and Higher Education Denmark.
In-depth Review: Measuring the Information Society and Statistics on Science, Technology and Innovation Ian Ewing Deputy Australian Statistician.
EAIR SIG Exploiting Data Repositories Using data repositories and information sources to support KPI’s and Strategic Planning: A Case Study Presented by:
GOVERNANCE SETTINGS FOR SUCCESSFUL S3 PROCESS Jurgita Petrauskienė , Chisinau.
Assessing Performance within Higher Education in Norway Ole-Jacob SKODVIN Marie WIEN FJELL Geir Åge ANDREASSEN Arne MOI Norwegian Ministry of Education.
Scientists and public communication: A survey of popular science publishing across 15 countries EMA Thematic Conference, Bordeaux March 29-30, 2010 Peter.
Faculty of Economics and Business Administration, University of Iceland Highlights of High Competitiveness (Hvað skýrir samkeppnishæfni?) Helga Kristjánsdóttir.
Determinants of Competitiveness Helga Kristjánsdóttir University of Iceland August 27th 2008 REYST Reykjavik Energy Graduate School of Sustainable Systems.
Pentti Pulkkinen Programme Manager Academy of Finland Research funding and administration in Finland
UFD The Quality Reform in Norwegian Higher Education Royal Ministry of Education and Research.
Jan Švejnar University of Michigan and CERGE-EI, Prague EU Conference on Social sciences and humanities in Europe Brussels, December 12-13, 2005 Improving.
Scottish Enterprise Denmark’s economy and comparisons with Scotland SE Board performance Committee November 2006.
The Finnish Innovation System and Comparisons with Scotland May 2007.
THE BIBLIOMETRIC INDICATORS. BIBLIOMETRIC INDICATORS COMPARING ‘LIKE TO LIKE’ Productivity And Impact Productivity And Impact Normalization Top Performance.
Demographic change and migration: challenges & solutions. Lithuanian case By Rimantas Šadžius Minister of Finance Republic of Lithuania.
The swedish research barometer 2016
Chairman, Danish Council for Research Policy
Spreading excellence and widening participation from a Marie Skłodowska-Curie Actions (MSCA) perspective Peter Whitten DG Education and Culture Mobility.
The RCN’s advisory role
Nordic Fields of Higher Education
CRIStin, reporting and rewarding research
Nordic CODATA Data Citation Workshop Research Indicators in the Finnish Universities Funding Model 23th Nov 2016 Tomi Halonen Counsellor of Education.
Performance-Based Funding in Higher Education
On the Knowledge Based Economy in Bosnia and Herzegovina
Strategy of the Internationalisation of Slovenian Higher Education
Presentation transcript:

Results versus resources An analysis of publicly funded research in Norway Jan Fagerberg, TIK (University of Oslo), CIRCLE (University of Lund) and SPRU (University of Sussex) Helsinki, ”A more open research system” NOU 2011: 6, delivered May 2, 2011

”Expert committee” asked to: Establish indicators for ”results” Relate these to use of resources Focus on the efficiency/productivity of publicly funded research Suggest changes in the distribution of resources that might ”benefit society economically” Place special emphasis on basic research and doctoral education (higher education sector) -Limit the analysis to publicly financed research, the overwhelming part of which are carried out in universities, hospitals and institutes. e.g., not analyse the efficiency of the entire innovation system The minister: Tora Aasland

Measuring the efficiency of public sector research What to measure Quantity? Quality? Use by the research community (citations)? Use in society at large? (social returns) – important but difficult to measure in (sufficiently) precise way New PhDs Internationalisation ? Efficiency – relate results to resources (R&D as defined by the OECD) – with a lag! How (pilot-project) Quantity: Publications Quality (citations): ISI Web of science (articles) Two databases, the Norwegian “Cristin” (everything) and ISI Web of Science (journal articles) How to adjust for differences between different academic fields? PhD production (rel to labour force) Involvement in EU research, cross- country co-authorship in research Compare with “similar” countries Result: A “barometer” for the efficiency of public sector research – A tool for everybody, not just an instrument for control …

Composition: Norwegian Data Base "Cristin", % Composition: ISI Web of Science, % Share of “Cristin” publications in ISI Web of Science, % Natural science21,433,387,8 Medicine and health23,433,781,4 Technology12,316,173,7 Social science22,710,626,4 Humanities20,26,317,7 Source: NIFU/DBH/Thomson Reuters(ISI Web of Knowledge) Differences across fields Publications in ”Cristin” that are also in ISI Web of Science,

Research production (articles) relative to public R&D expenses, selected countries Source: Calculations based on data from ISI Web of Science and the OECD

How to test for differences in specialization of countries/institutions? (a) Calculate shares of publications/citations for each country or institution for each area (natural science, health, technology, social science, humanities) (b) Calculate similar shares for R&D expenditure Divide (a) on (b) – this gives the productivity per field – with an average of 1 Weigh together the field specific productivity-figures with shares in R&D expenditure, this gives overall productivity Requires that R&D expenditure can be decomposed according to area: Only Nordic countries?

Differences in composition of expenses do not explain a lot Source: Calculations based on data from ISI Web of Science and the OECD

Citations relative to public R&D expenses, selected countries Source: Calculations based on data from ISI Web of Science and the OECD

Internationalisation: R&D support from the EU as a percentage of public R&D Source: Calculations based on data from NIFU and the OECD

New PhDs per thousand employed, 2008 og 2001 Source: Calculations based on OECD(ISCED 6)

Within Norway: Big differences in research productivity (publications and articles (ISI) relative to R&D expenses) Source: ISI Web of Science, Statistics Norway and DBH (Cristin) Adjusted for differences in scientific profile

Even bigger differences in citations (relative to R&D expenses, adjusted)

Some lessons from the “barometer” The Norwegian public research system has become more efficient in recent years But still far behind the frontier (Denmark/Sweden) Low competitiveness in EU (look to Finland!) Fewer new PhDs than Sweden and Finland, and probably too few satisfy future demand (especially in technology) Big differences in efficiency/productivity across Norwegian institutions Need – and scope – for improvements Much of what we wish to measure is difficult to measure (with precision): Need for more research and better indicators of social and economic effects of publicly financed research Much of what we wish to measure is difficult to measure (with precision): Need for more research and better indicators of social and economic effects of publicly financed research

Why isn’t productivity higher The time allocated to research in higher education may not be sufficiently well exploited (productivity very skew, many produce little or nothing) Universities may not support good researchers sufficiently well (pay salary but not much more ….) Too little competition for resources in the system - lack of open competition arenas for good research (only supporting a few centers of excellence not good use of available resources) The closed door problem: Only one research council & its resources increasingly go to a limited set of thematic fields (defined by politicians in cooperation with well established interests) The governement’s incentives to higher productivity may not work as intended (do not affect those that make the actual decisions?) ?

Main recommendations Research barometer Research program on social & economic effects of publicly funded research Open research arena: A new arena in the research council open to all areas of research – modeled after ERC (broad, cross-disciplinary panels) - special emphasis on novel & cross-disciplinary research More PhDs (narrowing the gap vis-à-vis Sweden/Finland ) & more competitive allocation of stipends More competitive allocation of resources in all sectors (example health) A new (temporary) system for automatic support to researchers producing above a certain threshold level to help institutions developing better routines Total cost 2 bill NOK (well within the goal of 1% of GDP), of which 1 bill to PhDs Open up!