Duncan Ross Director, data and analytics Times Higher Education.

Slides:



Advertisements
Similar presentations
Usage statistics in context - panel discussion on understanding usage, measuring success Peter Shepherd Project Director COUNTER AAP/PSP 9 February 2005.
Advertisements

Using Incites to evaluate Research Performance Advanced
Research networks for innovation in East Asia – who does the future belong to 27/09/2012 Research Collaboration in Selected ASEAN Countries Dr Janet Ilieva.
What are the characteristics of academic journals
Understanding College Rankings Amy VanSurksum, International Officer (USA Midwest & Northeast) University of Glasgow.
Mahidol University Wisdom of the Land International Relations Division, Mahidol University 17/10/2011 Top 10 THE World University Rankings (
International Benchmarking – Comparing Like with Like– What about the Future? Ken Sloan, Director for Universities and Higher Education HESA International.
Bibliometrics overview slides. Contents of this slide set Slides 2-5 Various definitions Slide 6 The context, bibliometrics as 1 tools to assess Slides.
1 Using metrics to your advantage Fei Yu and Martin Cvelbar.
Innovation Measurement
T H O M S O N S C I E N T I F I C Editorial Development James Testa, Director.
Edouard Mathieu Head of the Benchmarking Center Invest in France Agency * ARWU: Academic Ranking of World Universities 2005 A few remarks on ARWU*
SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE KIEV, 31 JANUARY.
Talent for Innovation – The Role of Universities Ned Costello, Chief Executive, IUA.
The Web of Science database bibliometrics and alternative metrics
The Role of Citations in Warwick’s Strategy and Improving Them Nicola Owen (Academic Registrar) Professor Mark Smith (PVC Research: Science and Medicine)
DIGEST OF KEY SCIENCE AND ENGINEERING INDICATORS 2008 Presentation Slides National Science Board.
I-Search Paper Turning Your Research Into Paragraphs The following information was gathered from BLS.gov: Median pay $55,050 Requires a Bachelor’s Degree.
HONG KONG AND SINGAPORE 22 – 30 MARCH EXCELLENCE IN RESEARCH AND INNOVATION  Focus on Areas of Strength (Flagship Programme/Research Niches)
Trends of Science & Techn ology Potential and R esource in Japan Yuko NAGANO National Institute of Science and Technology Policy JAPAN Feb. 21 th 2010.
Bibliometrics toolkit: ISI products Website: Last edited: 11 Mar 2011 Thomson Reuters ISI product set is the market leader for.
RANKINGS WORKSHOP STRATEGIES FOR MARKETING, BRANDING, AND IMPROVING INTERNATIONAL RANKINGS MICHAEL FUNG DIRECTOR OF PLANNING & INSTITUTIONAL RESEARCH THE.
Innovation for Growth – i4g Universities are portfolios of (largely heterogeneous) disciplines. Further problems in university rankings Warsaw, 16 May.
Uwe Brandenburg Options and limits of measurability: the experience from the Excellence Ranking in the light of the global ranking discussion.
Rajesh Singh Deputy Librarian University of Delhi Measuring Research Output.
The Web of Science, Bibliometrics and Scholarly Communication 11 December 2013
SCOPUS AND SCIVAL EVALUATION AND PROMOTION OF UKRAINIAN RESEARCH RESULTS PIOTR GOŁKIEWICZ PRODUCT SALES MANAGER, CENTRAL AND EASTERN EUROPE LVIV, 11 SEPTEMBER.
THOMSON REUTERS RESEARCH IN VIEW Philip Purnell September 2011 euroCRIS symposium Brussels.
THOMSON REUTERS—GLOBAL INSTITUTIONAL PROFILES PROJECT DR. NAN MA SCIENCE AND SOLUTION CONSULTANT THOMSON REUTERS OCT 19 TH, 2010.
April 9, 2003Santiago, Chile The ISI Database: Reflecting the Best of International and Regional Research Keith R. MacGregor Sr. Vice President The Americas,
The University of Warwick An International University? Dr David Law Academic Registrar and Director of International Office.
Science Publishing An Elsevier Perspective Presented by: Carl Schwarz Location: Moscow Date:9 December 2006.
Evaluation in R&D sphere in Ukraine: Real practice and problems of transition to new standards Igor Yegorov Centre for S&T Potential and Science History.
A Bibliometric Comparison of the Research of Three UK Business Schools John Mingers, Kent Business School March 2014.
Assessing regional engagement and knowledge transfer – ranking or benchmarking? David Charles, EPRC, University of Strathclyde.
Prospective Student Decision Making Rachel Sandison Head of SRAS.
Bibliometrics toolkit Website: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx Further info: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx Scopus Scopus was launched by Elsevier in.
The Web of Science, Bibliometrics and Scholarly Communication
SciVal Spotlight Training for KU Huiling Ng, SciVal Product Sales Manager (South East Asia) Cassandra Teo, Account Manager (South East Asia) June 2013.
THE IMPACT OF RAE ON SERIAL PUBLICATION Professor Judith Elkin UK Serials Group March 2004.
Outcomes of the online academia consultation Mr. Christopher Clark Head, Partnership and Resource Mobilization Division International.
Making an impact ANU Library. Topics Research data management Open access Bibliometrics Researcher profiles Where to publish 2.
Building Academic Excellence in Malaysia: Perspectives from an International Campus Christine Ennew Provost and CEO, University of Nottingham Malaysia.
1 RUSSIAN SCIENCE UNDER THE MICROSCOPE Philip Purnell Moscow, October 2013.
INCITES TM INSTITUTIONAL PROFILES David Horky Country Manager – Central & Eastern Europe Informatio Scientifica / Informatio.
Scientists and public communication: A survey of popular science publishing across 15 countries EMA Thematic Conference, Bordeaux March 29-30, 2010 Peter.
MEASURING RESEARCHERS: FROM RESEARCH PUBLICATIONS AND COMMUNICATION TO RESEARCH EVALUATION Lucie Vavříková 1.
Leiden University. The university to discover. Internationalisation as a unifying force – what should you know Dr Robert Coelen Vice-President International.
The Thomson Reuters Journal Selection Policy – Building Great Journals - Adding Value to Web of Science Maintaining and Growing Web of Science Regional.
THOMSON REUTERS INCITES Marta Plebani – Country Account Manager – Italy, Slovenia, Croatia 12 May 2011.
Measuring Research Impact Using Bibliometrics Constance Wiebrands Manager, Library Services.
Bibliometrics at the University of Glasgow Susan Ashworth.
Nicki Horseman Lead HE analyst Times Higher Education.
UNIVERSITY RANKINGS AND THEIR IMPACT Hamed Niroumand, Post-Doc, PhD, P. Eng. Buein Zahra Technical University.
Role of librarians in improving the research impact and academic profiling of Indian universities J. K. Vijayakumar Ph. D Manager, Collections & Information.
Academic Ranking of World Universities
Tools for Effective Evaluation of Science InCites David Horky Country Manager – Central and Eastern Europe
Where Should I Publish? Journal Ranking Tools
The swedish research barometer 2016
Bibliometrics toolkit: Thomson Reuters products
Prof.Dr. Melih Bulu, Istinye University March 23
Christina Lohr Product Manager Research Metrics, Elsevier
Johannes Sorz, Bernard Wallner, Horst Seidler and Martin Fieder
Emerging Sources Citation Index
Advanced Scientometrics Workshop
Serbia in the Rankings Professor Ellen Hazelkorn
SciVal to support building a research strategy
Internationalisation of higher education in the UK
South Asia Challenges and benefits of research collaboration in a diverse region March 2019 Maria de Kleijn-Lloyd.
South Asia Challenges and benefits of research collaboration in a diverse region March 2019 Maria de Kleijn-Lloyd.
Presentation transcript:

Duncan Ross Director, data and analytics Times Higher Education

A brief overview of THE methodology Data Sources 13 Metrics (Not published) 5 Pillars (Published)

Criteria for participation: More than 1000 scholarly articles From Elsevier’s Scopus database Articles, reviews, books, conference papers 200 per year (some scope for movement) (for last year) (for this year) –Data collated in July Universal education We require activity in more than one of the subject areas Undergraduate teaching Teach at undergraduate level Evidence of significant number of undergraduate students

Covering the top research focused universities Universities Universities Universities 70 countries 78 UK universities 4%

Subject level coverage Two new subjects in : Business, Computer Sciences Extended information up to 31 taught subjects Doctorates to academic staff Doctorates to bachelor’s degrees awarded Teaching reputation Income to academic staff Staff to student ratio Papers to academic staff Research income to academic staff Research reputation Field Weighted Citations Industry research income to academic staff International to domestic staff International to domestic student Publications with international author WUR Arts Clinical Eng & Tech Social Science Physical Science Life Science

Challenges to the UK: Reputation

Academic reputation survey Subjective data “Brand” Survey of academics selected by Elsevier Balanced by geography –UNESCO data 10,500 responses

Reputation changes over time

Where do universities get support? One of the features of the Universities with the highest reputation is the breadth of their support All receive large votes from every region Harvard receives stronger recognition from Asia than from North America

Eurovision effect: do countries vote for themselves? There is some evidence that academics vote for universities in their country or region Some countries rely heavily on this Others are hugely international

Understand where your reputational strengths are

Challenges to the UK: Research, teaching and investment

How should UK universities be grouped? ClusterNumberExamples Emerging Talents 1Huddersfield Developing Expertise5Nottingham Trent, Coventry, Central Lancashire Core Strengths24Essex, Sheffield Hallam, Strathclyde Effective Publishers9Swansea, Aston, Heriot-Watt Technology Challengers3Newcastle, Leicester, Surrey Life Science Challengers29Dundee, Loughborough, Birmingham International Powerhouse5Manchester, Imperial, Edinburgh Old Stars2Cambridge, Oxford

Directly provided University data Objective measures of capacity Details at institutional and subject level Data prepopulated where possible –UK & USA from public data Data gathered Spring Reflects 2013 data –Challenges of different systems

Bibliometric measures from Scopus Moved from Thomson Reuters Web of Science to Elsevier’s Scopus Three measures Field Weighted Citations to avoid subject bias

International Outlook in the UK Box and whiskers plots show the distributions of all UK institutions in the World University Rankings Great Universities act on the world stage Data focus on –Ability to recruit internationally –Research links How does the UK do? UK does very well on all international measures This is both a strength, and a vulnerability

International Outlook in the UK vs USA Stronger across the board A particular challenge in the USA is the increasing emphasis on in-state students within the state systems UK USA

International Outlook in the UK vs Germany There are indications that Germany is starting to think more internationally Significant increase in international students in Germany Increasing willingness to teach in English Germany UK

Research inputs in the UK Research is another key area of focus Data focus on –Productivity –Research income –Academic reputation How does the UK do? The UK has very varied productivity measures Research income is left-skewed – there is a long tail of institutions with strong income

Research in the UK vs USA The UK leads on productivity Research income stronger and more equal in the US Reputation stronger in the US, although median very similar USA UK

Research in the UK vs Germany German productivity higher Research income much stronger GermanyUK

Research in the UK vs China Productivity weaker in China Income already beating UK Reputationally weak ChinaUK

Citations and Industry Income in the UK Citation Impact measures quality of output Field weighted across 334 subjects Articles, Reviews, Conference papers (inclusive) Industry Income represents the ability to persuade business to partner with academia Relies on effect output How does the UK do? Generally strong on citations – gaining the benefit of English Industry income tightly grouped and relatively weak

Citations and Industry Income in the UK vs USA US leads on income and citations More US institutions are performing strongly in terms of citations – right skew Caveats: This represents most, but not all of the US R1 institutions, and some R2 institutions Financial data has been converted using PPP to ensure comparability UK USA

Citations and Industry Income in the UK vs Germany German industry links deeper and stronger Citations mixed – higher median, but not as strong amongst the leading universities UK Germany

Citations and Industry Income in the UK vs China Much stronger industry focus Citations much weaker – facing the challenge of English However increasing state pressure on English publication ChinaUK

Teaching in the UK Teaching reflects a crucial mission Data focus on –“Presage” the capacity to teach –Reputation for ability to teach How does the UK perform? Three metrics are very tightly grouped Doctorate to bachelor degrees, Institutional income to academic staff, and Students to academic staff Teaching reputation shows the usual exponential ‘long tail’

Teaching in the UK vs USA The diversity of the US system clearly shows in the data, as does financial strength USAUK

Teaching in the UK vs Germany Germany has a stronger focus on post-graduate learning, especially doctorates Again, better financed than the UK UKGermany

Teaching in the UK vs China Lower teaching reputation Similar funding Slightly stronger Student to staff ratio UKChina

Conclusions The data shows that UK universities face significant challenges – from emerging nations as well as traditional competitors International systems are willing to change to adopt the best from UK France becoming more universal Germany reaching out to foreign students Other systems also have their challenges Japan facing student shortages USA facing pressure of “value” Despite the failure of AHELO, teaching is going to increasingly be seen as a key international benchmark

Thank