Ranking universities: The CHE Approach Gero Federkeil CHE – Centre for Higher Education Development International Colloquium “Ranking and Research Assessment.

Slides:

Advertisements

Similar presentations

Current initiatives in rankings: how do you see them from the perspective of your agency? Tia Loukkola 28 September 2009.

Advertisements

CHE and Coimbra Group 1 Ranking, Rating, Benchmarking... what is serving which purpose?

Excellence in Europe and the Institute of Physics Eötvös Loránd University Budapest, HUNGARY Jenő KÜRTI 20. March www:

Multi-dimensional, field-based rankings Gero Federkeil, CHE, Germany Special Workshop: Introduction to Academic Rankings for the Rectors of.

Professor Sabiha Essack B. Pharm., M. Pharm., PhD Dean and Head of School Quality Promotion and Assurance in Teaching and Learning A Pilot Study in the.

CYPRUS UNIVERSITY OF TECHNOLOGY Internal Evaluation Procedures at CUT Quality Assurance Seminar Organised by the Ministry of Education and Culture and.

: Institutional Research Consultancy Unit League and Ranking Tables and their Influence on Graduate Surveys Presentation to Victorian Statistical Officers.

Mapping Diversity – The U-Multirank Approach to Rankings Gero Federkeil Workshop Universidade Nova de Lisboa, 29th June 2012.

Facilitators: Janet Lange and Bob Munn

The CHE Research Ranking of German Universities Sonja Berghoff International Colloquium “Ranking and Research Assessment in Higher Education”

Ranking - New Developments in Europe Gero Federkeil CHE – Centre for Higher Education Development The 3rd International Symposium on University Rankings.

University of Vienna Rectorate – Office of the Rectorate May 30, 2008 Claudia Kögler University of Vienna, Office of the Rectorate.

Quality Assurance and Development Unit College of Applied Medical Sciences Females 1.

EURASHE FORUM 1. Content of Presentation 2 I.General observations on staff mobility II.Findings of the Bologna Follow-Up Group (BFUG) Working Group on.

Introductory Task 1. What term means a belief in the importance of traditional values and competition? 2. What term means the idea that human behaviour.

Market Research. Market Research – What is it? Gathering information on (for example)… …finding new markets …evaluating public opinion …gaining insight.

Institutional Internationalisation Strategies and their (possible) impact on the quality of educational programs Arthur Mettinger Austrian Bologna Expert,

Quality teaching in higher education, an OECD approach Fabrice Hénard, December 2010.

Workshop on research assessment in CERIF Stephen Grace, Brigitte Jörg, Aija Kaitera, Maximilian Stempfhuber.

Rating and Ranking: Pros and Cons Dr. Mohsen Elmahdy Said Professor, Mechanical Design and Production Department Faculty of Engineering – Cairo University.

The CHE ranking The multi-dimensional way of Ranking Isabel Roessler CHE – Centre for Higher Education Development International Conference “Academic Cooperation.

Training of National Judges INFO DAY Introduction to the new Call for Proposals 2014 Raffaella Battella - DG Competition.

Richard West & Elena Frumina.  The Russian context the new global context  ESP/EAP teaching in Russia – 2002 to 2012  The need for change 

1 Trends in Research Assessment and Higher Education, and their impact on TS Gyde Hansen Copenhagen Business School (CBS) 2008.

Wojciech Fenrich Interdisciplinary Centre for Mathematical and Computational Modelling (ICM) University of Warsaw Prague, KRE 12,

Difficulties and Possibilities of University Rankings in Hungary Magdolna Orosz (Eötvös Loránd University Budapest, Hungary) Academic cooperation and competitiveness.

Presentation of the Montenegrin Higher Education System Regional Cooperation in Higher Education: Hungary and the Western Balkans University of Szeged,

Quality in Education and Training

Integration Development Programme in the Field of Statistics of the Eurasian Economic Union for EEC THE EURASIAN ECONOMIC COMMISSION.

Uwe Brandenburg Options and limits of measurability: the experience from the Excellence Ranking in the light of the global ranking discussion.

What Can National Rankings Learn from the U-Multirank-Project ? Gero Federkeil, CHE, Germany IREG-Forum: National University Rankings on the.

University of Warsaw The Office for Quality of Education 11th of December th of December 2008.

INTITUTIONAL AUDIT & (SELF)-ACCREDITATION Ton Vroeijenstijn.

ENQA a key player in the European Higher Education Area Meeting of the Belarus University System representatives Minsk, March 2013 Josep Grifoll / Жузэп.

Gero Federkeil Expert Seminar „Quality Assurance and Accreditation in Lifelong Learning“, Berlin, February 2011 Rankings and Quality Assurance.

Quality Assurance & University Rankings. Shanghai Ranking (Shanghai Jiao Tong University) THES (Times Higher Education Supplement) CHE Ranking »Centrum.

Role of University Rankings in Kazakhstan Prof. Sholpan Kalanova BRATISLAVA 2011.

Certifying the Management of Diversity in HEI Dr. Daniela De Ridder Hannah Leichsenring York, June 23th 2009.

AMU DoQuP FINAL REPORT MD, PhD, Associate Professor G.Ahmadov Azerbaijan Medical University Bishkek, April 22, 2015.

1 The role of Government in fostering competitiveness and growth Ken Warwick Deputy Chief Economic Adviser UK Department of Trade and Industry.

Quality in Education and Training Cases of Good Practice in VET and HE Main results of the study Lorenz Lassnigg.

Quality assurance Higher education development and reforms Jiří Nantl (Masaryk University/Council of Higher Education/ National Board for Qualifications,

Natalya Kryvulina, Andrey Kashyn June, 2009 Astana, Kazakhstan.

Assessing regional engagement and knowledge transfer – ranking or benchmarking? David Charles, EPRC, University of Strathclyde.

League tables as policy instruments: the political economy of accountability in tertiary education Jamil Salmi and Alenoush Saroyan CIEP, June 2006.

The NCATE Journey Kate Steffens St. Cloud State University AACTE/NCATE Orientation - Spring 2008.

UNIVERSITY OF PORTSMOUTH/ ASSOCIATION OF UNIVERSITY ADMINISTRATORS (AUA) THE UNIVERSITY SECTOR : BUT NOT AS WE KNOW IT Graham Galbraith Vice-Chancellor,

July 2007 National Quality Assurance and Accreditation Committee & Quality Assurance and Accreditation Project Role of Action Planning in The Developmental.

1 Quality Assurance in VET M. Kirsch & Y. Beernaert Internal Quality Assurance and the self-evaluation report Magda Kirsch & Yves Beernaert Bulgaria –

Bi- and multilingual universities - Helsinki: 1-3 september UNIFR Language Policy A Brief History 1889Foundation, bilingual administration, teaching.

EAIR SIG Exploiting Data Repositories Using data repositories and information sources to support KPI’s and Strategic Planning: A Case Study Presented by:

Framework for Excellence What is the Framework? The Framework is the Governments National Assessment Framework for Education and Training Public.

League tables as policy instruments: the political economy of accountability in tertiary education Jamil Salmi and Alenoush Saroyan 2 nd IREG Meeting Berlin,

Report on present status of the quality assurance system at University of Split Željko Dujić, MD, PhD Vice rector for science and international affaires.

Buchberger - KieferEducation Sector Development Project, World Bank 1 REFLECTIONS ON THE ONGOING REFORM AND OPEN ISSUES STRUCTURE 3 considerations about.

February 2009 Hogeschool van Arnhem en Nijmegen Drs. Ron Bormans President HAN Board Studiekeuze123.

UNIVERSITIES EVALUATIONS AND RANKINGS Philippe VINCKE Rector of the Université Libre de Bruxelles.

University of Warsaw. The quality of education assurance and enhancement system at the University of Warsaw.

BU in Excellent graduate employability rate of 93.3%* BU rose in all three major UK university league tables in the.

Technische universität dortmund r Transfer Office at TU Dortmund: Impacts and Potentials.

2007. Faculty of Education ► Staff 300 (incl.100 in Teacher training school) ► 20 professorships ► 80 lecturers ► 9 senior assistants ► 12 assistants.

Rosie Drinkwater & Professor Lawrence Young Group Finance Director, Pro Vice-Chancellor (Academic Planning & Resources) League Tables Where are we, why.

Classification & Ranking in Higher Arts Education New EU developments and the role of ELIA.

KA107 practices in a Partner Country HEI perspective: University of Novi Sad, Serbia Erasmus+ Annual Conference Heidelberg, 1-2 June 2017.

U-Multirank – The first Multidimensional Global University Ranking

Employment and Social Affairs Platform

Dr Camille B. Kandiko Howson Academic Head of Student Engagement

PRESENTATION OF EXISTING EVALUATION

Indicators&Criteria in External Quality Assessment

Presentation transcript:

Ranking universities: The CHE Approach Gero Federkeil CHE – Centre for Higher Education Development International Colloquium “Ranking and Research Assessment in Higher Education” 12 & 13 December 2007, Bruxelles

2 Ranking and Research Assessment, 12/07, Bruxelles Presentation I.The CHE – Centre for Higher Education Development II.Rankings – Aims and methodology III.The CHE ranking approach  Basic Approach  Indicators and data base  Publication  Impacts

3 Ranking and Research Assessment, 12/07, Bruxelles I. CHE – Center of Higher Education Development private, not-profit organisation founded in 1994 by Bertelsmann Foundation and German Rectors Conference purpose: promotion of reforms in German higher education Ranking of German universities among founding tasks of CHE activities: HE policy issues consulting ranking, since 1998 staff: ~ 30 people more information:

4 Ranking and Research Assessment, 12/07, Bruxelles First ranking published in 1998 after two years of preparation Published in co-operation with media partner: since 2005 weekly newspaper „Die Zeit“ responsibility for concept & data exclusively at CHE „Zeit“: publication / distribution High international reputation (Usher & Savino, Tavenas, OECD) Internationalisation: since 2004: Austrian universities 2005: Swiss universities 2006/07: EU-funded pilot project with Dutch/ Belgian (Flemish) universities 2008: Dutch universities, University Bozen/Bolzano (I) I. The CHE: ranking tradition

5 Ranking and Research Assessment, 12/07, Bruxelles II. Rankings: Aims and Methodology Ranking refers to a method: comprehensive comparison of HEIs by quantitative indicators made by external/independant institutions/actors  Ranking is different from benchmarking / evaluation: external vs. internal target groups publication of all results vs. confidentiality focus on indicators vs. processes no causal analysis in rankings !

6 Ranking and Research Assessment, 12/07, Bruxelles II. Rankings rankings differ by target groups, particular goals information for prospective students (US News, CHE) information about global positioning (Shanghai Jiatong, THES) Information for HE community (Germany: National Science Foundation Ranking of Research Grants, CHE Research Ranking) even: basis for accreditation (e.g.Nigeria) Rankings vary in aims and target groups as well as „in terms of what they measure, how they measure it and how they implicitly define quality“ (Usher & Savino)

7 Ranking and Research Assessment, 12/07, Bruxelles II. Rankings: Aims and Methodology Main target group of (most) rankings is least informed group on higher education  need for reduction of complexity of information Higher education institutions themeselves use data for comparison  need for detailed & sophisticated information Rankings have to find a balance in order to both reach target group & get acceptance within HE

8 Ranking and Research Assessment, 12/07, Bruxelles II. The most popular ranking... clear, unequivocal rank positions clear, uncontested rules for calculation of overall score one rank can make a difference

9 Ranking and Research Assessment, 12/07, Bruxelles Exampe: THES World Rankings Can we rank universities like this? – Some Do! composite overall score weights of indicators ? is Johns Hopkins 92,9 % as good as Harvard? league table with clear rank positions ranking of whole universities

10 Ranking and Research Assessment, 12/07, Bruxelles No individual ranks in league tables No overall score from weighted indicators No ranking of whole universities Multidimensional ranking Ranking of single fields / programmes Rank groups top intermediate bottom III. THE CHE approach – an alternative

11 Ranking and Research Assessment, 12/07, Bruxelles CHE rankings CHE ranking data target group: prospective students target group: HE sector CHE University RankingCHE Research Ranking Indicators on:  teaching  resources  research Detailed analysis of data/ indicators on  research

12 Ranking and Research Assessment, 12/07, Bruxelles labour market, employability city, university students study outcome teachingressources research overall assessment (students, professors) internationalisation III. The CHE-Ranking: Indicators 20 – 25 indicators...

13 Ranking and Research Assessment, 12/07, Bruxelles III. The CHE-Ranking: Indicators... from different data sources… research  publications /citations (bibliometric analysis)  research grants (faculties/departments)  research reputation (professors survey)

14 Ranking and Research Assessment, 12/07, Bruxelles III. The CHE-Ranking:Indicators... facts as well as judgements teaching  student-staff-ratio (fact)  student assessment of contact between students and professors  student assessment of course organisation

15 Ranking and Research Assessment, 12/07, Bruxelles III. The CHE ranking: Data sources Survey among universities / departments Student survey Professor survey Bibliometric analysis Patent analysis Official higher education statistics

16 Ranking and Research Assessment, 12/07, Bruxelles III. Publication analysis DIE ZEIT overview 5 indicators; „Study Guide“ all data + Interactive ranking densification differentiation

17 Ranking and Research Assessment, 12/07, Bruxelles III. The CHE ranking: Internet Publication

18 Ranking and Research Assessment, 12/07, Bruxelles 1. Ranking overview

19 Ranking and Research Assessment, 12/07, Bruxelles 1. Ranking overview Reputation

20 Ranking and Research Assessment, 12/07, Bruxelles 1. Ranking overview Reputation

21 Ranking and Research Assessment, 12/07, Bruxelles University Heidelberg, Medicine 2. Detailed results

22 Ranking and Research Assessment, 12/07, Bruxelles 3. Personal Ranking Selection of (up to ) 5 indicators

23 Ranking and Research Assessment, 12/07, Bruxelles 3. Personal Ranking... giving personal „weights“ to indicators:

24 Ranking and Research Assessment, 12/07, Bruxelles 3. Personal Ranking... and the result – a personal ranking:

25 Ranking and Research Assessment, 12/07, Bruxelles 3. Personal Ranking... taht looks different with different indicators:

26 Ranking and Research Assessment, 12/07, Bruxelles III. Impacts: Individual 2/3 of students use ranking as one source of information differences by fields /types of students:  law, medicine, engineering  humanities studies show: ranking covers needs of information of prospective students (indicators)

27 Ranking and Research Assessment, 12/07, Bruxelles III. Impacts: Institutional Ranking not used for funding decisions /allocation of money !!! Institutions use data (published data & additional analysis) as a starting point for analysis of strengths and weaknesses for internal comparison / benchmarking between faculties, incl. contracts between president - faculties for external comparison / benchmarking with other institutions But ranking helps to identify deficits & asking questions, but does not give all answers

Thank you very much! More information: Mailto: International Colloquium “Ranking and Research Assessment in Higher Education” 12 & 13 December 2007, Bruxelles