Www.che.de What Can National Rankings Learn from the U-Multirank-Project ? Gero Federkeil, CHE, Germany IREG-Forum: National University Rankings on the.

Slides:

Advertisements

Similar presentations

N Mapping and Ranking: New higher education transparency tools Don F. Westerheijden, CHEPS, University of Twente, the Netherlands.

Advertisements

Regions for Economic Change | LMP Workshop 3C When exchanging is good for innovation: Experiences from the Lisbon Monitoring Platform How can INTERACT.

WP4 – 4.1 and 4.2 Preparatory activities for the creation of the WATERMODE permanent network 1 Technical Committee Meeting Venice, June 24-25, 2010 VENETO.

U-MULTIRANK Approach to m ultidimensional evaluation of HEI performance Getalo Elena lead expert, Development Programs Office, Tomsk Polytechnic University.

CHE and Coimbra Group 1 Ranking, Rating, Benchmarking... what is serving which purpose?

EAC HIGHER EDUCATION POLICY

Building a European Classification of Higher Education Institutions Workshop ‘New challenges in higher education research and policy in Europe and in CR’,

Multi-dimensional, field-based rankings Gero Federkeil, CHE, Germany Special Workshop: Introduction to Academic Rankings for the Rectors of.

Workshop Mapping Estonian Universities Frans Kaiser & Marike Faber, Tartu (Estonia) 21 March 2011.

NMP-NCP meeting - Brussels, 27 Jan 2005 Towards FP 7: Preliminary principles and orientations… Nicholas Hartley European Commission DG Research DG Research.

U-Multirank – The implementation of a multidimensional international ranking IREG Forum on University Rankings – Methodologies under scrutiny Warsaw,

Mapping Diversity – The U-Multirank Approach to Rankings Gero Federkeil Workshop Universidade Nova de Lisboa, 29th June 2012.

The CHE Research Ranking of German Universities Sonja Berghoff International Colloquium “Ranking and Research Assessment in Higher Education”

Ranking - New Developments in Europe Gero Federkeil CHE – Centre for Higher Education Development The 3rd International Symposium on University Rankings.

Towards a Multi-dimensional Ranking: Transparency in Missions and Performances of Higher Education Institutions The EU context Sophia Eriksson Waterschoot.

1 UNICA WORKING GROUPS ON RESEARCH EVALUATION AND ADMINISTRATIVE EXCELLENCE Prof. Véronique Halloin, GS of Fund for Scientific Research.- FNRS Prof. Philippe.

Ecdc.europa.eu Christian Tauch DG Education and Culture Fostering student mobility: Next steps?

Association for the Education of Adults EAEA European AE Research – Look towards the future ERDI General Assembly, 2004.

Ranking universities: The CHE Approach Gero Federkeil CHE – Centre for Higher Education Development International Colloquium “Ranking and Research Assessment.

The world’s first global, multi-dimensional, user-driven university* ranking (* includes all higher education institutions) Jordi Curell Director Higher.

15 April Fostering Entrepreneurship among young people through education: a EU perspective Simone Baldassarri Unit “Entrepreneurship” Forum “Delivering.

TeamSTEPPS TM National Implementation Measurement The following slides are not part of the TeamSTEPPS Instructor Guide. Due to federal 508 compliance requirements.

FAST-LAIN (Further Action on Sustainable Tourism – Learning Area Innovation Networks) Project Overview ACTION N °: /CIP/10/B/N04S00 T ITLE : Knowledge.

The CHE ranking The multi-dimensional way of Ranking Isabel Roessler CHE – Centre for Higher Education Development International Conference “Academic Cooperation.

Robin van IJperen European Commission IREG Conference, Astana16 June 2009 Towards a Multi-dimensional Ranking: the View of the European Commission on Transparency.

U-Multirank – The implementation of a multidimensional international ranking Higher Education Conference Rankings and the Visibility of Quality Outcomes.

International Aspects of the European Research Agenda Lesley Wilson EUA Secretary General Monash University 15 November 2007.

MEADOW: Guidelines for a European survey of organisations Nathalie Greenan CEE and TEPP-CNRS Exploring possibilities for the development of European data.

The European Agenda for Culture The OMC and the Structured dialogue with civil society.

1 Science and Society: EU Strategy and actions Dr. Rainer GEROLD Director Science and Society Research DG European Commission.

The Open Method of Coordination in the area of Innovation Policy

Major Current Trends in Innovation: The OECD Science, Technology and Industry Outlook 2014 Dominique Guellec Head, Country Studies and Outlook Division.

Quality in Education and Training

1 Master in Engineering Policy and Management of Technology S & T Policy BENCHMARKING INDUSTRY-SCIENCE RELATIONSHIPS OCDE – March 2002 Anabela Piedade.

Erasmus centralised actions and higher education policy Brussels, 23 rd January 2012 Vanessa Debiais-Sainton Endika Bengoetxea Higher Education; Erasmus.

ESPON Seminar 15 November 2006 in Espoo, Finland Review of the ESPON 2006 and lessons learned for the ESPON 2013 Programme Thiemo W. Eser, ESPON Managing.

1 G. Pignault 01/04/06 EFCE WPE Palermo FCC / FCCE Project « First Certificate of Chemistry / First Certificate of Chemical Engineering » CPE Lyon CEFI.

Gero Federkeil Expert Seminar „Quality Assurance and Accreditation in Lifelong Learning“, Berlin, February 2011 Rankings and Quality Assurance.

Role of University Rankings in Kazakhstan Prof. Sholpan Kalanova BRATISLAVA 2011.

Classifying higher education institutions: why and how? EAIR Forum ‘Fighting for Harmony’, Vilnius August 2009 Frans Kaiser Christiane Gaehtgens.

1 WERT: WP 5 RG EVANS ASSOCIATES November 2010 Aim To pilot and evaluate the content and context of the course material with target groups To help women.

European Scout Office 2014 European Scout Committee

The importance of training and awareness Hanns Kirchmeir, E.C.O. Institute for Ecology In Cooperation with: Federal Agricultural Research and Education.

The Knowledge Exchange Presentation to CNI April 2005 Bas Cordewener, SURF Sigrun Eckelmann, DFG Norman Wiseman, JISC.

Certifying the Management of Diversity in HEI Dr. Daniela De Ridder Hannah Leichsenring York, June 23th 2009.

Making Good Use of Research Evaluations Anneli Pauli, Vice President (Research)

Assessing regional engagement and knowledge transfer – ranking or benchmarking? David Charles, EPRC, University of Strathclyde.

Future programme in the field of youth Consultation day 8 September 2010.

HU113: Technical Report Writing Prof. Abdelsamie Moet Teaching Assistant: Mrs. Rana El-Gohary Fall 2012/13 Pharos University in Alexandria Faculty of Engineering.

The Governance and Management of European Universities – Future Trends Thomas Estermann Senior Programme Manager European University Association Targu.

Classifying European Institutions of Higher Education Phase II Frans van Vught.

The Culture Capital Exchange Developing International Networks and Collaborations in Higher Education

HTA Benefits and Risks Dr Bernard Merkel European Commission.

The industrial relations in the Commerce sector EU Social dialogue: education, training and skill needs Ilaria Savoini Riga, 9 May 2012.

CEIHE II CONFERENCE SANTANDER APRIL 2008 Dr Peter W A West Secretary to the University.

2008 Communication “A European Agenda for Culture in a globalizing world” Published by the European Commission May 2007 Adopted by the Culture Council.

EUROPEAN COMMISSION Directorate-General for Education and Culture Life Long Learning: Education and Training policies School Education and Higher education.

Presentation By L. M. Baird And Scottish Health Council Research & Public Involvement Knowledge Exchange Event 12 th March 2015.

King Saud University, College of Science Workshop: Programme accreditation and quality assurance Riyadh, June 13-14, 2009 III.1 The accreditation report:

Classification & Ranking in Higher Arts Education New EU developments and the role of ELIA.

Fostering student mobility:

On the feasibility of a new approach

WP1. Methodology and structure of questionnaires

U-Multirank – The first Multidimensional Global University Ranking

N Classification of Dutch and Flemish Higher Education Institutions.

Cohesion Policy and Cities

WG Transparency PLA Noël Vercruysse February 16th 2011

Rankings from the perspective of European universities

Customer Satisfaction Measurement in European Public Administrations

Training on joint doctoral studies

Presentation transcript:

What Can National Rankings Learn from the U-Multirank-Project ? Gero Federkeil, CHE, Germany IREG-Forum: National University Rankings on the Rise Bratislava, Oct. 2011

2 IREG Forum | Gero Federkeil | Bratislava

3 The project Commissioned by the European Commission 2-year project, 2009 – June 2011 Report now available: Ján Figel, the former European Commissioner for Education, Training, Culture and Youth: “- to allow stakeholders to make informed choices; - to help institutions to position themselves and improve their performance” Two phases: o Design of new instrument o Testing the feasibility of new instrument

IREG Forum | Gero Federkeil | Bratislava Specification of U-Multirank Five dimensions: o Teaching & learning o Research o Knowledge transfer o International orientation o Regional engagement Long list of indicators to be tested in pilot project development of data collection tools and processes (questionnaires, definitions, FAQs, communication + feedback processes) methods for building ranking groups instead of league tables

IREG Forum | Gero Federkeil | Bratislava Testing U-Multirank Two levels: Institution (FIR) Fields (FBR) Global sample of higher education and research institutions: 159 (target: 150), 2/3 Europe, 109 completed institutional questionnaires Two fields: Business studies Engineering (electrical and mechanical)

Bais logic: Mapping Diversity IREG Forum | Gero Federkeil | Bratislava Diversity of higher education institutions in Europe & the world Identifying comparable institutions that can be compared in one ranking Description of horizontal diversity  Types/profiles Description of horizontal diversity  Types/profiles Assessment of vertical diversity  Performance Assessment of vertical diversity  Performance Complementary instruments of transparency +

Mapping and Ranking IREG Forum | Gero Federkeil | Bratislava Mapping: Selection of a comparable set of universities based on institutional profiles Teaching and learning Research involvement Knowledge exchange Regional engagement International orientation Student profile Example: Comprehensive, teaching oriented institution Mainly undergraduate education Low research orientation Low international orientation Regionalyl embedded (e.g. recruiting) Subset of comparable institutions to be compared in a ranking

Mapping and Ranking IREG Forum | Gero Federkeil | Bratislava Ranking: Multi-dimensional ranking for subset of institutions No composite indicator! No number 1 !

9 IREG Forum | Gero Federkeil | Bratislava

Mapping and Ranking IREG Forum | Gero Federkeil | Bratislava Most national HE systems are diversified HE systems: Different types/profiles of institutions exist  Need to identify comparable institutions for ranking  Mapping systems can increase the comparabiliy and improve the quality of rankings  U-Map defines indicators for mapping & is setting a standard for Europe

Multi-dimensional Approach IREG Forum | Gero Federkeil | Bratislava Multi-Multirank identified a set of indicators for 5 dimensions U-Multirank introduced 2 „new“ dimensions: knowledge transfer regional engagement Indicators have been discussed intensively with stakholders

Innovative indicators IREG Forum | Gero Federkeil | Bratislava Teaching and learning: For rankings which want to inform (prospective) students indicators based on students‘ assessment of their teaching and learning experience are highly useful and are feasible (in most settings) Knowledge transfer: Joint publications with industry Research funds from industry But problems with regard to data (e.g. on spin offs/licenes)

Innovative indicators IREG Forum | Gero Federkeil | Bratislava International Orientation Rating indicator on international orientation of programmes is more meaningful than linear ranking of number of int. students Regional Engagement: Important for many HEIs yet most problematic dimension in U-Multirank Bibliometric indicator: Regional co-publications Further development is necessary

User-driven Approach IREG Forum | Gero Federkeil | Bratislava Intensive stakeholder consultation helped to increase acceptance Multi-dimensional, personalised rankings allow individual users to produce ranking based on their own preferences and networks and aossciations of universities to start benchmarking / create their own ranking

Data collection IREG Forum | Gero Federkeil | Bratislava International rankings have to rely on self-reported data due to lack of international data bases (except bibliometric, patent data) Feedback loop with universities concerning self-reported data on institution, faculties & programmes helped to increase consistency & quality of data Parallel / conflicting national data collections (e.g. student surveys)  raises issue of coordination national – international rankings in general

16 IREG Forum | Gero Federkeil | Bratislava

Outlook: National rankings and U-Multirank IREG Forum | Gero Federkeil | Bratislava There will be a continuing demand for national rankings ! Definition of a core set of indicators for national rankings and U-Multirank? Network of national rankings, e.g. Germany – Austria – Switzerland - Netherlands – Spain …. that share data which can be used for U-Multirank

18

What Can National Rankings Learn from the U-Multirank-Project ? Gero Federkeil, CHE, Germany IREG-Forum: National University Rankings on the Rise Bratislava, Oct. 2011