1. Copyright © 2008 QS Top Universities (www.topuniversities.com) Times Higher - QS World University Rankings Methodology & Malaysia’s Performance Ben Sowter Head of Research QS Bangkok 7 April 2008 1

2. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Establish QS background & credentials  Explain research methodology  New developments  Understand limitations of rankings  Provide insight into performance enhancement specific to improved ranking  Collect feedback and input Objectives 2

3. Copyright © 2008 QS Top Universities (www.topuniversities.com) Session Flow 3

4. Copyright © 2008 QS Top Universities (www.topuniversities.com) QS A brief introduction 4

5. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Nunzio Quacquarelli  MBA Wharton  MBA Career Guide  Approximately 100 staff in 2008  Asia Office in Singapore  Asia Research Unit Founded 1989/1990 5

6. Copyright © 2008 QS Top Universities (www.topuniversities.com) …to enable motivated people around the world to fulfill their potential, by fostering international mobility, educational achievement and career development Our Channels  primary research  leading-edge editorial & publications  developmental events  web solutions QS Mission…

7. Copyright © 2008 QS Top Universities (www.topuniversities.com) www.topuniversities.com

8.  Over 1,180,000 visits in 2007  Over 6,000 visits per day in 2008  Increasingly strong prominence in Google & Yahoo searches  Ranked 53,626 in Alexa  Home of the THE – QS World University Rankings  Institution Profiles  Detailed study abroad information www.topuniversities.com 8

9. Copyright © 2008 QS Top Universities (www.topuniversities.com)  New revised and updated edition available now  Contains much information not available on web Top Universities Guide

10. Copyright © 2008 QS Top Universities (www.topuniversities.com) Other QS Initiatives  QS World Grad School Tour  QS Top Grad School Guide  QS World MBA Tour  QS Top MBA Career Guide  QS APPLE – Korea July 2008  QS Top Apply  QS Education Trust  QS Intelligence Unit 10

11. Copyright © 2008 QS Top Universities (www.topuniversities.com) QS Offices & Events 11

12. Copyright © 2008 QS Top Universities (www.topuniversities.com) THE CONTEXT THE – QS World University Rankings

13. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Interest in ranking things and people  Hospitals  Schools  Local authorities  Rich lists; Britain, world, Asian British, footballers  Universities: The Times / US News etc… Why rank universities? 13

14. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Higher education becoming more global  Knowledge the key driver of international competitiveness  Increasing desire for comparative information  Unique positions of THE and QS as international and independent experts in higher education  Raises awareness of all 500+ universities involved in the project Why World Rankings? 14

15. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Worldwide, the demand for international education is forecast to increase rapidly  In 2003, an estimated 3.1 million students studied internationally  There are likely to be in excess of 5.8 million international students in 2010  Two-thirds of this global demand will be Asians  US domination of international student recruitment has begun to falter – tight Visas, increased competition (IIE, NAFSA, CCE)  Bologna Accord will create an ‘explosion in English- language based postgraduate courses in Europe’ International Study Trends 15

16. Copyright © 2008 QS Top Universities (www.topuniversities.com) Student Mobility on the Rise 16

17. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Government funding of tertiary education being cut (per capita) in most countries around the world (IFC)  Many governments targeting international students as a source of tertiary sector funding  Australia has estimated that international students are more important to their economy than manufacturing & mining  The UK Government estimates that 270,000 students contribute $3 billion in fees & a further $3 billion in other spending International Study Trends 17

18. Copyright © 2008 QS Top Universities (www.topuniversities.com)  By 2010 The European Commissions Bologna Accord will make room for over 500,000 first degree graduates to study in other EU nations for a Masters degree  By 2016 In the USA, recent Abraham Lincoln Study Abroad legislation aims to encourage 1 million students to study overseas  By 2020 Over 3 million Asians are expected to study outside their home country (Source: IDP – British Council) International Study Trends 18

19. Copyright © 2008 QS Top Universities (www.topuniversities.com) “ ” World University Rankings can help differentiate the active, from the dormant…volcanoes! Professor Shih, President National University of Singapore 19

20. Copyright © 2008 QS Top Universities (www.topuniversities.com) AVAILABLE GLOBAL RANKINGS THE – QS World University Rankings

21. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Operated by Shanghai Jiao Tong University in China  Focuses principally on research output  Nobel Prizes & Fields Medals  Citations  HiCis  Strongly correlated with educational reputation  Historical dependency  Available on www.arwu.org www.arwu.org Academic Ranking of World Universities 21

22. Copyright © 2008 QS Top Universities (www.topuniversities.com) CriteriaIndicatorWeight Quality of Education Alumni of an institution winning Nobel Prizes and Fields Medals 10% Quality of Faculty Staff of an institution winning Nobel Prizes and Fields Medals 20% Highly cited researchers in 21 broad subject categories 20% Research Output Articles published in Nature and Science* 20% Articles in Science Citation Index-expanded, Social Science Citation Index 20% Size of Institution Academic performance with respect to the size of an institution 10% Shanghai Jiao Tong Criteria 22

23. Copyright © 2008 QS Top Universities (www.topuniversities.com) Webometrics Ranking of World Universities  Focuses on web profile  Research productivity using Google Scholar  Search Engine performance  Site popularity  Good practices in web management  Fully automated  Tracks in the realm of 14,000 institutions  Prone to anomaly  A university domain change can be disastrous  Available on www.webometrics.info www.webometrics.info 23

24. Copyright © 2008 QS Top Universities (www.topuniversities.com) IndicatorWeight Size Number of pages recovered from four engines: Google, Yahoo, Live Search and Exalead. 20% Rich Files After evaluation of relevance to academic and publication activities and considering the volume of the different file formats, the following were selected: Adobe Acrobat (.pdf), Adobe PostScript (.ps), Microsoft Word (.doc) and Microsoft Powerpoint (.ppt). These data were extracted using Google, Yahoo Search, Live Search and Exalead. 15% Scholar Google Scholar provides the number of papers and citations for each academic domain. These results from the Scholar database represent papers, reports and other academic items. 15% Visibility The total number of unique external links received (inlinks) by a site can be only confidently obtained from Yahoo Search, Live Search and Exalead. 50% Webometrics Criteria 24

25. Copyright © 2008 QS Top Universities (www.topuniversities.com) World University Rankings 25

26. Copyright © 2008 QS Top Universities (www.topuniversities.com) THE - QS World University Rankings  Began in 2004  Collaboration between Times Higher Education (THE) & QS  THE running since 1971  THE is a weekly newspaper distributed to academics in the UK and internationally  Formerly associated with The Times  Published annually in the fall

27. Copyright © 2008 QS Top Universities (www.topuniversities.com) THE METHODOLOGY THE – QS World University Rankings

28. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Four key themes, as basis for comparison:  Research Quality  Graduate Employability  International Outlook  Teaching Quality Our Approach 28

29. Copyright © 2008 QS Top Universities (www.topuniversities.com) CriteriaIndicatorBrief DescriptionWeight* Research Quality Peer Review Composite score drawn from peer review (which is divided into five subject areas). 3,703 responses. 40% Citations per Faculty Score based on research performance factored against the size of the research body 20% Graduate Employability Recruiter Review Score based on responses to recruiter survey. 738 responses 10% International Outlook International Faculty Score based on proportion of international faculty 5% International Students Score based on proportion of international students 5% Teaching Quality Student Faculty Score based on student/faculty ratio 20% Ranking Criteria & Weights *All decisions regarding the allocation of weightings are the responsibility of the Times Higher Education Supplement 29

30. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Began in 2004 with list of the top 500 world institutions by research impact  Excludes single-faculty institutions  Excludes postgraduate-only institutions  Added on recommendation from certain countries where English publication culture is not strong (e.g. Germany)  Each year list is re-evaluated  Omitted institutions are welcome to make a case for inclusion with supporting evidence for their inclusion relative to an included institution  566 universities considered in 2007 Selection of Initial List 30

31. Copyright © 2008 QS Top Universities (www.topuniversities.com) “ ” Peer review is an effective way to evaluate universities. It takes smart people to recognise smart people Sir Richard Sykes Rector, Imperial College 31

32. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Peer review is the centrepiece of this ranking  5,101 respondents  International spread  Weighted Results  Subject spread  Arts & Humanities  Engineering & IT  Life Sciences & Biomedicine  Natural Sciences  Social Sciences  Overall score built up from each faculty area  Active academics  3 year “latest response” Peer Review of Research Output 32

33. Copyright © 2008 QS Top Universities (www.topuniversities.com)  3 year latest response  Invitation to previous respondents  World Scientific Database (180,000)  Singapore Headquarters  www.worldscientific.com www.worldscientific.com  Mardev Database (12,000+)  Part of Reed Elsevier  UK Headquarters  www.mardev.com www.mardev.com  Academic Sign-up facility  www.topuniversities.com www.topuniversities.com Peer Review – Selection of Peers 33

34. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Harvard second to Berkeley  Oxford and Cambridge  Well-liked universities all over the world  Little evidence of patriotism bias  UK and North America dominate the top 20 Observations: Peer Review 34

35. Copyright © 2008 QS Top Universities (www.topuniversities.com) The Recruiter Review 35

36. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Another group who have knowledge of university quality  Key relevance to “graduate employability” criteria  Introduced for 2005 rankings  Sourced from QS database and media and university referrals (over 120 lists received for 2007)  Improved response for 2006 & 2007  Continuing development focus for 2008 Recruiter Review 36

37. Copyright © 2008 QS Top Universities (www.topuniversities.com)  UK  Strong but less so than in previous years  Some institutions with particular strengths do well  Bocconi, HEC Observations: Recruiter Review 37

38. Copyright © 2008 QS Top Universities (www.topuniversities.com) Quantitative Measures 38

39. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Research Quality  citations/faculty  Teaching Quality  faculty student ratio  International Outlook  % international faculty and students  Graduate Employability  ?? Quantitative Measures 39

40. Copyright © 2008 QS Top Universities (www.topuniversities.com)  All personnel metrics based on FTE  If no FTE data is available an average is calculated based on national or regional norms  FTE numbers are a more accurate measure of an institution’s commitment to teaching and research Full Time Equivalent (FTE) 40

41. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Winner – Caltech  US, French, Swiss, Netherlands etc institutions all well placed  Both Asian and European amongst the well- placed  Weak correlation (0.21) with research – but not zero  FTE numbers have had a profound effect on institutions with an atypical approach to part-time or distance learning Observations: Staff/Student 41

42. Copyright © 2008 QS Top Universities (www.topuniversities.com)  US shows up badly  HKUST top in staff  London School of Economics top in students  Caltech among few US with international staff Observations: International 42

43. Copyright © 2008 QS Top Universities (www.topuniversities.com) Citations per Faculty Score  Classic measure of research quality  Citations per staff member (not per paper)  5 year score (changed from 10 in 2006 to increase “topicality”)  Source: Scopus

44. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Medical faculty is a big plus  Or major biomedical income  CalTech the winner, then Stanford & MIT  Big country effect Observation: Citations 44

45. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Method used in various domestic rankings such as The Times (UK)  Stabilise data year on year  More accurate application of weightings throughout the sample  Smoothes any anomalies that remain  Essentially smoothes the curve for each individual indicator Z-Score Aggregation 45

46. Copyright © 2008 QS Top Universities (www.topuniversities.com) The Effect of Z-Score Application on Rankings Indicators 46

47. Copyright © 2008 QS Top Universities (www.topuniversities.com) 2007 Indicator Correlations Peer Review 0.59 Recruiter ReviewStrong Peer Review 0.28 International FacultyWeak Peer Review 0.35 International StudentsModerate Peer Review 0.32 Student FacultyModerate Peer Review 0.45 Faculty CitationsModerate Recruiter Review 0.33 International FacultyModerate Recruiter Review 0.37 International StudentsModerate Recruiter Review 0.27 Student FacultyWeak Recruiter Review 0.12 Faculty CitationsWeak International Faculty 0.66 International StudentsStrong International Faculty 0.15 Student FacultyWeak International Faculty 0.15 Faculty CitationsWeak International Students 0.23 Student FacultyWeak International Students 0.19 Faculty CitationsWeak Student Faculty 0.21 Faculty CitationsWeak 47

48. Copyright © 2008 QS Top Universities (www.topuniversities.com) 1.Online System  More thorough and complete data all the way down the list  Less need for averages 2.Peer Review  Countries with disproportionately high response but a small number of institutions lose unnatural advantage 3.FTE Data  Universities with particularly high or low numbers for part-time will be influenced 4.Scopus  Less pronounced bias towards US and English speaking world 5.Z-Score aggregation  Less advantage for the best institutions in lower weighted indicators  Increased stability year on year Effects of 2007 developments… 48

49. Copyright © 2008 QS Top Universities (www.topuniversities.com)  The ranking has limitations. Lack of data on:  Teaching quality  Student satisfaction  Investment in infrastructure  The ranking relies on the best comparable data available World University Rankings - Issues? 49

50. Copyright © 2008 QS Top Universities (www.topuniversities.com) THE RESULTS THE – QS World University Rankings

51. Copyright © 2008 QS Top Universities (www.topuniversities.com) Comparing Results THE – QS 1Harvard 2=Cambridge 2=Yale 2=Oxford 5Imperial 6Princeton 7=Caltech 7=Chicago 8UCL 10MIT SHANGHAI 1.Harvard 2.Stanford 3.Berkeley 4.Cambridge 5.MIT 6.Caltech 7.Columbia 8.Princeton 9.Chicago 10.Oxford WEBOMETRICS 1.MIT 2.Stanford 3.Harvard 4.Penn State 5.Berkeley 6.Michigan 7.Wisconsin 8.Minnesota 9.Illinois 10.Cornell

52. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Harvard  The US – 57 in top 200  Harvard’s lead the smallest yet  Oxford and Cambridge also well placed  But that’s only part of the story Key Findings 52

53. Copyright © 2008 QS Top Universities (www.topuniversities.com)  The top 200 includes universities in 28 states  US, UK, Canada, Australia, Netherlands  Korea, China, Japan, Singapore  Thailand, Malaysia  Continental Europe  Developing world small but improving (1 in 2004, 2 in 2005, only UNAM in 2006, 3 in 2007) Key Findings 53

54. Copyright © 2008 QS Top Universities (www.topuniversities.com) Top 20Top 50Top 100 Region/Country 200720062005200420072006200520042007200620052004 N. America 14 (11)(12)(11) 23 (25)(23) 43 (36)(35)(38) Europe 4 (5) 12 (12)(13) 35 (41)(37) Asia/Australia 3 (4)(3)(4) 15 (14) 22 (23)(28)(25) USA 13 (11)(12)(11) 20 (22)(20) 37 (33)(31)(35) UK 4 (4) 8 (8) 19 (15)(13)(14) Australia 1 (1) 6 (6) 8 (7)(12)(11) Where are the top universities? 54

55. Copyright © 2008 QS Top Universities (www.topuniversities.com) 2007200620052004 1Harvard 2Cambridge MITBerkeley 3YaleOxfordCambridgeMIT 4OxfordMITOxfordCaltech 5ImperialYaleStanfordOxford 6PrincetonStanfordBerkeleyCambridge 7ChicagoCaltechYaleStanford 8CaltechBerkeleyCaltechYale 9UCLImperialPrinceton 10MITPrinceton Ecole Polytechnique ETH Zurich Consistency of Results 55

56. Copyright © 2008 QS Top Universities (www.topuniversities.com) 20072006NAMECOUNTRYSCORE 11HARVARD UniversityUnited States100 2=2University of CAMBRIDGEUnited Kingdom100 2=3University of OXFORDUnited Kingdom100 2=4=YALE UniversityUnited States100 59Imperial College LONDONUnited Kingdom99 610PRINCETON UniversityUnited States100 7=7CALIFORNIA Institute of Technology (Caltech)United States100 7=11University of CHICAGOUnited States100 925UCL (University College LONDON)United Kingdom96 104=MASSACHUSETTS Institute of Technology (MIT)United States100 1112COLUMBIA UniversityUnited States100 1221MCGILL UniversityCanada100 13 DUKE UniversityUnited States98 1426University of PENNSYLVANIAUnited States97 1523JOHNS HOPKINS UniversityUnited States99 16 AUSTRALIAN National UniversityAustralia100 1719=University of TOKYOJapan100 1833=University of HONG KONGHong Kong95 196STANFORD UniversityUnited States100 20=35=CARNEGIE MELLON UniversityUnited States96 The Results 56

57. Copyright © 2008 QS Top Universities (www.topuniversities.com) Top Asia Pacific* Schools RANK IN REGION 2007 RANK 2006 RANK INSTITUTION NAMECOUNTRY PEER REVIEW RECRUITER REVIEW FACULTY STUDENT CITATIONS PER FACULTY INT'L FACULTY INT'L STUDENTS OVERALL 21719=University of TOKYOJapan100929688254491.1 31833=University of HONG KONGHong Kong959085791008990.7 42529=KYOTO UniversityJapan99898390292487.2 733=19=National University of SINGAPORESingapore100933484100 84.3 93614PEKING UniversityChina10098 53322684.2 1038=50=The CHINESE University of Hong KongHong Kong837980 1008583.8 114028TSINGHUA UniversityChina959210059203683.3 144670=OSAKA UniversityJapan83758691172980.0 1651=63SEOUL National UniversityKorea, South92548079162477.1 1753=58=HONG KONG University of Science & TechnologyHong Kong848228921009676.9 206961=NANYANG Technological UniversitySingapore818237721009973.6 2185=116=FUDAN UniversityChina8796456831 71.6 2290=118TOKYO Institute of TechnologyJapan67865991344270.5 23=102=108National TAIWAN UniversityTaiwan86683979182468.0 23=102=168=TOHOKU UniversityJapan53599684403268.0 25112=128=NAGOYA UniversityJapan53748385253066.1 27125180NANJING UniversityChina74724569591464.4 29132=198=KOREA Advanced Institute of Science & TechnologyKorea, South65276485532863.7 30136128=KYUSHU UniversityJapan50688082173162.8 31149=154CITY University of Hong KongHong Kong625137761005161.2 32151=133=HOKKAIDO UniversityJapan49697682192161.1 34155=165=University of Science and Technology of CHINAChina75772876161160.9 35161=120KEIO UniversityJapan52889145251659.9 36163=179SHANGHAI JIAO TONG UniversityChina72923855351159.7 * Excludes Australia and New Zealand 57

58. Copyright © 2008 QS Top Universities (www.topuniversities.com) Malaysia Results RANK IN REGION2007 RANK 2006 RANK INSTITUTION NAME PEER REVIEW RECRUITER REVIEW FACULTY STUDENT CITATIONS PER FACULTY INT'L FACULTY INT'L STUDENTS OVERALL 61246=192=Universiti MALAYA (UM)66 3814634149.4 74307=277=Universiti Sains MALAYSIA (USM)55453227383042.4 76309=185 Universiti Kebangsaan MALAYSIA (UKM) 61352513972842.3 91364=292=Universiti Putra MALAYSIA (UPM)4845 13192338.1 108416=-Universiti Teknologi MALAYSIA (UTM)------- 254 313 242 336 58

59. Copyright © 2008 QS Top Universities (www.topuniversities.com) Average Positions for Asian Institutions in the Top 500 59

60. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Peer opinion  Citations per paper  Not aggregated Faculty Level Data 60

61. Copyright © 2008 QS Top Universities (www.topuniversities.com) Faculty Level: Top 5s  Arts & Humanities  Harvard  Berkeley  Oxford  Cambridge  Yale  Engineering & IT  MIT  Berkeley  Stanford  Caltech  Cambridge  Life Sciences & Biomedicine  Harvard  Cambridge  Oxford  Johns Hopkins  Berkeley  Natural Sciences  Berkeley  MIT  Cambridge  Harvard  Princeton  Social Sciences  Harvard  Berkeley  LSE  Yale  Stanford

62. Copyright © 2008 QS Top Universities (www.topuniversities.com) Faculty Level: Malaysia  Arts & Humanities  USM (227)  UKM (233=)  UM (233=)  UPM (336)  Engineering & IT  UM (166)  UKM (192)  UPM (222)  USM (234)  UTM (328)  Life Sciences & Biomedicine  UM (107)  USM (122)  UKM (153)  UPM (207)  UTM (302)  Natural Sciences  UKM (116)  UM (124)  USM (161)  UPM (165)  Social Sciences  UM (119)  UKM (146)  USM (208=))  UPM (233)  UTM (356=)

63. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Available at www.topuniversities.com www.topuniversities.com  Top 100 for the following subject areas  Arts & Humanities  Engineering & IT  Life Sciences & BioMedicine  Natural Sciences  Social Sciences  World’s oldest universities  Year on year results The Results 63

64. Copyright © 2008 QS Top Universities (www.topuniversities.com) THE FUTURE THE – QS World University Rankings

65. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Submit a broad range of quantitative and qualitative data (including those we need for the rankings) about your institution using our online interface  http://schools.qsnetwork.com http://schools.qsnetwork.com  Populate and enrich your profile on www.topuniversities.com www.topuniversities.com  Educate visitors on other aspects of your institution Online Database 65

66. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Supply us with lists of employer contacts for the recruiter review  Exclusive single use only  Benefit your institution in recruiter review  Improve the overall strength of recruiter review Recruiter Review 66

67. Copyright © 2008 QS Top Universities (www.topuniversities.com)  Recruiter Review Breakdown  Preview Access to Recruiter Survey  Academic Sign Up Facility  Subject Focuses  Personalised Rankings  Innovation Showcase  Engagement Database  Entry Requirements Translator  PhD Matching Engine Coming Soon! 67

68. Copyright © 2008 QS Top Universities (www.topuniversities.com) Thank You Ben Sowter ben@qsnetwork.com Presentation slides available on www.topuniversities.com/professional/seminars/downloads www.topuniversities.com/professional/seminars/downloads 68