Graduate Tracer Studies and Benchmarking ACE Workshop, May 09, 2018

Outline Graduate Tracer Studies Objectives Update Pre-survey results Timeline Benchmarking Terms of Reference for participating institutions

Graduate Tracer Studies

Graduate Tracer Studies: Objectives Develop a graduate tracer study methodology (master’s and PhD graduates) to give an overview of the state of employability of graduates Conduct related exercises to obtain the needed data, analysis and reporting Facilitate capacity building workshops to discuss the reports and train universities Work closely with the benchmarking team to ensure a holistic approach to improving quality and relevance in SSA institutions

Graduate Tracer Studies: Update A pre-survey was conducted to determine: Interest of ACEs in participating and their contact details Whether data should be collected at ACE or Institutional level Degree level of graduates to be targeted (undergrads, master’s, doctoral) The type of information centers are interested in obtaining from such a survey Best mode of survey delivery Most attractive incentives for graduates to participate Finalizing procedures for bringing on board MyCOS

Graduate Tracer Studies: Pre-Survey Results 25 out of 46 ACEs across 11 countries responded to the survey (8 ACE Is and 17 ACE IIs) ACE Center Institution ACE I – Bénin SMA Institut de Mathématiques et de Sciences Physiques ACE I – Ghana RWESCK Kwame Nkrumah University of Science and Technology (KNUST) WACCBIP University of Ghana ACE I – Nigeria CERHI University of Benin, Benin City ACEPRD University of Jos ACEGID Redeemer's University PAMI African University of Science and Technology OAU-PARK Obafemi Awolowo University

Graduate Tracer Studies: Pre-Survey Results (ACE II) Center Institution ACE II – Ethiopia CDT-Africa Addis Ababa University ACE II – Kenya CESAAM Egerton University ACEII-PTRE Moi University ACE II – Malawi CEPHEM University of Malawi Aquafish Lilongwe University of Agriculture and Natural Resources ACE II – Mozambique CS-OGET Universidade Eduardo Mondlane ACE II – Rwanda ACEIoT University of Rwanda ACEESD ACEITLMS University of Rwanda- College of Education ACE II – Tanzania IRPM & BTD Sokoine University of Agriculture WISE - Futures Nelson Mandela African Inst. of Sci. & Tech. (NM-AIST) CREATES SACIDS ACE II – Uganda PHARMTRAC Mbarara University of Science and Technology ACALISE Uganda Martyrs University MARCCI Makerere University ACE II – Zambia ACE for Sust.. Mining Copperbelt University

Graduate Tracer Studies: Pre-Survey Results How many cohorts have already graduated from your ACE? ACE I (3 centers graduated 1 cohort; 5 centers graduated 2 cohorts); ACE II (3 centers graduated 2 cohorts; 2 centers graduated 4 cohorts; 1 center graduated 5 cohorts)

Graduate Tracer Studies: Pre-Survey Results Number of graduates in each cohort ACE I ACE II

Graduate Tracer Studies: Pre-Survey Results If you have graduated at least one cohort, please estimate the number of graduates for each cohort who are 1) master’s 2) PhDs 3) undergraduates (if applicable). 885 graduates across all ACEs (50% master’s; 6% PhDs; 44% undergrads)

Graduate Tracer Studies: Pre-Survey Results For each cohort, please indicate the number of graduates for whom you have the contact information (email and/or phone number)? 81% or 358 out of 443 master’s graduates, and 89% or 51 out of 57 PhD graduates and 100% for the undergrads

Graduate Tracer Studies: Pre-Survey Results What kind of information do you wish to obtain from a tracer study? Info. Desired from Tracer Study Frequency 1. Employment status/employability 15 2. Skill competency/requirement/gap 11 3. Suggestions for/satisfaction with teaching & learning improvement 10 4. Salary/performance/promotion information 6 5. Type of employment 4 6. Additional academic training 7. Social/economic contributions 8. Current location 3 Info. Desired from Tracer Study Frequency Job satisfaction 2 Employer satisfaction/suggestions for improvement Contact/demographic information Length of job search 1 Current position at employer Interest in continuing education at center Interest in donating Publications Entrepreneurship

Graduate Tracer Studies: Pre-Survey Results What are the method(s) of survey delivery that in your opinion will have the greatest response rates from your graduates? 17 out of 25 believe emails; What are examples of incentives you would recommend to be given to graduates who take the survey, in order to obtain the greatest response rates? (i.e. what rewards would be most attractive)? The Examples of Incentives Frequency Fellowship/scholarship/conference funding 10 Free lectures/workshops/resources for alumni 8 Survey results 4 Mobile/internet top up 2 Alumni gatherings/networking No incentive 1 University appreciation letter Mentor current students Raffle/prize Academic transcript

Graduate Tracer Studies: Proposal Based on these results, we determined: Data can be collected at ACE (pilot); Scale up possible at institutional level 25 ACEs are interested; 11 have 0 graduates Master’s degree level of graduates (2016 & 2017) to be targeted for pilot Survey will focus on employment, skills, and evaluation of teaching & learning Best mode of survey delivery: Emails (primary); Calls (secondary) Most attractive incentives for graduates to participate: scholarships, center resources Other ACES can still join, the pilot particularly those who have graduated 1 or more cohorts and have their contact details

Graduate Tracer Studies: Timeline Develop the standard methodology (variable indicator system) of the graduate tracer study for both master’s and doctoral graduates. – June 2018 Consultations on methodology with ACEs and other Higher education stakeholders- July 2018 Survey questions translated and transferred onto online platform – Aug 2018 Survey period for master’s graduates only (pilot with only ACEs) –Sep – Nov 2018 Dissemination of results and regional workshops – Dec 2018/ 2019 (tbc)

Benchmarking

Benchmarking: Objectives Facilitate benchmarking, graduate tracer studies, student surveys and other relevant exercises under the initiative that are relevant for the SSA higher education sector and based on global best practices; Support the SSA higher education sector by providing capacity building opportunities for higher education institutions and government agencies/ministries in quality data management, including its collection, analysis, interpretation and its strategic use; and Invest in key partnerships that would add value through financial, technical and/or other in- kind support to the Hub’s activities, ensuring it remains relevant and sustainable. Ministerial meeting, once a year at the rep level. Unless told otherwise, the PSC member from the ACE 1 will continue Clear separation of discussions/decisions.

Benchmarking: Update Secured some funding to support Benchmarking host institution and technical assistance Expressions of interest for host institution applications Technical Assistance firm “Shanghai Ranking” have been contracted (as of last week) Soliciting list of interested universities and national agencies. So far: Universities: Botswana (1), Cameroon (6), DRC (6), Ethiopia (9), Gabon (?),Ghana (5), Kenya (3), Niger (?), Nigeria (?), Lesotho (1), Malawi(5), Mauritania (1), Rwanda (1), Senegal (?), Tanzania (49), Uganda (3), Zambia (2)

Benchmarking: Terms of Reference Expected outcomes Eligibility Existence of a comprehensive and functional Management Information System (MIS) for the university Evidence of trained staff that understand how to collect, analyze and use data to inform the university’s policy makers Improvements in quality and relevance of the university’s programs evidenced by interventions that improve at least 2 indicators each year Improvement in relevance of programs at the university as evidenced by positive outcome of graduate tracer studies in subsequent years of participation A private, public, research or teaching university based in sub-Saharan Africa Head of University willing to sign a commitment letter for the participation of the university Commitment to submit required data Willingness and commitment of the university to make practical and relevant changes informed by the results from the benchmarking and graduate tracer studies exercise Agree that the results will be made public

Benchmarking: Timeline Update of institutional benchmarking methodology and development of a data verification scheme - May 2018 Institutional Benchmarking data collection – June – August 2018 Development of national higher education system benchmarking methodology - July 2018 Consultations on national higher education system benchmarking methodology with other Higher Education stakeholders- Aug 2018 National system level data collection – Aug - Sept 2018 Data cleaning and verification – Sep – Oct 2018 Overall and individual reports ready and disseminated - Dec 2018/early 2019 Regional and national level workshops - 2019

Questions, Comments, Feedback? ebentil@worldbank.org