1. Graduate Tracer Studies and Benchmarking
ACE Workshop,
May 09, 2018

2. Outline Graduate Tracer Studies Objectives Update Pre-survey results
Timeline
Benchmarking
Terms of Reference for participating institutions

3. Graduate Tracer Studies

4. Graduate Tracer Studies: Objectives
Develop a graduate tracer study methodology (master’s and PhD graduates) to give an overview of the state of employability of graduates
Conduct related exercises to obtain the needed data, analysis and reporting
Facilitate capacity building workshops to discuss the reports and train universities
Work closely with the benchmarking team to ensure a holistic approach to improving quality and relevance in SSA institutions

5. Graduate Tracer Studies: Update
A pre-survey was conducted to determine:
Interest of ACEs in participating and their contact details
Whether data should be collected at ACE or Institutional level
Degree level of graduates to be targeted (undergrads, master’s, doctoral)
The type of information centers are interested in obtaining from such a survey
Best mode of survey delivery
Most attractive incentives for graduates to participate
Finalizing procedures for bringing on board MyCOS

6. Graduate Tracer Studies: Pre-Survey Results
25 out of 46 ACEs across 11 countries responded to the survey (8 ACE Is and 17 ACE IIs)
ACE
Center
Institution
ACE I – Bénin
SMA
Institut de Mathématiques et de Sciences Physiques
ACE I – Ghana
RWESCK
Kwame Nkrumah University of Science and Technology (KNUST)
WACCBIP
University of Ghana
ACE I – Nigeria
CERHI
University of Benin, Benin City
ACEPRD
University of Jos
ACEGID
Redeemer's University
PAMI
African University of Science and Technology
OAU-PARK
Obafemi Awolowo University

7. Graduate Tracer Studies: Pre-Survey Results (ACE II)
Center
Institution
ACE II – Ethiopia
CDT-Africa
Addis Ababa University
ACE II – Kenya
CESAAM
Egerton University
ACEII-PTRE
Moi University
ACE II – Malawi
CEPHEM
University of Malawi
Aquafish
Lilongwe University of Agriculture and Natural Resources
ACE II – Mozambique
CS-OGET
Universidade Eduardo Mondlane
ACE II – Rwanda
ACEIoT
University of Rwanda
ACEESD
ACEITLMS
University of Rwanda- College of Education
ACE II – Tanzania
IRPM & BTD
Sokoine University of Agriculture
WISE - Futures
Nelson Mandela African Inst. of Sci. & Tech. (NM-AIST)
CREATES
SACIDS
ACE II – Uganda
PHARMTRAC
Mbarara University of Science and Technology
ACALISE
Uganda Martyrs University
MARCCI
Makerere University
ACE II – Zambia
ACE for Sust.. Mining
Copperbelt University

8. Graduate Tracer Studies: Pre-Survey Results
How many cohorts have already graduated from your ACE? ACE I (3 centers graduated 1 cohort; 5 centers graduated 2 cohorts); ACE II (3 centers graduated 2 cohorts; 2 centers graduated 4 cohorts; 1 center graduated 5 cohorts)

9. Graduate Tracer Studies: Pre-Survey Results
Number of graduates in each cohort
ACE I
ACE II

10. Graduate Tracer Studies: Pre-Survey Results
If you have graduated at least one cohort, please estimate the number of graduates for each cohort who are 1) master’s 2) PhDs 3) undergraduates (if applicable). 885 graduates across all ACEs (50% master’s; 6% PhDs; 44% undergrads)

11. Graduate Tracer Studies: Pre-Survey Results
For each cohort, please indicate the number of graduates for whom you have the contact information ( and/or phone number)? 81% or 358 out of 443 master’s graduates, and 89% or 51 out of 57 PhD graduates and 100% for the undergrads

12. Graduate Tracer Studies: Pre-Survey Results
What kind of information do you wish to obtain from a tracer study?
Info. Desired from Tracer Study
Frequency
1. Employment status/employability 15
2. Skill competency/requirement/gap 11
3. Suggestions for/satisfaction with teaching & learning improvement 10
4. Salary/performance/promotion information 6
5. Type of employment 4
6. Additional academic training
7. Social/economic contributions
8. Current location 3
Info. Desired from Tracer Study
Frequency
Job satisfaction 2
Employer satisfaction/suggestions for improvement
Contact/demographic information
Length of job search 1
Current position at employer
Interest in continuing education at center
Interest in donating
Publications
Entrepreneurship

13. Graduate Tracer Studies: Pre-Survey Results
What are the method(s) of survey delivery that in your opinion will have the greatest response rates from your graduates? 17 out of 25 believe s;
What are examples of incentives you would recommend to be given to graduates who take the survey, in order to obtain the greatest response rates? (i.e. what rewards would be most attractive)?
The Examples of Incentives
Frequency
Fellowship/scholarship/conference funding 10
Free lectures/workshops/resources for alumni 8
Survey results 4
Mobile/internet top up 2
Alumni gatherings/networking
No incentive 1
University appreciation letter
Mentor current students
Raffle/prize
Academic transcript

14. Graduate Tracer Studies: Proposal
Based on these results, we determined:
Data can be collected at ACE (pilot); Scale up possible at institutional level
25 ACEs are interested; 11 have 0 graduates
Master’s degree level of graduates (2016 & 2017) to be targeted for pilot
Survey will focus on employment, skills, and evaluation of teaching & learning
Best mode of survey delivery: s (primary); Calls (secondary)
Most attractive incentives for graduates to participate: scholarships, center resources
Other ACES can still join, the pilot particularly those who have graduated 1 or more cohorts and have their contact details

15. Graduate Tracer Studies: Timeline
Develop the standard methodology (variable indicator system) of the graduate tracer study for both master’s and doctoral graduates. – June 2018
Consultations on methodology with ACEs and other Higher education stakeholders- July 2018
Survey questions translated and transferred onto online platform – Aug 2018
Survey period for master’s graduates only (pilot with only ACEs) –Sep – Nov 2018
Dissemination of results and regional workshops – Dec 2018/ 2019 (tbc)

16. Benchmarking

17. Benchmarking: Objectives
Facilitate benchmarking, graduate tracer studies, student surveys and other relevant exercises under the initiative that are relevant for the SSA higher education sector and based on global best practices;
Support the SSA higher education sector by providing capacity building opportunities for higher education institutions and government agencies/ministries in quality data management, including its collection, analysis, interpretation and its strategic use; and
Invest in key partnerships that would add value through financial, technical and/or other in- kind support to the Hub’s activities, ensuring it remains relevant and sustainable.
Ministerial meeting, once a year at the rep level. Unless told otherwise, the PSC member from the ACE 1 will continue
Clear separation of discussions/decisions.

18. Benchmarking: Update
Secured some funding to support Benchmarking host institution and technical assistance
Expressions of interest for host institution applications
Technical Assistance firm “Shanghai Ranking” have been contracted (as of last week)
Soliciting list of interested universities and national agencies. So far:
Universities: Botswana (1), Cameroon (6), DRC (6), Ethiopia (9), Gabon (?),Ghana (5), Kenya (3), Niger (?), Nigeria (?), Lesotho (1), Malawi(5), Mauritania (1), Rwanda (1), Senegal (?), Tanzania (49), Uganda (3), Zambia (2)

19. Benchmarking: Terms of Reference
Expected outcomes
Eligibility
Existence of a comprehensive and functional Management Information System (MIS) for the university
Evidence of trained staff that understand how to collect, analyze and use data to inform the university’s policy makers
Improvements in quality and relevance of the university’s programs evidenced by interventions that improve at least 2 indicators each year
Improvement in relevance of programs at the university as evidenced by positive outcome of graduate tracer studies in subsequent years of participation
A private, public, research or teaching university based in sub-Saharan Africa
Head of University willing to sign a commitment letter for the participation of the university
Commitment to submit required data
Willingness and commitment of the university to make practical and relevant changes informed by the results from the benchmarking and graduate tracer studies exercise
Agree that the results will be made public

20. Benchmarking: Timeline
Update of institutional benchmarking methodology and development of a data verification scheme - May 2018
Institutional Benchmarking data collection – June – August 2018
Development of national higher education system benchmarking methodology - July 2018
Consultations on national higher education system benchmarking methodology with other Higher Education stakeholders- Aug 2018
National system level data collection – Aug - Sept 2018
Data cleaning and verification – Sep – Oct 2018
Overall and individual reports ready and disseminated - Dec 2018/early 2019
Regional and national level workshops

21. Questions, Comments, Feedback? ebentil@worldbank.org