Technical and Advisory Meeting Lusaka, Zambia Training on Monitoring & Evaluation and reporting of Results Framework IUCEA and World Bank May 5, 2019

AGENDA Objective of M&E Key Elements of M&E Overview of M&E for the project Results Framework Indicators Roles and Responsibilities of M&E Officers Beneficiary Survey Q&A

Objective of M&E Monitoring and evaluation aims to assist timely decision making, ensure accountability, and provide the basis for evaluation and learning It is a management tool to track your progress

2. Key Elements of M&E Understanding of the definition of indicators and data collection methodology Availability of data to be collected Timing of data collection Accuracy of data Timely reporting Roles and Responsibilities of data collection, analysis, and reporting Feedback provision and learning Decision making and continuous improvement

3. Overview of M&E for the project Results Framework DLIs 5 year implementation plan Annual work plan aims to achieve DLIs and annual target for the Results Framework Annual Work Plan

4. Results Framework Indicators Note: Indicators in PINK are the same as DLIs. Data will be collected via independent verifier 4. Results Framework Indicators PDO (to strengthen selected Eastern and Southern African higher education institutions to deliver quality post-graduate education and build collaborative research capacity in the regional priority areas) Indicators 1. Regional students enrolled in ACEs: (i) Masters (No. of Female) (ii) PhD (No. of female) This indicator measures the number of African students (excluding those from the ACE hosting country) who are enrolled in (i) Masters who have successfully completed at least one semester and (ii) PhDs at the ACEs. -> Number of regional students enrollment 2. Students (national and regional) enrolled in ACEs: (i) Masters (No. of female) (ii) PhD (No. of female) This indicator measures the total number of students (national and regional) enrolled in (i) Masters, who have successfully completed at least one semester and (ii) PhD programs at ACEs ->Number of total students enrollment (both regional and national)

4. Results Framework Indicators Note: Indicators in PINK are the same as DLIs. Data will be collected via independent verifier 4. Results Framework Indicators PDO (to strengthen selected Eastern and Southern African higher education institutions to deliver quality post-graduate education and build collaborative research capacity in the regional priority areas) Indicators 3. MOUs on partnerships for collaboration in applied research and training entered into by the ACEs This indicator measures the number of partnerships for collaboration in applied research and training as measured by signed MoUs and signed proposals that outline at least a two year partnership work program 4. Accredited education programs offered by the ACEs This indicator measures the quality of Masters and PhD programs and counts the number of programs accredited nationally, regionally and internationally by a body satisfactory to IUCEA and the World Bank. -> International accreditation is not constrained by a formal accreditation. It can be a form of joint degree program with foreign universities for example. 5. Direct Project Beneficiaries (of which female) This indicator measures the direct project beneficiaries (and proportion of female project beneficiaries). -> Include faculties, students and ACE center staff who are enrolled in ACE program, who teach ACE courses and who participate in exchanges as direct beneficiaries (users of facilities will not count)

4. Results Framework Indicators Note: Indicators in PINK are the same as DLIs. Data will be collected via independent verifier 4. Results Framework Indicators Component 1: Strengthening ACEs in Regional Priority Areas 1. Faculty and PhD students exchanges to promote research and teaching (No. of female) This indicator measures number of faculty and PhDs who are hosted by ACEs from other institutions or when ACEs sends their faculty/PhD students to other institutions; locally, in the region or internationally for a “period” of minimum two weeks (for teaching or research collaboration). 2. Amount of externally generated revenue by the ACEs This amount includes externally generated revenue deposited into the ACE’s account from tuition fees, other student fees, joint research, sale of consultancies, fund raising and donations, or other external sources: 3. Internationally recognized research publications in disciplines supported by the ACE Program and with regional coauthors This indicator records the number of internationally recognized research publications produced by the ACEs in total and with regional coauthors. 4. No. of institutions hosting ACEs participating in the PASET benchmarking exercise This indicator measures the number of ACE hosting universities that agree to participate in the PASET benchmarking exercises.

4. Results Framework Indicators Note: Indicators in PINK are the same as DLIs. Data will be collected via independent verifier 4. Results Framework Indicators Component 2: Capacity Building Support to ACEs through Regional Interventions -> this indicators is for IUCEA 1. Events that foster partnerships between ACE and private sector/industry This indicator measures the number of events organized by IUCEA or contracted firm to build partnerships with private sector/industry

4. Results Framework Indicators Note: Indicators in PINK are the same as DLIs. Data will be collected via independent verifier 4. Results Framework Indicators Component 3: Facilitation, Coordination and Administration of Project Implementation -> These indicators are for IUCEA 1. Knowledge sharing events with ACEs, partner institutions, academia and diaspora This indicator measures the number of knowledge sharing events organized by IUCEA. Where ACEs can share experience and research output 2. Reports by ACEs on Beneficiary Satisfaction ACE reports on beneficiary satisfaction on teaching 3. Timely verification of ACE achievement of DLIs Percentage of ACEs that have had their DLIs verified by the date specified in the POM 4. Biannual reporting on M&E of the ACEs The report will aggregate individual results from the results framework for each ACE.

5. Roles and Responsibilities of M&E Officers M&E Officers in ACEs Support Annual Work Plan development Collect data and report on the Results Framework indicators every 6 months to IUCEA M&E officer (until the independent verifier comes in) Create a trend analysis using the Results Framework indicators collected by IUCEA to monitor the progress Create a database of ACE students (for DLI and beneficiary survey) M&E Officer in IUCEA Provide advisory support and review Annual Work Plan Aggregate Results Framework indicators from all ACEs Analyze Results Framework indicators, provide feedback to ACEs, and identify areas of support required Share the results with the World Bank Develop an annual report

6. Beneficiary Survey Objective: The objective of the beneficiary survey is to collect information on students enrolled in ACEs to assess their satisfaction level in terms of quality of teaching and learning, faculties, facilities, and research. Survey target audience: The target of the survey would be students enrolled in ACEs for short courses, masters and PhD program. Frequency: Annual Data Collection Approach: It will be conducted when the DLI verification of student enrollment takes place. The survey will be sent online via email. Data Analysis and Dissemination: IUCEA M&E officer conducts a data analysis using a descriptive analysis methodology comparing the results among ACEs to identify the commonalities and disparities. IUCEA M&E officer also identifies the areas of improvement for ACEs and communicate the results to ACEs. ACEs are expected to take necessary actions to improve the satisfaction of beneficiary.

7. Q&A Contact IUCEA – Samson Ojesi Email: sojesi@iucea.org Skype: samson.ojesi Mobile: +256-7590-272776 Whatsapp: +267-762-32794