GEAR project Process Evaluation

Overview of GEAR Evaluation Components Outcomes Multi-component internal evaluation External evaluator: Prof. Carol Hagemann-White, University of Osnabrück, DE External Evaluation Internal Evaluation EFFECTIVENESS EVALUATION Teachers’ Seminar pre- and post- training questionnaires  test the teachers’ training effectiveness post- training questionnaires  assess seminar’s procedures and identify potential facilitators/barriers for future implementation pre- post- and follow-up questionnaires (intervention & control group)  test the effectiveness of GEAR Workshops in classes pre- post- and follow-up questionnaires (teachers implementing workshops)  test the impact of GEAR Workshops in classes post- training questionnaires (students & teachers)  assess workshops’ procedures and identify potential facilitators/barriers for future implementation PROCESS EVALUATION EVALUATION OF MASTER GEAR PACKAGE TEACHER’S MANUAL & STUDENTS’ HANDOUTS EVALUATION

Outline Overview Aim & Objectives Method Schedule of Process Monitoring Reporting Monitoring Tools

Overview Monitoring data collection: Baseline data: activities to be implemented at specific times, available budget per activity Data Source documents: agreed work plan and contractual budget Performance targets: implementation of all planned activities, on time, within the provisioned budget Tool for data collection: process monitoring checklists Frequency of data collection: every 3 or 6 months respectively Involved parties: External Evaluator, Coordinator & Partners Data flow Data synthesis & reporting Coordinator will undertake synthesis of data provided by all partners, as follows: Monitoring of activities: every 3 months Monitoring of expenditures: every 6 months Monitoring of dissemination activities: every 6 months Final reporting: External Evaluator Template 1 Template … Template 8 Coordinator to Partners 1 st Process Evaluation Form … Process Evaluation Form 8 th Process Evaluation Form Partners to Coordinator 1 st Process Evaluation Report … Process Evaluation Report 8 th Process Evaluation Report Coordinator to External Evaluator Final Report based on the 8 Process Reports Coordinator All PartnersCoordinator External Evaluator

AIM & Objectives Aim Monitoring & tracking of the implementation progress  Timely identification of potential deviations/ problems  Decision making & undertaking corrective actions  Smooth implementation Secondary Objectives Systematic, consistent and reliable information on project progress Facilitation of the project’s reporting

Method Method Measure actual results against expected results Continuous comparison among actual performance AND work plan  scheduled activities execution time table  timely execution of the activities budget  implementation according provisions expected quality  quality of final deliverables

Schedule of Process Monitoring Reporting Duration Throughout the project 8 Process evaluation reports Every 3-month period NoSent templateProgress reportContent of Progress report 1 st Implementation progress + Financial report 2 nd Implementation progress + Dissemination report 3 rd Implementation progress + Financial report 4 th Implementation progress + Dissemination report 5 th Implementation progress + Financial report 6 th Implementation progress + Dissemination report 7 th Implementation progress + Financial report 8 th Implementation progress + Dissemination report Feb 10May 10Aug 10Nov 10Feb 11May 11Aug 11Nov 11 G E A R A G A I N S T I P V - I M P L E M E N T A T I O N Dec 09 Grant Agreement Dec 11 Final Report Oct 10 Final Report

Monitoring Tools 8 Process Monitoring Checklists Structure: 3 distinct sessions / checklist: “GENERAL EVALUATION” its items will be unchanged throughout the project “DETAILED EVALUATION: EXPECTED RESULTS PER INDIVIDUAL ACTIVITY BY YOUR ORGANIZATION“ its items will be modified according to the work plan “DETAILED EVALUATION: EXPECTED RESULTS PER INDIVIDUAL ACTIVITY BY THE COORDINATOR“ its items will be modified according to the work plan