1. WP6: Delivery and evaluation of learning environment and training programme Dublin, June 201324/05/13

2. WP6 Objectives To adapt the platform, tools and learning programmes to the scenarios in the school pilot sites and the teacher networks To carry out an evaluation of their utilisation, results and outcomes To feedback the evaluation results into further development of the final project outputs Dublin, June 201324/05/13

3. WP6 Activities WA6.1: installing and adapting the tools and learning programme in each site. Access via a dedicated web platform hosted Arcola (CEPCEP; EA; UNIV; TCD; MENON; CONTOUR) WA6.2: designing the evaluation approach and the methods, tools and instruments for data collection (Arcola). WA6.3: evaluation of the tools and programme in each pilot site WA 6.4: Evaluation data analysis and reporting (Arcola) Dublin, June 201324/05/13

4. The Pilot Sites Schools – UK – Charlton Park Academy, London (CONTOUR) – BE - ? (MENON) – PT - ? (CEPCEP) – EL - ? (EA) – IE - ? (TCD) Networks – Lithuanian teacher network (UNIV) – EU school heads (ESHA) Dublin, June 201324/05/13

5. Example: Charlton Park Academy ‘Special Needs’ school, south east London 3 Learning modules – Module 1: developing emotional intelligence. – Module 2: developing effective governance – Module 3: developing evaluation skills Primary users – school governors – Governors remotely accessing the platform, social media tools and three learning modules ‘on demand’ (i.e. as and when they have the time) over the duration of work package 6 (i.e. between November 2013 and July 2014) – Governors participating in three ‘Action Learning Sets’ over this period. These are review workshops in which users of the IGUANA system critically review their experiences of using the system. They last about 2 hours each. – Governors participating in the evaluation of the pilot. This will entail completing a survey questionnaire providing their views on whether and how IGUANA works. Secondary users – small group of teachers – ‘champions’ Dublin, June 201324/05/13

6. Over-arching Evaluation approach 24/05/13Dublin, June 2013 Internal Project (WP7) Pilot Impacts Overall Evaluation of IGUANA

7. Theory of Change 24/05/13Dublin, June 2013 IGUANA concept Theory of Change Logic Model Evaluation Report The Conceptual Framework How the concept is converted into an intervention logic How the intervention logic is implemented What value and impacts are associated with the intervention logic and conceptual framework “Specification of an explicit theory of how and why a programme or intervention might cause or have caused an effect”

8. Logic Model 24/05/13Dublin, June 2013

9. Assessing ‘distance travelled’ in a theory of change 24/05/13Dublin, June 2013 Context Input Output Outcomes Impact The frame- work within which an intervention is located What is invested, e.g. money, skills, people, activities What has been produced Short and medium term results Long- term outcomes Context indicators Resource / input indicators Output indicator s Outcome / result indicators Impact indicators ‘Distance travelled’ indicators

10. Triangulation 24/05/13Dublin, June 2013

11. The Internal Project Evaluation 24/05/13Dublin, June 2013 ToC and Logic Model Project Management Partners Survey Quality System Partner Evaluation Support

12. Quality System 24/05/13Dublin, June 2013 Specification of Quality expectation and assessment/acceptance criteria QUALITY CONTROL – Internal Review; External Review for Key Deliverables QUALITY REGISTER

13. Quality Control Checklist 24/05/13Dublin, June 2013 Quality Control CheckY/NReviewer recommendations/comments Generic Minimum Quality Standards Document Summary provided (with adequate synopsis of contents) IGUANA format standards complied with Language, grammar and spelling acceptable Objectives of Description of Work covered Work deliverable relates to adequately covered Quality of text is acceptable (organisation and structure; diagrams; readability) Comprehensiveness is acceptable (no missing sections; missing references; unexplained arguments) Usability is acceptable (deliverable provides clear information in a form that is useful to the reader) Deliverable specific quality criteria Deliverable meets the 'acceptance Criteria' set out in the Quality Register For Supplementary Review Deliverables only Deliverable approved by external reviewers Checklist completed by Name: Signature: Date:

14. Impacts Assessment Methodology 24/05/13Dublin, June 2013 MethodDescription 1User Surveys Survey 1: Pre-test/post-test survey of users participating in the pilot programme. Survey 2: Ex-post survey of participants Both surveys will be delivered through a self-administered questionnaire (on-line/e-mail) 2Interviews Interviews with a representative sample of users. The interviews will entail the use of a semi-structured questionnaire 3Focus Groups. One focus group involving 10-12 users who participated in the pilot programme should be implemented in each of the pilot locations. 4Observation Observation of the use of the IGUANA tools practice, focusing on their usability and effectiveness 5Case Studies Ethnographic ‘histories’ of the experiences of a small representative sample of users participating in the pilot programme. 6Secondary data analysisCollection and analysis of data derived from: participation rates in learning activities; utilisation of platform and tools; content analysis of on-line interactions