Collaborative Design for Smart Pupils STEM – IMPACT EVALUATION Erasmus + Collaborative Design for Smart Pupils STEM – IMPACT EVALUATION

Index Introduction Quantitative analysis Impact measuring Qualitative analysis Collaborative Design for smart pupils evaluation model

Index Introduction Quantitative analysis Impact measuring Qualitative analysis Collaborative Design for smart pupils evaluation model

Project’s indicators monitoring 1. Introduction Impact evaluation Identify the impact of the Collaborative design for smart pupils by a comparative model between different data sets from: Pupils involved vs pupils non-involved Pupils involved within the two schools Pupils evolution during different stages of the project To apply predictive model in an impact evaluation kit that allows objectify the achievement of the objectives of an initiative/action in order to promote STEM vocations Develop a qualitative model to assess the impact among the different stakeholders Implement a model based on a large and representative sample of students and analyse the results, obtaining a detailed study of the impact on the interest in studying STEM. Project’s indicators monitoring Identify and monitor the different key indicators to assess the evolution of the project: number of pupils involved, number of teachers involved, number of families involved, number of activities, number of used methodologies, number of documents… Develop qualitative analysis of the project’s evolution

Index Introduction Quantitative analysis Impact measuring Qualitative analysis Collaborative Design for smart pupils evaluation model

2. Quantitative analysis Decision elements: conceptual groupings

2. Quantitative analysis For a good and correct model, and to obtain valid conclusions on the impact of outreach activities implemented in the project, two groups among the total students in the sample were established On the one hand, a group of students participated in various educational activities, constituting the experimental group or participant group, while the other students did not participate in any of these actions, constituting the control group . Additionally, for not somehow influence the perception of students in both groups, the technique blind study was applied, so that none of the students in the sample knew the experiment or the relationship between activities and questionnaires conducted during the project.

Index Introduction Quantitative analysis Impact measuring Qualitative analysis Collaborative Design for smart pupils evaluation model

3. Impact measuring To measure the impact of outreach activities included in this project , it has conducted a study of the propensity of students to choose a STEM studies. To do this, the information obtained through the surveys to compare the propensity among different groups of students will take advantage . Measuring impact is presented as a comparison between the degree of interest in the study of STEM between the treatment group and control group at study end

Index Introduction Quantitative analysis Impact measuring Qualitative analysis Collaborative Design for smart pupils evaluation model

4. Qualitative Analysis Recent studies show that it is not only important quantity of STEM activities in the education world but also the quality of these. Following the Delphi method will make a qualitative analysis based on: Focus group with experts - Several interviews with the different stakeholders: - Teachers - Parents - Students - Industry - Qualitative analyses of the different key findings

Index Introduction Quantitative analysis Impact measuring Qualitative analysis Collaborative Design for smart pupils evaluation model

5. Collaborative Design for smart pupils evaluation model Oct’ 2015 Jan’ 2016 15 June 2016 15 Sept’ 2016 15 Oct’ 2016 Jan’ 2017 May/Juny 2017 Sept’ 2017 Expert Panels (BCN/Toulouse) First Quantitative and Qualitative analysis Last Quantitative and Qualitative analysis First Quantitative analysis Stakeholders interviews (first Qualitative analysis) Stakeholders interviews (last Qualitative analysis) Official report

Thank you!