1. Collaborative Design for Smart Pupils STEM – IMPACT EVALUATION
Erasmus +
Collaborative Design for Smart Pupils
STEM – IMPACT EVALUATION

2. Index Introduction Quantitative analysis Impact measuring
Qualitative analysis
Collaborative Design for smart pupils evaluation model

3. Index Introduction Quantitative analysis Impact measuring
Qualitative analysis
Collaborative Design for smart pupils evaluation model

4. Project’s indicators monitoring
1. Introduction
Impact evaluation
Identify the impact of the Collaborative design for smart pupils by a comparative model between different data sets from:
Pupils involved vs pupils non-involved
Pupils involved within the two schools
Pupils evolution during different stages of the project
To apply predictive model in an impact evaluation kit that allows objectify the achievement of the objectives of an initiative/action in order to promote STEM vocations
Develop a qualitative model to assess the impact among the different stakeholders
Implement a model based on a large and representative sample of students and analyse the results, obtaining a detailed study of the impact on the interest in studying STEM.
Project’s indicators monitoring
Identify and monitor the different key indicators to assess the evolution of the project: number of pupils involved, number of teachers involved, number of families involved, number of activities, number of used methodologies, number of documents…
Develop qualitative analysis of the project’s evolution

5. Index Introduction Quantitative analysis Impact measuring
Qualitative analysis
Collaborative Design for smart pupils evaluation model

6. 2. Quantitative analysis
Decision elements: conceptual groupings

7. 2. Quantitative analysis
For a good and correct model, and to obtain valid conclusions on the impact of outreach activities implemented in the project, two groups among the total students in the sample were established
On the one hand, a group of students participated in various educational activities, constituting the experimental group or participant group, while the other students did not participate in any of these actions, constituting the control group .
Additionally, for not somehow influence the perception of students in both groups, the technique blind study was applied, so that none of the students in the sample knew the experiment or the relationship between activities and questionnaires conducted during the project.

8. Index Introduction Quantitative analysis Impact measuring
Qualitative analysis
Collaborative Design for smart pupils evaluation model

9. 3. Impact measuring
To measure the impact of outreach activities included in this project , it has conducted a study of the propensity of students to choose a STEM studies. To do this, the information obtained through the surveys to compare the propensity among different groups of students will take advantage .
Measuring impact is presented as a comparison between the degree of interest in the study of STEM between the treatment group and control group at study end

10. Index Introduction Quantitative analysis Impact measuring
Qualitative analysis
Collaborative Design for smart pupils evaluation model

11. 4. Qualitative Analysis
Recent studies show that it is not only important quantity of STEM activities in the education world but also the quality of these.
Following the Delphi method will make a qualitative analysis based on:
Focus group with experts
- Several interviews with the different stakeholders:
- Teachers
- Parents
- Students
- Industry
- Qualitative analyses of the different key findings

12. Index Introduction Quantitative analysis Impact measuring
Qualitative analysis
Collaborative Design for smart pupils evaluation model

13. 5. Collaborative Design for smart pupils evaluation model
Oct’ 2015
Jan’ 2016
15 June 2016
15 Sept’ 2016
15 Oct’ 2016
Jan’ 2017
May/Juny 2017
Sept’ 2017
Expert Panels (BCN/Toulouse)
First Quantitative and Qualitative analysis
Last Quantitative and Qualitative analysis
First Quantitative analysis
Stakeholders interviews (first Qualitative analysis)
Stakeholders interviews (last Qualitative analysis)
Official report

14. Thank you!