1. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Evaluation‚ Review of remote experiments and curriculum improvement by EU partners‘ Andreja Rojko, University of Maribor 3. PQCC Meeting Belgrade, 14.5.2015

2. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution SCOPE One of the comments provided at first monitoring visit of National Erasmus+Office representatives held on 5/12/2014: Following the visit findings, we would like to make the following recommendation and kindly ask you to take them on board during the next implementation of the project: EU partners need to review all remote experiments and curriculum improvement at RS institutions initiated under NeReLa project; In this presentation contains some suggestion how necessary action can be executed and draft of one of the questionnaires.

3. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Task Review of all remote experiments and curriculum improvement at RS institutions 1. Review of remote experiments 2. Review of curriculum improvement Two separate activites, common final report

4. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Framework DEV 2: Building up NeReLa network of remote engineering laboratories DEV2.4 Developing of set of new remote engineering experiments at partner universities (May 2016) 1. Review of remote experiments

5. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Implementation After DEV2.4 Developing of set of new remote engineering experiments at the partner universities is available June 2016 All instructions on how the experiments can be accessed need to be provided to EU partners (maybe within DEV2.4 report). 1. Review of remote experiments

6. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Implementation List of remote experiments according to topics Reviews will be assigned according to specializations of EU partners Review will be organised in such way that we have at least 4 reviews for each experiment. Organization:UNIMB 1. Review of remote experiments

7. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Implementation SUMMARY Shortly describe the experiment, detected weaknesses and advantages from technical and educational point of view. Provide any other comments that may help at improvement of the experiment. 1. Review of remote experiments DRAFT EVALUATION FORM

8. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Implementation GENERAL (Depends on final solution) Booking system Yes/No Usefulness of booking system 0.. 5 (excellent) Integration with existing course management system 0.. 5 (excellent) Simplicity of sign-on system 0.. 5 (excellent) 1. Review of remote experiments DRAFT EVALUATION FORM

9. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Implementation INSTALLATION AND PLATFORMS Is additional software/application necessary? Yes/No Does additional software/application require installation (so that the user needs to have admin rights)? Yes/No Is installation easy and straightforward? 0.. 5 (excellent) Cross-platform attribute; on which platforms it can be executed? MS Windows, Linux, MAC OS X, FreeBSD Cross-platform attribute; access from mobile devices (smartphone, tablets). Android, IOS, MS Win 1. Review of remote experiments DRAFT EVALUATION FORM

10. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Implementation COMMUNNICATION Tutorial on usage of remote experiment is clear and concise. 0.. 5 (excellent) Intuitiveness of the user interface/software 0.. 5 (excellent) Response time after user action. 0.. 5 (excellent) Level of access to physical hardware 0.. 5 (excellent), not applicable Level of access to software 0.. 5 (excellent), not applicable Capture of experimental results 0.. 5 (excellent), Storage of experimental results 0.. 5 (excellent) 1. Review of remote experiments DRAFT EVALUATION FORM

11. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Implementation COMMUNNICATION Visual feedback yes/no Quality of visual feedback 0.. 5 (excellent) Audio feedback 0.. 5 (excellent) Quality of audio feedback 0.. 5 (excellent) Comprehensiveness of a provided visual/audio feedback 0.. 5 (excellent) Reliability of the experiment 0.. 5 (excellent) Conveys an expression of conducting a real experiment 0.. 5 (excellent) 1. Review of remote experiments DRAFT EVALUATION FORM

12. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Implementation EDUCATIONAL The educational goals of the experiment are clearly set. 0.. 5 (excellent) The educational goals are fulfilled. 0.. 5 (excellent) The experiment is accompanied by an adequate explanations 0.. 5 (excellent) Suitability of the experiment for a secondary level. 0.. 5 (excellent) Suitability of the experiment for a university level. 0.. 5 (excellent) Educational material for teacher 0.. 5 (excellent) Educational material for learner, secondary level 0.. 5 (excellent), not applicable Educational material for learner, university level 0.. 5 (excellent), not applicable 1. Review of remote experiments DRAFT EVALUATION FORM

13. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Framework DEV 4: Piloting of using the LiRex resources at at HE institutions and secondary vocational schools DEV 4.1 Integration of remote experiments into the curricula of networked partner universities (May 2016) DEV 4.4. Integration of remote experiments into the curricula of selected vocational schools (June 2016). 2. Review of curriculum improvement

14. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Implementation Based on DEV 4.1 and 4.4 each EU partner provides a short review, 1-2 pages based on template (Andreja). Template can be presented and discussed at the 4th PQCC. Deadline for the report of EU partners: 1 month after DEV 4.1 and DEV 4.4 are available. Joined review: 2 months after DEV4.1 and 4.4 2. Review of curriculum improvement

15. Building Network of Remote Labs for strengthening university-secondary vocational schools collaboration LOGO of partner institution Conclusion Draft evaluation questionnaire for ‘Review of remote experiments by EU partners’ will be further developed. Its results can be used also for QA of WP2 and in the evaluation form for the teachers. Review of curriculum improvement will be done based on template and DEV4.1 and DEV4.4. Next version of questionnaire can be discussed at 4 th PQCC meeting