1. JEROEN DONKERS & MARIEKE VAN DER SCHAAF www.project-watchme.eu

2. EU-PROJECT WATCHME Workplace-based e-Assessment Technology for Competency-based Higher Multi- professional Education. 7th Framework, ICT Call 11 Objective ICT-2013.8.2 Technology-enhanced learning, b) Learning analytics, educational data mining March 2014 - April 2017 11 partners 3.4 M€ costs / 2.6 M€ EU-declarable

3. MOTIVATION & GOAL “Continuing education at the workplace has seen increasing demand as a crucial means of acquiring the requisite professional knowledge and skills. Electronic Portfolios (e-portfolios) for workplace training provide a global view of each trainee’s progress but offer no dynamic feedback to exploit the rich learning assessment data that could be analysed to support responsive adaptation for more efficient and rewarding training.” WATCHME effectively deploys Learning Analytics to deliver personalised learning; supporting learner empowerment, enhanced Quality-of-Experience, flexibility and mobility plus efficiency gains through workplace-based feedback and assessment.

4. APPROACH mobile, electronic portfolio-based system LA and student models tailored feedback visualisation dashboard empirically validated for its quality and contribution to trainees’ learning professional environments (human medicine, veterinary medicine and teacher training)

5. PARTNERS 1.Utrecht University, NL (www.uu.nl) GENERAL LEADwww.uu.nl 2.University Medical Centre Utrecht, NL (www.umcutrecht.nl)www.umcutrecht.nl 3.Szent Istvan University, Hungary (www.sziu.hu)www.sziu.hu 4.University of Tartu, Estonia (www.ut.ee)www.ut.ee 5.Universitätsmedizin Charité Berlin, Germany (www.charite.de)www.charite.de 6.University of California San Francisco, USA (www.ucsf.edu)www.ucsf.edu 7.Maastricht University, NL (www.maastrichtuniversity.nl) TECHNICAL LEADwww.maastrichtuniversity.nl 8.Mateum, NL (www.mateum.nl)www.mateum.nl 9.University of Reading, UK (www.reading.ac.uk)www.reading.ac.uk 10.Jayway, Denmark (www.jayway.com)www.jayway.com 11.NetRom, Rumania/NL (www.netrom.nl)www.netrom.nl User partners Producer partners

6. USER PARTNERS 1.Utrecht UniversityTeacher education Veterinary medicine 2.University Medical Centre UtrechtMedicine (Anesthesiology) 3.Szent Istvan UniversityVeterinary medicine 4.University of TartuTeacher education 5.Universitätsmedizin Charité BerlinMedicine (Nephrology/dialysis) 6.University of California, San FranciscoMedicine

7. PRODUCER PARTNERS 1.Maastricht University, EDUC, FHML Design, technical coordination, Integration 2.Mateum BV EPASS development and support 3.University of Reading, Intelligent System Research Laboratory Student modelling 4.Jayway Visualization and feedback 5.NetRom Software SRL software development (6. Charité: Educational game)

8. ARCHITECTURE

9. E-PORTFOLIO

10. STUDENT MODELLING Our context: Many students Online learning Changing environment Soft evidence (including narrative) Need for flexible and scalable student modelling

11. MULTI-ENTITY BELIEF NETWORKS - MEBN Probabilistic: deal with soft evidence and uncertainty Online learning possible Versatile: models adopt themselves to situation of the student Scalable: shared fragments of knowledge Semantically labelled

12. ?

13. Sensor data

14. VISUALIZATION OF AGGREGATED DATA Combine  Countable data (students, assessments, relations)  Information from knowledge fragments  Combine with individual student model

15. JUST IN TIME FEEDBACK Student model must indicate appropriateness of  Type of feedback  Content of feedback  Moment of feedback Probabilistic

16. FITTING ALL TOGETHER Interfaces between:  Assessment tools and portfolio  portfolio server and student model server  Student model server and visualisation  Student model server and feedback Integration of visualisation and feedback in portfolio

17. WORK PACKAGES WP1 Project management (Utrecht University) WP2 Competency-based workplace definition with EPAs, for feedback and assessment (UMCU) WP3 System architecture and assessment tools (Maastricht University) WP4 Developing student models (University of Reading) WP5 Feedback and visualization modules (JAYWAY) WP6 Implementation and evaluation overall system (University of Tartu) WP7 Dissemination and exploitation (Charité Berlin)

18. PLANNING