1. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se Uppsala universitets Learning Lab Adaption and integration of the Evaluation System sakai tool into the Uppsala Student Portal Matthias Palmér matthias.palmer@learninglab.uu.se Project lead of development at Uppsala Student Portal Phd student in Technology Enhanced Learning, KTH Carl Nettelblad carl.nettelblad@it.uu.se ● Developer at Uppsala Student Portal ● Phd student in ???, Uppsala University

2. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se Outline of Talk Introduction to UUSP (Uppsala University Student Portal) Needs and Requirements (for a course evaluation system) Sakai tool EvalSys (Evaluation Systems) A mockup (html + javascript proof of concept user interface) Technical Integration Issues Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues

3. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se Introduction to UUSP Everything the student needs in one place (mail, profile info, personal file storage etc.) Most importantly a Learning Environment Aims to support all courses at the university Help department administrators help teachers Available tools today: –Messages –Forum –Resources –Progress –Groups Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues –Simple web page (sakai) –Enrollment –Links –Teacherlist –Register for exam

4. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se Adequate administration Teachers or administrators attach tools to: –Course instances (regular case) –Course instance parts (divide big courses) –Courses (enables continuity) –Departments (allows efficient communication) –Programmes (long term educational perspective) –Joint section (teach multiple courses/parts as one) Students only sees: –Aggregated course instance view (shows tools from course instance, course, institution and joint section) –Aggregated course instance part view (shows tools from course instance part and joint sections) –Programme view Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues

5. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se A quick view on UUSP Show max 2 screenshoots of UUSP Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues

6. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se A quick view on UUSP Show max 2 screenshoots of UUSP Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues

7. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se A quick view on UUSP Show max 2 screenshoots of UUSP Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues

8. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se Evaluation Stakeholder Needs Students –Anonymity –Results easily available for informed decisions Teachers –Subject specific questions –Feedback on own performance Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues Departments –Data for quality review –Course development University central administration –Reporting –Strategic planning Ok in most systems We will have to focus on these

9. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se Specific requirements Templates and questions –Shared within department –Available from faculty and university wide levels Statistics on common questions –Between courses –Over long time Push central questions into all evaluations Separate evaluation initiation (teacher) from interpretation of results (quality evaluator) Block inappropriate free text answers Course report based on results Questions should be available in two languages Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues

10. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se EvalSys features Evaluations initiated from templates Access is Private, Public or Expert Support for university wide template (Automatic customization to different department needs via hierachy marks on questions) Email reminders Result reports in various formats Anonymous access Simple URLs to send around Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues

11. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se EvalSys issues (UUSP perspective) Weak integration with Sakai sites Single university wide template will become gigantic and unmanagable (if every course needs a few specific questions) No department templates Reused questions are copies (can diverge => statistics across evaluations breaks) Multilingual questions Work with results –Block bad free text responses –Write course report Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues

12. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se Mockup Demo Mockup Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues

13. Uppsala universiets Learning Lab (ULL), www.ull.uu.sewww.ull.uu.se Technical Integration Issues Using Sakai as a pure tool provider Initiating evaluations from the API UUSP flexibility => site != course inst. (one site per added tool instead) Sites as owners of templates (corresponding to a department) Etc. Introduction to UUSP Needs & Requirements EvalSys Mockup Tech. Integ. Issues