1. Learning and Teaching Development Service
Diversifying and expanding online exam provision
Dr Rebecca Gill
Learning Enhancement and Technology Adviser, Learning and Teaching Development Service
24/05/2019
Change pics here
Learning and Teaching Development Service

2. Technology Enhanced Learning Roadmap
Key Objective 5: Make online summative assessment possible for a wide range of assessment types and in non-cluster environments
Learning and Teaching Development Service

3. Learning and Teaching Development Service
The story so far …
OLAF
24/05/2019
Learning and Teaching Development Service

4. Learning and Teaching Development Service
The story so far …
OLAF
Service
online
assessment
and
feedback
24/05/2019
Learning and Teaching Development Service

5. Learning and Teaching Development Service
OLAF Service scale
Learning and Teaching Development Service

6. Constraints on OLAF Service expansion
Staff capacity
24/05/2019
Learning and Teaching Development Service

7. Constraints on OLAF Service expansion
Staff capacity
Space
24/05/2019
Learning and Teaching Development Service

8. Constraints on OLAF Service expansion
Staff capacity
Space
Technical limitations
24/05/2019
Learning and Teaching Development Service

9. Learning and Teaching Development Service
24/05/2019
Learning and Teaching Development Service

10. Technology Enhanced Learning Roadmap
Key Objective 5: Make online summative assessment possible for a wide range of assessment types and in non-cluster environments
Learning and Teaching Development Service

11. Diversifying and expanding online exam provision
2017/18
Pilot exams feasibility study
2018/19
Pilot phase 2
2019/20 – 2021/22
Further expansion of diversified online exam provision
24/05/2019
Learning and Teaching Development Service

12. 2017/18 pilot exams – feasibility study
Bring Your Own Device (BYOD)
Online written answer/essay
Formative exam: Stage 1 Biomedical Sciences
379 students on module, 251 sat the exam
Multiple choice questions (MCQs)
Option to use own laptops, alternatively used University PCs
Summative exams: Stage 1 Biology (101 students) and Stage 2 Psychology (38 students)
Essay, MCQ, fill in the blank and short answer questions
All students took first part on University PCs, option to take essay part on paper
24/05/2019
Learning and Teaching Development Service

13. Bring Your Own Device implementation
24/05/2019
Learning and Teaching Development Service

14. BYOD: student evaluation 2017/18
Learning and Teaching Development Service

15. BYOD: what did students think?
Felt the browser was easier to look at - eyes were not feeling strained or tired looking at it
Easier to use as I frequently use my own laptop
I found the software very user-friendly. The flagging a section and overview options were convenient.
Biomedical Sciences Stage 1 students, 2017/18
24/05/2019
Learning and Teaching Development Service

16. BYOD: what do staff think?
Transferring our ICEMI to UNIwise was a seamless process for SBMA academic and administrative staff and involved no more work than using the OLAF system. […] Only a small proportion of students elected to use their own devices for their exam […] but those who did found it useful, experienced no problems and would be happy to use their own devices again. Dr Alison Howard, Biomedical Sciences stage 1 module leader
24/05/2019
Learning and Teaching Development Service

17. BYOD: why didn’t students opt in?
Somewhat uncomfortable downloading unknown programs onto personal computer
a mouse is easier to use when completing the exam rather than a touchpad on a laptop
easier and more reliable to use university computer
screen is too small
because it’s heavy to carry about
I was worried my laptop would run out of battery/crash
Biomedical Sciences Stage 1 students, 2017/18
24/05/2019
Learning and Teaching Development Service

18. Next steps in supporting BYOD online exams
Take exam using own laptop as default
Students without a suitable laptop sit exam in a PC cluster
Student briefings and practice exams
Specialist support in exam venues
Power provision
Back up university-owned laptops
24/05/2019
Learning and Teaching Development Service

19. Online written exam implementation
24/05/2019
Image from ‘Get started guide for the participant’
Learning and Teaching Development Service

20. Online written exams: student evaluation 2017/18
24/05/2019
Learning and Teaching Development Service

21. Online written exams: what do students think?
I feel it helped me structure my answer more clearly and cohesively
Biology Stage 1 student, 2017/18
It was something I was nervous for, however I actually feel it really helped and I would definitely want to do my essay on the computer again.
Psychology Stage 2 student, 2017/18
Makes more sense to type as most things are typed now. It's faster and great to have spell check
Psychology Stage 2 student, 2017/18
24/05/2019
Learning and Teaching Development Service

22. Marking online written exams
24/05/2019
Image from ‘Get started guide for the participant’
Learning and Teaching Development Service

23. Online written exams: what do staff think?
I believe that the ease of reading each paper actually led to fairer marking. Students with poor handwriting or poor writing skills are often given the benefit of doubt and this bias disappeared. Annotations/corrections/comments are easy to make Dr Gabriele Jordan, Psychology stage 2 module leader
24/05/2019
Learning and Teaching Development Service

24. The next chapter: pilot phase 2 2018/19
Bring your own device exams – ‘opt out’ model
Further online written/essay exam pilots, combine with BYOD
Exams using new question types not available in Blackboard
‘Whitelisting’ web pages in locked down exams
24/05/2019
Learning and Teaching Development Service

25. Learning and Teaching Development Service
To be continued…
To discuss participating in the Diversifying and Expanding Online Exam Provision project contact
Tell us about your future online exam requirements by competing this form:
24/05/2019
Learning and Teaching Development Service