Implementing a mobile e-Portfolio system – Lessons learned a year on Luke Woodham, Fiona Howat, Jonathan Round, Terry Poulton, St. George’s, University of London

WPBAs at SGUL Year 1Year 2Year 3 Year 4Year 5 Basic Science Transition Pre-Clinical Practice Foundation MBBS5 Year 1 Transitional (T) Year MBBS5 Year 2 MBBS4 Year 1 Penultimate (P) Year Final (F) Year Workplace-based assessments (WPBAs) Key element in both learning (formative) and summative assessment of clinical competency

Complex, hard to read Difficult to analyse – No validation – “spoilt” assessments – Illegible Large number of forms to manage – Lost and damaged forms – Difficulties in storage Submission difficulties when off-site Difficult for students to monitor progress Paper WPBAs

E-Portfolio – Aims Key Aims – Students should “own” their own data - provide learners with real-time access to their progress – Improving feedback to students – Reduced administration load

e-Portfolio - ‘state of the art’ issues Mature web-based systems for desktop data entry, were available, but heavily criticised: Why? Student/clinician encounters don’t take place at a computer The responsibility for completing assessments lies with the student not the teacher Potential solution? - a mobile solution that does not require network access - wifi is not reliably available.

MyProgress Web-based – Hosted solution – Commercially developed by MyKnowledgeMap – All data stored centrally Allows data input from both the web and mobile devices – Cross-platform Works offline – Downloads new assessments for use offline – Uploads completed assessments back to system

Pilots Series of pilots – Medicine and Radiography – Iterative improvements based upon feedback – Expanding scope Multiple attachments and sites, increased participant numbers Feedback – Improved feedback from using tablets rather than phones – Increase in number of assessments completed – or at least submitted

Academic Year Year 3 Year 4Year 5 Transition Pre-Clinical Practice Transitional (T) Year Penultimate (P) Year Final (F) Year Following a series of pilots to establish feasibility, introduced Myprogress for completion of WPBAs – Gradual rollout in Medicine – Also used in Diagnostic Radiography, Co-curricular award, and next year in Therapeutic Radiography Electronic WPBAs Paper WPBAs Electronic WPBAsPaper WPBAs Electronic WPBAs

Technical Setup Students provided with 7” Android tablets Set up with institutional account for installing Myprogress Students able to use for other aspects of studies

An opportunity for WPBA is identified The student begins to enter assessment details onto their mobile device The device is passed to the assessor The assessor completes and locks the assessment and hands the device back to the student who then submits the assessment when they next have network access

Key Lesson - Students need to “own” their portfolio How can students be encouraged to feel they “own” their portfolio? – If students have responsibility, they need to have power to ensure all their WPBAs are complete

WPBA sent RESPONSIBILITY POWER Academic Registry Standard WPBAs Completed WPBA

If students have responsibility, they need to have power to ensure all their WPBAs are complete Unfortunately, in one aspect, we broke this rule.

Signoff returned RESPONSIBILITY POWER Clinical sign-off Signoff sent Face-to-Face Meeting Academic Registry

Current and Future challenges Engaging with clinical tutors – Communication and training Support – Technical challenges – How to effectively support multiple courses and sites Changing the culture – Ensuring students “own” their own portfolio – Increasing acceptance amongst clinical staff opportunities!

Thank you and Questions