1. OpenLabyrinth: a platform for medical education research & evaluation David Topps Jean Rawling Heather Armson Medbiq 2015 http://openlabyrinth.ca

2. Notices & Disclaimers Declaration of Interest – I advocate the use of OpenLabyrinth – I am the OpenLabyrinth Dev Consortium lead – Open source project – I (sadly) do not make money from this Copyright disclaimer – Most images are Creative Commons – Remainder used under Section 29 (Fair Dealing) Copyright Act of Canada (2012) – Do not assume you can reuse these images

3. Education research tool Annotated bibliography – 130+ items http://tiny.cc/OLab3bib – broad application

4. Downsides of long cases Complex branching VP cases – Powerful narratives – Learning by discovery & reflection Not time efficient – Only 2-3 key points of learning or evaluation in 20-30 minute case

5. Speed limit

6. Speed up!

7. Assessment Not fact retention Clinical reasoning – Script Concordance Testing – Situational Judgement Testing Moving beyond Best-of-Five answers

8. Why not SurveyMonkey? Not just questionnaires Data stored on local servers – Keeps ethics happy Control over – Access – Reports Any similarity to existing faculty members is completely coincidental

9. Flexible exam emulator SAMP Learning Environment (SAMPle) – Short answer management problems – CFPC Key Feature Questions – MCC-QE

10. Time pressure Lots of studies on critical tasks What about routine chores? – Rushing Roulette cases – Series of lab tests – In-Tray exercise

11. Adaptive testing Conditional logic – from branching cases Layered triplets – vs isolated questions and stems

12. Path analysis

13. Play nice with others Linking to other tools – OAuth

14. Play nice with others Linking to other tools – IMS-LTI

15. Play nice with others Linking to other tools – xAPI – Medbiq interest group http://medbiq.org/mailman/listinfo/xapi_medbiq.org – Easier… but harder – LRS analytic tools – Funder hesitance

16. Automatic item generation Game changer xAPI pull, not just push qBanq – Also pull, not push – Nobody wants to push!

17. Who wants to play? New multi-part funding xAPI item sharing info@openlabyrinth.ca