1. Digital and Digging It:
The Case of Virtual Microscopy (VM)
and Computer-Based Exams (CBE)
at BUSM
CEIT Workshop March 26, 2012
Debbie Vaughan and Jana Brady
Boston University School of Medicine

2. PRESENTATION Virtual Microscopy (VM) Our journey to VM
Demo: virtual microscopy
Pedagogical enhancements made possible by VM
Summary of Why VM? Pedagogical Advantages, Disadvantages,
Student opinions
ExamSoft® Computer-based Exams (CBE)
Our journey to CBE
What can it do? and How do we do it?
(with sample screenshots; Demo available)
Summary of Why CBE? Pedagogical Advantages, Disadvantages,
Student opinions/ourcomes

3. BUSM histology laboratory in the early 20th century
Traditional order:
lecture
laboratory

4. Our Histology laboratory in the late 20th century
Improved order:
laboratory
lecture

5. Virtual Microscopy (VM)
Summer 2006
Begin investigation of Bacus™ VM system
Fall 2007
Preparation (servers, contract, $$, selection, syllabus,…)
Bacus™ VM begins
-teaching modified
-sessions held in library computer classrooms
Fall 2007
Fall 2008
History of
Virtual Microscopy (VM)
at BUSM
Fall 2009
Pilot VM with laptops
BUSM students required to have laptops
-L2 classrooms remodeled and designed for laptop use
-students use laptops for Bacus™ VM
Fall 2010
Preparation for NDP VM (feasibility, negotiations, contracts,…)
Fall 2011
Replaced Bacus™ VM system with NDP VM system
Fall 2012

6. After less than five years with the Bacus™ VM system,
we had to replace it. vm
Demonstration:

7. Digitized Images: can be viewed at 9 levels of magnification
can be dragged along the x- and y- axes, and sometimes ‘focused’ along the z-axis

8. Fall 2007: VM permits desirable pedagogical enhancements
Current teaching
sequence:
:Laboratory
(self-study)
Discussion Session
(interactive)
Lecture
BUSM computer lab: Students can easily work together.

9. Other Instructional Technologies:
SmartSync permits the synchronization of computers.
Turning Point® ARS quiz assures the
self-study is completed before Discussion.
SmartBoard Interactive Whiteboard
encourages student presentation and participation.

10. pilot VM with laptops in model computer classroom
Spring 2010:
pilot VM with laptops in model computer classroom
Interactive small group Discussion Sessions are encouraged in medical school.

11. all BUSM students required to have laptop computer
Fall 2010:
all BUSM students required to have laptop computer
Histology Discussion Sessions: L2 classrooms designed for laptop use

12. L2 classrooms can be opened for exams
Practical Exams: students view annotated slides (questions) in NDP
and enter answers in Blackboard 8

13. Virtual Microscopy
Why?
Inadequate glass slide collection
Increasing expense of materials distribution and upkeep
Limited availability of microscopes and slide sets
Pedagogical advantages:
Improved histological material
Students continue to develop ability to analyze and interpret material
Learning curve for interpreting material faster without microscope
Ability to divide laboratory exercises into self-study followed by interactive discussion sessions
Disadvantages:
Histological material is identical for all students
Students do not use microscopes
Student feedback:
Value study anywhere and anytime where internet available (incl. iPad)
Efficient and effective system for group study
Can capture images and label for review, consultation, and study

14. PRESENTATION Virtual Microscopy (VM) Our journey to VM
Demo: virtual microscopy
Pedagogical enhancements made possible by VM
Summary of Why VM? Pedagogical Advantages, Disadvantages,
Student opinions
ExamSoft® Computer-based Exams (CBE)
Our journey to CBE
What can it do? and How do we do it?
(with sample screenshots; Demo available)
Summary of Why CBE? Pedagogical Advantages, Disadvantages,
Student opinions/ourcomes

15. History of CBE at BUSM Discover ExamSoft® at AAMC annual meeting
Fall 2009
Discover ExamSoft® at AAMC annual meeting
Preparation (due diligence; explore vendors; contracts; $$...)
on-going preparation with MED administration and faculty
BUSM students required to have laptops
Fall 2010
Pilot ExamSoft® with GMS Histology students
Fall 2011
Use ExamSoft® in four BUSM I courses
Fall 2012
Most BUSM I and II courses will use ExamSoft® CBE

16. ExamSoft® Computer based Exams:
Exams may be secure or not secure
Variety of questions—MCQ,T/F, essay, Fill-in-blanks—are possible
Questions, and MCQ choices, can be completely or partially randomized
High quality images and video can be included and can be manipulated
Time limit is set for each exam; elapsed time and time warnings can be set
Navigation panel shows which questions answered and unanswered
Examtakers can cross out choices

17. About
Home Page: register students; monitor students and exams; options
SofTest: the exam (exam taker’s view)
exam takers download software that is automatically updated
exam takers download encrypted exam
with password, computer enters secure mode with access only to exam
at completion of exam, answers are automatically uploaded with internet connection
SofTeach-Web: exam construction
database of questions to use in the exam; variety of question types
questions tagged by customizable categories: e.g., topic, cognitive level, author, USMLE category, clinical type, etc.
construct exam
set security levels, details of release, and other controls
communication with exam takers
SofScore Web: scoring exam
statistics: by exam taker, by category, by exam, by question
grading
customize released results; can to students

18. About
Home Page: register students; monitor students and exams; options
SofTest: the exam (exam taker’s view)
exam takers download software that is automatically updated
exam takers download encrypted exam
with password, computer enters secure mode with access only to exam
at completion of exam, answers are automatically uploaded with internet connection
SofTeach-Web: exam construction
database of questions to use in the exam; variety of question types
questions tagged by customizable categories: e.g., topic, cognitive level, author, USMLE category, clinical type, etc.
construct exam
set security levels, details of release, and other controls
communication with exam takers
SofScore Web: scoring exam
statistics: by exam taker, by category, by exam, by question
grading
customize released results; can to students

19. MCQ with high resolution image that can be moved or resized
Exam screen:
MCQ with high resolution image that can be moved or resized
and navigation panel.

20. MCQ illustrating cross-out function, and “alarm” panel for timing
Exam screen:
MCQ illustrating cross-out function, and “alarm” panel for timing

21. About
Home Page: register students; monitor students and exams; options
SofTest: the exam (exam taker’s view)
exam takers download software that is automatically updated
exam takers download encrypted exam
with password, computer enters secure mode with access only to exam
at completion of exam, answers are automatically uploaded with internet connection
SofTeach-Web: exam construction
database of questions to use in the exam; variety of question types
questions tagged by customizable categories: e.g., topic, cognitive level, author, USMLE category, clinical type, etc.
construct exam
set security levels, details of release, and other controls
communication with exam takers
SofScore Web: scoring exam
statistics: by exam taker, by category, by exam, by question
grading
customize released results; can to students

22. Database of entered questions:
Questions categorized by topic folder, item description, categories, creator,
type, and if previously used, by biserial score, date used, and difficulty.

23. Two unused questions are selected…
Create
an exam
Open folder
Two unused questions are selected…
…and added to the exam being created.

24. About
Home Page: register students; monitor students and exams; options
SofTest: the exam (exam taker’s view)
exam takers download software that is automatically updated
exam takers download encrypted exam
with password, computer enters secure mode with access only to exam
at completion of exam, answers are automatically uploaded with internet connection
SofTeach-Web: exam construction
database of questions to use in the exam; variety of question types
questions tagged by customizable categories: e.g., topic, cognitive level, author, USMLE category, clinical type, etc.
construct exam
set security levels, details of release, and other controls
communication with exam takers
SofScore Web: scoring exam
statistics: by exam taker, by category, by exam, by question
grading
customize released results; can to students

25. Sofscore: item analysis statistics
question #1

26. Exam Takers’ results can be customized for reports, and release
Sofscore:
Exam Takers’ results can be customized for reports, and release

27. ExamSoft Computer-Based Exams
Why?
All professional exams (e.g., USMLE exams) are computer-based
Sustainability: reduce paper use
Cost basis is per student, not per exam
Pedagogical advantages:
Ability to track student performance by categories, such as topic, cognitive level, type of question
Ability to track question stats and design exam by various categories you set yourself
No apparent negative effect on grades
Disadvantages:
Initial software glitches
Space for giving exams to class of 180 students
Student feedback:
Most students see value of CBE
Students appreciate ability to track performance by categories
Generally students prefer ExamSoft to paper exams

28. BUSM Students: fall/winter feedback
( ) %
“ExamSoft was easy to use”
“I prefer ExamSoft to
paper and pencil exams” %

29. Thank you for your attention!
Deborah W. Vaughan, PhD
Department of Anatomy and Neurobiology, BUSM
&
Jana Brady, MS
Education Technologist, BUSM
NDP: busmnz.bumc.bu.edu
ExamSoft:

31. Topics: presented step-wise in the course syllabus