1. TESTING AS TEACHING CO-MEDICAL ANATOMY: A PRACTICAL VIEW Kevin Patton Ph.D. St. Charles Community College St. Louis University Medical School www.lionden.com/ifaa_2004.htm

2. TESTING AS TEACHING

3. Completing a test or quiz can be a learning process in itself 1973. McKenzie 1973. McKenzie 1978. Denton and Crowley 1978. Denton and Crowley 1979. Elton and Laurillard 1979. Elton and Laurillard 1981. Fisher, Williams,and Roth 1981. Fisher, Williams,and Roth 1989. Rudman 1989. Rudman 1991. Dempster 1991. Dempster 1994. Frederiksen 1994. Frederiksen 2000. Connor-Greene 2000. Connor-Greene 2002. Haladyna, Downing, and Rodriquez 2002. Haladyna, Downing, and Rodriquez 2002. Kennedy 2002. Kennedy 2003. Halpern and Hakel 2003. Halpern and Hakel

4. Online, preprogrammed testing tools

5. Online testing a powerful form of testing & teaching Automatic Automatic Accessible Accessible Images, including animations Images, including animations Immediate feedback Immediate feedback Flexible Flexible Multiple repetitions Multiple repetitions

6. Case Study Anatomy & Physiology course Anatomy & Physiology course Students Students Undergraduate Undergraduate Nursing Nursing Occupational therapy Occupational therapy Other health-related professions Other health-related professions

7. Old way New way All paper tests All paper tests 6 written tests 6 written tests Limited illustrations, photographs, other images Limited illustrations, photographs, other images Both online & paper tests Both online & paper tests 9 online tests 2 online practice exams 2 written exams 9 online tests 2 online practice exams 2 written exams All types of images available All types of images available

8. Online tests Images edited in Photoshop Images edited in Photoshop Image/photo editing program Image/photo editing program Images saved as.jpg or.gif files Images saved as.jpg or.gif files Tests created in Respondus Tests created in Respondus Test creation software Test creation software Uploads tests to online testing platform Uploads tests to online testing platform Tests administered in WebCT Tests administered in WebCT Online testing platform Online testing platform WebCT also creates tests but interface is less friendly than Respondus WebCT also creates tests but interface is less friendly than Respondus

9. Online tests Images edited in Photoshop Images edited in Photoshop Image/photo editing program Image/photo editing program Images saved as.jpg files Images saved as.jpg files Tests created in Respondus Tests created in Respondus Test creation software Test creation software Uploads tests to online testing platform Uploads tests to online testing platform Tests administered in WebCT Tests administered in WebCT Online testing platform Online testing platform WebCT also creates tests but interface is less friendly WebCT also creates tests but interface is less friendly

10. Image source: Scan images from your textbook

11. Image sources: Image collections From your textbook/atlas publisher Purchased collection Online resources

12. Image sources: your own Photos you take yourself Medical images you acquire

13. Edit in Photoshop Save as.jpg file

14. Advanced editing From Gray’s Anatomy online version

15. Animations From http://www.merck.com

16. Online tests Images edited in Photoshop Images edited in Photoshop Image/photo editing program Image/photo editing program Images saved as.jpg files Images saved as.jpg files Tests created in Respondus Tests created in Respondus Test creation software Test creation software Uploads tests to online testing platform Uploads tests to online testing platform Tests administered in WebCT Tests administered in WebCT Online testing platform Online testing platform WebCT also creates tests but interface is less friendly WebCT also creates tests but interface is less friendly

17. Item title Saved image file Item Choices Randomize choices Correct answer & Point value x

18. Item preview

19. Item types

20. Multiple choice

21. Simple identification (short answer style)

22. Multiple Response

23. Ordering (matching style)

24. Case Study (multiple choice or short answer or paragraph style)

25. Settings

26. Organize items into “question sets”

28. Question sets in WebCT Randomized within set

29. Items must be answered one at a time Each test may be taken 3 times

30. Randomization Each item may have randomized choices Each item may have randomized choices Each question set may be randomized Each question set may be randomized Each attempt by each student is different Each attempt by each student is different Each attempt by each student is unpredictable Each attempt by each student is unpredictable Literally thousands of different combinations! Literally thousands of different combinations!

31. Publish test to WebCT platform

32. Online tests Images edited in Photoshop Images edited in Photoshop Image/photo editing program Image/photo editing program Images saved as.jpg files Images saved as.jpg files Tests created in Respondus Tests created in Respondus Test creation software Test creation software Uploads tests to online testing platform Uploads tests to online testing platform Tests administered in WebCT Tests administered in WebCT Online testing platform Online testing platform WebCT also creates tests... but interface is less friendly than Respondus WebCT also creates tests... but interface is less friendly than Respondus

33. Students may now take tests online

34. Students view results online Immediate feedback Immediate feedback Students may effectively prepare for their next attempt Students may effectively prepare for their next attempt

35. Automatic scoring may also be programmed to provide the correct answer or to provide additional feedback

36. Effectiveness What is the experience of the teacher? What is the experience of the teacher? I found that the online approach is effective I found that the online approach is effective Grades seemed to improve Grades seemed to improve

37. Grade improvement? Old way New way Course Average 70747984 Final Exam 46516767 Number of students 159197210209 Valid comparisons? Improvement in course average?

38. Grade improvement? Old way New way Course Average 70747984 Final Exam 46516767 Number of students 159197210209 Improvement in final exam scores?

39. Grade improvement? Old way New way Course Average 70747984 Final Exam 46516767 Number of students 159197210209 Improvement in student retention? (all groups began each semester at 225)

40. Effectiveness What is the experience of the teacher? What is the experience of the teacher? I found that the online approach is effective I found that the online approach is effective Grades seemed to improve Grades seemed to improve Less class time spent on testing Less class time spent on testing Less time grading tests Less time grading tests

41. Effectiveness What is the experience of students? What is the experience of students? Online survey of 171 students Online survey of 171 students Found that the online approach is effective Found that the online approach is effective

42. Do online tests make you better prepared for the exams? YesNo1701 99.4%0.6%

43. Do online tests help you learn the concepts of the course better? YesNo15516 90.6%9.4%

44. Do online tests help you prepare for practical exams in the lab? YesNo15318 89.5%10.5%

45. What resources do you use while taking an online test? ResourceYesNoTextbook1647 Outlines1701 Notes14228 Printout of previous attempt 15516

46. Do online tests have a high level of difficulty? YesNo10665 62.0%38.0%

47. Effective learning Students are challenged by online tests Students are challenged by online tests Students spend time exploring resources Students spend time exploring resources Textbook/atlas Textbook/atlas Course outlines Course outlines Class notes Class notes Previous test attempts Previous test attempts Students feel better prepared for exams Students feel better prepared for exams Students feel they’ve learned more overall Students feel they’ve learned more overall

48. Some practical points How do I apply to an existing course? How do I apply to an existing course? Add online quizzes or tests? Add online quizzes or tests? Replace some in-class tests? Replace some in-class tests? Do I have an online testing platform available? Do I have an online testing platform available? Your institution / consortium? Your institution / consortium? Your textbook publisher? Your textbook publisher? Do I need an add-on design program? Do I need an add-on design program?

49. More practical points What software do I need? What software do I need? Do I have an image editor? Do I have an image editor? Do I have a test design program? Do I have a test design program? What skills do I need? What skills do I need? Can I edit an image? Can I edit an image? Can I learn the testing software? Can I learn the testing software? Can I manage the online platform? Can I manage the online platform? What help is available to gain these skills and support them? What help is available to gain these skills and support them?

50. TESTING AS TEACHING CO-MEDICAL ANATOMY: A PRACTICAL VIEW Kevin Patton Ph.D. St. Charles Community College St. Louis University Medical School www.lionden.com/ifaa_2004.htm