1. Online Assessments: Sharing Resources (and Workload) Online Assessments Sharing Resources (and Workload) Charles Hannon Instructional Technologist, Gettysburg College Reiko Itoh Assistant Professor Japanese Studies, Gettysburg College

2. Online Assessments: Sharing Resources (and Workload) Objections & Responses Objection: multiple-choice quizzes are inadequate assessment tools Impersonal Unimaginative Response: true, but they are valuable learning tools Repeatable, allow feedback, available when students are, etc.

3. Online Assessments: Sharing Resources (and Workload) Three Uses Of Online Quizzes At Gettysburg Ungraded Languages—Spanish, German, Japanese Sciences-- old tests for study material Ungraded, then graded IDS course on Reconstruction

4. Online Assessments: Sharing Resources (and Workload) Three Uses Of Online Quizzes At Gettysburg Graded, in place of paper exams Physics “Just in time” assessment »Wireless CEs and other handhelds Biology “Pre-lab” assessments

5. Online Assessments: Sharing Resources (and Workload) Particular Example—online Quizzes In Japanese Instruction IT workshop Technical issues with Japanese—IE, IME, etc. Comprehension test using video clips (part of an exam)

6. Online Assessments: Sharing Resources (and Workload) Online Quizzes In Japanese Overview of midterm project Benefits of online language quizzes Midterm practice quizzes Job titles Honorifics Particles Verb tenses and conjugation

7. Online Assessments: Sharing Resources (and Workload) Midterm Data: Survey Results Prior to using practice quizzes (12 responses): 67% had taken online quizzes before 91% expected them to be “helpful” or “extremely helpful” 67% said that if all their professors put practice tests online, they would use them most or all of the time; 33% said “occasionally”

8. Online Assessments: Sharing Resources (and Workload) Midterm Data: Survey Results After the midterm (10 responses): 90% said they returned to the online quizzes to practice 90% said they believed that doing so improved their results on the exam 80% said that if all their professors put practice tests online, they would use them most or al of the time; 20% said “occasionally”

9. Online Assessments: Sharing Resources (and Workload) Survey Conclusions Students are already “online” and believe in the usefulness of online learning tools Using the quizzes was a positive experience

10. Online Assessments: Sharing Resources (and Workload) Midterm Data: Usage Statistics Two-week period following in-class session 600 hits not counting instructor (153 in previous 2-week period) Most occur day before and day Of exam

11. Online Assessments: Sharing Resources (and Workload) Midterm Data: Usage Statistics When did students use online practice quizzes? HourHits % 0273.90 % 820.28 % 940.57 % 107911.4 % 1113719.7 % 12436.21 % 13162.31 % 1410.14 % 1510.14 % 16142.02 % 17101.44 % 188011.5 % 19415.92 % 20466.64 % 21355.05 % 22101.44 % 2314621.0 % Total692100 %

12. Online Assessments: Sharing Resources (and Workload) Midterm Data: Effect on student learning Weak students who did not use the practice exams did poorly (as usual) Weak students who did use the practice exams performed much better than usual Above-average students also improved; top students did well (as usual)

13. Online Assessments: Sharing Resources (and Workload) Lessons Learned Students need hands-on (hand-holding) guidance –Earlier is better –Shape learning habits as new technology is introduced Needs to be a close connection between practice tests and the real thing Students will use these tools more than you think and at all hours

14. Online Assessments: Sharing Resources (and Workload) Shared Resources Site Overview of current contents http://cnav.www.gettysburg.edu:82/courses/ SHAREDhttp://cnav.www.gettysburg.edu:82/courses/ SHARED –Username: faculty –Password: guest Contact: channon@gettysburg.edu

15. Online Assessments: Sharing Resources (and Workload) Online Assessments Sharing Resources (and Workload) What everybody echoes or in silence passes by as true to-day may turn out to be falsehood to-morrow, mere smoke of opinion, which some had trusted for a cloud that would sprinkle fertilizing rain on their fields. Henry David Thoreau, Walden.