2. Assessing Students Online League for Innovation 2005 Dallas, TX October 24, 8:00 AM – 9:00 AM Manchester, Tower Mezzanine

3. 2 Who Are We? Montgomery County Community College, Blue Bell, PA  Patricia Rahmlow Assistant Professor, Computer Science prahmlow@mc3.edu prahmlow@mc3.edu  Marie Hartlein Associate Professor, Computer Science mhartlein@mc3.edu mhartlein@mc3.edu  Linda Moulton Professor Mathematics and Computer Science lmoulton@mc3.edu lmoulton@mc3.edu http://faculty.mc3.edu/prahmlow/Presentations/index.html

4. 3 Who Are You?  Disciplines  Online, hybrid, face-to-face professor  Blackboard, WebCT, other  Use publisher packages  Use online quizzes

5. 4 Why Assess Students Online?  Space and time independent

6. 5 Why Assess Students Online?  Immediate feedback

7. 6 Why Assess Students Online?  Learning aide

8. 7 Uses of Online Assessment  Evaluation of student learning  Pre-test  Post-test

9. 8 Uses of Online Assessment  Evaluation of student learning  Assessment of knowledge  Exams  Make-up tests

10. 9 Uses of Online Assessment  Evaluation of student learning  Assessment of knowledge  Self-evaluation  Repetitive testing  Feedback

11. 10 Uses of Online Assessment  Evaluation of student learning  Assessment of knowledge  Self-evaluation  Distance learning assessment  Keeps students as “distance” learners  More convenient for student

12. 11 Online Assessment Tools  Course delivery software  Blackboard  WebCT  Publisher course delivery sites

13. 12 Online Assessment Tools  Course delivery software  Simulated software application testing  SAM  Train IT  SimNet  SNAP

14. 13 Online Assessment Tools  Course delivery software  Simulated software application testing  Free / low-cost quiz sites http://getonline.wichita.edu/transitions/asses s.asp#assessmenttools

15. 14 Online Assessment Tools  Course delivery software  Simulated software application testing  Free / low-cost quiz sites  Textbook web sites  Computer Science Concepts http://csilluminated.jbpub.com/  Information Literacy Concepts http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,1799886-,00.html  Active Help Desk http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/chapter0 3/index.html  Accounting Textbook http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html

16. 15 Online Assessment Modes  Time constraints  None  Timed – warning mode  Timed – shut down mode

17. 16 Online Assessment Modes  Time constraints  Number of attempts  One  Multiple  Unlimited  Student specific

18. 17 Online Assessment Modes  Time constraints  Number of attempts  Restricted access  Site password  Assessment password **********

19. 18 Online Assessment Modes  Time constraints  Number of attempts  Restricted access  Survey  Anonymous  Course evaluation ?

20. 19 Knowledge Based Questions  True/False  Multiple Choice  Matching  Multiple Answer  Ordering  Fill in the Blank  Essay  Calculated Numeric  Calculated Formula  File Response  Hot Spot  Fill in Multiple Blanks  Jumbled Sentence  Opinion Scale/Likert  Short Answer  Either/Or  Quiz Bowl

21. 20 Performance Based Questions  Open / close files  Search internet  Send email  Format documents  Develop formulas  Query a database

22. 21 Assessment Integrity  Timed  Allow use of textbook  Insufficient time to look up all answers

23. 22 Assessment Integrity  Timed  Question pool  Large pool of questions  No two quizzes identical

24. 23 Assessment Integrity  Timed  Question pool  Randomize questions  Facilitates face-to-face use  Less likely to memorize answers

25. 24 Assessment Integrity  Timed  Question pool  Randomize questions  Frequent assessments  Less likely someone else will take assessment

26. 25 Assessment Integrity  Timed  Question pool  Randomize questions  Frequent assessments  Don’t reveal answers  Send answers after exam time ends  Send only correct / incorrect indicator  Time release results

27. 26 Assessment Integrity  Timed  Question pool  Randomize questions  Frequent assessments  Don’t reveal correct answers  Proctored

28. 27 Assessment Integrity  Timed  Question pool  Randomize questions  Frequent assessments  Don’t reveal correct answers  Proctored  Other forms of assessment  “Portfolio” of student ability  Discussions  Homework / Projects

29. 28 Technical Issues  ISP Disconnect  “Passive” assessments  Keep under 30 minutes  Reset quizzes  Question pools  “Active” assessments  Count first recorded response  Pop-up Blockers  Special Software

30. 29 Tool Selection  Cost  Ease of use  Student  Access  Software  Professor  Set-up  Grading (SCORM)  Purpose  Graded assessment  Self-assessment

31. 30 Demonstrations  SAM  http://sam2003.course.com http://sam2003.course.com  Blackboard  https://my.mc3.edu/ https://my.mc3.edu/  Textbook web sites  Computer Science Concepts http://csilluminated.jbpub.com/  Information Literacy Concepts http://wps.prenhall.com/bp_evans_techinaction_2/0,10009,17998 86-,00.html  Active Help Desk http://media.pearsoncmg.com/ph/bp/bp_evans_tiahelpdeskcd_2/c hapter03/index.html  Accounting Textbook http://wps.prenhall.com/bp_slater_collacctg_9/0,8786,1172076-,00.html