1. SITE Conference – 3/2003 1 Successful Online Assessment, Evaluation, and Interaction Techniques Presented by: Dr. Barbara K.Mckenzie – Dept. of MIT, State University of West Georgia (bmckenzi@westga.edu) Dr. Barbara K.Mckenzie – Dept. of MIT, State University of West Georgia (bmckenzi@westga.edu)bmckenzi@westga.edu Dr. Nancy G.Mims – Dept. of Educational Leadership and Foundations, Western Carolina University (nmims@wcu.edu) Dr. Nancy G.Mims – Dept. of Educational Leadership and Foundations, Western Carolina University (nmims@wcu.edu)nmims@wcu.edu Dr. Elizabeth Bennett – Dept. of MIT, State University of West Georgia (ebennett@westga.edu ) Dr. Elizabeth Bennett – Dept. of MIT, State University of West Georgia (ebennett@westga.edu )ebennett@westga.edu

2. SITE Conference – 3/2003 2 Introduction Accountability increasingly important Accountability increasingly important DL classes must be held accountable for student learning DL classes must be held accountable for student learning 3 areas that impact success of any DL course 3 areas that impact success of any DL courseAssessmentEvaluationInteraction

3. SITE Conference – 3/2003 3 Focus To describe a variety of successful assessment, interaction and evaluation techniques used by distance instructors To describe a variety of successful assessment, interaction and evaluation techniques used by distance instructors Techniques - extracted from multiple sources Review of the literature Conversations with experts Collective experiences of the authors

4. SITE Conference – 3/2003 4 Assessment A way of determine learning gains (Simonson, 2003) A way of determine learning gains (Simonson, 2003) Identifies gaps between what is expected and what is taking place in classes Identifies gaps between what is expected and what is taking place in classes

5. SITE Conference – 3/2003 5 Assessment Techniques Students complete online learning styles questionnaires Students complete online learning styles questionnaires Creates greater awareness of students’ backgrounds and how they learn the best Example: http://tunis.commnet.edu/told/orientation/0ld_onli neLearning.html http://tunis.commnet.edu/told/orientation/0ld_onli neLearning.html http://tunis.commnet.edu/told/orientation/0ld_onli neLearning.html Design your own needs assessment instrument Design your own needs assessment instrument

6. SITE Conference – 3/2003 6 Assessment Techniques Create your own online technology needs assessment or use an online version with students the first week of class Have students apply class concepts to projects to projects and post them for review

7. SITE Conference – 3/2003 7 Assessment Techniques Create web quests for students to access online resources (e.g., Track Star -- http://trackstar.hprtec.org) Create web quests for students to access online resources (e.g., Track Star -- http://trackstar.hprtec.org) http://trackstar.hprtec.org Assign students to virtual learning groups to do projects that demonstrate their skills in utilizing course content Assign students to virtual learning groups to do projects that demonstrate their skills in utilizing course content Track students online to determine how frequently they are participating in the course Track students online to determine how frequently they are participating in the course

8. SITE Conference – 3/2003 8 Assessment Techniques Design and administer formative assessments during the course Design and administer formative assessments during the course to determine how students are doing suggestions for improvements Require reflective journals during the course Require reflective journals during the course to demonstrate students’ understanding and overall growth during the course

9. SITE Conference – 3/2003 9 Assessment Techniques Have students write one minute papers Have students write one minute papers describing what they have just learned Require students to post a certain number of times during the course Require students to post a certain number of times during the course Include participation as part of their grade

10. SITE Conference – 3/2003 10 Interaction Two way communication activities that take place in the course: Student to student Student to instructor Student to virtual learning group and other virtual learning groups Instructor to student Instructor to virtual learning group

11. SITE Conference – 3/2003 11 Interaction Techniques: Getting to Know Each Other Students design and display self introduction PowerPoint pres. Students share information about themselves and others introduce them to the class on the BB Students take a digital photo, type selected information, and post online (e.g., Name, e-mail address, where employed, goals of course, hobbies, something unique)

12. SITE Conference – 3/2003 12 Interaction Techniques: Group Projects Assign students to virtual learning groups and have them complete a required group project Assign students to virtual learning groups and have them complete a required group project Have virtual learning group complete a group selected project Have virtual learning group complete a group selected project

13. SITE Conference – 3/2003 13 Interaction Techniques: Synchronous Sessions Participate in online chats after being introduced to netiquette Participate in online chats after being introduced to netiquette Debate activities between virtual learning groups Debate activities between virtual learning groups

14. SITE Conference – 3/2003 14 Interaction Techniques: Group Discussions Have students post reactions to required readings and respond to others postings Have students post reactions to required readings and respond to others postings Interview an expert and post information online for class to review Interview an expert and post information online for class to review

15. SITE Conference – 3/2003 15 Interaction Techniques: Instructor Feedback Poll students online Poll students online Yes/No and Multiple Choice questions Speak to students online and have them respond by speaking Speak to students online and have them respond by speaking File sharing and feedback from the instructor File sharing and feedback from the instructor Have virtual office hours Have virtual office hours

16. SITE Conference – 3/2003 16 Interaction Techniques: Student Centered Cyber café Cyber café Provide anonymous BB for students to post comments Provide anonymous BB for students to post comments Online games (e.g., crossword puzzles) Online games (e.g., crossword puzzles)

17. SITE Conference – 3/2003 17 Interaction Techniques: Frequently Asked Questions Information on questions of concern to students Information on questions of concern to students Days & times for OL support Days & times for OL support How to attach documents How to attach documents Continue to enhance as needed Continue to enhance as needed

18. SITE Conference – 3/2003 18 Evaluation To answer questions focusing on the “value” of the class To answer questions focusing on the “value” of the class How effective was the class? Should class be continued or not? What changes are needed? Is the class worth the time and expense?

19. SITE Conference – 3/2003 19 Evaluation Techniques Develop an online summative evaluation survey that asks students to report on the value of Course content Technology used Overall satisfaction with the course

20. SITE Conference – 3/2003 20 Evaluation Techniques Interview students online or by phone at the end of the course for feedback Interview students online or by phone at the end of the course for feedback Interview students a semester or a year after the course to determine its impact Interview students a semester or a year after the course to determine its impact Use the institution’s summative evaluation survey Use the institution’s summative evaluation survey

21. SITE Conference – 3/2003 21 Evaluation Techniques Create your own summative evaluation survey Create your own summative evaluation survey Use course reflections Use course reflections Focus group discussions with students after course to evaluate effectiveness of the course Focus group discussions with students after course to evaluate effectiveness of the course Give an open book exam at end of course to evaluate students’ critical thinking skills Give an open book exam at end of course to evaluate students’ critical thinking skills

22. SITE Conference – 3/2003 22 Acknowledgement This presentation was made possible through funding by the PT3 Grant at the State University of West Georgia

23. SITE Conference – 3/2003 23 Successful Online Assessment, Evaluation, and Interaction Techniques Presented by: Dr. Barbara K.Mckenzie – Dept. of MIT, State University of West Georgia (bmckenzi@westga.edu) Dr. Barbara K.Mckenzie – Dept. of MIT, State University of West Georgia (bmckenzi@westga.edu)bmckenzi@westga.edu Dr. Nancy G.Mims – Dept. of Educational Leadership and Foundations, Western Carolina University (nmims@wcu.edu) Dr. Nancy G.Mims – Dept. of Educational Leadership and Foundations, Western Carolina University (nmims@wcu.edu)nmims@wcu.edu Dr. Elizabeth Bennett – Dept. of MIT, State University of West Georgia (ebennett@westga.edu ) Dr. Elizabeth Bennett – Dept. of MIT, State University of West Georgia (ebennett@westga.edu )ebennett@westga.edu