The Assessment of Teaching with Technology Dan Talley Dakota State University June 4, 2004

Perspective on the Issue “The study produced two pieces of bad news: 1) The experimental group, using computer conferencing, showed no progress in their ability to compose an essay. 2) The control group, taught by traditional methods, showed no progress either.” – Paraphrased from a talk on an early use of computer conferencing in English composition courses.

Recommended Approach 2-step process to Assess Teaching with Technology (Ehrmann, 1995): Study which teaching and learning strategies are best (especially those that would not even be feasible without the newer technologies). Study which technologies best support those strategies.

Adapting Your Course to Include Assessment Instructional Design of the Course to Integrate Technology Use and Incorporate Assessment Tools Assessment of Student Use of Technology Assessment of Student Performance from Technology Use

Types of Course Assessment Classroom Assessment Used to provide information for the instructor about student progress while the course is ongoing. (Angelo & Cross, 1993) Outcomes Assessment Used to provide information about student progress after the course is finished. May be shared with external reviewers.

Writing TwT Assessment Goals and Objectives Goal: Wireless Mobile Computing Technology will be Integrated into my course to Promote Student Learning. Objectives The objectives will vary from course to course, by faculty member. Common objectives can be identified.

Possible Objectives Encourage Contact between Students and Faculty Promote Collaborative Student Learning Promote Active Learning Techniques Provide Prompt Feedback Increase Student Time on Task Communicate High Expectations Respect Diverse Talents and Ways of Learning Encourage Creativity

Assessment of the Objectives Your Task: Identify, Modify, or Develop Assessment Tools to Assess the Objectives Track Usage of Technology Tools (Laptop/Tablet PC, WebCT, etc.) Track Performance (Scores/Grades) Student Feedback Instructor (Self-)Feedback

Assessment Tools Student Attitude Survey / Interview Faculty Self-Report Learning Strategies and Tech Use Tracking Student Self-Report Tech Use Tracking - Log or Journal Computer-based Student Tech Use Tracking (WebCT?) Pre-Test / Post-Test Experimental Design Classroom Research (Control Section / Treatment Section) SOS, Tek.Xam, etc.

Subjects to Assess General Teaching and Learning Teaching, Learning and Technology Technology Use Student Satisfaction Course Satisfaction Satisfaction with Training Self-Reported Learning Outcomes Student Academic and Demographic Info

Assessment Using Wireless Mobile Computing Online Surveys and Tests Online Assessment Question Bank (WebCT-based?) Online Assessment Questionnaire Template Online Classroom Assessment Tools Resources Developed over the Summer

Written Analysis and Summary Close the Feedback Loop Qualitative Analysis of Results Quantitative Analysis of Results Simple Correlations between different measures More advanced techniques Summarize Your Findings and Suggest Ideas to Improve Future Results

Future Faculty Development A Team from DSU was chosen to attend The Collaboration 2004 Summer Institute. Design New Faculty Development Program for Laptop/Tablet Integration into Teaching and Learning Seven Faculty, Four Days Look for Faculty Orientation and Fall Semester Sessions