1. Observation and Evaluation of the Use of Clickers in CU Physics Courses Kennda Lynch ASTR 5835 Teaching Seminar, Spring 2008

2. Study Objective Evaluate the differences in perceived teaching effectiveness in a clicker course and in a non- clicker course Evaluate the differences in perceived teaching effectiveness in a clicker course and in a non- clicker course Evaluate the differences in perceived effectiveness of clickers in two different clicker- based courses. Evaluate the differences in perceived effectiveness of clickers in two different clicker- based courses. Evaluate the difference in perceived effectiveness of clickers between students who had previous experience with clickers and students who have not Evaluate the difference in perceived effectiveness of clickers between students who had previous experience with clickers and students who have not

3. Study Set-up Course Observations Course Observations Observed 2 lectures each of two different introductory Physics courses Observed 2 lectures each of two different introductory Physics courses Instructor Questionnaire Instructor Questionnaire Interviewed instructors from both courses Interviewed instructors from both courses Reviewed course Websites & Syllabus Reviewed course Websites & Syllabus Surveyed Students Surveyed Students Surveyed 129 students in Course A (Instructor of course B declined survey) Surveyed 129 students in Course A (Instructor of course B declined survey)

4. Instructor Questionnaire Course A Instructor Course A Instructor 3 years teaching at CU 3 years teaching at CU 1 st time using clickers in a course 1 st time using clickers in a course Thinks clickers are great for large intro courses but does not know if they will use them upper level, smaller courses Thinks clickers are great for large intro courses but does not know if they will use them upper level, smaller courses Course B Instructor Course B Instructor 3 years teaching at CU 3 years teaching at CU Has used clickers before and will use clickers again Has used clickers before and will use clickers again Course B Co-Instructor Course B Co-Instructor 16 years of teaching at CU 16 years of teaching at CU Has used clickers before and will use clickers again Has used clickers before and will use clickers again

5. Student Survey 1. Is this your 1st clicker course? A. Yes B. No 2. Do you think the use of clickers is helping you to understand the material in this particular course? A. Yes B. No C. Other___________________________________________ 3. Do you think courses that use clickers are better than courses that do not? A. Yes B. No C. It depends on the course D. It depends on the instructor E. Both C & D 4. Would you take another course that uses clickers? A. Yes B. No C. Only if I have to (i.e. the course is required for my major)

6. Overall Results

7. Question 2: Do you think the use of clickers is helping you to understand the material in this particular course?

8. Question 3: Do you think courses that use clickers are better than courses that do not?

9. Question 4: Would you take another course that uses clickers?

10. Comments from Question 2 Sometimes Sometimes I don't know I don't know No, but it makes me come to class No, but it makes me come to class Sort of some questions help, a lot do not Sort of some questions help, a lot do not This is a terrible course to judge by… This is a terrible course to judge by… When material relevant to the lab or tutorials When material relevant to the lab or tutorials Clickers can only do so much… Clickers can only do so much… Only to answer questions on exams Only to answer questions on exams when they give hard problems or concepts it just confuses me when they give hard problems or concepts it just confuses me Depends on the nature of the question Depends on the nature of the question The time could be better spent explaining concepts The time could be better spent explaining concepts It gives me a chance to think about the material It gives me a chance to think about the material

11. Qualitative Observations Websites & Syllabus Websites & Syllabus Course and Clicker expectations well laid out in both classes Course and Clicker expectations well laid out in both classes Course B lists weekly Clicker questions Course B lists weekly Clicker questions In Class Observations of Instructor In Class Observations of Instructor Course A Course A Course B Course B Some Fun Student Observations Some Fun Student Observations

12. Conclusions Overall students think clickers help them learn. Overall students think clickers help them learn. Clickers effectiveness may depend on experience of instructor (dont have any supporting data) Clickers effectiveness may depend on experience of instructor (dont have any supporting data) Clickers may not be good for every class Clickers may not be good for every class