CONSIDER Neelam Soundarajan Swaroop Joshi Jeremy Morris Computer Sc. and Engineering Department Ohio State University

Motivation Fact: People learn best when they discuss their ideas rather than hear a presentation Fact: The most effective discussions are those among peers, not between students and instructors! Fact: The most effective discussions are among peers who disagree with each other (about the topic) CONSIDER

But … Classtime is limited so it is difficult to have serious, extended discussions in small groups in class; discussions outside class are difficult to organize … Some students may dominate face-to-face discussions; other students, possibly ones with good ideas, may remain silent … The discussions are ephemeral with no long- term record of how they evolved … CONSIDER

CONSIDER ... a web app in which Conflicting Student Ideas are Discussed, Evaluated, and Resolved (or Refuted!) Phase 1: Individual students answer a question on the app Phase 2: The instructor/app assigns students to anonymous groups of 4-5 students each, ensuring that each group is made up of students with conflicting ideas Anonymity: Students in each group will be named S1, S2, S3, S4, … CONSIDER

Phase 3: Heart of CONSIDER … Phase 3: Students in each group, via anonymous posts, discuss their positions, trying to persuade the others in the group of the correctness of their own positions and pointing out relations between their own position and that of others Phase 3 is organized as a series of rounds Each round lasts 24 hours CONSIDER

Phase 3 Rounds During each round, each student can only see the posts from the previous (and earlier) rounds … posts from the current round, even if they have already been made, will not be visible until the round ends In each round, each student is required to make one post in which he/she responds to the posts of each student from the previous round CONSIDER

Phase 3 Rounds (contd) In the response, the student must not only state his/her current position but also state whether he/he agrees with, disagrees with, or is neutral (or unsure) about each of the previous round's posts, and why The student may freely edit his/her post until the end of the round (since no one else will see it until that point) CONSIDER

Phase 3 Rounds (contd.) Does the student have to respond to his/her own post from the previous round? Yes! … That is the whole point of the discussion! … when the student realizes why his/her previous position was flawed and accepts the position presented by one (or more) of the other students or arrives at a position that is a combination of his/her previous position and the other students' positions, chances are deep learning is taking place … CONSIDER

Phase 4: Summary Round In the final round, each student makes a final submission consisting of: His/her final answer to the original problem A summary of the discussion in the group and how it helped him/her arrive at the final answer The student's grade depends only on the correctness of the final answer & the quality of the discussion summary No penalty for changing your answer! … indeed, that is the whole point of the activity: developing deep understanding by discussing your idea with others who have different conceptions CONSIDER

Other After the final round, students will/should have access to all of the posts in the group including from the final (summary) round CONSIDER tutorial: http://go.osu.edu/consider-tutorial More details: http://web.cse.ohio-state.edu/~neelam/courses/onlineCollabLearning.html Send me your Google id so you can be added as an authorized user for the CONSIDER app CONSIDER

Timeline for CONSIDER First activity assigned (on the CONSIDER app): Tuesday, 10/25, by 6:00 pm Individual submissions due: Wednesday, 10/26, by 11:59 pm First round discussion starts: Thursday, 10/27, at 11:00 am First round discussion ends: Fri, 10/28, 11:00am 2nd round discussion ends: Sat.,10/29. 12:00 noon Final submission due: Mon., 10/31, 12:00 noon CONSIDER

Other (contd) But does it really work? That is, do students who use CONSIDER really develop deeper understanding? We are studying this question; and want to use data from our course. So you will get a "consent form" on your Carmen/Canvas account to allow us to use data from your classwork in this research Important: The data will be completely anonymized before we use it in that research CONSIDER