1. Research Problem Based on currently available literature, it is unclear whether the use of student-owned, web-enabled devices as student response systems introduces non-class related distractions and thereby negates some of the benefits of clickers on student engagement in large lecture settings.

2. Research Question Does the use of web-enabled student response systems on personally owned devices impact student engagement in class activities compared to paper-based submissions of student work?

3. Research Methods Experimental design:Counterbalanced, split-class design for 3 class activities over 1 semester. Treatments: A. paper submission no devices out B. paper submission devices allowed C. electronic submission on devices no devices devices devices Hypothesis: paper paper electronic 1. Device overrides: high low low 2. Use overrides: high low higher How will I collect these data?1.Video-taping: video tape samples of students at a time to increases likelihood of capturing behavior. 2.Observers: use of randomized, pre-determined grid of students being scored at set times for set period of time. 3.Observe before, during, and after activity. 4.Scored with: Engagement scored or recorded in class using Behavioral Engagement Related to Instruction (BERI) protocol My strategy to analyze these data will be: 1.Repeated measures ANOVA

4. Alignment of Research Question and Methods Research Question: Does the use of web-enabled student response systems on personally owned devices impact student engagement in class activities compared to paper-based submissions of student work? Three treatments allow separation of effect of electronic device from effect of web- enabled student reporting systems. Two methods to triangulate engagement: 1. Assessing engagement by video taping student and scoring each student later 2. Assessing engagement by in class observation 3.Both are scored using Behavioral Engagement Related to Instruction (BERI) protocol: