Survey Feedback in Online Courses: How do we get it? How do we use it?

Sean Burns, Learning Analyst, Research & Analytics, CSU Online Kimberley Corwin, Learning Analyst, Research & Analytics, CSU Online Matt Titchener, Lead Web Developer, CSU Online Matt Creighton Web Developer, CSU Online

Research & Analytics A working group of learning analysts, web/LTI developers, and database managers currently housed at CSU Online. Director, Dave Johnson Learning Analysts, Sean Burns, Kimberley Corwin, & Brittany Taylor Database Team, Steve Juarez, Jordan Schroeder, & David Newton Web Team, Matt Titchener, Matt Creighton, & Gavin Miller Instructional Designers, Lydia Page, Sirui Wang, LiShan Tao, Desiree Pina Purpose: To help faculty and administrators access and understand learning data

What are we doing now? Working with instructional designers and faculty in newly developed online classes We needed a way to quickly and easily obtain student feedback on these courses, so we developed a survey tool What are we NOT talking about? Course evaluation Teaching effectiveness overall, or teaching evaluation Institutional Review Board (IRB)-protected research

Problem: How do we measure? Solutions Gather different types of data (survey feedback, performance data, longitudinal, quantitative and qualitative) Need formative first (then summative) Organize and deliver student feedback in reports

Survey Tool Question Bank Customizable Surveys Multiple Choice Ranking Free Response Matching Customizable Surveys Select groups of questions Set start and end dates Add to courses of interest

Giving the Survey Survey link within weekly modules Mid-survey 40% through class Post-survey 80% through class Students click directly on the link and go straight to the survey Takes an average of 3 minutes to complete Student responses, course identifiers, and timestamps collected

Giving the Survey

Reporting

Reporting

Reporting Automated R Markdown Report Generated

Reporting

Reporting

Workshop: Developing Questions Evaluation Plan: What other questions do you want answered (not necessarily a survey question)? What can students tell you that’s actionable? Can you ask it in a survey? Do you need other data? How can we improve the reports? How can we improve response rates?

Discussion/Q&A Other questions or comments?

More Surveys! Remember to evaluate your sessions (feedback is important, after all!) From the PDI Emails: Participants will be able to log in to the TILT website, navigate to the PDI web page, click on "Manage Your Registrations," and for each session title there will be a button to "Evaluate Your Session."

Thank you! Sean Burns, Sean.Burns@colostate.edu Kimberley Corwin, Kimberley.Corwin@colostate.edu Matt Titchener, Matt.Titchener@colostate.edu Matt Creighton, Matthew.Creighton@colostate.edu