1. Survey Feedback in Online Courses: How do we get it? How do we use it?

2. Sean Burns, Learning Analyst, Research & Analytics, CSU Online
Kimberley Corwin, Learning Analyst, Research & Analytics, CSU Online
Matt Titchener, Lead Web Developer, CSU Online
Matt Creighton Web Developer, CSU Online

3. Research & Analytics
A working group of learning analysts, web/LTI developers, and database managers currently housed at CSU Online.
Director, Dave Johnson
Learning Analysts, Sean Burns, Kimberley Corwin, & Brittany Taylor
Database Team, Steve Juarez, Jordan Schroeder, & David Newton
Web Team, Matt Titchener, Matt Creighton, & Gavin Miller
Instructional Designers, Lydia Page, Sirui Wang, LiShan Tao, Desiree Pina
Purpose: To help faculty and administrators access and understand learning data

4. What are we doing now?
Working with instructional designers and faculty in newly developed online classes
We needed a way to quickly and easily obtain student feedback on these courses, so we developed a survey tool
What are we NOT talking about?
Course evaluation
Teaching effectiveness overall, or teaching evaluation
Institutional Review Board (IRB)-protected research

5. Problem: How do we measure?
Solutions
Gather different types of data (survey feedback, performance data, longitudinal, quantitative and qualitative)
Need formative first (then summative)
Organize and deliver student feedback in reports

6. Survey Tool Question Bank Customizable Surveys Multiple Choice
Ranking
Free Response
Matching
Customizable Surveys
Select groups of questions
Set start and end dates
Add to courses of interest

7. Giving the Survey Survey link within weekly modules
Mid-survey 40% through class
Post-survey 80% through class
Students click directly on the link and go straight to the survey
Takes an average of 3 minutes to complete
Student responses, course identifiers, and timestamps collected

8. Giving the Survey

9. Reporting

10. Reporting

11. Reporting
Automated R Markdown Report Generated

12. Reporting

13. Reporting

14. Workshop: Developing Questions
Evaluation Plan:
What other questions do you want answered (not necessarily a survey question)?
What can students tell you that’s actionable?
Can you ask it in a survey? Do you need other data?
How can we improve the reports?
How can we improve response rates?

15. Discussion/Q&A
Other questions or comments?

16. More Surveys!
Remember to evaluate your sessions (feedback is important, after all!)
From the PDI s:
Participants will be able to log in to the TILT website, navigate to the PDI web page, click on "Manage Your Registrations," and for each session title there will be a button to "Evaluate Your Session."

17. Thank you! Sean Burns, Sean.Burns@colostate.edu
Kimberley Corwin,
Matt Titchener,
Matt Creighton,