Show me the data! Actionable insight from open courses

Analytics “actionable insights through problem definition and the application of statistical models and analysis against existing and/or simulated future data” Cooper, A – Cetis Analytics Series What-is-Analytics-Vol1-No-5

Overview Data

Overview Data Analytic

Overview Data Analytic Insight

Overview Data Analytic Insight Who? Institution Tutor Self … Educational Commercial

Overview Data Analytic Insight Who? Institution Tutor Self … Educational Commercial How? Social network Discourse Content Disposition Context … Administration

Overview Data Analytic Insight Who? Institution Tutor Self … Educational Commercial How? Social network Discourse Content Disposition Context … Administration What? Platform Service … Availability Access

Overview Data Analytic Insight Who? Institution Tutor Self … Educational Commercial How? Social network Discourse Content Disposition Context … Administration What? Platform Service … Availability Access

Misconception detection Daphne Koller

Optimal Video Length for Student Engagement Philip Guo

Deconstructing Disengagement Kizilcec, R. F., Piech, C., & Schneider, E. (2013) Deconstructing disengagement: analyzing learner subpopulations in massive open online courses

Data ©Abode of Chaos :44:58

Data Access

Data Shapes

Data Flows ©Patrick Goossens :11:05

YouTube Analytics

Google Analytics

Google Analytics Define events to track in GA

Google Analytics Define events to track in GA Develop custom segmentations with eye on actionable insight

Google Analytics Define events to track in GA Develop custom segmentations with eye on actionable insight Provide data using developed templated queries

Canvas API

Canvas API

Canvas API

Canvas API

Canvas API

Network effects The social network diagrams can be used to identify: isolated students group malfunction users that are information brokers Hansen, D. L., Shneiderman, B., & Smith, M. (2010). Visualizing threaded conversation networks: mining message boards and lists for actionable insights.

ocTEL (WordPress)

Analytically cloaked “Learning and knowledge creation is often distributed across multiple media and sites in networked environments. Traces of such activity may be fragmented across multiple logs and may not match analytic needs.” Suthers, D. D., & Rosen, D. (2011). A unified framework for multi-level analysis of distributed learning

Count % of Total Total Inputs250 # Matched % # No Match % # Bad Input00.00%

Count % of Total Total Inputs250 # Matched % # No Match % # Bad Input00.00% In sample 41% (n.103) s returned bio

Count % of Total Total Inputs250 # Matched % # No Match % # Bad Input00.00% In sample 41% (n.103) s returned bio API returns other social profiles

Detecting and Analyzing Subpopulations within Connectivist MOOCs Retrospective investigation into learner subpopulation detection within the connectivist courses. Using free and open source tools we will attempt to resolve activity data from multiple sources to permit the analysis of any engagement patterns.

Summary Data Analytic Insight Who? Institution Tutor Self … Educational Commercial How? Social network Discourse Content Disposition Context … Administration What? Platform Service … Availability Access

Thank you! Questions? Martin Hawksey