Shipwrecked on Data Island? eLCC 2012 Shipwrecked On Data Island? eLCC 2012
Castaways John Schmahl, Director of Student Services Liz Dzabic, Quality Assurance Coordinator Karen Kaemmerling, Social Science Associate Dean
Stormy Seas Potential controversies Get off Data Island to benefit students and instructors
Examples of Data Gathering Student enrollment Drop rates Student surveys Quality Assurance Reports D2L Data Analytics
Bring Data Together
QC Squared: Quality Control Cycle
POS 105 Design
Navigation Problems Students “lost” Not finding “Content Link” Not visiting all Syllabus pages Not visiting Homework page for unit assignments Mobile device use
Solutions in New Design Guide students through course Streamlined Syllabus- one page Streamlined Unit pages- one page Quick links in Schedule to content and tools
Analytics – Syllabus hits Syllabus ElementMulti-page designSingle-page design Course Info5.1 hits/person6.4 hits/person Instructor Info4.8 hits/person6.4 hits/person Course Materials6.7 hits/person6.4 hits/person Activities and Design6.5 hits/person6.4 hits/person Course Policies5.8 hits/person3.4 hits/person Schedule10.3 hits/person9.1 hits/person The single page design did not show an increased level of access compared to the component pages. Surprisingly, the course policies page was more likely to be accessed in the multi-page design, despite being “buried” in other links.
Analytics – Unit page hits Unit AssignmentsMulti-page designSingle-page design Introductory unit2.95 hits/item/person 23.6 hits/person 4.9 hits/person Unit 14.0 hits/item/person 32.2 hits/person 8.0 hits/person Unit 24.5 hits/item/person 36 hits/person 5.58 hits/person The single page design showed an increased # of hits per item across both sections than the multi-page design. But the multi-page design showed more total hits, as expected.
Timing of content access Classes approximately the same size. Daily hits to the content tool nearly unaffected by design.
Content Hits Per Day for 10 Week Courses Old format New format
Content Hits Per Day for 15 Week Courses Old format New format
Drop Rates and Retention New formatDrop%Old FormatDrop% Spring 1 Spring 2 Summer 24% 28% 26% Spring 1 Spring 2 Summer 32% 31% 19% Avg.26%Avg.28% New formatPass%Old FormatPass% Spring 1 Spring 2 Summer 63% 36% 50% Spring 1 Spring 2 Summer 41% 27% 59% Avg.47%Avg.41% Pass rate is a percentage of enrollment at census
Inconclusive Students adjust Students are the unknown It’s not the answer that matters; it’s asking the questions and the process of collaboration!
QA and Social Science Pilot Closing the Loop between QA Data and Instructor Performance
Closing the Loop Prescribe a Plan Coaching Instructor Observations Hire or Not? QA Report
Prescribing a Plan Team meeting Communication Clarify expectations Outline follow-up plan Provide additional resources as needed
Coaching Tools
Course Observations
Rich student-instructor interaction!
Data Subcommittee %27s+island&FORM=IGRE
Leaving Data Island
Are you talking to Wilson?
Questions John Schmahl Karen Kaemmerling - Liz Dzabic - Images from Power Point Clip Art or Morguefiles.com