UNMEASURED LEARNING’S DAY OFF DATA RULES UNMEASURED LEARNING’S DAY OFF

Why use xAPI? Can get a lot of it very easily xAPI gives us more. But why? What can we do with xAPI “We can track people”

Why use xAPI? Can get a lot of it very easily xAPI gives us more. But why? What can we do with xAPI “We can track people”

"We know they've been trained to do it, but do they actually do it?" Why use xAPI? "We know they've been trained to do it, but do they actually do it?" “When L&D professionals can provide data and analysis linked to strategy, they will be a key influencer. “ “speaking in the language of business, rather than trying to sell learning “

Why use xAPI?

Why use xAPI?

Why use xAPI? “As an instructional designer I've never had to deal with analysis, statistics(?) or wrangling datasets. I feel a steep learning curve coming on.”

Why use xAPI? It is a learning curve… But it’s not that steep. You can do a lot with xAPI… Using the tools you already have

Data is messy…

Data is messy…

Explore

Explore

Explore

Explore

What Do You Want to Know? Participation Performance

Participation Related How are people using resources available? How much time are they spending? What elements/resources are proving useful? What aspects of participation affect results? What aspects of participation affect completions?

Performance Related Are we teaching the right things? How does course performance correspond to job performance? Did X have the desired effect on Y?  

Did anything change?

Did anything change? At first glance, not really, but… Reply rates increased by 12% And then we looked a little further… Lesson – keep exploring – and – a little extra data goes a long way

More Questions, More Insights When we saw the reply rates, I wondered if that translated to improved completion rates…not really, but we learned something new

More than a popularity contest IHG comment popularity – it wasn’t just what people were looking at, it’s what they were discussing QUALITATIVE

More than a popularity contest Looking at what works and what resonates By Region By Functional role By Business Unit Insights drive design improvements. It’s not just counts – it’s what those counts mean IHG – Business insights, regional concerns what content is meeting needs DfD – Diff roles like diff types of content – and it didn’t fall out how we anticipated.

Did it work? Retail Sales Course Data: Enrollments Completions Course Performance Regional data CONTEXT is where we find the answers… Power of Context– we saw that in IHG, we also see that here.

Did it work? Outcomes Average Transaction Value is +32% for relevant regions Country wide sales for product category are +19% after product specific training. Power of Context– we saw that in IHG, we also see that here. Everything in this preso was done with spreadsheets…

The Road Ahead Text analytics Recommenders Learning Paths

UNMEASURED LEARNING’S DATA RULES Janet Laane Effron Data Scientist, HT2 Janet@ht2.co.uk @jleffron UNMEASURED LEARNING’S DAY OFF