London February European Commission Information Society and Media GaLA Game and Learning Alliance The European Network of Excellence on Serious Games Metrics for SG in Corporate Training Yulia Bachvarova, Bartwin van der Pols CYNTELIX

London February European Commission Information Society and Media Features related to the context of corporate training 2 What to measure? Our focus: effectiveness of learning in corporate training Learning in corporate setting is related to: Knowledge transfer (capturing knowledge, making tacit knowledge explicit, etc) Impact on business or environment Organizational perspective (visibility, effectiveness, ROE, ROI) Interoperability perspective (reusability, durability,interoperability,etc) Investor perspective (training cost, personnel cost, etc) Employer perspective (in-place task efficiency, effectiveness of task accomplishment) Employee perspective (motivation, self-efficacy)

London February European Commission Information Society and Media Our approach 3 Shift from static measures (the typical pre and post test) Adopt dynamic perspective Do not measure the outcomes of knowledge works, but its processes (organizational practices) thus actually address the dynamic dimension of knowledge

London February European Commission Information Society and Media General observations 4 Features are composite Features are interrelated Effectiveness for learning in corporate training is a composite feature. It is composed of other features which reside at different levels of abstraction and are in a specific relationships (precedence, inclusion, etc)

London February European Commission Information Society and Media The dynamic aspect of measurement 5 An example: immersion Has three stages: engagement, endorsment, full immersion Need to pass a threhold to move from one stage to another First stage: Aceess - usability Investment: time, effort, attention Second stage: Emotional involvement Third stage: empathy, atmosphere (visual, auditory, mental) We are looking at this type of dynamics within or between features How are the different levels of immersion and learning related? What is the relationship between immersion and flow?

London February European Commission Information Society and Media Summary Move from measure for control purposes (You can only manage what you can measure), to measure in order to understand the field For that our focus is on understanding the interdependencies of features We want to be able to measure features at the different stages of game development so that measurement informs the design process Devise metrics based on scintific methodology - more costly in terms of time and effort, but more reliable results and with scientific merit The work in GaLA dedicated to metrics needs to be synchronized