1. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting GaLA Game and Learning Alliance The European Network of Excellence on Serious Games WP7 Integration in Corporate Training Johann Riedel UNOTT Nottingham University Business School 1

2. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting WP7 Tasks & Timeline T7.1 Corporate user and training stakeholder requirements (CEDEP) T7.2 Metrics for SG in corporate training (Cyntelix) T7.3 Integration methodologies for corporate training (UNOTT) T7.4 Community of corporate users (NURC) » D7.1 D7.2 D7.3 D7.4 2 Task 7.1 Task 7.2 Task 7.3 Task 7.4 WP7 STARTM12M24M36 END

3. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting SG Integration in Companies 3 SG Corporate Integration Training People Development Intervention Change Mngt, Decision Mkg, Culture Adapt Viral Diffusion Use game dynamics to diffuse Gamification of operations, Interaction with Customer

4. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting Exploratory Case Studies on SG Integration Call for cases resulted in 5 cases being collected:- ABN Bank Lego Serious Play Wallbreakers Afghanistan OpenSea 4

5. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting Case Study Questionnaire Organisation details Adopted SG, Aims of adoption, adoption attitude Awareness, Rationale for adoption Description of use Barriers encountered Benefits of use Changes to practice attributable to SG How SG overcame problems Benefits for stakeholders (non-participants, management) Recommendations for practice 5

6. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting Cases - Preliminary Analysis Large-ish organisations involved: 4,000 employees to 100,000+ 2 military 2 cases are corporate change/ strategy interventions – LSP, Wallbreakers 1 case is about company core values 3 Operational training: Afghanistan, OpenSea, ABN All but one are early adopters, the 5th is a first follower Single SG use: Afghanistan, LSP, Wallbreakers Multiple-SGs: ABN, Nato Limited deployment (1 department/ branch): LSP, Wallbreakers, Afghanistan [50 - 400 participants] Wide deployment: ABN, Nato User org is developer: Nato Commissioned SG: ABN Key finding: support from senior management is critical for adoption 6

7. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting Metrics for Serious Games in Corporate Training The goal of task 7.2 – To design metrics that can measure the effectiveness of Serious Games in corporate training Measuring the effectiveness for learning of SGs in corporate training (year 1 and 2) –Results contributed to WP1 SG Study Template Metrics of integration will be further considered in years 3 & 4

8. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting Corporate Metrics Approach Study: How corporates understand and evaluate the effectiveness of corporate training –studied Nonaka’s SECI knowledge model, Kirkpatrick model, ROI model Existing measurable features for games and/or SGs that influence the effectiveness for learning - to evaluate if / how these can be used

9. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting Methodology A paradigm shift: the accent of measurement falls on the process not on the outcomes –Put more attention on knowledge transfer and use existing measures of the levels of social interactions as a starting point All studied features are interrelated with two main interdependencies composed-of and prerequisite –this makes it possible to understand why a certain measured effect has been achieved –allow measuring at different stages in the game design

10. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting Integration Metrics 10 We defined a Maturity model (MM) for integrating SG in corporate training: It is a general model for any type of SG Collected data on the integration of SG from 64 national companies and around 15 international ones For a SG to be successfully integrated it needs to prove its effectiveness to move to the next level of maturity

11. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting WP7 Metrics Next Steps 11 Collect data of existing evaluation practices of games in corporations Collect additional data on integration of games in corporations to fine tune the existing maturity model to the different types of games Review empirical studies to understand how game features relate to learning outcomes Incorporate the results of the previous steps in the metrics design Year 4 Evaluate and correct the approach Formulate the findings as a guide for corporations to adopt different types of SG in their trainings

12. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting WP7 Community Building 12 Focus on lead-users Online Educa, Gaming Workshop, Nov 2012, Berlin (with WP9) LinkedIn SG group grown: from 1,400 to 3,350 – 2,000 increase New LinkedIn Gamification Group started, now has 3,700 members Events for industry and users: Number: 11

13. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting WP7 Events Playgen ran 5 half-day workshops called MAKE PLAY – where 80 participants working in various SMEs and organisations across health, advertising, media, charity and enterprise participated to learn about Serious Games and how to make them. Games For Brands – 300 participants – LONDON 27th October 2011 – exploring the opportunities for brand and content owners to discover the potential for games. Games for TV – 200+ participants – LONDON 18th April 2012 – a dedicated one-day interactive conference and workshop designed for the television, production, licensing, publishing and related sectors to understand how to turn their content into games across all platforms and devices. We also ran Games For Places – and the Play Day during the Digital Shoreditch Festival 13

14. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting WP7 Events NURC established contacts to the Modelling & Simulation community in NATO and in the fields of defence, security, anti-piracy, etc. Attendance at Workshops on Modelling & Simulation and SGs Contacts with other defence institutes and schools in order to coordinate shared e-learning test/training activities in Year 3 ORT organised a Serious Games thematic workshop at Cap Digital, Paris Region, 22 September 2012 UNOTT/ BIBA/ OUNL/ TUD Workshop on SG Evaluation and hands-on Online Educa, Berlin, 2012 14

15. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting WP7 Metrics 15 WP7TargetsAchieved Year 1Year 2Year 3Year 4TotalYear 1Year 2Year 3Year 4Total Conference Publications233311297 Book Chapters0121 Journal Publications123 Nr of 1st tier publications111 Nr of other journal publications112 Nr of other conference publications8 Integration Case Studies51655 Joint Research Activities122511 Industry Events22261114 Articles in industry press12360

16. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting WP7 Publications Book Chapters Hansen, PK. (2012) Innovation and learning facilitated by play In: Seel, N.M. (Ed.) Encyclopedia of the Sciences of Learning, Springer Science + Business Media B.V. ISBN 978-1-4419-1427-9 Riedel, JCKH. & Baalsrud Hague, J. (2011) Serious games and the evaluation of the learning outcomes - challenges and problems, In: Maria Manuela Cruz-Cunha, Vítor Hugo Carvalho & Paula Tavares (Eds.) Computer Games as Educational and Management Tools: Uses and Approaches, IGI Global, Hershey, PA, pp263-279. ISBN 978-1-60960-569-8. http://www.igi-global.com/requests/details.asp?ID=711 Conference Papers 1st Tier Azadegan, A. & Riedel, JCKH. (2012) Serious Games Integration in Companies: A Research and Application Framework, ICALT2012 - International Conference on Advanced Learning Technologies and Technology-enhanced Learning, IEEE Computer Society & IEEE TC on Learning Technology, Rome, 4-6 July 2012. ISBN: 978-0-7695-4702-2/12. www.scuolaiad.it/ICALT2012 2nd Tier Azadegan, A; Riedel, JCKH. & Baalsrud Hauge, J. (2012) Serious Games adoption in corporate training, In: Ma, M; Oliveira, MF; Baalsrud Hauge, J; Duin, H; Thoben, K-D. (Eds.) Serious Games Development and Applications: Proceedings of the 3rd International Conference SGDA, 26-29 September 2012, Bremen, Germany. Lecture Notes in Computer Science LNCS7528, Springer, Heidelberg. ISBN 978 3 642 33686 7. DOI: 10.1007/978-3-642-33687-4, pp74-85. Baalsrud Hauge, J. & Riedel, J.C.K.H. (2012) Evaluation of Simulation Games for Teaching Engineering and Manufacturing, In: De Gloria, A. & de Freitas, S. (2012) 4th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES’12), Elsevier Procedia Computer Science, Vol. 15, pp. 210-220. http://www.sciencedirect.com/science/journal/18770509 Yulia Bachvarova, Stefano Bocconi, Bartwin van der Pols, Maria Popescu and Ion Roceanu (2012) Measuring the effectiveness of learning with Serious Games in corporate training, VS-Games’12: 4th International Conference on Games and Virtual Worlds for Serious Applications, Genoa, Italy, 29-31 October 2012. In: De Gloria, A. & de Freitas, S. (2012) 4th International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES’12), Elsevier Procedia Computer Science, Vol. 15, pp. 221-232. http://www.sciencedirect.com/science/journal/18770509 16

17. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting Publications /2 Domain Conference Papers – other Tiers Nielsen, L.M. (2012) Balancing Design Project Supervision and Learning Facilitation, In: Chris Baelus, Guido De Grande, William J. Ion (eds) Proceedings Of The 14th International Conference on Engineering and Product Design Education (E&PDE 12): Design Education For Future Wellbeing, 6 September 2012, Antwerp, Belgium, The Design Society, ISBN 978-1-904- 670360. I A. Stănescu, A. Ştefan, M. Kravcik, T. Lim, R. Bidarra (2012) Interoperability Strategies for Serious Games Development, Proceedings of the 8th International Scientific Conference "eLearning and Software for Education", Bucharest, 26 – 27 April 2012, ISBN 2066-026X-12-151, page 373-378. Paananen, H.; Smeds, R. (2012) The Systems Snapshot - A Serious Game for Increasing Understanding of Organizational Models, Leadership and Communication in Increasingly Complex Systems. In: “Innovation and Serious Games”, the IFIP WG 5.7 16th Workshop on Experimental Interactive Learning in Industrial Management, in collaboration with the EU Network of Excellence GaLA. Bergische Universität Wuppertal, Germany, June 3-5, 2012. Workshop Publication, pp 51-59. Azadegan, A; Riedel, JCKH. & Baalsrud Hauge, J. (2012) An Application Framework for Serious Games Integration in Companies, In: Hoeborn, G. (Ed.) Workshop-Publication The IFIP WG 5.7 16th Workshop on Experimental Interactive Learning in Industrial Management, in collaboration with the EU Network of Excellence GaLA Innovation and Serious Games, 4-6 June, Wuppertal, Germany. pp13-25. Edition Winterwork, Borsdorf. ISBN 978-3-86468-187-5. Baalsrud Hauge, J; Pourabdollahian, B. & Riedel, JCKH. (2012) The Use of Serious games in the education of Engineers, In: Emmanouilidis, C., Taisch, M., and Kiritsis, D. (Eds) Competitive Manufacturing for Innovative Products and Services: Proceedings of the APMS2012 Conference Advances in Production Management Systems, Rhodes, Greece, 24-26 September 2012. 17

18. Luxembourg January 28 2013 European Commission Information Society and Media 2 nd Review Meeting WP7 Next Steps 18 To revisit the exploratory case with research questions derived from the analysis To carry out in-depth case studies on the key research questions Continue Metrics work Continue community building activity eg. ORT seminar on best practises in serious games end of January 2013 (to coincide with the BETT Show). Develop articles for professional publications in HR/ Training on SGs Partially based on case studies