GaLA Final Review European Commission Information Society and Media GaLA Game and Learning Alliance The European Network of Excellence on Serious Games WP2 Research & Development (Year 4) S. Arnab, T. Lim, P. Moreno-ger, I. Stanescu, K. Kiili, A. Perttula, S. Louchart, M. Ninaus, M. Ott, J. Earp, B. Manjon,, N. Suttie, G. Pereira, D. Brown 1

GaLA Final Review European Commission Information Society and Media Content Introduction –Looking back –Priority Areas –Reviewers’ recommendations and comments Year 4 –Aims –Activities and coordination –Key reports as products of WP2 –Informing roadmap: reflecting on research –Highlights –Development outcomes –Metrics Conclusions 2

GaLA Final Review European Commission Information Society and Media Introduction: Looking back 3 Y1: Foundation Y2: Solutions Y3 + Y4: Implementation, Application, Evaluation and Reflection To facilitate joint research activities by aggregating, systematizing and synthesizing relevant research topics with a view to highlighting hot topics. 9 technical committees on specific topics + 1 coordinating technical committee. Year 2 and Year 3 – streamlined under three priority areas (Design, Assessment, Reusability)

GaLA Final Review European Commission Information Society and Media Looking Back: Priority Areas (PA) PA1: Assessing learners, analysing learning and adaptability –GLEANER (Game LEarning ANalytics for Educational Research) –Flow model for SGs analysis PA2: Understanding games for learning constructs to aid evaluation and design –Learning-Game Mechanics model (LM-GM) towards defining Serious Games Mechanics (SGM) –Process, Purpose, Structure method (PPSM) PA3: Encapsulating key elements for a successful development and deployment of SGs for learning –SG-REF 4 Priority Area 1: Learning analytics and Flow Priority Area 3: Reusability for SG development PriorityArea 2: Games for learning constructs

GaLA Final Review European Commission Information Society and Media Review: Key comments and recommendations “…the Roadmap is a high priority…a Roadmap should be disseminated and clearly available as resource produced by the network.” “A reflective synthesis of the lessons learned by the studies already conducted…” “The more likely areas of meaningful contribution include the first two priority areas reported in WP2.” “…a synthesis of research and development in the areas of learning analytics and flow experience…an analysis of the research literate in the area of flow experiences in games as opposed to learning environments and then SGs…” “… develop a set of priorities for year 4, and associated KPIs so that those outside the project can use the KPIs to assess the impact of the effort…” 5

GaLA Final Review European Commission Information Society and Media Reflecting on key areas LA for SGs Flow for SGs Serious Games Mechanics 6 Reflecting Updating and building knowledge base State-of-the-art Knowledge Base Trends, gaps and challenges Synthesis workshop Contribute to roadmap (D1.7) Contributing to Roadmap (WP1) P1 P2P3 Year 4: Implementation, Analysis and Reflection

GaLA Final Review European Commission Information Society and Media Coordination and Reporting Coordination: –Contributing to overall GALA roadmap (WP1) – synthesizing research –Priority on 3 areas for final reports – Learning Analytics, Flow and Serious Games Mechanics Reporting is streamlined (D2.4 deliverable): –3 key reports - Learning Analytics, Flow and Serious Games Mechanics –Synthesis/summary report – summarising key themes from existing trends, challenges and the 3 key reports 7

GaLA Final Review European Commission Information Society and Media Key contributions to the field: 3 key reports 1.Learning analytics for Serious Games (D2.4 Report 1) Highlights (knowledge contribution): SG-Tailored Learning Analytics: GLEANER (Game LEarning ANalytics for Educational Research) Analysis of application contexts and scenarios ( What, Where, When to measure) Proposal of an abstract Learning Analytics model ( Levels of abstraction, Processing steps) Practical validation ( Evaluation trials, Lessons learned, Practical guidelines) Development contribution: Public API for game-to-server communication –Specifies communication protocols and data models Opensource implementation of a back-end service –Interoperable data collection service –Widgets for different analyses and visualizations –Dashboard for real-time analytics Opensource implementation of a client-side plugin –In Java, attachable to different game engines 8

GaLA Final Review European Commission Information Society and Media Key contributions to the field: 3 key reports 2. Flow for Serious Games (D2.4 Report 2) Highlights (knowledge contribution): Flow research in serious games field has started after the millennium and the research on this theme is fragmented. Flow has a positive influence on game based learning outcomes Flow can be used in game analysis and as a game quality measure in serious games. Development contribution: Flow Framework for Educational Games 9 To facilitate the analysis of educational games and to provide design-support for game developers.

GaLA Final Review European Commission Information Society and Media Key contributions to the field: 3 key reports 3. Serious Games Mechanics (SGM) (D2.4 Report 3) Highlights (knowledge contribution): Game design patterns and their pedagogic practice associations and implications Design for SG analysis and to support SG design to fielded capability 10 Development contribution: LM-GM mapping Process, purpose and structure methodology (PPSM)

GaLA Final Review European Commission Information Society and Media Informing Roadmap: Key themes 1.Serious Games Design Key themes: Flexible learning spaces Learner centred design SG design methodology Evaluation and assessment Key themes: Learning analytics and stealth assessment Neuroscientific measures 3. Total cost of ownership Key themes: Simplified SG design, development and deployment Enhanced serious games environments Multidisciplinary collaborations in SGs ecosystems New business models

GaLA Final Review European Commission Information Society and Media Highlights: Key challenges and opportunities 12 Flexible and hybrid learning spaces for a more seamless, connected and context-aware environment Synergy between SGs and Gamification for learning Serious Games Mechanics blending play-learn dimensions Personalisation and collaboration SG-tailored stealth assessment and learning analytics Trans-disciplinary approach in SG design and evaluation Standards, interoperability and reuse to enable simplified, cost-efficient, mature serious game design, development and deployment

GaLA Final Review European Commission Information Society and Media Opportunities: Supporting current trends! Seamless, connected and context-aware environment 13

GaLA Final Review European Commission Information Society and Media Opportunities: Synergy 14

GaLA Final Review European Commission Information Society and Media Opportunities: Scaffolding ecosystem 15

GaLA Final Review European Commission Information Society and Media Development outcomes: Models, APIs SG-Tailored Learning analytics (GLEANER API) 3 requests (IT, UK), 2 future support (SP, PT) and 182 unique visitors Implemented by 3 first and second party and 1 third party. Cited and referenced 31 times (excluding self citations). Flow model for SGs A structure to consider and study principles Several case studies have been conducted Cited 36 times (13 excluding self-citations) Serious Games Mechanics (SGM) LM-GM mapping with a Purpose, Process, and Structure methodology (PPSM) using the PPSM Play Cards as a tool cited 28 times excluding self-citation 16 /workshop requests for SGM card game The Serious Games Reusability Point of Reference (SGREF) (also refer to WP8) A total of 72 references uploaded to the system (43 non-GALA).

GaLA Final Review European Commission Information Society and Media 3 Key Reports The report summaries published on the SGS website and the article hits from 25 th August 2014 – 24 th October 2014 are as follows: Report 1- D2.4 Learning Analytics for SGs: 1012 hits, 6 report requests (1 France, 1 UK, 1 Portugal, 1 Canada, 1 Malta, 1 Belgium) Report 2- D2.4 Flow for SGs: 1003 hits, 5 report requests (1 France, 1 UK, 1 Portugal, 1 Canada, 1 Belgium) Report 3- D2.4 Serious Games Mechanics: 1133 hits, 7 report requests (3 France, 1 UK, 1 Portugal, 1 Canada, 1 Belgium) 17

GaLA Final Review European Commission Information Society and Media WP2 Metrics Highlights 18

GaLA Final Review European Commission Information Society and Media Conclusions WP2 responded to reviewers’ recommendations. Reflective syntheses highlighting trends, challenges and actions Contributed to GALA roadmap R&D outcomes –Three key reports –Development outcomes WP2 measures are documented in appendix B Further work will be framed under the SGS 19