1. UNCLASSIFIED Jerzy Jarmasz Learning & Training Group, Human-Systems Integration Defence R&D Canada, Toronto Research Centre MLS Concept Evaluation Train the Trainer Workshop 16-17 December 2014, Dayton OH Individual Training & Education Research for the Canadian Armed Forces

2. UNCLASSIFIED R&D Support to IT&E modernization in the CAF One of the top priorities of the Chief of Military Personnel is to modernize IT&E The custodian of IT&E, and of its modernization, in the CAF is the Canadian Defence Academy (CDA) We are supporting CDA with R&D focused on answering questions such as: What’s the effectiveness & best use of mobile learning (use cases, methods)? How to ensure the most effective use of simulation for “risky” training? How can we make neuro-adaptive training systems suited to the military context? How can new computing technologies effectively support training for collaborative/distributed/international missions?

3. UNCLASSIFIED Thematic organization of IT&E R&D Instructor support Virtual resource Centre Compendium of learning & training R&D HanDLes knowledge management tool Validation of instructor support tools (e.g. LeaP) Training for advanced cognitive skills Mental Resilience and Readiness training Complex Decision Making training Training Toolkit for the Comprehensive Approach Validating advanced learning environments Biomarkers of learning & expertise Neuro-Adaptive Training Systems Assessment of the Classroom of the Future Human Factors assessment of wearable technologies and gesture-based computing Validation of synthetic environments Identification of Driver Training Simulator requirements Mobile learning Evaluation Mobile Learning Framework Interactive Classroom Response System RCN Technical Skills Mobile Apps Small Arms Coaching App

4. UNCLASSIFIED Selected research projects Mobile learning framework Knowledge management tools for instructors (Virtual Resource Centre) Marksmanship coaching app: study findings Comprehensive Approach Training Neuro-adaptive intelligent tutoring systems Command-and-Control LiveSpaces Lab (C2L2) for distributed learning Some training infrastructure (CAF App store, ONGARDE)

5. UNCLASSIFIED Objectives: Support CDA's efforts at developing an official policy/way ahead on the use of mobile devices in IT&E with evidence- based recommendations leveraging the latest research literature and integrating from studies DRDC examining the effectiveness of mobile devices in a number of representative CAF use cases. Start-End: April 2014 to March 2016 Partnership: CDA, ADL, TTCP Lead: Dr. Jerzy Jarmasz Activities : Study on the digital literacy of personnel in the CAF. Integrate the findings of the mobile learning effectiveness studies under the IT&E research project Propose a “concept of operations” for mobile device- based learning & training in the CAF based on use cases, user characteristics and findings on effectiveness Framework for the Application of Mobile Learning

6. UNCLASSIFIED Virtual Resource Centre Objectives: Support CAF instructor development with user-friendly web- based, searchable/tailorable resources providing a knowledge base of validated learning & training practices and decision support tools. One-stop shop for CAF instructors needing resources Vehicle for making results of DND research learning & training more accessible to instructors & trainers Deliverables: Knowledge management tools (in-house and commercial) for efficient, intuitive search of instructional material repositories, and matching learning objectives to instructional materials. Effectiveness/usability findings for select KM tools

7. UNCLASSIFIED Objectives: Develop and evaluate an app designed to help Unit Sergeants coach personnel for Annual Personal Weapons Test (which all CAF personnel must complete yearly). Start-End: April 2014 to March 2017 Lead: Dr. Stuart Grant Partnerships: CDA, Combat Training Centre Gagetown, US ARI Findings to date : Initial study with US instructional material (via ARI) Compared paper pub with app version of same Key findings: “anywhere, anytime” training not used regardless of format Yet test videos (pre & post-test) improved performance  value of multimedia in e- learning Mobile App - Small Arms Instruction

8. UNCLASSIFIED Training Toolkit for the Comprehensive Approach Objectives: Develop & evaluate the effectiveness of a range of training tools, including paper tools &mobile apps, in support of training CAF members for the Comprehensive Approach to Operations (i.e., Whole-of-Government missions). Leverages previous multi-year projects on whole-of-government operations & comprehensive approach for the Canadian Army Activities: Skill development tools (scenario- based) Performance support tools (Acronym App, guides to OGD and Military planning processes) Adaptation of Comprehensive Approach tools developed by the Netherlands (TNO) Support to the MLS Concept Evaluation Study

9. UNCLASSIFIED Neuro-Adaptive Training Systems Development Objectives: Enhance the delivery of computer-based training (including distance learning, simulation, intelligent tutoring systems) with system that adapts delivery to learner’s progress and skill level based on behavioural measures and biomarkers of learning. Leveraging open-source framework called Generalized Framework for Intelligent Tutors (GIFT; created for US DoD) Integrating parallel work on biomarkers of learning & expertise, being conducted in partnership with the University of Ottawa Activities: Analysis of requirements and concept of employment (report). Prototype system (software, some computer & sensor hardware). Recommendations & guidelines for employment in CAF instruction (report).

10. UNCLASSIFIED Distributed Learning: Command & Control LiveSpace Lab (C2L2) Objectives: validate a collaborative and distributed classroom using multiple interconnected, high-resolution computer displays, mobile devices, alternative input modalities such as touch- and gesture-based input, and high-bandwidth interconnectivity to enhance course delivery in CAF classrooms Facility is one instance of the Command & Control LiveSpace Lab (C2L2) architecture used in a number of TTCP nations Activities: C2L2-as-classroom proof of concept (hardware and software) Evaluation of specific instructional interventions suited to interactive, media-rich environment (e.g., virtual 3D models, gesture-based manipulation)

11. UNCLASSIFIED OnliNe Government Advance R&D Environment (ONGARDE) Objectives To provide a common secure online R&D environment for Federal Security Sector To conduct research, development, and evaluation activities To support of IT&E and CAF Campus Learning Portal To enable information-sharing of projects, lessons learned and best practices To promote collaboration and engagement between S&T/ODG with CAF (doing more with less)

12. UNCLASSIFIED CAF Mobile App Store (CAFMAS) CAFMAS uses mobile devices to address S&T requirements within IT&E CAF Campus Engine Secure deployment of mobile apps independent of iTunes and Google Play to iOS and Android devices (the only known platform in GOC/NATO to do this) Supports ‘Bring Your Own Device’ (BYOD) strategy to reduce the cost of Mobile Learning CAFMAS is linked to ONGARDE and supports modern learning methodologies and technologies IT&E related S&T results will be produced as Apps on CAFMAS

13. UNCLASSIFIED