University of Maryland Exploring Natural user interfaces for stem learning in a mixed reality environment Melika abolhassani Daniel Apon Seokbin KanG Jinfeng Rao Zehua Zeng University of Maryland

Introduction Mixed Reality (MR) is a computing paradigm where digital information is visually displayed “on top of” the user’s view of the world. Think: GOOGLE GLASS Past research confirms MR-technologies’ efficacy in improving general-purpose learning – but STEM learning has not been fully explored!

Proposed Research We ask: Proposed Deliverables: What happens in the teaching and learning process – of STEM-based topics – when MR is used in the K-12 classroom? How can MR help with specific educational objectives, e.g. teaching programming to kids? Proposed Deliverables: Study of useful, natural user interfaces in STEM learning environments Development and evaluation of MR prototypes for STEM-based learning

Intellectual Merit Interdisciplinary: MR technical design led by state-of-the-art in the pedagogical and behavioral psychology research fields Application-driven exploration in the MR design space Fresh approach toward (notoriously difficult) STEM educational outcomes

Broader Impacts Introduce a new generation of American children to computer science and other STEM topics, in an exciting and immerse learning experience Improved tech awareness and digital collaboration skills of students After initial design costs: Correcting or updating the MR learning interface is less costly than any entirely-real-world learning environment

Time, Costs, and Long-term Planning Our initial Proposed Project: Two-year timespan Budget: $250,000 (for researcher salary, equipment, software licenses) Research conducted by three Ph.D. students and one post-doc Our long-term Sustainability Plan: Low-cost software licensing to K-12 schools to fund ongoing technical support and R&D

Thank You! Questions?