Designing a multimedia interactive to support shared learning experiences Steve DiPaola & Caitlin Akai Simon Fraser University Steve DiPaola & Caitlin Akai Simon Fraser University Siggraph Boston 2006 Educator’s Workshop

8/2/062 Outline Technology in informal learning spaces Design issues for multimedia interactives Introduction to the Virtual Beluga project Technical description of the simulation Educational content Interaction design

8/2/063 Technology in informal learning spaces Informal learning spaces like museums, sciences centres and aquaria are increasingly incorporating technology into their exhibits These spaces contain many design constraints that can limit the potential of technology Appropriate design of multimedia exhibits can ensure technology enhances educational content and visitor experience

8/2/064 Design issues for multimedia interactives Need for robustness Limited contact time Exhibits must work without supervision High traffic/use Visitors travel in groups Need to generate repeat visits Educational content should be engaging and accessible

8/2/065 Virtual Beluga Project In collaboration with Vancouver Aquarium and Bill Kraus from Digital Biology Highly realistic dynamic virtual beluga simulation Interaction goal was to create a user-centric, shared, collaborative, and reflective learning space Important to encourage deeper interaction with the content than what is available through traditional wall signage or video

8/2/066 Overview of vBeluga Virtual belugas are shown in a wild pod context Incorporates research on beluga behavior and vocalization conducted at aquarium Simulation is based on artificial intelligence architecture so belugas can learn and alter their behavior based on changes in their environment Physically-based system allows for natural whale locomotion and realistic water Realistic graphics achieved through the use of actuators (virtual bones and muscles)

8/2/067 Simulation System Variable content is supported - individual organisms can grow and change over time, new organisms can be added/removed Easy to update to reflect changes in current scientific thinking The non-deterministic nature of the simulations means that no two simulations are alike The system is fully scalable - the number and complexity of organisms is limited only by the speed and memory of the computer on which it runs Behavioral system consists of two layers: –A low level navigational system –A high level action selection system

8/2/068 Adaptive behavior system Advanced Layer: Action Selection - Suite of behaviors (action selection) -Internal state -Memory of past events Primitive Layer: Navigation -Navigation and obstacles - Neural network bridging sensors and actuators

8/2/069 `

10 Educational messages Data from researchers, aquarium staff and visitors was incorporated into the interactive Key educational messages: –Belugas live in an acoustic world –Human activities affect the way belugas use sound to navigate and communicate –Our knowledge of wild beluga behavior is very limited

8/2/0611

8/2/0612 Interaction Design Goals To allow visitors to engage in interactive ‘what-if’ scenarios Focus on collaboration - especially between adult & children Technology removed from direct visitor contact Visitors should not control ‘wild’ belugas Solution: Camera tracked tabletop Flexibility

8/2/0613 Designing for flexibility Modularity Open-ended scenarios Layers Scalability

8/2/0614 Flexibility of use General gallery Summer camp Beluga encounters Corporate events

8/2/0615 Conclusion Effective design of multimedia interactives can overcome some of the constraints associated with public informal learning spaces Highly realistic simulations can provide a novel and engaging format for presenting educational content Dynamic open-ended scenarios used to encourage collaboration and interaction among a range of visitors

8/2/0616 Our competition

8/2/0617 Acknowledgments Steve DiPaola Bill Kraus of Digital Biology Vancouver Aquarium Valerie Vergara - PhD student and aquarium researcher For more information see: