1. An Adaptive Approach Using Serious Games for Health
Physiological Computing System for Physical Training in Healthy Seniors
An Adaptive Approach Using Serious Games for Health
John E. Muñoz, Sergi Bermúdez, Mónica Cameirão, Elvio Rubio
M-ITI/ LARSyS
Goal
This project proposes the development of an adaptive videogame architecture based on physiological measures of the player by sensing cardiorespiratory fitness parameters. The main contribution of this work is to study the system adaptations based on physiological computing principles, development of a software tool to close the gap between physiology and videogames to control physical performance and promote highly motivating and personalized Exergames for seniors.
User’s Modelling With Personas
The rapid contextual design process (user-centered approach) was used:
9 local senior adults (8 female, M=62.3, SD=6.2).
Two main topics: a) patterns of digital gameplay, b) motivators to play.
Analysis of exercise routines, socialization and relationship with colleagues sequence models for work-out practices, affinity diagram for revealing opportunities Exergames’ integration in the gym and user’s Personas modelling to communicate user’s needs.
Exergame’s Design
Multiple game design techniques, informants and iterations:
Feedback from sport science professionals, exercise instructors and games for health experts.
An Exergame Jam to accelerate the game development process.
Several iterations with end-users and game designers to improve game mechanics and aesthetics.
4 Exergames in a Portuguese trip adventure covering Lisbon, Madeira, Porto and the Douro Region. A B C D
Contextual Design
Fig. 2. Exergames developed using the contextual design information. A. Grape Stomping, Duoro Region, B. Rabelos VR, Porto, C) Exerfado, Lisbon, D. Toboggan Ride, Madeira.
Fig. 1. Short version of the three User’s Personas modelled depicting skeptic (left), curious (middle) and enthusiastic (right) users.
Real Time Adaptation (Biocybernetic Loop Engine)
An integrated software tool designed for an easy creation of physiologically modulated videogames using of wearable sensors.
Includes a signal acquisition panel, which facilitates the connectivity of multiple physiological sensors and the processing of their signals
Considers a Biocybernetic console to rapidly create and iterate adaptive rules using a visual scripting module
Contains a game connector tool that ties physiological modulations to game variables.
Offline Multimodal Signal Processing (PhysioLab)
PhysioLab is a multivariate signal toolbox created to simplify physiological signal processing and is freely available at
EMG, ECG and EDA signals and it is fully operated using a graphical user interface.
Out-of-the-lab fitness experiments, specially for the cardiorespiratory field.
Assist both researchers and non-experts in processing physiological signals.
Providing wide variety of feature extraction, filtering and artifact removal methods.
Data interpretation is aided through cardiorespiratory radar plots (figure 5).
Physiological Computing Systems
Fig. 3. Left: PhysioLab graphical user interface showing the analysis, signal visualization and feature extraction panels.
Right: some of the sensors supported by PhysioLab
Fig. 4. Screenshot for the signal acquisition panel (left) and BL console (right) illustrating the biocybernetic loop engine software tool.
Modulation of Physiological Responses During Exergaming
A first pilot study with 17 older adults (64.5 ± 6.4 years) revealed:
Higher game performance in Exergaming as compared to conventional handheld.
Energy expenditure and kinetic energy were affected by the game difficulty.
Users were more galvanic-responsive to positive feedback than negative.
Planning a Longitudinal Intervention
Goal
Disentangle the role of physiology
to boost the effectiveness of
Adaptive Exergames
Longitudinal Study
3 Months
Traditional exercise vs Exergaming
20 Active Seniors
Fig. 6. Diagram depicting the Exerpong setup consisting of a Kinect sensor, a projected environment the physiological sensors.
Fig. 5. Left: differences between HR responses during handheld and exergame interaction. Right: cardiorespiratory radar plots
CMUP-ERI/HCI/0046/2013