Steering Committee meeting Interreg SYSIASS project Activity 3 Huosheng Hu June 20 th 2012 ISEN 1 Part-financed by the European Regional Development Fund

Part-financed by the European Regional Development Fund Activity 3 2 Sub-action 1: Definition of the spec & functionalities of multi-modal HMI This has been done and achieved. Sub-action 2: Head gesture based HMI and EMG based HMI At Essex, we have deployed a webcam and a Brain-fingers EMG sensor to build a hands-free control interface for the intelligent wheelchair. More details can be seen from the papers listed below. Sub-action 3: Integration of head gesture, EMG and BCI data At Essex, we have integrated the information gathered from head gestures, EMG signals and brainwaves to construct a multimodal human-machine interface for hands-free control of the intelligent wheelchair. More details can be seen from the papers listed below.

Part-financed by the European Regional Development Fund Activity 3 3 1)L. Wai and H. Hu, A multi-modal human machine interface for controlling an intelligent wheelchair using face movements, Proc. of IEEE Int. Conf. on Robotics and Biomimetics, Phuket, Thailand, 7-11 December 2011, pages )L. Wei and H. Hu, Towards Multimodal Human-Machine Interface for Hands-free Control: A survey, Technical Report CES-510, University of Essex, ISSN , January )E.J. Rechy-Ramirez and H. Hu, Head movements based control of an intelligent wheelchair in an indoor environment, submitted to IEEE Int. Conference on Robotics and Biomimetics, Guangzhou, China, 7-8 December 2012.

Part-financed by the European Regional Development Fund Activity 3 4 Sub-action 4: Integration of all the algorithms developed in activities 1, 2, 3. This is to be done next, especially algorithms from Activity 2. Sub-action 5: Test the integrated algorithms on the real wheelchair This will be done soon. Sub-action 6: collect data from extensive field tests This will be done next year.