Attention detection in driver simulator project #4 INPG : L. Bonnaud, A. Caplier UCL : D. trevisan, B. Macq Participants : A. Benoit, G. Chanel, P. Ngo,

Slides:

Advertisements

Similar presentations

SEMINAR ON VIRTUAL REALITY 25-Mar-17

Advertisements

Mobile Police Communication Wuhan Tianyu Information Industry Co., Ltd Jul

Sensor technologies leading a convergence of human interface and product differentiation Ian Olsen, Executive Director, Optical Sensors Business.

C1 - The Impact of CAD on the Design Process.  Consider CAD drawing, 2D, 3D, rendering and different types of modelling.

Haptic Glove Hardware Graduation Project Prepared by Yaman A. Salman Eman M. Masarweh 2012.

Digital Interactive Entertainment Dr. Yangsheng Wang Professor of Institute of Automation Chinese Academy of Sciences

Rest and Stress Systems NetECG Systems Holter Systems PC Based ECG Systems.

Department of Electrical and Computer Engineering He Zhou Hui Zheng William Mai Xiang Guo Advisor: Professor Patrick Kelly ASLLENGE.

Lesson 4 Alternative Methods Of Input.

Didier Perroud Raynald Seydoux Frédéric Barras.  Abstract  Objectives  Modalities ◦ Project modalities ◦ CASE/CARE  Implementation ◦ VICI, Iphone,

Introduction Testing is examining the project performance according to the specifications that have been agreed. This will include the robustness of the.

MUltimo3-D: a Testbed for Multimodel 3-D PC Presenter: Yi Shi & Saul Rodriguez March 14, 2008.

PERA PER sonal A ssistance Engin Deveci Computer Engineering Department Bogazici University Can Komar Computer Engineering Department.

Background Background Problem domain Current situation Proposed solution System architecture Functional requirements Non-functional requirements Major.

Emotions from PNS system

Optimal Secondary Controls Using a Configurable Haptic Interface William Durfee Department of Mechanical Engineering University of Minnesota Supported.

Distributed Information Systems - The Client server model

Non-invasive Techniques for Human Fatigue Monitoring Qiang Ji Dept. of Electrical, Computer, and Systems Engineering Rensselaer Polytechnic Institute

Next Generation Desktop Environment Project Looking Glass 3D Farrukh Shakil CS /02/06.

A Navigation System for Increasing the Autonomy and the Security of Powered Wheelchairs S. Fioretti, T. Leo, and S.Longhi yhseo, AIMM lab.

Cooperative crash prevention using human behavior monitoring Susumu Ishihara*† and Mario Gerla† (*Shizuoka University / †UCLA) Danger ! ! !

The Camera Mouse: Visual Tracking of Body Features to Provide Computer Access for People With Severe Disabilities.

OverView on Interaction Metaphore Murtaza Hussain.

FUNDAMENTALS OF PROGRAMMING SM1204 SEMESTER A 2012.

GAMING CONSOLES … “Evolution to the next level” Presented by:- Manindar Singh Ratan Regd.No.: Branch:- IT, Group:- ‘B’ Sem:- 7 th,CVRCE Game.

Conducting Situated Learning in a Collaborative Virtual Environment Yongwu Miao Niels Pinkwart Ulrich Hoppe.

Software Framework for Teleoperated Vehicles Team Eye-Create ECE 4007 L01 Karishma Jiva Ali Benquassmi Safayet Ahmed Armaghan Mahmud Khin Lay Nwe.

Demo Guidelines Lesson 9. Modules 9.1Demo Video Guidelines 9.2Begin Filming Pitch Video 9.3Continue working on prototype.

DYNAMIC WAP BASED VOTING SYSTEM Bertrand COLAS Submission date: May 2002 School of Computing Bachelor of Engineering with Honours in Computer.

GSI 1.0 by A. Elmekati M. Zeghal Geotechnical System Identification Software Framework 8/20/07 Introducing.

Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015 Karthikeyan Ganesan, Wuyang Zhang, Zihong Zheng.

Hybrid Sim design review Paul Hubbard Oct

GENESIS OF VIRTUAL REALITY  The term ‘Virtual reality’ (VR) was initially coined by Jaron Lanier, founder of VPL Research (1989)..

Siemens.com© Siemens AG 2015 – All rights reserved. Haptic information for reliable displays Marc Burkhardt, Birgit Milius, Damaris Dose / RHF2015 September.

A Space Game By William Sistar. The Problem What is provided:  Most network games are single player  Some do allow team work but not in a common environment.

Lecture 15 – Social ‘Robots’. Lecture outline This week Selecting interfaces for robots. Personal robotics Chatbots AIML.

Prototype 3: MI prototype for video surveillance and biometry CVDSP-UJI Computer Vision Group – UJI Digital Signal Processing Group – UV November 2010.

Low cost tactile feedback platform for teleoperation and VR sensing Human Machine Interaction & Low cost technologies Adrien Moucheboeuf - July 8 th, 2015.

The Effect of Interface on Social Action in Online Virtual Worlds Anthony Steed Department of Computer Science University College London.

Wild West. What is our project about? 2- player Gun shooting game Video processing done to detect hand motion Process hand motion to update gun locations.

Linux Startup Process Presenter: Dipu Gupta.

1.4 Wrist-Worn Wellness Watch Tom Honeywill Vadim Melnikov Grace Fuller.

Multimedia: What next? Nicolas D. Georganas University of Ottawa- Canada.

© 2003 Gina Joue & Brian Duffy Dr. Brian Duffy

Computer Software Types Three layers of software Operation.

Counting How Many Words You Read

Delivering Business Value through IT Face feature detection using Java and OpenCV 1.

Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015 Karthikeyan Ganesan, Wuyang Zhang, Zihong Zheng.

CPS Integration - Jia Bai Effective interaction -> understand the interaction between the control system and the communication network Secured communication.

IBM - CVUT Student Research Projects IBM Presence detection Milan Stezka

Mobile Analyzer A Distributed Computing Platform Juho Karppinen Helsinki Institute of Physics Technology Program May 23th, 2002 Mobile.

1 07/11/07 Using an Event-Based Approach to Improve the Multimodal Rendering of 6DOF Virtual Contact Jean Sreng, Florian Bergez, Jérémie Le Garrec, Anatole.

Integrated Hospital & Healthcare Information System.

Driver Monitoring System for Shift Workers Idea #1 – Acti Sync.

Virtual Reality Prepared By Name - Abhilash Mund Regd.No Branch - Comp.sc & engg.

Google. Android What is Android ? -Android is Linux Based OS -Designed for use on cell phones, e-readers, tablet PCs. -Android provides easy access to.

FINGERTEC FACE ID FACE RECOGNITION Technology Overview.

Attention Tracking Tool

Outline Introduction Standards Project General Idea

System Management MAS.

Computer Basics Section 2.1 YOU WILL LEARN TO… Identify hardware

Video and Sensor Network Architecture and Displays

License Plate Recognition SystemMay 13-17

NBKeyboard: An Arm-based Word-gesture keyboard

Autonomous object-tracking system

Interior Camera - A solution to Driver Monitoring Status

Multi-Sensor Soft-Computing System for Driver Drowsiness Detection

Hardware and system development:

Lesson 4 Alternative Methods Of Input.

Presentation transcript:

Attention detection in driver simulator project #4 INPG : L. Bonnaud, A. Caplier UCL : D. trevisan, B. Macq Participants : A. Benoit, G. Chanel, P. Ngo, V. Levacic, C. Thillou Guest star : L. Lawson

6/3/20152 Objectives Multimodal detection of user state –Hypo vigilance –Stress level –In the context of driving simulator Alarm => multimodal feedback to the user Test of OpenInterface as an integration platform

6/3/20153 Signals used for user state assessment Video (camera) Physiological (biopac) HeadEyesMouthECGGSR Hypovigilance ?? Stress ?

6/3/20154 General architecture Significative rotation ? High frequency ? Both eyes closed ? Video Mouth opening detector ECG analysis Head rotation estimation Eyes blinks detector GSR analysis GSRECG Yawn ? Fusion (redundancy, equivalence) High heart rate variation ? High GSR ? Local Peak ? Fission (redundancy, equivalence) Sonic feedback Graphical feedback Haptic feedback Screenloudspeaker Vibrating wheel Dialog controller

6/3/20155 Face motions analysis

6/3/20156 Physiological signals “database” 3 subjects : thanks to participants! 3 situations : –rest / relaxation –Stress stimuli while reading a newspaper Hand clapping Light in eyes Answering simple question Telephone call, “your dead” (killer game) –Playing with the driving simulator (difficult tracks)

6/3/20157 GSR signal

6/3/20158 GSR signal

6/3/20159 GSR signal

6/3/ ECG signal : preprocessing

6/3/ ECG : stress assessment

6/3/ Simplified architecture of 1st prototype Significative rotation ? High frequency ? Both eyes closed ? Video Mouth opening detector ECG analysis Head rotation estimation Eyes blinks detector GSR analysis GSRECG Yawn ? Fusion (redundancy, equivalence) High heart rate variation ? High GSR ? Local Peak ? Fission (redundancy, equivalence) Sonic feedback Graphical feedback Haptic feedback Screenloudspeaker Vibrating wheel Dialog controller Network messages (XML) 1st PC, Matlab, Linux 2nd PC, Simulator, Windows

6/3/ Realization of 1st prototype Significative rotation ? High frequency ? Both eyes closed ? Video Mouth opening detector ECG analysis Head rotation estimation Eyes blinks detector GSR analysis GSRECG Yawn ? Fusion (redundancy, equivalence) High heart rate variation ? High GSR ? Local Peak ? Fission (redundancy, equivalence) Sonic feedback Graphical feedback Haptic feedback Screenloudspeaker Vibrating wheel Dialog controller Network messages (text)

6/3/ Conclusion First working prototype (demo available) –Firewire camera Matlab interface under Linux –Modification of the simulator (multi threading, TCP server, message display) –TCP client in Matlab First try with Open Interface integration  problem with Matlab integration  to be solved by Lionel next week Usefulness of physiological signals Reliable online face motions analysis Still a lot of work to do !!!