Blue eye technology

Contents What is BlueEye technology ? What is BlueEye technology ? What is BlueEyes ? What is BlueEyes ? System designing System designing System overview System overview DAU DAU CSU CSU Data security Data security IBM research IBM research Conclusion Conclusion Motivation What is BlueEyes ? Physiological foundations System design System implementation Future improvements Project work summary System demonstration

What is blue eye technology ? The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings. The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings.

How can we make computers “see” and “feel” ? Blue eyes uses sensing technology to identify a user’s actions and to extract key information. Blue eyes uses sensing technology to identify a user’s actions and to extract key information. Information is then analyzed to determine the user’s physical, emotional, or informational state. Information is then analyzed to determine the user’s physical, emotional, or informational state.

What is BlueEyes ? The complex solution for human-operator monitoring: –V–V–V–Visual attention monitoring –P–P–P–Physiological condition –O–O–O–Operator’s position detection –W–W–W–Wireless data acquisition using bluetooth –R–R–R–Recorded data playback Motivation What is BlueEyes ? Physiological foundations System design System implementation Future improvements Project work summary System demonstration

Designing A personal area network for linking all the operators and the supervising system A personal area network for linking all the operators and the supervising system Two major units Two major units - DAU (data acquisition unit ) - CSU (central system unit ) Motivation Physiological foundations System design System implementation Future improvements Project work summary System demonstration

System overview Central System UnitData Acquisition Unit Atmel 89C52 microcontroller Jazz Multisensor Connection Manager Data Analysis Visualization Module Bluetooth Bluetooth technology provides means for creating a Personal Area Network linking the operators and the central system. Data Logger Motivation What is BlueEyes ? Physiological foundations System design System implementation Future improvements Project work summary System demonstration Objectives System overview DAU CSU

ID card DAU - components MC PCM codec ID card interface Simple keyboard Jazz Multisensor Beeper LCD display LED indicators Atmel 89C52 microcontroller UART MAX232 UART Bluetooth module microphone earphone

DAU - features Lightweight Lightweight Runs on batteries - low power consumption Runs on batteries - low power consumption Easy to use - does not disturb the operator working Easy to use - does not disturb the operator working ID cards for operator authorization ID cards for operator authorization Voice transmission using hardware PCM codec Voice transmission using hardware PCM codec Data Acquisition Unit Atmel 89C52 microcontroller Jazz Multisensor Bluetooth Motivation What is BlueEyes ? Physiological foundations System design System implementation Future improvements Project work summary System demonstration Objectives System overview DAU CSU

CSU – components CONNECTION MANAGER – main task to perform low-level blue tooth communication CONNECTION MANAGER – main task to perform low-level blue tooth communication DATA ANALYSIS MODULE – performs the analysis of the raw sensor data in order to obtain information about operator’s physiological condition DATA ANALYSIS MODULE – performs the analysis of the raw sensor data in order to obtain information about operator’s physiological condition DATA LOGGER MODULE – provides support for storing the monitored data. DATA LOGGER MODULE – provides support for storing the monitored data. VISULAIZATION MODULE – provides user interface for the supervisors VISULAIZATION MODULE – provides user interface for the supervisors

CSU - features Central System Unit Connection Manager Data Analysis Visualization Module Bluetooth Connection management Connection management Data processing Data processing Visualization Visualization Data recording Data recording Access verification Access verification Connection Manager Motivation What is BlueEyes ? Physiological foundations System design System implementation Future improvements Project work summary System demonstration ystem overview DAU CSU Data Logger

Data security Only registered mobile devices can connect to the system Only registered mobile devices can connect to the system Bluetooth connection authentication Bluetooth connection authentication Access rights restrictions Access rights restrictions Personal and physiological data encryption Personal and physiological data encryption Motivation What is BlueEyes ? Physiological foundations System design SecurityF uture improveme nt s Project work summary System demonstration

Current Developments BLUE EYE – EMOTIONAL MOUSE BLUE EYE – EMOTIONAL MOUSE MAGIC pointing MAGIC pointing BLUE EYE enabled SUITOR BLUE EYE enabled SUITOR Becomes active when the user makes an eye contact and automatically detect users area of interest and start searching it.

Pressure Pressure Galvanic skin response Galvanic skin response Skin temperature Skin temperature Heart beat Heart beat emotion mouse

geometric facial data extraction disgust 2. fear 3. joy 4. surprise 5. sadness 6. anger e-motion

Conclusion In the near future, ordinary household devices- such as television, refrigerators, ovens may be able to do their jobs when we look at them and speak to them. In the near future, ordinary household devices- such as television, refrigerators, ovens may be able to do their jobs when we look at them and speak to them. Future applications of blue eye technology is limitless Future applications of blue eye technology is limitless Reduces difference between human and computer Reduces difference between human and computer

QUESTIONS

Thank you Motivation What is BlueEyes ? Physiological foundations System design System implementation System demonstration Future improvements Project work summary