Play game, pause video, move cursor… with your eyes

Slides:



Advertisements
Similar presentations
Artificial passenger.
Advertisements

Igor Markov Face Detection and Classification on Mobile Devices.
Hand Gesture for Taking Self Portrait Shaowei Chu and Jiro Tanaka University of Tsukuba Japan 12th July 15 minutes talk.
The future of mobile photography is here Meet MMCam: Designed to improve the quality of mobile photography, MMCam offers mobile users a better experience:
Virtual Dart: An Augmented Reality Game on Mobile Device Supervisor: Professor Michael R. Lyu Prepared by: Lai Chung Sum Siu Ho Tung.
MUltimo3-D: a Testbed for Multimodel 3-D PC Presenter: Yi Shi & Saul Rodriguez March 14, 2008.
The PULSE: SAAS (Software as a Service) By Debjit Biswas, ,
Video Surveillance Capturing, Management and Analysis of Security Videos. -Abhinav Goel -Varun Varshney.
MACHINE VISION GROUP Multimodal sensing-based camera applications Miguel Bordallo 1, Jari Hannuksela 1, Olli Silvén 1 and Markku Vehviläinen 2 1 University.
Eye tracking: principles and applications 廖文宏 Wen-Hung Liao 12/10/2009.
Sixth Sense Technology. Already existing five senses Five basic senses – seeing, feeling, smelling, tasting and hearing.
The Camera Mouse: Visual Tracking of Body Features to Provide Computer Access for People With Severe Disabilities.
HiTrack Introduction Shanghai Zhuo-Shi Software Technology Co., Ltd Shanghai Zhuo-Shi Software Technology Co., Ltd
FRITZ SCHNEIDERPEACHAM CYBERNETICS Introduction To Digital Photography II – Camera Features.
Live Demo Augmented reality – lets see some pictures flying…Augmented reality – lets see some pictures flying… Facebook -Facebook -
Counting How Many Words You Read
GOOGLE GLASS TECHNOLOGY. Project Glass is a research and development program by Google to develop an augmented reality Head Mounted display (HMD). The.
Markerless Augmented Reality Platform Design and Verification of Tracking Technologies Author:J.M. Zhong Date: Speaker:Sian-Lin Hong.
Functions and Features: Advantages : Disadvantages and Limitations : Price:
VIDEO COMPOSITION. Why do we care about composition? Keeps the viewers attention in the right place Provides continuity.
A facial recognition system is a computer application for automatically identifying or verifying a person from a digital image or a video frame from.
AUGMENTED REALITY VIJAY COLLEGE OF ENGG. FOR WOMEN PRESENTED BY…….
Mobile eye tracker construction and gaze path analysis By Wen-Hung Liao 廖文宏.
Video Quality Lens Once you have selected a camera, the next step is to select the appropriate lenses and any other relevant components necessary in the.
How to Recover Deleted System Apps on Android? /recovrdroiddata /Android-Data-Recovery /alexwaston14/android-news/ /channel/UC78X71c6EY-3gboc8qP6a9Q.
Lecture Input Devices Keyboard. Mouse Microphone Digital Camera Scanner.
Android Application Development Company India
HD-SDI COLOR IR LED CAMERA
Framing The Joker By the end of the lesson you will have an understanding of how the framing in the opening sequence place the Joker as the villain.
EYE TRACKING TECHNOLOGY
A device tat transfers data from the outside world into a computer
Day 3: computer vision.
Hand Gestures Based Applications
SIXTH SENSE TECHNOLOGY
Camera Basics.
Introduction to Skin and Face Detection
Intelligent Face Recognition
Multimedia Terminology.
Goal: To understand what it will take to find another “Earth”
CHAITANYA INSTITUTE OF SCIENCE AND TECHNOLOGY
Fingerprint Smartphone
The design of smart glasses for VR applications The CU-GLASSES
Personal Digital Devices Lesson 1
Introduction and examples
MSC projects for for CMSC5720(term1), CMSC5721(term2)
Augmented Reality And Virtual Reality.
Hands-free Eyes-free Text Messaging
Introduction to Digital Photography
Google translate app demo
Submitted by imtiaz hussain BBE/785.
FACE DETECTION USING ARTIFICIAL INTELLIGENCE
Film Studies Need to Know (Or what I should have gotten 1st Semester)
Classroom Digital Camera
Receiving your new Microsoft Surface Pro 4
Cinematic Elements …as they relate to Film.
WinHEC Online & Fall Creators Update Overview
Senior Capstone Project Gaze Tracking System
To be supervised by Prof. KH Wong
Basic Camera Settings.
Lenses Are classified by their Focal Length.
Get to Know Your Camera.
Android App Developing with communication included
Chapter 1: Image processing and computer vision Introduction
Getting to Know Your Digital Camera
眼動儀與互動介面設計 廖文宏 6/26/2009.
Introduction to Digital Photography
1.
Tracking the Eyes using a Webcam
Copyright Tobii Technology, Inc.
Presentation transcript:

Play game, pause video, move cursor… with your eyes HiTrack Introduction Play game, pause video, move cursor… with your eyes www.sightsoft.cn 2013. 7. 20

HiTrack eye/head tracking Use front-camera to detect pupil center, Track the movement of eyes and head. Users can play game, move cursor… Speed >10 frames per second Accuracy Location accuracy: 100*100 Robust to light 重视

SightPlane http://sightsoft.cn/fe.apk 1 Move faster Move plane with your eyes. 2 Eye pausing Automatically pause the game when look away 重视

Augmented Reality http://sightsoft.cn/ar.apk 1 Watching picture, pop up a 3-dimensional space scene 2 Roaming in space with eyes 重视

Eye pausing pause when look away Some scenes http://sightsoft.cn/se.apk pause when look away Some scenes 1) Looked up to see if the station on the subway, the phone automatically pauses the movie. 2)Automatically pause games when leave for a while.

Eye self-shot Automatic photo when staring at the screen Some scenes http://sightsoft.cn/se.apk Automatic photo when staring at the screen Some scenes No need to touch any button to take photos, only staring 1-2 seconds. So release your hands. Most natural way to start camera. 重视

Eye zooming Size vary with eyes' distance to screen. Some scenes http://sightsoft.cn/se.apk Size vary with eyes' distance to screen. Some scenes 1) Video gets smaller when close to the screen, for privacy. 2) Text gets bigger when close to the screen, suitable for elderly. 重视

*Focus statistics Get users’ real-time focus and attention data Some scenes 1) Analyze students' attention for Online Education. 2) Get millions video audiences’interest and focus. *Available in next version 重视

*Eye unlocking Use iris recognition to unlock the screen . Some scenes 1) Pick up a locker phone, automatically unlock after user looked at it. 2) Automatically lock the phone when detect a stranger’s eye. *Need infrared camera 重视

Accurate Eye Center Location Key Feature 1 Accurate Eye Center Location Use reliable method to locate the iris border, which is the most notable feature in visible-spectrum eye images. Use fast and robust detectors to find the center of pupil. Support complicated illumination conditions Support different pose.

Example: Dark face + Look up Key Feature 1 Example: Dark face + Look up Dark face Look up illumination compensation left eye right eye Detect result white rectangle contains detected face white cross is the eye position

Fast Key Feature 2 Detect one frame < 0.1 second in most phone. Eye blink 0.3 second Detect one frame < 0.1 second in most phone. Use many highly optimized detectors, which are 10 times faster than standard algorithm.

completely Software-based Key Feature 3 completely Software-based Easy integration in Android and other systems. Only need hardware is 0.3 Megapixel camera, which is satisfied by most devises. Complete documentation. Many demos with source code. Only need 10 lines of code to implement some amazing eye control function.

Key Feature 3 Only 4 lines to implement eye-pausing function. //1 Create HiTrack instance hitrack = HiTrackerPreview.newInstance( null,0x0 ); //2 set Listener hitrack.setSightListener( new HiTracker.SightListener() { @Override public void onSightLeave(long time, int flag) { //3 pause video when look away pauseVideo( time,0x0 ); } public void onSightEnter(long time, int flag) { //4 play video when look at the screen playVideo( ); } );

Key Feature 4 Robust to Light Complex illumination environment HiTrack use a novel O(n) illumination compensation algorithm. In very strong sidelight, increase the accuracy from 30% to 70%.

Low Power Consumption Key Feature 5 Dynamic FPS tracking frames vary from 2-20 per second. Only need 1/10 power consumption in low fps mode. For example: 2 fps is right for eye-pausing.

www.sightsoft.cn expert at fast and robust image processing Face detection Eye Tracking Image Search Many years’hard working and coding at fast and robust image processing in the real uncontrolled environments. Novel patents on real-time eye tracking at mobile device.

Eye tracking for the future www.SightSoft.cn MAIL: cys@sightsoft.cn WeChat: grusoft QQ: 304718494