National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALISATION BY LOPAMUDRA MOHAPATRA ( )

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS INTRODUCTION  What is blink detection?  What is eye tracking?  What is localization of eye?

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS  WHY WE GO FOR EYE LOCALIZATION Face normalization Eye gaze based human computer interface. For reading detection. Security systems using the human iris for identification.

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS PROPOSED PROTOCOL WHOLE METHOD EYETRACKING THRESHHOLDING FRAMEDIFFERENCING EYE LOCALIZATION

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS THRESH HOLDING

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS FRAME DIFFERENCING

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS FRAME DIFFERENCING

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS ALGORITHMS Steps in the blink detection (1) Obtain location of possible motion using Frame differencing. (2) Suitably thresh hold the motion regions and obtain blobs using morphological operation and connected components.

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS ALGORITHM CONTD…... (3) Remove unsuitable blobs that is either too big or too small or have incorrect width to height ratios to be considered as eyes. (4) Repeat (1) to (3) until a suitable pair of blobs are found and mark their positions. (5) Compute optical flow field in the blob regions (6)Mark dominant direction of motion of blobs.

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS Algorithm contd….. If the dominant motion is downward in a pair of blobs their positions are noted.These would represent eye closure during a blink. If the motion is not downward then steps (1) to (6) are repeated. (7) Repeat steps (1) to (6). (8)Discard blobs that are not suited near the location of the blobs found with downward motion.

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS Algorithm contd (8 ) Compute optical flow to ascertain if the dominant motion is upward with two ball remaining or repeat from step (7). (9) If the dominant motion is upward, then classify the frame beginning from the frame where downward motion was detected to the frame where upward motion was detected as blink frames. If after downward motion no upward motion is detected upto 3 frames it is considered as no blinks. Process of blink detection is started from newframe.

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS (10) The bounding boxes of the blobs where blink is deemed to have occurred is taken as eye detection. OPTICAL FLOW METHOD: It allows for the differentiation between vertical eyelid movements during blinks and movement of eyeball and horizotal head movements. EYE TRACKING : After the location of eyes tracking is done by using KLT tracker.

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS EYETRACKING In eye tracking mainly there are 20 feature points are taken,which gives the more accuracy. * These feature pts are taken from the eye area and they are tracked in different places,and reinitialization is done.

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS Results of eye tracking (a) eye region initialized (b) tracked eye regions to a movement just before blink.

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS COMPUTATION SPEEDUP To speed up localization we need to speed up in - Optical Flow - Eye tracking. EXPERIMENTAL RESULT : (1) Optical flow: 10 sec (2) Tracking of eyes : 10 sec (3) reading image from disk: 13 sec

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS CONCLUSION In this paper we have proposed an accurate and fast method for locating and tracking the eyes of a computer user situated in front of the monitor. By computing optical flow and using both the magnitude and direction of the flow vectors, we can differentiate blinking from the other motions. In this way our study completed.

National institute of science & technology BLINK DETECTION AND TRACKING OF EYES FOR EYE LOCALIZATION LOPAMUDRA CS THANK YOU!!!