1. eNTERFACE 08 Project 9 “ Tracking-dependent and interactive video projection ” Mid-term presentation August 19th, 2008

2. Summary Sensor fusion for robust tracking: Tracking should be robust to severe illumination changes Modeling human motion attention of a visual scene: Regions of interest should be dynamically highlighted and visual effects corresponding to outstanding events should be displayed

3. Sensor fusion for robust tracking I) Real time segmentation (EyesWeb application) IR segmentation: tracking of the lights that are located on the participants hats OK Video segmentation: o extraction of color blobs from the participants’ hat OK o extraction of participants silhouette for gesture analysis OK

4. Sensor fusion for robust tracking

5. II) Common frame of reference (use of OpenCV library) Computation of the transform matrix (for projective and affine transforms) from selected points in the two images (IR and color ones): OK Projection of an image onto another space by means of the Projective Transformation Matrix: OK Video & IR fusion: camera problems (lens/resolution)….to be adapted Image from WarpPerspective EW block (original: 720*576). Projection of IR image onto Color image : Sensor fusion for robust tracking

6. Attentive system Get features and compute their attention Selection of motion features (speed/direction & contraction/energy): OK Get stable feature vectors through time: OK Get space/time features statistics: under development Implementation of a formula based on rarity & contrast to compute a feature vector attention index: OK (to be tested)

7. Attentive system

8. Conclusion We worked hard and we will work even harder : Most of the bricks needed to build the project are there Several scenarios for the final demo were set up: “Disapearing dancer” patch ! We will : Finalize image fusion by taking into account hardware issues Refine trajectory analysis of blobs and obtain their statistics Compute features attention index Connect the “Disapearing dancer” patch to the attention index for the final demo