4th European Micro-UAV Meeting Sept. 15-17, 2004 Generic Visual Perception Processor GVPP www.gvpp.org

Topic Generic Visual Perception Processor Real time processing CAMERA Action 4 adaptive properties Real time processing Detect persons, objects and events by temporal coincidence with unsupervised collective decision Track persons and objects in the image with anticipation of their motions Learning by example.

Understanding Introduction Perception GVPP Imaging processing Action Imaging processing Perception Understanding Action Power IP GVPP Nb. frames/seconds

Method - 1 Method - 1

Method - 2

Method - 3

Method - 4

Histogram Registers RMAX RMAX/2 NBPTS MIN POSMOY POSRMX MAX

A generic Spatio-Temporal Neuron STN block API REG Registers API Bus par. Time-Coincidences Bus PARAM Reg. FoG D F: automatic Classification G: Anticipation

Self Action STN MVT STN X-Y FoG Z NBPTS Initial ROI Final ROI TEMPORAL DOMAIN SPATIAL DOMAIN WHAT and WHERE* STN MVT STN X-Y FoG Z MOTION NBPTS Initial ROI Final ROI

Motion Perception

Self Organization - 1 Motion Perception

Self Organization - 2 Recruitment Color Analysis

Self Organization - 3 Main Color Found Inhibition No Main Color Analysis On the Main Area Tree generation For Labeling

Self Organization - 4 Improvement

Self Organization - 5 Face Organization Labeled and learned Perception/Synthesis

Eyes Tracking

Generic Visual Perception Processor

GVPP – System on a Chip

A LONG STORY 1986 2000 One statistic computation One System on Chip with 23 statistics computations

2004 GVPP7-B

ANTICIPATION

Lines Perception

EDGE ORIENTATION FLOW

CURVES FLOW

Horizon Perception

STABILIZATION

Automotive Application

Game on TV

GVPP7-B

PRELIMINARY INFORMATION Array Format (max): 800Hx600V max Frame Rate: 0-100 VGA frames per second progressive-scan Interface Mode: Master/Slave Data Rate (max): 40 mega pixel per second Dynamic Range: 10-bits Parameters: Luminance, Hue, Saturation, Motion (orientation, velocity), Spatial lines orientation,curves,corners Computation: 64 STN blocks Multi-scales possibilities Internal OS C language 0.5 Watt 3.3 Volts @ 13.5MHz Interface: PCI, I2C, RS232

GVPP road map

The Robotic Future

www.gvpp.org Thanks you for your attention