SMART CAMERAS AS EMBEDDED SYSTEM SMVEC

SMART CAMERA  See, think and act  Intelligent cameras  Embedding of image processing algorithms  Can be networked together to a single host system SMVEC

Components  Image sensor  Image Digitalization circuitry  Image memory  Processor (often a DSP or suitably powerful processor)  Program- and data memory (RAM, nonvolatile FLASH)  Communication interface (RS232,Ethernet)  I/O lines (often optoisolated)  Lens holder or built in lens (usually C, CS or M-mount)  Built in illumination device (usually LED)  Purpose developed real-time operating system SMVEC

Standard smart Vision System SMVEC

ARCHITECTURE  Image sensor  Analog to Digital Electronics  Embedded processing electronics  Interface  Processed image data & Camera control SMVEC

Image sensor  Photons to electrons  Charge integration  Charges to voltage  Amplification of voltage  Analog output SMVEC

ADC  CCD analog output is converted to 8 channels  256 pixel element each  20MHz data rate for each sample  Camera data rate at 160MHZ SMVEC

Image processing PPerformed by embedded algorithm BLOCKS: PProcessing PLD FFIFO Memory BBuffer OOutput SMVEC

Image PROCESSING ARCHITECHTURE SMVEC

Processing PLD Programming logic Device Embedded with processing algorithm Micro processor has a bi-directional path Inputs Raw pixel data Timing and Control Signals SMVEC

FIFO  Acts as a Master Controller for Smart Camera SMVEC

Static Grey Scale Thresholding  Upper and Lower bound are established  Data of interest and non-interesting data  “Data of interest” are transmitted out of camera  Non-Interesting data are not transmitted.  Boundary values are in Grey Scale (0-255) SMVEC

EXAMPLE SMVEC

The static threshold algorithm is given by IF (PIXEL GRAY IS > (CENTER + UPPER)) OR (PIXEL GRAY IS < (CENTER – LOWER) ) THEN TRANSMIT PIXEL ELSE IGNORE PIXEL SMVEC

Embedded Image Processing Algorithm  Algorithms are embedded in hardware with PLD  Operates at 20MHZ data rate per channel  Effective Processing rate is 40MHZ  Each image processing PLD can process can process 2 channels of image data SMVEC

System Overview Consist of up to Twenty 2048 pixel High sensitivity line Transmissive Illumination is provided Makes use of fiber optic technology Data’s are captured from camera by frame grabber System Software controls the illumination source with a funny logic control scheme SMVEC

System Block Diagram

SMART CAMERAS ADVANTAGES  Cost  Simplicity  Integration  Reliability SMVEC

Applications  Automated inspection for quality assurance  Non contact measurements  Code reading and verification  Inspection of continuously flowing materials such as coils, tubes, wires, extruded plastic SMVEC

Applications  Detection of position and rotation of parts for Robot guidance and automated picking  Unattended surveillance  Biometric recognition and access control  visual sensor networks SMVEC

CONCLUSION SMVEC