Traffic Sign Identification Team G Project 15. Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman.

Slides:



Advertisements
Similar presentations
Patient information extraction in digitized X-ray imagery Hsien-Huang P. Wu Department of Electrical Engineering, National Yunlin University of Science.
Advertisements

By: Mani Baghaei Fard.  During recent years number of moving vehicles in roads and highways has been considerably increased.
A Graph based Geometric Approach to Contour Extraction from Noisy Binary Images Amal Dev Parakkat, Jiju Peethambaran, Philumon Joseph and Ramanathan Muthuganapathy.
Road-Sign Detection and Recognition Based on Support Vector Machines Saturnino, Sergio et al. Yunjia Man ECG 782 Dr. Brendan.
Chamfer Distance for Handshape Detection and Recognition CSE 6367 – Computer Vision Vassilis Athitsos University of Texas at Arlington.
Evaluating Color Descriptors for Object and Scene Recognition Koen E.A. van de Sande, Student Member, IEEE, Theo Gevers, Member, IEEE, and Cees G.M. Snoek,
November 12, 2013Computer Vision Lecture 12: Texture 1Signature Another popular method of representing shape is called the signature. In order to compute.
Image Segmentation Image segmentation (segmentace obrazu) –division or separation of the image into segments (connected regions) of similar properties.
Facial feature localization Presented by: Harvest Jang Spring 2002.
Color Image Processing
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
Yiming Zhang SUNY at Buffalo TRAFFIC SIGN RECOGNITION WITH COLOR IMAGE.
COMP322/S2000/L181 Pre-processing: Smooth a Binary Image After binarization of a grey level image, the resulting binary image may have zero’s (white) and.
Real-time Embedded Face Recognition for Smart Home Fei Zuo, Student Member, IEEE, Peter H. N. de With, Senior Member, IEEE.
3. Introduction to Digital Image Analysis
A Study of Approaches for Object Recognition
Processing Digital Images. Filtering Analysis –Recognition Transmission.
Segmentation Divide the image into segments. Each segment:
Example-Based Color Transformation of Image and Video Using Basic Color Categories Youngha Chang Suguru Saito Masayuki Nakajima.
Traffic Sign Recognition Jacob Carlson Sean St. Onge Advisor: Dr. Thomas L. Stewart.
An Approach to Korean License Plate Recognition Based on Vertical Edge Matching Mei Yu and Yong Deak Kim Ajou University Suwon, , Korea 指導教授 張元翔.
Highlights Lecture on the image part (10) Automatic Perception 16
A Self-Organizing Approach to Background Subtraction for Visual Surveillance Applications Lucia Maddalena and Alfredo Petrosino, Senior Member, IEEE.
Stockman MSU Fall Computing Motion from Images Chapter 9 of S&S plus otherwork.
Smart Traveller with Visual Translator. What is Smart Traveller? Mobile Device which is convenience for a traveller to carry Mobile Device which is convenience.
Redaction: redaction: PANAKOS ANDREAS. An Interactive Tool for Color Segmentation. An Interactive Tool for Color Segmentation. What is color segmentation?
Lecture 6: Feature matching and alignment CS4670: Computer Vision Noah Snavely.
CS 376b Introduction to Computer Vision 04 / 02 / 2008 Instructor: Michael Eckmann.
1 Mean shift and feature selection ECE 738 course project Zhaozheng Yin Spring 2005 Note: Figures and ideas are copyrighted by original authors.
OBJECT RECOGNITION. The next step in Robot Vision is the Object Recognition. This problem is accomplished using the extracted feature information. The.
SSIP 2003 Project suggestions. Project 1  Label the group photo- locate and identify faces and label them.  * Input group photo ( for example 10 people)
Digital Image Processing & Analysis Spring Definitions Image Processing Image Analysis (Image Understanding) Computer Vision Low Level Processes:
Intelligent Vision Systems ENT 496 Object Shape Identification and Representation Hema C.R. Lecture 7.
Introduction EE 520: Image Analysis & Computer Vision.
Digital Image Processing CCS331 Relationships of Pixel 1.
Lecture 7: Features Part 2 CS4670/5670: Computer Vision Noah Snavely.
Fourier Descriptors For Shape Recognition Applied to Tree Leaf Identification By Tyler Karrels.
1 Research Question  Can a vision-based mobile robot  with limited computation and memory,  and rapidly varying camera positions,  operate autonomously.
Autonomous Robots Vision © Manfred Huber 2014.
Jack Pinches INFO410 & INFO350 S INFORMATION SCIENCE Computer Vision I.
Vision and Obstacle Avoidance In Cartesian Space.
Counting windows Project participants (in alphabetical order): Akif Durdu Middle East Technical University, Turkiye Viktor Jónás Budapest Polytechnic,
1 Machine Vision. 2 VISION the most powerful sense.
By Pushpita Biswas Under the guidance of Prof. S.Mukhopadhyay and Prof. P.K.Biswas.
Intelligent Robotics Today: Vision & Time & Space Complexity.
Image Segmentation Image segmentation (segmentace obrazu)
Instructor: Mircea Nicolescu Lecture 5 CS 485 / 685 Computer Vision.
Digital Image Processing CSC331
Color Image Segmentation Mentor : Dr. Rajeev Srivastava Students: Achit Kumar Ojha Aseem Kumar Akshay Tyagi.
1 Shape Descriptors for Maximally Stable Extremal Regions Per-Erik Forss´en and David G. Lowe Department of Computer Science University of British Columbia.
Digital Image Processing CCS331 Relationships of Pixel 1.
License Plate Recognition of A Vehicle using MATLAB
Optical Character Recognition
Coin Recognition Using MATLAB - Emad Zaben - Bakir Hasanein - Mohammed Omar.
EE368 Final Project Spring 2003
Course : T Computer Vision
A Plane-Based Approach to Mondrian Stereo Matching
Color Image Processing
Color Image Processing
Recognition of biological cells – development
Traffic Sign Recognition Using Discriminative Local Features Andrzej Ruta, Yongmin Li, Xiaohui Liu School of Information Systems, Computing and Mathematics.
Color Image Processing
Feature description and matching
Computer Vision Lecture 4: Color
Color Image Processing
Aim of the project Take your image Submit it to the search engine
Aline Martin ECE738 Project – Spring 2005
Color Image Processing
Midterm Exam Closed book, notes, computer Similar to test 1 in format:
Midterm Exam Closed book, notes, computer Similar to test 1 in format:
Presentation transcript:

Traffic Sign Identification Team G Project 15

Team members Lajos Rodek-Szeged, Hungary Marcin Rogucki-Lodz, Poland Mircea Nanu -Timisoara, Romania Selman Kulac-Ankara, Turkey Zsolt Husz-Timisoara, Romania

Lajos Rodek Sign recognition ideas Sign library preparation Presentation Lots of laughing

Marcin Rogucki Sign recognition coding Sign recognition ideas Sign detection ideas Presentation

Mircea Nanu Sign detection ideas Sign detection coding Web page preparation Moral support and jokes

Selman Kulac Gathering sign images General ideas Presentation

Zsolt Husz Sign detection coding Sign detection ideas Picture acquisition Many, many testing

Our goal Final goal: to detect and identify all traffic sign in arbitrary images

Assumptions No human interaction No preprocessing of the image Flexible handling of images Image is not rotated by more than 30 degrees Images can contain any number of signs or no signs at all Only daylight images are taken At most ¼ of a sign may be covered No background constrains / limitations

General program idea Program consists of two separated problems: Detecting signs on the image Recognizing detected regions of possible sign locations

Sign detection 1 Signs features: Well defined colors with high saturation They are rather homogenous Sharp contours Known basic shapes Allowed colors: Red, blue (dominant colors) Yellow Green (very rare) White, black (found mostly inside of signs)

Sign detection 2 Main steps: Edge detection (3 by 3 Sobel) Converting image to HSV color space Reducing number of colors Segmentation relying on the color Marking probable signs with boundary boxes Joining adjacent regions Removing background

Sign detection 3 Region database Region joining Border extraction Input Sobel Conversion to grayscale Region extension Color detection Conversion to HSV Output

Sign recognition 1 Input: Picture containing at most one sign (subrange of the original image) with eliminated background Sign templates and names Output: Sign name in case it is a traffic sign Localization on the image

Sign recognition 2 Tasks: Detecting the shape of a sign Finding corners if necessary Transforming the shape (Perspective/rotation  Facing/upright) Color unification Comparison with templates

Sign recognition 3 Detecting the shape: Building a chain code Computing angles between vectors Checking number of the corners Defining a shape (triangle,square,circle)

Sign recognition 4 Finding corners: “Charged particles” based approach Particles run away from each other and locate corners as furthest possible points in the figure

Sign recognition 5 Transforming the sign: Inverse texture mapping according to the corners and shape

Sign recognition 6 Color unification: Simplifying colors depending on similarity Allowed colors: Red, green, blue, yellow, white, black, background (pink) Computing a histogram

Sign recognition 7 Comparison with a template: Normalized histograms are compared resulting in a RMS measure Raster pictures are compared pixel by pixel Probability based decision

Results 1

Results 2

Results 3

Achievements Everything works fine Every team member is happy Signs are detected and recognized correctly in most cases All assumptions are met Works even in unusual cases (e.g. night pictures)

Future improvements Better reliability with fast motion blurring More independency with illumination Robustness on sign detection (fine-tuning the heuristically adopted constrains) Better library templates Speed-ups Adaptation for a sequence of images

Thank you for your attention!

References Intel, “Intel Image Processing Library, Reference Manual”, 2000, Intel, “Open Computer Vision Library, Reference Manual”, 2001, D. A. Forsyth, J. Ponce, “Computer Vision: A Modern Approach”, Prentice Hall, 2003 George Stockman, Linda G. Shapiro, “Computer Vision”, Prentice Hall, 2001