Download presentation
Presentation is loading. Please wait.
Published byAlbert Richard Powell Modified over 9 years ago
1
Learning Object Representation Andrej Lúčny Department of Applied Informatics Faculty of Mathematics, Physics and Informatics Comenius University, Bratislava andy@microstep-mis.com www.microstep-mis.com/~andy
2
Regular objects few parameters fully describe the object recognize object = specify its parameters
3
Regular objects e.g. Hough transform Conversion of image to parameters
4
Image Three arrays r[h,w], g[h,w], b[h,w], values 0..255 corresponding to color ingredients
5
Red ingredient
6
Green ingredient
7
Blue ingredient
8
Intensity map bw[i,j] = 0.3*r[i,j] + 0.59*g[i,j] + 0.11*b[i,j]
9
Looking for edges: one line can be represented as a function
10
column intensity Edges corresponds to sharp sectors
11
Sobel operator a i-1,j-1 a i-1,j a i-1,j+1 a i,j-1 a i,j a i,j+1 a i+1,j-1 a i+1,j a i+1,j+1 b i,j 01 -202 01 º = dx i,j = a i-1,j+1 + 2a i,j+1 + a i+1,j+1 - a i-1,j-1 - 2a i,j-1 - a i+1,j-1 a i-1,j-1 a i-1,j a i-1,j+1 a i,j-1 a i,j a i,j+1 a i+1,j-1 a i+1,j a i+1,j+1 b i,j -2 000 121 º = dy i,j = a i+1,j-1 + 2a i+1,j + a i+1,j+1 - a i-1,j-1 - 2a i-1,j – a i-1,j+1
12
Sobel operator approximated image derivation (gradient) Concerning a threshold Sobel operator indicates us edges threshold
13
Sobel operator |dx||dy|
14
Sobel operator |grad| = √ (dx + dy ) 2 2
15
Binary image
16
Thinning ?? ? ? ?? ? ? ? ??? ?? ? ?? ? ??
18
Hough transform Example: Circle Task: how to turn thinned image to circle parameters Paramaters: center x-coordinate center y-coordinate radius x y r
19
Hough transform Each parameter has a particular range E.g. for image with resolution 320 x 240 : Range of center x-coordinate is 0..319 Range of center y-coordinate is 0..239 Range of radius is 10..200 We evaluate probability of each tupple (x,y,r) from the given range
20
Hough transform x y The probability P[x,y,r] is given by number of witnesses, i.e. white pixels on thinned image which would be white if one draws circle with parameters x,y,r. r
21
Hough transform Circle is recognized !
22
Irregular objects Parameters of irregular objects are not clear ! It is better look an universal method how to learn their representation
23
Irregular objects e.g. Dominant orientation templates How such objects are represented?
24
Simple but fast and efficient method Dominant orientation templates (DOT)
25
Motivation template image dealing with thinned edges
26
Edges detector Canny intensity |gradient| orientations |dx| thinned edges |dy|
27
Orientations (dx, dy) 0 1 2 34 5 6 7
28
Template based on the orientations
29
Template object is covered by non-overlapping regions
30
Template We concern orientation of any pixel in region, which lies on edge
31
Template We select set of dominant (prevailing) orientations
32
Template We have such set of few dominant templates for each region
33
Template The sets of dominant orientations form the representation of the object
34
How to use the template We cover image by regions and select one most dominant orientation for each region template image
35
How to use template Object is found if for the most of regions the dominant orientation from image is an element of the set of dominant orientations in template templateimage
36
Basic formal expression I – current image O – image from which the template is created c – position on the image I R – region c + R – corresponding region put to position c DO( O, R ) : set of (maximally k) dominant orientations in region R in template, i.e. on the image O do( I, R ) : dominant orientation in region R in the current image I do( X, R ) = DO( X, R ) for k = 1 δ(x) = x ? 1 : 0 where x is true or false
37
Does it work ? Yes, if we put region R to proper position c No, otherwise Therefore we will need more templates for various positioning of regions templates positions …
38
Advanced formal expression I – current image O – image from which the template is created w(O,M) – image O shifted by M c – position on the image I R – region, c + R – corresponding region put to position c DO( O, R ) : set of (maximally k) dominant orientations in region R in template, i.e. on the image O do( I, R ) : dominant orientation in region R in the current image I δ(x) = x ? 1 : 0 where x is true or false
39
More effective but less precise approach We can summarize more overlapping templates to one. We simply add orientations from overlapping regions. Such template must fit regardless shifting, but can detect also phantoms integrated template templates …
40
Formalism of the efficient approach I – current image O – image from which the template is created w(O,M) – image O shifted by M c – position on the image I R – region, c + R – corresponding region put to position c DO( O, R ) : set of (maximally k) dominant orientations in region R in template, i.e. on the image O do( I, R ) : dominant orientation in region R in the current image I δ(x) = x ? 1 : 0 where x is true or false =
41
More viewpoints Still one template represents the object from one viewpoint only Therefore we need to create more templates from various viewpoints Again we can integrate more templates which are similar enough to one (in the same way as shifted templates)
42
DOT efficiency Belonging of orientation to a template can be represented by bits 0 or 1 and all DOT can be expressed in form of bit operations Therefore DOT is very fast and running in real time
43
Object border DOT can provide also approximate border of the object. It is created by those edge pixels for which we have found their orientation in the template
44
How to get template? Scan object put to contrast scene by camera from various viewpoints (i.e. not in the natural scene but under specific conditions) or separate object from scene by another method (e.g. by movement detector)
45
Failure of recognition pattern 1. 2. Failure or creativity ? phantom
46
Further study Hinterstoisser, S. - Lepetit, V. - Ilic, S. - Fua, P. - Navab, N.: Dominant Orientation Templates for Real-Time Detection of Texture-Less Objects. IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, California (USA), June 2010
47
Thank you ! Andrej Lúčny Department of Applied Informatics Faculty of Mathematics, Physics and Informatics Comenius University, Bratislava andy@microstep-mis.com www.microstep-mis.com/~andy
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.