1. A Fuzzy Indexing and Retrieval System
Research Group on Intelligent Machines
A Fuzzy Indexing and Retrieval System
of Historic Mosaics
W. Maghrebi, M.A. Khabou, A. Ben Ammar, A.M. Alimi
 We propose a System for indexing and retrieval of mosaics. The system presents three principal moduls :
The segmentation modul : deals with the object boundary extraction using a fusion between edges and regions segmentation methods,
The mosaics DB indexing modul :we describe the mosaic image object with fuzzy textual information,
the retrieval modul : we request the mosaic DB with textual and drawing query.
The System description
Digitization
Filtring
Mosaics
Filtred DB
Object annotation
Background/ foreground separation using fusion of wang and kown thershold method
Fuzzy object features extraction
Boundary extraction : canny (adaptative threshold), Robert Gradient (Gray , hue and saturation), sobel and perwitt
Fuzzy object position : 3 horizontal position and three vertical ones
Fuzzy object relationships (e.g near, far_from, very_far_from, at_left,…)
Fuzzy object HSV color : 12 x 3 x 3 fuzzy color.
Segmentation modul
Indexing modul
Region detection: region growing
Fuzzy color region detection : fuzzy HVS Segmentation.
XML formalisation
Textuel Query
Query formalization
Salient results
User
XML DB
Shape fuzzy similarity
Drawing query
Retrieval modul
The System Results
(a)
(b)
(c)
(d)
(f)
(h)
(i)
(e)
(g)
(j)
(k)
(a) Original image (b) foreground/background separation (c) morpholigical operation to eliminate holes (d) background elimination (e ) boundary extraction using canny with adaptative thershold (f) object edge determintation (g) object contour (h) region growing (i) fusion of small and include region (j) fusion between homogenous and neighbours region (k) contour extracted from region segmentation
<classe_name>personne</classe_name>
  <object_descrip>homme+chasseur+qui+tient+un+batton</object_descrip>
- <centre_gravite>
  <x> </x>
  <y> </y>
  </centre_gravite>
- <position_objet>
  <degreh>1.0</degreh>
  <degrev>1.0</degrev>
  <position>droite bas</position>
  </position_objet>
  <surfaceobjet> </surfaceobjet>
  <pertinence> </pertinence>
  <Hue_histogram> </Hue_histogram>
- <Fuzzy_Color>
  <Color>black</Color>
  <Color>brown</Color>
  <Color>dark_brown</Color>
  <Color>dark_beige</Color>
  <Color>gray</Color>
  </Fuzzy_Color> DB
Precision (%)
Recall (%)
Squid 86 71
Mosaic 87 94
Object class
Recall rate (%)
Precision rate (%)
Person
85.7
60.0
Animal
83.0
45.5
Graphics
44.4
88.9
average
71.03
64.8
(d)
(a)
(b)
(c)
(a) Example of xml object description (b) Digital Museum textual GUI (c) Digital Museum drawing GUI (d) Experimental results