The Extraction and Classification of Craquelure for Geographical and Conditional Based Analysis of Pictorial Art Mouhanned El-Youssef, Spike Bucklow, Roman.

Slides:



Advertisements
Similar presentations
Applications of one-class classification
Advertisements

Complex Networks for Representation and Characterization of Images For CS790g Project Bingdong Li 9/23/2009.
Fire Detection & Assessment Practical work E. Chuvieco (Univ. of Alcalá, Spain)
QR Code Recognition Based On Image Processing
Road-Sign Detection and Recognition Based on Support Vector Machines Saturnino, Sergio et al. Yunjia Man ECG 782 Dr. Brendan.
Automatic Video Shot Detection from MPEG Bit Stream Jianping Fan Department of Computer Science University of North Carolina at Charlotte Charlotte, NC.
Extended Gaussian Images
IDEAL 2005, 6-8 July, Brisbane Multiresolution Analysis of Connectivity Atul Sajjanhar, Deakin University, Australia Guojun Lu, Monash University, Australia.
Image Indexing and Retrieval using Moment Invariants Imran Ahmad School of Computer Science University of Windsor – Canada.
Quadtrees, Octrees and their Applications in Digital Image Processing
Shape and Dynamics in Human Movement Analysis Ashok Veeraraghavan.
RETRIEVAL OF MULTIMEDIA OBJECTS USING COLOR SEGMENTATION AND DIMENSION REDUCTION OF FEATURES Mingming Lu, Qiyu Zhang, Wei-Hung Cheng, Cheng-Chang Lu Department.
Pattern Recognition Topic 1: Principle Component Analysis Shapiro chap
CONTENT BASED FACE RECOGNITION Ankur Jain 01D05007 Pranshu Sharma Prashant Baronia 01D05005 Swapnil Zarekar 01D05001 Under the guidance of Prof.
Quadtrees, Octrees and their Applications in Digital Image Processing
Scale Invariant Feature Transform (SIFT)
Project IST_1999_ ARTISTE – An Integrated Art Analysis and Navigation Environment Review Meeting N.1: Paris, C2RMF, November 28, 2000 Workpackage.
Binary Image Analysis. YOU HAVE TO READ THE BOOK! reminder.
Smart Traveller with Visual Translator for OCR and Face Recognition LYU0203 FYP.
Face Processing System Presented by: Harvest Jang Group meeting Fall 2002.
Feature extraction Feature extraction involves finding features of the segmented image. Usually performed on a binary image produced from.
Scale-Invariant Feature Transform (SIFT) Jinxiang Chai.
1 Activity and Motion Detection in Videos Longin Jan Latecki and Roland Miezianko, Temple University Dragoljub Pokrajac, Delaware State University Dover,
Image Segmentation by Clustering using Moments by, Dhiraj Sakumalla.
Entropy and some applications in image processing Neucimar J. Leite Institute of Computing
Multiclass object recognition
Computer vision.
Lecture 19 Representation and description II
Prakash Chockalingam Clemson University Non-Rigid Multi-Modal Object Tracking Using Gaussian Mixture Models Committee Members Dr Stan Birchfield (chair)
OBJECT RECOGNITION. The next step in Robot Vision is the Object Recognition. This problem is accomplished using the extracted feature information. The.
Chapter 9.  Mathematical morphology: ◦ A useful tool for extracting image components in the representation of region shape.  Boundaries, skeletons,
General Tensor Discriminant Analysis and Gabor Features for Gait Recognition by D. Tao, X. Li, and J. Maybank, TPAMI 2007 Presented by Iulian Pruteanu.
Texture analysis Team 5 Alexandra Bulgaru Justyna Jastrzebska Ulrich Leischner Vjekoslav Levacic Güray Tonguç.
Access Control Via Face Recognition Progress Review.
Intelligent Vision Systems ENT 496 Object Shape Identification and Representation Hema C.R. Lecture 7.
COMPARISON OF IMAGE ANALYSIS FOR THAI HANDWRITTEN CHARACTER RECOGNITION Olarik Surinta, chatklaw Jareanpon Department of Management Information System.
COLOR HISTOGRAM AND DISCRETE COSINE TRANSFORM FOR COLOR IMAGE RETRIEVAL Presented by 2006/8.
Morphological Image Processing
Quadtrees, Octrees and their Applications in Digital Image Processing.
November 13, 2014Computer Vision Lecture 17: Object Recognition I 1 Today we will move on to… Object Recognition.
Handwritten Recognition with Neural Network Chatklaw Jareanpon, Olarik Surinta Mahasarakham University.
Face Recognition: An Introduction
CSCE 643 Computer Vision: Extractions of Image Features Jinxiang Chai.
Handwritten Hindi Numerals Recognition Kritika Singh Akarshan Sarkar Mentor- Prof. Amitabha Mukerjee.
Dengsheng Zhang and Melissa Chen Yi Lim
Singer similarity / identification Francois Thibault MUMT 614B McGill University.
CVPR2013 Poster Detecting and Naming Actors in Movies using Generative Appearance Models.
Ivica Dimitrovski 1, Dragi Kocev 2, Suzana Loskovska 1, Sašo Džeroski 2 1 Faculty of Electrical Engineering and Information Technologies, Department of.
Face Image-Based Gender Recognition Using Complex-Valued Neural Network Instructor :Dr. Dong-Chul Kim Indrani Gorripati.
GENDER AND AGE RECOGNITION FOR VIDEO ANALYTICS SOLUTION PRESENTED BY: SUBHASH REDDY JOLAPURAM.
Speech Lab, ECE, State University of New York at Binghamton  Classification accuracies of neural network (left) and MXL (right) classifiers with various.
Timo Ahonen, Abdenour Hadid, and Matti Pietikainen
CS654: Digital Image Analysis
2D-LDA: A statistical linear discriminant analysis for image matrix
1 Review and Summary We have covered a LOT of material, spending more time and more detail on 2D image segmentation and analysis, but hopefully giving.
Sheng-Fang Huang Chapter 11 part I.  After the image is segmented into regions, how to represent and describe these regions? ◦ In terms of its external.
Content Based Coding of Face Images
COMP 9517 Computer Vision Binary Image Analysis 4/15/2018
Medical Image Analysis
Automatic Video Shot Detection from MPEG Bit Stream
IMAGE PROCESSING RECOGNITION AND CLASSIFICATION
Traffic Sign Recognition Using Discriminative Local Features Andrzej Ruta, Yongmin Li, Xiaohui Liu School of Information Systems, Computing and Mathematics.
COMP 9517 Computer Vision Segmentation 7/2/2018 COMP 9517 S2, 2017.
PRESENTED BY Yang Jiao Timo Ahonen, Matti Pietikainen
Mean Shift Segmentation
Multiscale Feature Identification in the Solar Atmosphere
Scale-Space Representation of 3D Models and Topological Matching
Object Recognition Today we will move on to… April 12, 2018
Aline Martin ECE738 Project – Spring 2005
Research Institute for Future Media Computing
Presentation transcript:

The Extraction and Classification of Craquelure for Geographical and Conditional Based Analysis of Pictorial Art Mouhanned El-Youssef, Spike Bucklow, Roman Gr. Maev

Background Craquelure represents the unique crack formations on paintings that is related to the materials and methods employed by the artist Paintings from a particular geographical area tend to exhibit similar trends in their craquelure patterns Craquelure is of important interest to art conservators for they indicate the condition of the painting and areas potentially exhibiting mechanical stress

Background Image courtesy of Dr. Bucklow French Painting – Smooth crack lines – Curved – Large Islands

Background Image courtesy of Dr. Bucklow Flemish Painting – Jagged crack lines – Ordered and straight – Small Islands

Objectives To develop a craquelure analysis algorithm capable of classifying each craquelure pattern to their corresponding region of origins To establish a crack monitoring system that will monitor and track the growth of cracks over the course of a painting’s life

Agenda 1)Project Outline 2)Crack Extraction Techniques 3)Crack Hierarchal Representation 4)Feature Extraction/Dimension Reduction 5)Classification 6)Crack Monitoring System 7)Questions and Discussion

Project Outline

Crack Extraction Techniques Mathematical Morphology is used to extract crack lines from an image Mathematical Morphology consists of four operations: – Dilation – Erosion – Closing (Dilation Erosion) – Opening (Erosion Dilation)

Flash Video

Mathematical Morphology

Crack Extraction Techniques: Thresholding Global thresholding Segmented thresholding Offset Thresholding The greyscale image then needs to be thresholded to a binary image. Three general thresholding techniques:

Global Thresholding

Segmented Thresholding

Offset Thresholding

Comparison Global ThresholdSegmented ThresholdOffset Threshold

Crack Hierarchal Representation After crack extractions, a line following algorithm is applied to the image A sequence of numbers (chain code) is recorded based on the crack direction Edge points, node points and line lengths are determined in a hierarchal fashion

Crack Hierarchal Representation An illustration of the crack following algorithm is displayed below: Crack Following Algorithm: Each neighbouring pixel is assigned a number value The crack line above would display the following chain code:

Crack Hierarchal Representation After applying the crack following algorithm, our crack pattern is structured in terms of nodes, edges, lines and distances The green lines in the figure are crack lines that form an island (a closed loop). Red pixels represent nodes and yellow pixels represent edge points.

Feature Extraction The length of each individual line segment is calculated during the hierarchal representation of the crack pattern Various other features are extracted from the network A histogram is obtained by tallying the direction vectors in the chain code The number of islands is calculated within a crack network

Feature Extraction Overall features extracted are: Number of Islands Node density Edge density Directionality Histogram Distance between nodes Straight line to actual line ratio Line Jaggedness Lines per node Average line length

Feature Extraction Line size is calculated as: Straight line to actual line ratio: Line Significance:

Feature Extraction Flemish Craquelure Italian Craquelure Dutch Craquelure French Craquelure

Dimension Reduction Reducing the dimensions of a feature space is necessary before classification Principle Component Analysis (PCA) as well as Linear Discriminant Analysis (LDA) is used for feature reduction The Fisher ratio test is used to determine which variable best discriminates between classes

Classification After dimension reduction, the features were fed into a Linear Discriminatory Analysis (LDA) classifier for classification The results were found to be: Predicted Class ClassFlemishFrenchItalianDutch Actual Class Flemish67.0%0%12.5%20.5% French0%92.5%6.0%1.5% Italian22.5%10%59.0%8.5% Dutch34%0%6.0%60.0%

Crack Monitoring System The crack monitoring system is used to monitor the growth of cracks on the surface to determine the “health” of a painting. The monitoring system must be: Must be rotation invariant Must be scale invariant Must be robust

Crack Monitoring System Present1 year ago

Crack Monitoring System

Conclusions A framework for the classification of craquelure patterns has been established A health monitoring system can be used to detect and monitor the growth of cracks in paintings

Future Work Expand on the classification process by investigating alternative techniques Continue building a database of craquelure images for different types of paintings (ie. French, Dutch..) Refine the health monitoring algorithm and develop a set of acquisition constraints

Questions and Discussion

Refrences [1] Spike Bucklow, "The Description of Craquelure Patterns," Studies in Conservation, vol. 42, no. 3, pp , [2] Alexandra Moxley, "The Art of Fogery," The Undergraduate Scholar, pp. 1-10, [3] Spike Bucklow, "A Stylometric Analysis of Craquelure," Computers and the Humanities, vol. 31, pp , [4] Fazly Salleh Abas, "Analysis of Craquelure Patterns for Content-Based Retrieval," University of Southampton, Southampton, PhD Thesis [5] Irene Crisologo, Chrisopher Monterola, and Maricor Soriano, "Statistical Feature- based Craquelure Classification," International Journal of Modern Physics C, vol. 22, no. 11, pp , September [6] P. Willigen, A Mathematical Study on Craquelure and other Mechanical Damage in Paintings, E Klerk and H. Maaren, Eds. Dellf, The Netherlands: Delft Univeristy Press, [7] W. Stanley Taft and James W. Mayer, The Science of Paintings. New York, USA: Springer-Verlag, 2000.