Color Space for Skin Detection – A Review

Slides:



Advertisements
Similar presentations
Matthias Wimmer, Bernd Radig, Michael Beetz Chair for Image Understanding Computer Science TU München, Germany A Person and Context.
Advertisements

Road-Sign Detection and Recognition Based on Support Vector Machines Saturnino, Sergio et al. Yunjia Man ECG 782 Dr. Brendan.
Evaluating Color Descriptors for Object and Scene Recognition Koen E.A. van de Sande, Student Member, IEEE, Theo Gevers, Member, IEEE, and Cees G.M. Snoek,
Wen-Hung Liao Department of Computer Science National Chengchi University November 27, 2008 Estimation of Skin Color Range Using Achromatic Features.
 Image Characteristics  Image Digitization Spatial domain Intensity domain 1.
Computer Vision Chapter 6 Color.
Image Processing IB Paper 8 – Part A Ognjen Arandjelović Ognjen Arandjelović
Color spaces CIE - RGB space. HSV - space. CIE - XYZ space.
COLORCOLOR A SET OF CODES GENERATED BY THE BRAİN How do you quantify? How do you use?
AlgirdasBeinaravičius Gediminas Mazrimas Salman Mosslem.
Color Image Processing
Light Light is fundamental for color vision Unless there is a source of light, there is nothing to see! What do we see? We do not see objects, but the.
The Viola/Jones Face Detector (2001)
Modeling Pixel Process with Scale Invariant Local Patterns for Background Subtraction in Complex Scenes (CVPR’10) Shengcai Liao, Guoying Zhao, Vili Kellokumpu,
HCI Final Project Robust Real Time Face Detection Paul Viola, Michael Jones, Robust Real-Time Face Detetion, International Journal of Computer Vision,
Motion Detection And Analysis Michael Knowles Tuesday 13 th January 2004.
1 Color Segmentation: Color Spaces and Illumination Mohan Sridharan University of Birmingham
A Study of Approaches for Object Recognition
Processing Digital Images. Filtering Analysis –Recognition Transmission.
Face Detection: a Survey Speaker: Mine-Quan Jing National Chiao Tung University.
1 Color Color Used heavily in human vision Used heavily in human vision Color is a pixel property, making some recognition problems easy Color is a pixel.
Color: Readings: Ch 6: color spaces color histograms color segmentation.
CSE 291 Final Project: Adaptive Multi-Spectral Differencing Andrew Cosand UCSD CVRR.
Shadow Removal Seminar
CSE 803 Stockman Fall Color Used heavily in human vision Color is a pixel property, making some recognition problems easy Visible spectrum for humans.
Smart Traveller with Visual Translator. What is Smart Traveller? Mobile Device which is convenience for a traveller to carry Mobile Device which is convenience.
1 Probabilistic Formulation for Skin Detection Sanun Srisuk Seminar I.
Face Processing System Presented by: Harvest Jang Group meeting Fall 2002.
Jacinto C. Nascimento, Member, IEEE, and Jorge S. Marques
Statistical Color Models (SCM) Kyungnam Kim. Contents Introduction Trivariate Gaussian model Chromaticity models –Fixed planar chromaticity models –Zhu.
Matthias Wimmer, Bernd Radig, Michael Beetz Chair for Image Understanding Computer Science Technische Universität München Adaptive.
VINCENT URIAS, CURTIS HASH Detection of Humans in Images Using Skin-tone Analysis and Face Detection.
Entropy and some applications in image processing Neucimar J. Leite Institute of Computing
Computer vision.
BACKGROUND LEARNING AND LETTER DETECTION USING TEXTURE WITH PRINCIPAL COMPONENT ANALYSIS (PCA) CIS 601 PROJECT SUMIT BASU FALL 2004.
COLOR HISTOGRAM AND DISCRETE COSINE TRANSFORM FOR COLOR IMAGE RETRIEVAL Presented by 2006/8.
1 Webcam Mouse Using Face and Eye Tracking in Various Illumination Environments Yuan-Pin Lin et al. Proceedings of the 2005 IEEE Y.S. Lee.
November 13, 2014Computer Vision Lecture 17: Object Recognition I 1 Today we will move on to… Object Recognition.
Object Recognition in Images Slides originally created by Bernd Heisele.
1 Research Question  Can a vision-based mobile robot  with limited computation and memory,  and rapidly varying camera positions,  operate autonomously.
Histograms and Color Balancing Computational Photography Derek Hoiem, University of Illinois 09/10/15 “Empire of Light”, Magritte.
Graphics Lecture 4: Slide 1 Interactive Computer Graphics Lecture 4: Colour.
DIGITAL IMAGE. Basic Image Concepts An image is a spatial representation of an object An image can be thought of as a function with resulting values of.
Autonomous Robots Vision © Manfred Huber 2014.
Histograms and Color Balancing Computational Photography Derek Hoiem, University of Illinois 09/13/11 “Empire of Light”, Magritte.
A Reliable Skin Detection Using Dempster-Shafer Theory of Evidence
Face Detection Final Presentation Mark Lee Nic Phillips Paul Sowden Andy Tait 9 th May 2006.
Image features and properties. Image content representation The simplest representation of an image pattern is to list image pixels, one after the other.
Learning and Removing Cast Shadows through a Multidistribution Approach Nicolas Martel-Brisson, Andre Zaccarin IEEE TRANSACTIONS ON PATTERN ANALYSIS AND.
Shadow Detection in Remotely Sensed Images Based on Self-Adaptive Feature Selection Jiahang Liu, Tao Fang, and Deren Li IEEE TRANSACTIONS ON GEOSCIENCE.
1 of 32 Computer Graphics Color. 2 of 32 Basics Of Color elements of color:
EE368 Final Project Spring 2003
Color Image Processing
Color Image Processing
Color Image Processing
Ido Omer Michael Werman
Traffic Sign Recognition Using Discriminative Local Features Andrzej Ruta, Yongmin Li, Xiaohui Liu School of Information Systems, Computing and Mathematics.
Color Image Processing
Motion Detection And Analysis
Color: Readings: Ch 6: color spaces color histograms
Perception and Measurement of Light, Color, and Appearance
Digital Image Processing
Computer Vision Lecture 4: Color
Color: Readings: Ch 6: color spaces color histograms
Introduction to Perception and Color
Color Image Processing
Object Recognition Today we will move on to… April 12, 2018
Estimation of Skin Color Range Using Achromatic Features
Color Image Processing
A Reliable Skin Detection Using Dempster-Shafer Theory of Evidence
Presentation transcript:

Color Space for Skin Detection – A Review Nikhil Rasiwasia Fondazione Graphitech, University of Trento, (TN) Italy

Contents Papers under consideration Why to detect skin? Methods of Skin Detection Using Skin Color Advantages Issues with Color How exactly is the skin color modeled Different Color Models Comparison of different Color Models Results from [1] Results from [2] Another perspective – Results from [3] Conclusions

Papers under consideration [1]Michael J Jones & James R Rehg, “Statistical Color Models with Application to Skin Detection” [2]D.Zarit, “Comparison of five color models in skin pixel classification” [3]Albiol, “optimum color spaces for skin detection” Other papers [4]Min C. Shin “Does colorspace transformation make any difference on skin detection” [5]Vezhnevets, “A survey on Pixel-Based skin color detection techniques”

Why to detect skin? Person Detection Face Detection and Face Tracking Hand Tracking for Gesture Recognition Robotic Control Other Human Computer Interaction A filter for pornographic content on the internet Other uses in video applications

Methods of Skin Detection Pixel-Based Methods Classify each pixel as skin or non-skin individually, independently from its neighbors. Color Based Methods fall in this category Region Based Methods Try to take the spatial arrangement of skin pixels into account during the detection stage to enhance the methods performance. Additional knowledge in terms of texture etc are required

Skin Color based methods - Advantages Allows fast processing Robust to geometric variations of the skin patterns Robust under partial occlusion Robust to resolution changes Eliminate the need of cumbersome tracking devices or artificially places color cues Experience suggests that human skin has a characteristic color, which is easily recognized by humans.

Issues with skin color What colour space to be used? Are Skin and Non-skin colors seperable? Illumination changes over time. Skin tones vary dramatically within and across individuals. Different cameras have different output for the identical image. Movement of objects cause blurring of colours. Ambient light, shadows change the apparent colour of the image. What colour space to be used? How exactly the colour distribution has to be modelled?

Different Color Models - Issues 2 Increased separability between skin and non skin classes Decreased separability among skin tones Cost of conversion for real time applications What is the color distribution model used Keeping the Illumination component – 2D color space vs. 3D color space Stability of color space (at extreme values)

How exactly the colour distribution has to be modelled? Non parametric – Estimate skin color distribution from the training data without deriving an explicit model of the skin. Look up table or Histogram Model Bayes Classifier Parametric – Deriving a parametric model from the training set Gaussian Model

What colour space to be used? Different Color Models RGB Normalized RGB HIS, HSV, HSL Fleck HSV TSL YcrCb Perceptually uniform colors CIELAB, CIELUV Others YES, YUV, YIQ, CIE-xyz

RGB – Red, Green, Blue Most common color space used to represent images. Was developed with CRT as an additive color space [1] – Rehg and Jones have used this color space to study the separability of the color space

Normalized RGB – rg space 2D color space as ‘b’ component is redundant b = 1 – g – r Invariant to changes of surface orientation relatively to the light source

HSV, HSI, HSL (hue, saturation, value/intensity/luminance) High cost of conversion Based on intuitive values Invariant to highlight at white light sources Pixel with large and small intensities are discarded as HS becomes unstable. Can be 2D by removing the illumination component

Y Cr Cb YCrCb is an encoded nonlinear RGB signal, commonly used by European television studios and for image compression work. Y – Luminance component, C – Chorminance

Perceptually uniform colors “skin color” is not a physical property of an object, rather a perceptual phenomenon and therefore a subjective human concept. Color representation similar to the color sensitivity of human vision system should Complex transformation functions from and to RGB space, demanding far more computation than most other colorspaces

Results from [1] – Rehg & Jones Used 18,696 images to build a general color model. Density is concentrated around the gray line and is more sharply peaked at white than black. Most colors fall on or near the gray line. Black and white are by far the most frequent colors, with white occurring slightly more frequently. There is a marked skew in the distribution toward the red corner of the color cube. 77% of the possible 24 bit RGB colors are never encountered (i.e. the histogram is mostly empty). 52% of web images have people in them.

General Color model - RGB

Marginal Distributions

Skin model

Non Skin Model

Other Conclusions Histogram size 32 gave the best performance, superior to the size 256 model at the larger false detection rates and slightly better than the size 16 model in two places. Histogram model gives slightly better performance as compared to Gaussian mixture. It is possible that color spaces other than RGB could result in improved detection performance.

Results from [2] Zarit et al. They compared 5 different color spaces CIELab, HSV, HS,Normalized RGB and YCrCb Four different metrics are used to evaluate the results of the skin detection algorithms. C %– Skin and Non Skin pixels identified correctly S %– Skin pixels identified correctly SE – Skin error – skin pixels identified as non skin NSE – Non Skin error – non skin pixels identified as skin They compared the 5 color space with 2 color models – look up table and Bayes classifier

Look up table results HSV, HS gave the best results Normalized rg is not far behind CIELAB and YCrCb gave poor results

Bayes method results Using different color space provided very little variation in the results

Another perspective – [3] Albiol et al, “optimum color spaces for skin detection” As from [2] we see that using different methods (Look up table and Bayes) the results were different Abstract: The objective of this paper is to show that for every color space there exists an optimum skin detector scheme such that the performance of all these skin detectors schemes is the same. To that end, a theoretical proof is provided and experiments are presented which show that the separability of the skin and no skin classes is independent of the color space chosen.

Features Used 4 color space – RGB, YCrCb, HSV, Cr Cb Proved mathematically for the existence of optimum skin color detector D(xp)=> highest detection rate (PD for a given false alarm rate PFA) using Neyman-Pearson Test

Results CbCr color space It can be noticed that the performance is lower since the transformation from any three dimensional color space to the bidimensional CbCr color is non invertible if an optimum skin detector is designed for every color space, then their performace will be the same.

Conclusions The skin colors form a separate cluster in the RGB color space. Hence skin color can be used as a cue for skin detection in images and videos. The performance of different color space may be dependent on the method used to model the color for skin pixel. For the common methods – Look up table, bayes classifier, gaussian the results are Look up table – HS performs the best followed by normalized RGB Bayes – is not largely affected by the the color space Gaussian – No general result can be derived from the papers under consideration Removing the illumination component does increase the overlap between skin and non skin pixels but a generalization of training data is obtained

Results from [5] Colorspace does not matter in nonparametric (Bayes) methods, though the overlap is a significant performance metric in the parametric (Gaussian) case. Dropping of luminance seems logical. – Though the skip overlap increases due to the dimensionality reduction, but there is a generalization of the training data. Prefers normalized RG, HS colorspace. Just by assessing skin overlap can not give an idea of the goodness of the colorspace as different modelling methods react very differently on the colorspace change.