Image Enhancement in the Spatial Domain

Image Enhancement in the Spatial Domain The spatial domain: The image plane For a digital image is a Cartesian coordinate system of discrete rows and columns. At the intersection of each row and column is a pixel. Each pixel has a value, which we will call intensity. The frequency domain : A (2-dimensional) discrete Fourier transform of the spatial domain We will discuss it in chapter 4. Enhancement : To “improve” the usefulness of an image by using some transformation on the image. Often the improvement is to help make the image “better” looking, such as increasing the intensity or contrast.

Background A mathematical representation of spatial domain enhancement: where f(x, y): the input image g(x, y): the processed image T: an operator on f, defined over some neighborhood of (x, y)

Gray-level Transformation

Some Basic Gray Level Transformations

Image Negatives Let the range of gray level be [0, L-1], then

Log Transformations where c : constant

Power-Law Transformation where c, : positive constants

Power-Law Transformation Example 2: Gamma Correction

Piecewise-Linear Transformation Functions Case 1: Contrast Stretching

Piecewise-Linear Transformation Functions Case 2:Gray-level Slicing An image Result of using the transformation in (a)

Piecewise-Linear Transformation Functions Case 3:Bit-plane Slicing It can highlight the contribution made to total image appearance by specific bits. Each pixel in an image represented by 8 bits. Image is composed of eight 1-bit planes, ranging from bit-plane 0 for the least significant bit to bit plane 7 for the most significant bit.

Piecewise-Linear Transformation Functions Bit-plane Slicing: A Fractal Image

Piecewise-Linear Transformation Functions Bit-plane Slicing: A Fractal Image 7 6 5 4 3 2 1

Enhancement Using Arithmetic/Logic Operations Two images of the same size can be combined using operations of addition, subtraction, multiplication, division, logical AND, OR, XOR and NOT. Such operations are done on pairs of their corresponding pixels. Often only one of the images is a real picture while the other is a machine generated mask. The mask often is a binary image consisting only of pixel values 0 and 1. Example: Figure 3.27

Enhancement Using Arithmetic/Logic Operations AND OR

Image Subtraction Example 1

Image Subtraction Example 2 When subtracting two images, negative pixel values can result. So, if you want to display the result it may be necessary to readjust the dynamic range by scaling.

A noisy image g(x,y) can be defined by Image Averaging When taking pictures in reduced lighting (i.e., low illumination), image noise becomes apparent. A noisy image g(x,y) can be defined by where f (x, y): an original image : the addition of noise One simple way to reduce this granular noise is to take several identical pictures and average them, thus smoothing out the randomness.

Noise Reduction by Image Averaging Example: Adding Gaussian Noise Figure 3.30 (a): An image of Galaxy Pair NGC3314. Figure 3.30 (b): Image corrupted by additive Gaussian noise with zero mean and a standard deviation of 64 gray levels. Figure 3.30 (c)-(f): Results of averaging K=8,16,64, and 128 noisy images.

Noise Reduction by Image Averaging Example: Adding Gaussian Noise Figure 3.31 (a): From top to bottom: Difference images between Fig. 3.30 (a) and the four images in Figs. 3.30 (c) through (f), respectively. Figure 3.31 (b): Corresponding histogram.

Basics of Spatial Filtering In spatial filtering (vs. frequency domain filtering), the output image is computed directly by simple calculations on the pixels of the input image. Spatial filtering can be either linear or non-linear. For each output pixel, some neighborhood of input pixels is used in the computation. In general, linear filtering of an image f of size MXN with a filter mask of size mxn is given by where a=(m-1)/2 and b=(n-1)/2 This concept called convolution. Filter masks are sometimes called convolution masks or convolution kernels.

Basics of Spatial Filtering

Basics of Spatial Filtering Nonlinear spatial filtering usually uses a neighborhood too, but some other mathematical operations are use. These can include conditional operations (if …, then…), statistical (sorting pixel values in the neighborhood), etc. Because the neighborhood includes pixels on all sides of the center pixel, some special procedure must be used along the top, bottom, left and right sides of the image so that the processing does not try to use pixels that do not exist.

Smoothing Spatial Filters Smoothing linear filters Averaging filters (Lowpass filters in Chapter 4)) Box filter Weighted average filter Box filter Weighted average

Smoothing Spatial Filters The general implementation for filtering an MXN image with a weighted averaging filter of size mxn is given by where a=(m-1)/2 and b=(n-1)/2

Smoothing Spatial Filters Image smoothing with masks of various sizes

Smoothing Spatial Filters Another Example

Order-Statistic Filters Median filter: to reduce impulse noise (salt-and-pepper noise)

Sharpening Spatial Filters Sharpening filters are based on computing spatial derivatives of an image. The first-order derivative of a one-dimensional function f(x) is The second-order derivative of a one-dimensional function f(x) is

Use of Second Derivatives for Enhancement The Laplacian Development of the Laplacian method The two dimensional Laplacian operator for continuous functions: The Laplacian is a linear operator.

Use of Second Derivatives for Enhancement The Laplacian

Use of Second Derivatives for Enhancement The Laplacian To sharpen an image, the Laplacian of the image is subtracted from the original image. Example: Figure 3.40

Use of Second Derivatives for Enhancement The Laplacian: Simplifications The g(x,y) mask Not only

Use of First Derivatives for Enhancement The Gradient Development of the Gradient method The gradient of function f at coordinates (x,y) is defined as the two-dimensional column vector: The magnitude of this vector is given by

Use of First Derivatives for Enhancement The Gradient Roberts cross-gradient operators Sobel operators

Use of First Derivatives for Enhancement The Gradient: Using Sobel Operators

Combining Spatial Enhancement Methods

Combining Spatial Enhancement Methods