RECONSTRUCTION OF MULTI- SPECTRAL IMAGES USING MAP Gaurav

OUTLINE OBJECTIVE OBJECTIVE SYSTEM DESCRIPTION SYSTEM DESCRIPTION MATHEMATICAL DESCRIPTION MATHEMATICAL DESCRIPTION MAP MAP RESULTS & DISCUSSIONS RESULTS & DISCUSSIONS PERFORMANCE EVALUATION PERFORMANCE EVALUATION CONCLUSION CONCLUSION

OBJECTIVE What we have been doing till now: What we have been doing till now: Improving the state-of-art multi-spectral camera technology (eg. CyberEye 2100 capable of capturing 12 bands of the electromagnetic spectrum) Improving the state-of-art multi-spectral camera technology (eg. CyberEye 2100 capable of capturing 12 bands of the electromagnetic spectrum) Use of mosaic focal plane array technology for multi- spectral images Use of mosaic focal plane array technology for multi- spectral images Motive: To improve the use of multi-spectral images in fields like defence, medical, etc. Motive: To improve the use of multi-spectral images in fields like defence, medical, etc. Next Level: Next Level: Focus on improvement of the demosaicked output Focus on improvement of the demosaicked output

PROCESS DESCRIPTION Block Diagram: Block Diagram: Actual Scene/ Input Image Blur + Additive Noise Mosaicking Demosaicking Image Restoration Using MAP Output Image f m g

Mathematical Description where, m = mosaicked image f = actual scene/ image (multi-spectral image before acquisition process) h = blur kernel η = additive noise (noise added to all bands of the multi-spectral image) s = system non-linearity : image sampling using mosaicking process The System can be mathematically formulated as :

PROPOSED MODEL FOR RESTORATION Demosaicking MAP g = distorted demosaicked image

MAP – Maximum a Posteriori Probability Estimate Basic Equation: MAP estimate:

MAP contd… Problem Transformation: Taking log on both sides Prior Model: Assuming the f ‘s are taken out from an ensemble which have a Gaussian Distribution Noise Model: What is p(g/f) : same as noise distribution

MAP contd… To Maximize p(f/g) is same as maximizing log(p(f/g) Optimization: using Gradient Descent Lexicographic Ordering:

Results A synthetic multi-spectral image was used for experimentation. A synthetic multi-spectral image was used for experimentation. Bilinear Interpolation algorithm was used for demosaicking. Bilinear Interpolation algorithm was used for demosaicking. Initial Guess is taken as a Wiener Filter Result. Initial Guess is taken as a Wiener Filter Result. Gaussian Noise with constant variance was assumed. Gaussian Noise with constant variance was assumed. Blur was assumed to be Gaussian in nature. Blur was assumed to be Gaussian in nature. Three cases for Prior Distribution were considered Three cases for Prior Distribution were considered Gaussian Distribution (constant variance) Gaussian Distribution (constant variance) Gibbs Distribution Gibbs Distribution With Laplacian Kernel With Laplacian Kernel With Quadratic Variation With Quadratic Variation Convergence when Convergence when Metric for comparison of results: Mean Square Error Metric for comparison of results: Mean Square Error

Gibbs Distribution Prior Term : Gibbs distribution Prior Term : Gibbs distribution where, -V(f) is the of potentials, i.e., in our case difference between neighbourhood pixels. Use of Sobel filter to compute the potentials. -U(f) is the sum of potentials represents the Energy term -T is the absolute temperature (constant) -Z is the normalizing factor

Inverse Gaussian Inverse Gaussian where, -β is the strength of an edge - is the variance - r is the laplacian kernel -Quadratic variation

Original Image MAP Images Gaussian Prior Density Gibbs Prior Density

Mean Square Error Values Image Distorted Image Wiener Estimate MAP with Gaussian Prior MAP with Gibbs Prior dc mig f Tank Tank Tank Tank

Performance Evaluation Speed of Convergence: Noise variance : Cannot really predict how the noise variance affects the speed of convergence. At very less noise variance (<0.1) convergence not possible. Prior Distribution Variance: Remains constant after some particular value of prior distribution variance.

Reducing Step size : Convergence time increases (slow convergence) Doesn’t affect final MSE value Increasing Step size: Convergence guaranteed only till a particular value of step size (alpha = 1). Beyond that value no convergence possible. Optimum Value : alpha = 0.1 since here we obtain least MSE.

MSE reduces drastically at lower values of prior distribution variances. As the prior variance value goes up, the MSE values start to settle down.

CONCLUSION The MAP method successfully restores the least mean square error multi-spectral image. The MAP method successfully restores the least mean square error multi-spectral image. Thank You. -Gaurav