School of Electrical & Computer Engineering Image Denoising Using Gaussian Scale Mixtures in the Wavelet domain Alex Cunningham Ben Clarke Dy narath Eang.

Slides:



Advertisements
Similar presentations
Pattern Recognition and Machine Learning
Advertisements

2004 COMP.DSP CONFERENCE Survey of Noise Reduction Techniques Maurice Givens.
Patch-based Image Deconvolution via Joint Modeling of Sparse Priors Chao Jia and Brian L. Evans The University of Texas at Austin 12 Sep
Texture. Edge detectors find differences in overall intensity. Average intensity is only simplest difference. many slides from David Jacobs.
Computer Vision Group Digital Image Filters 26 th November 2012.
H. R. Sheikh, A. C. Bovik, “Image Information and Visual Quality,” IEEE Trans. Image Process., vol. 15, no. 2, pp , Feb Lab for Image and.
Image Denoising using Locally Learned Dictionaries Priyam Chatterjee Peyman Milanfar Dept. of Electrical Engineering University of California, Santa Cruz.
2008 SIAM Conference on Imaging Science July 7, 2008 Jason A. Palmer
Image Denoising via Learned Dictionaries and Sparse Representations
7th IEEE Technical Exchange Meeting 2000 Hybrid Wavelet-SVD based Filtering of Noise in Harmonics By Prof. Maamar Bettayeb and Syed Faisal Ali Shah King.
Speech Enhancement Based on a Combination of Spectral Subtraction and MMSE Log-STSA Estimator in Wavelet Domain LATSI laboratory, Department of Electronic,
SUSAN: structure-preserving noise reduction EE264: Image Processing Final Presentation by Luke Johnson 6/7/2007.
Announcements For future problems sets: matlab code by 11am, due date (same as deadline to hand in hardcopy). Today’s reading: Chapter 9, except.
Scalable Wavelet Video Coding Using Aliasing- Reduced Hierarchical Motion Compensation Xuguang Yang, Member, IEEE, and Kannan Ramchandran, Member, IEEE.
Texture Reading: Chapter 9 (skip 9.4) Key issue: How do we represent texture? Topics: –Texture segmentation –Texture-based matching –Texture synthesis.
1 Bayesian Restoration Using a New Nonstationary Edge-Preserving Image Prior Giannis K. Chantas, Nikolaos P. Galatsanos, and Aristidis C. Likas IEEE Transactions.
EE565 Advanced Image Processing Copyright Xin Li Statistical Modeling of Natural Images in the Wavelet Space Parametric models of wavelet coefficients.
(1) A probability model respecting those covariance observations: Gaussian Maximum entropy probability distribution for a given covariance observation.
Despeckle Filtering in Medical Ultrasound Imaging
Automatic Estimation and Removal of Noise from a Single Image
Noise Estimation from a Single Image Ce Liu William T. FreemanRichard Szeliski Sing Bing Kang.
Linear Algebra and Image Processing
Lossy Compression Based on spatial redundancy Measure of spatial redundancy: 2D covariance Cov X (i,j)=  2 e -  (i*i+j*j) Vertical correlation   
Applications of Image Filters Computer Vision CS 543 / ECE 549 University of Illinois Derek Hoiem 02/04/10.
1 Patch Complexity, Finite Pixel Correlations and Optimal Denoising Anat Levin, Boaz Nadler, Fredo Durand and Bill Freeman Weizmann Institute, MIT CSAIL.
CAP5415: Computer Vision Lecture 4: Image Pyramids, Image Statistics, Denoising Fall 2006.
1 Wavelets, Ridgelets, and Curvelets for Poisson Noise Removal 國立交通大學電子研究所 張瑞男
Medical Image Analysis Image Enhancement Figures come from the textbook: Medical Image Analysis, by Atam P. Dhawan, IEEE Press, 2003.
Wavelets and Denoising Jun Ge and Gagan Mirchandani Electrical and Computer Engineering Department The University of Vermont October 10, 2003 Research.
INDEPENDENT COMPONENT ANALYSIS OF TEXTURES based on the article R.Manduchi, J. Portilla, ICA of Textures, The Proc. of the 7 th IEEE Int. Conf. On Comp.
Hongyan Li, Huakui Wang, Baojin Xiao College of Information Engineering of Taiyuan University of Technology 8th International Conference on Signal Processing.
Image compression using Hybrid DWT & DCT Presented by: Suchitra Shrestha Department of Electrical and Computer Engineering Date: 2008/10/09.
Image Restoration using Iterative Wiener Filter --- ECE533 Project Report Jing Liu, Yan Wu.
R. Ray and K. Chen, department of Computer Science engineering  Abstract The proposed approach is a distortion-specific blind image quality assessment.
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 3: LINEAR MODELS FOR REGRESSION.
Rajeev Aggarwal, Jai Karan Singh, Vijay Kumar Gupta, Sanjay Rathore, Mukesh Tiwari, Dr.Anubhuti Khare International Journal of Computer Applications (0975.
School of Electrical & Computer Engineering Image Denoising Using Steerable Pyramids Alex Cunningham Ben Clarke Dy narath Eang ECE November 2008.
DCT.
Digital Image Processing Lecture 10: Image Restoration March 28, 2005 Prof. Charlene Tsai.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
EE565 Advanced Image Processing Copyright Xin Li Image Denoising Theory of linear estimation Spatial domain denoising techniques Conventional Wiener.
Digital Image Processing Lecture 10: Image Restoration
Introduction to Digital Signals
EE565 Advanced Image Processing Copyright Xin Li Why do we Need Image Model in the first place? Any image processing algorithm has to work on a collection.
Different types of wavelets & their properties Compact support Symmetry Number of vanishing moments Smoothness and regularity Denoising Using Wavelets.
EE565 Advanced Image Processing Copyright Xin Li Image Denoising: a Statistical Approach Linear estimation theory summary Spatial domain denoising.
COMPARING NOISE REMOVAL IN THE WAVELET AND FOURIER DOMAINS Dr. Robert Barsanti SSST March 2011, Auburn University.
Advanced Science and Technology Letters Vol.35(Security 2013), pp Image Steganograpy via Video Using Lifting.
APPLICATION OF A WAVELET-BASED RECEIVER FOR THE COHERENT DETECTION OF FSK SIGNALS Dr. Robert Barsanti, Charles Lehman SSST March 2008, University of New.
The Discrete Wavelet Transform for Image Compression Speaker: Jing-De Huang Advisor: Jian-Jiun Ding Graduate Institute of Communication Engineering National.
傅思維. How to implement? 2 g[n]: low pass filter h[n]: high pass filter :down sampling.
The Chinese University of Hong Kong
Wavelet Thresholding for Multiple Noisy Image Copies S. Grace Chang, Bin Yu, and Martin Vetterli IEEE TRANSACTIONS
SIMD Implementation of Discrete Wavelet Transform Jake Adriaens Diana Palsetia.
WAVELET NOISE REMOVAL FROM BASEBAND DIGITAL SIGNALS IN BANDLIMITED CHANNELS Dr. Robert Barsanti SSST March 2010, University of Texas At Tyler.
EE565 Advanced Image Processing Copyright Xin Li Why do we Need Image Model in the first place? Any image processing algorithm has to work on a collection.
Feature Matching and Signal Recognition using Wavelet Analysis Dr. Robert Barsanti, Edwin Spencer, James Cares, Lucas Parobek.
Image Processing Architecture, © Oleh TretiakPage 1Lecture 5 ECEC 453 Image Processing Architecture Lecture 5, 1/22/2004 Rate-Distortion Theory,
Biointelligence Laboratory, Seoul National University
Medical Image Analysis
WAVELET VIDEO PROCESSING TECHNOLOGY
Digital Image Processing Lecture 10: Image Restoration
Outline Introduction Signal, random variable, random process and spectra Analog modulation Analog to digital conversion Digital transmission through baseband.
Outlier Processing via L1-Principal Subspaces
Directional Multiscale Modeling of Images
The Chinese University of Hong Kong
Hidden Markov Tree Model of the Uniform Discrete Curvelet Transform Image for Denoising Yothin Rakvongthai.
Increasing Watermarking Robustness using Turbo Codes
Combination of Feature and Channel Compensation (1/2)
Image restoration, noise models, detection, deconvolution
Presentation transcript:

School of Electrical & Computer Engineering Image Denoising Using Gaussian Scale Mixtures in the Wavelet domain Alex Cunningham Ben Clarke Dy narath Eang ECE November 2008 Image Denoising Using Gaussian Scale Mixtures in the Wavelet domain

ECE6258 Digital Image Processing, Group3 2 School of Electrical & Computer Engineering Agenda Algorithm Overview Background  Wavelets  Steerable Pyramid Decomposition  Gaussian Scale Mixture  Bayesian Least Square Estimation Image Denoising Details Implementation Details  Detailed Algorithm  Detailed Matlab Implementation Results Comparison to other denoising techniques Improvement schemes

ECE6258 Digital Image Processing, Group3 3 School of Electrical & Computer Engineering Algorithm Overview General Denoising Algorithm: Decompose Image into Steerable Wavelet Pyramid Subbands For each subband:  Perform local Wiener Estimation  Denoise coefficients using Bayesian Least Squares Estimation  Reconstruct Denoised Subband Reconstruct image from denoised wavelet subbands Paper Source J. Portilla, V. Strela, M. Wainwright, and E. P. Simoncelli, “Image denoising using a scale mixture of Gaussians in the wavelet domain,” IEEE Trans. Image Processing, vol. 12, no. 11, pp. 1338–1351, November Additional Tools Matlab Pyramid Tools (Computational Vision Lab at NYU)

ECE6258 Digital Image Processing, Group3 4 School of Electrical & Computer Engineering Wavelet Overview Continuous Wavelet Transform (CWT) Discrete Wavelet Transform (DWT) CWT Decomposition: Images Source: Matlab Help

ECE6258 Digital Image Processing, Group3 5 School of Electrical & Computer Engineering Steerable Wavelet Pyramids (Spyr) Overview Spyrs Combine: Multiple Levels of DWT Multiple Orientations of Differential Filters “Steerability” comes from the set of oriented filters Can reconstruct image without aliasing (Circle) Image Source: E. Simoncelli, W. Freeman, “The Steerable Pyramid: A Flexible Architecture for Multi-Scale Derivative Computation,” 2 nd Ann. IEEE Intl. Conf. on Image Processing. Washington, DC. October, 1995.

ECE6258 Digital Image Processing, Group3 6 School of Electrical & Computer Engineering Gaussian Scale Mixture (GSM) Overview GSM = A useful statistical model Problem: Images are NOT spatially homogeneous or scale invariant and their statistics do NOT follow Gaussian distribution Solution: Use GSM to model wavelet coefficients Usefulness: Characterize the coefficients’ marginal distribution shape and strong correlation between the neighbors’ amplitudes Form:

ECE6258 Digital Image Processing, Group3 7 School of Electrical & Computer Engineering Bayesian Least Squares (BLS) Estimation Overview BLS = A useful estimation method Problem: Two-step empirical Bayes estimation is suboptimal Solution: Use BLS to estimate the real coefficients. Usefulness: Improves the empirical Bayes Estimator and it’s now a single step process

ECE6258 Digital Image Processing, Group3 8 School of Electrical & Computer Engineering GSM and Covariance Matrices There are five main variables:  w: noise subband  y: observed noisy image subband  x: model GSM subband  u: estimated real signal subband  z: scalar RV used as a multiplier The observation is the signal plus noise – these 3 RV’s are independent Similarly, the covariance matrices follow the same additive rule Taking E{z} = 1, then Eq(6a) can be rearranged Eq (5) Eq (6a) Eq (7)

ECE6258 Digital Image Processing, Group3 9 School of Electrical & Computer Engineering Bayes Least Squares and Local Wiener Estimation BLS estimates the denoised coefficients by estimating at the center coefficients of all neighborhoods It needs two main things:  E[X c |y,z]  p(z|y) Local Wiener Estimation helps compute the 1 st main item The 2 nd main item can be computed sequentially using Equations 13 and 14. Equations come directly from the author’s paper Eq (8) Eq (9) Eq (10) Eq (11) Eq (12) Eq (14) Eq (13)

ECE6258 Digital Image Processing, Group3 10 School of Electrical & Computer Engineering Image Denoising Algorithm Full algorithm: * 1) Decompose the image into subbands. 2) For each subband (except the lowpass residual):  a) Compute neighborhood noise covariance, C w, from the image-domain noise covariance.  b) Estimate noisy neighborhood covariance, C y.  c) Estimate C u from C w and C y using (7).  d) Compute A and M (Section III-B: Local Wiener Estimate).  e) For each neighborhood: i) For each value z in the integration range:  A) Compute E{x c |y,z} using (12).  B) Compute p(y|z) using (14). ii) Compute p(z|y) using (13) and(4). iii) Compute E{x c |y} numerically using (8). 3) Reconstruct the denoised image from the processed subbands and the lowpass residual. (p. 1343) * The algorithm is copied directly from the journal paper, p

ECE6258 Digital Image Processing, Group3 11 School of Electrical & Computer Engineering Matlab Algorithm Tree denoise_demo.m Load image of interest Make copy of image and add Gaussian noise of known variance Define number of levels/bands for steerable pyramid (SPyr) decomposition Calculate bound extensions and PSDs Decompose noise-image and noisy image into SPyr structure Perform denoising (denoise_ctrl.m) Reconstruct image from denoised SPyr samples Calculate signal-to-noise ratios, display images denoise_demo.m pyr_decomp.m denoise_ctrl.m pyr_reconstruct.m pyr_extract.m local_wiener_estimator.m expect_estimator.m covariance_calculator.m bound_extension.m pyr_insert.m

ECE6258 Digital Image Processing, Group3 12 School of Electrical & Computer Engineering Denoising Functions denoise_ctrl.m Extract particular subband (both noise image and noisy image) Calculate covariance matrices (covariance_calculator.m) Perform (local_weiner_estimator.m) from covariance matrices to get eigenvalues and eigenvectors Use eigenvalues/eigenvectors to estimate the real coefficients by find expectation values for each pixel in the neighborhood (expect_estimator.m) Reinsert denoised subband into pyramid structure covariance_calculator.m Create neighborhood matrices (for noise image and noisy images) assuming zero-mean Gaussian distributed Compute signal covariance (Cu) as difference between observed covariance (Cy) and noise covariance (Cw) local_wiener_estimator.m With assumption of AWGN, perform wiener calculations  Requires computation of eigenvalue/eigenvectors for covariance matrices  Result is that for various covariance matrices, we get wiener matrices expect_estimator.m Perform equations (12) and (14) From equation (14), perform equation (13) Use results of equations (12) and (13) to compute E{x c |y} numerically. Eq (8)* Eq (12) Eq (13) Eq (14)

ECE6258 Digital Image Processing, Group3 13 School of Electrical & Computer Engineering Statistical Results Portilla Basic 512x512 or 256x256, 8-bit grayscale images Scan σ across a range of standard deviations Compute Peak SNR (PSNR) for each of six images Last column σ(PSNR) is the estimated standard deviation of the results. Ours Compute same PSNR Compute Improvement SNR (ISNR) from noisy image to denoised image + σ is the input standard deviation for the AWGN Portilla PSNR table Our SNR table

ECE6258 Digital Image Processing, Group3 14 School of Electrical & Computer Engineering Pictorial Results Extreme case: σ (sigma) = 100 Moderate case: σ (sigma) = 10 SNR Improvement of 12.45dB SNR Improvement of 5.87dB

ECE6258 Digital Image Processing, Group3 15 School of Electrical & Computer Engineering Comparison Extreme case:  σ (sigma) = 100 Subjective ranking:  GSM-BLS (Portilla)  Wiener 5x5  Discrete wavelet transform (DWT)  Wavelet packet (WP)

ECE6258 Digital Image Processing, Group3 16 School of Electrical & Computer Engineering Improvement Scheme #1 ‘‘Image Denoising using shiftable directional pyramid and CGSM’’  Authors: An Vo, Truong Nguyen, & Soontron Oraintara  Publication date: May 2007  Synopsis: Improvement in PSNR values for certain images (Barbara) was achieveable by incorporating CGSM and PDTDFB. PDTDFB – Pyramidal Dual Tree Directional Filter Bank CGSM – Complex Gaussian Scale mixture.  *SSIM = Structural Similarity

ECE6258 Digital Image Processing, Group3 17 School of Electrical & Computer Engineering Improvement Scheme #2 ‘‘Image Denoising using GSM model and BLS estimation over wider range of observation’’  Author:Hyng Il Koo & Nam Ik Cho  Publication date: April 2008  Synopsis: Subjective improvement in the quality of the images by considering a larger range of coefficients and using a new statistical model for the p(y|z). CRF = Conditional random field Sum-product algorithm = inference algorithm

ECE6258 Digital Image Processing, Group3 18 School of Electrical & Computer Engineering References Original reference J. Portilla, V. Strela, M. Wainwright, and E. P. Simoncelli, “Image denoising using a scale mixture of Gaussians in the wavelet domain,” IEEE Trans. Image Processing, vol. 12, no. 11, pp. 1338– 1351, November Other denoising papers A. Vo, T. Nguyen, S. Oraintara, “Image Denoising using Shiftable Directional Pyramid and Scale Mixtures of Complex Gaussians” ISCAS 2007, pp , May 2007 H. I. Koo and N. I. Cho, “Image Denoising Based on a Statistical Model for Wavelet Coefficients,” ICASSP 2008, pp , April E. Simoncelli, W. Freeman, “The Steerable Pyramid: A Flexible Architecture for Multi-Scale Derivative Computation,” 2 nd Ann. IEEE Intl. Conf. on Image Processing. Washington, DC. October, 1995.