Hidden Markov Tree Model of the Uniform Discrete Curvelet Transform Image for Denoising Yothin Rakvongthai.

Slides:



Advertisements
Similar presentations
Discriminative Approach for Wavelet Denoising Yacov Hel-Or and Doron Shaked I.D.C.- Herzliya HPL-Israel.
Advertisements

LECTURE 11: BAYESIAN PARAMETER ESTIMATION
2004 COMP.DSP CONFERENCE Survey of Noise Reduction Techniques Maurice Givens.
H. R. Sheikh, A. C. Bovik, “Image Information and Visual Quality,” IEEE Trans. Image Process., vol. 15, no. 2, pp , Feb Lab for Image and.
Oriented Wavelet 國立交通大學電子工程學系 陳奕安 Outline Background Background Beyond Wavelet Beyond Wavelet Simulation Result Simulation Result Conclusion.
7th IEEE Technical Exchange Meeting 2000 Hybrid Wavelet-SVD based Filtering of Noise in Harmonics By Prof. Maamar Bettayeb and Syed Faisal Ali Shah King.
A gentle introduction to Gaussian distribution. Review Random variable Coin flip experiment X = 0X = 1 X: Random variable.
Wavelet-based Coding And its application in JPEG2000 Monia Ghobadi CSC561 project
EE565 Advanced Image Processing Copyright Xin Li Statistical Modeling of Natural Images in the Wavelet Space Parametric models of wavelet coefficients.
(1) A probability model respecting those covariance observations: Gaussian Maximum entropy probability distribution for a given covariance observation.
School of Electrical & Computer Engineering Image Denoising Using Gaussian Scale Mixtures in the Wavelet domain Alex Cunningham Ben Clarke Dy narath Eang.
Image Denoising using Wavelet Thresholding Techniques Submitted by Yang
EE513 Audio Signals and Systems Statistical Pattern Classification Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
© by Yu Hen Hu 1 ECE533 Digital Image Processing Image Restoration.
UF S.Klimenko LIGO-G Z l Introduction l Goals of this analysis l Coherence of power monitors l Sign X-Correlation l H2-L1 x-correlation l Conclusion.
Estimation-Quantization Geometry Coding using Normal Meshes
1 Wavelets, Ridgelets, and Curvelets for Poisson Noise Removal 國立交通大學電子研究所 張瑞男
Statistics for Engineer Week II and Week III: Random Variables and Probability Distribution.
Wavelets and Denoising Jun Ge and Gagan Mirchandani Electrical and Computer Engineering Department The University of Vermont October 10, 2003 Research.
Hongyan Li, Huakui Wang, Baojin Xiao College of Information Engineering of Taiyuan University of Technology 8th International Conference on Signal Processing.
R. Ray and K. Chen, department of Computer Science engineering  Abstract The proposed approach is a distortion-specific blind image quality assessment.
MDDSP Literature Survey Presentation Eric Heinen
Rajeev Aggarwal, Jai Karan Singh, Vijay Kumar Gupta, Sanjay Rathore, Mukesh Tiwari, Dr.Anubhuti Khare International Journal of Computer Applications (0975.
School of Electrical & Computer Engineering Image Denoising Using Steerable Pyramids Alex Cunningham Ben Clarke Dy narath Eang ECE November 2008.
Image Denoising Using Wavelets
23 November Md. Tanvir Al Amin (Presenter) Anupam Bhattacharjee Department of Computer Science and Engineering,
EE565 Advanced Image Processing Copyright Xin Li Image Denoising Theory of linear estimation Spatial domain denoising techniques Conventional Wiener.
Practical Poissonian-Gaussian Noise Modeling and Fitting for Single- Image Raw-Data Reporter: 沈廷翰 陳奇業.
Statistics. A two-dimensional random variable with a uniform distribution.
Random Variables (1) A random variable (also known as a stochastic variable), x, is a quantity such as strength, size, or weight, that depends upon a.
EE565 Advanced Image Processing Copyright Xin Li Why do we Need Image Model in the first place? Any image processing algorithm has to work on a collection.
Math 3360: Mathematical Imaging Prof. Ronald Lok Ming Lui Department of Mathematics, The Chinese University of Hong Kong Lecture 11: Types of noises.
Chapter 3 Foundation of Mathematical Analysis § 3.1 Statistics and Probability § 3.2 Random Variables and Magnitude Distribution § 3.3 Probability Density.
Phisical Fluctuomatics (Tohoku University) 1 Physical Fluctuomatics 4th Maximum likelihood estimation and EM algorithm Kazuyuki Tanaka Graduate School.
EE565 Advanced Image Processing Copyright Xin Li Image Denoising: a Statistical Approach Linear estimation theory summary Spatial domain denoising.
IE 300, Fall 2012 Richard Sowers IESE. 8/30/2012 Goals: Rules of Probability Counting Equally likely Some examples.
Lecture 2: Statistical learning primer for biologists
COMPARING NOISE REMOVAL IN THE WAVELET AND FOURIER DOMAINS Dr. Robert Barsanti SSST March 2011, Auburn University.
Fourier and Wavelet Transformations Michael J. Watts
APPLICATION OF A WAVELET-BASED RECEIVER FOR THE COHERENT DETECTION OF FSK SIGNALS Dr. Robert Barsanti, Charles Lehman SSST March 2008, University of New.
傅思維. How to implement? 2 g[n]: low pass filter h[n]: high pass filter :down sampling.
EE565 Advanced Image Processing Copyright Xin Li Further Improvements Gaussian scalar mixture (GSM) based denoising* (Portilla et al.’ 2003) Instead.
The Chinese University of Hong Kong
Jun Li 1, Zhongdong Yang 1, W. Paul Menzel 2, and H.-L. Huang 1 1 Cooperative Institute for Meteorological Satellite Studies (CIMSS), UW-Madison 2 NOAA/NESDIS/ORA.
3.1 Statistical Distributions. Random Variable Observation = Variable Outcome = Random Variable Examples: – Weight/Size of animals – Animal surveys: detection.
WAVELET NOISE REMOVAL FROM BASEBAND DIGITAL SIGNALS IN BANDLIMITED CHANNELS Dr. Robert Barsanti SSST March 2010, University of Texas At Tyler.
EE565 Advanced Image Processing Copyright Xin Li Why do we Need Image Model in the first place? Any image processing algorithm has to work on a collection.
Outline Random variables –Histogram, Mean, Variances, Moments, Correlation, types, multiple random variables Random functions –Correlation, stationarity,
Introduction to Medical Imaging Week 6: Introduction to Medical Imaging Week 6: Denoising (part II) – Variational Methods and Evolutions Guy Gilboa Course.
Bayesian fMRI analysis with Spatial Basis Function Priors
PERFORMANCE OF A WAVELET-BASED RECEIVER FOR BPSK AND QPSK SIGNALS IN ADDITIVE WHITE GAUSSIAN NOISE CHANNELS Dr. Robert Barsanti, Timothy Smith, Robert.
Univariate Gaussian Case (Cont.)
Directional Multiscale Modeling of Images
The Chinese University of Hong Kong
Fourier and Wavelet Transformations
Super-resolution Image Reconstruction
Special Topics In Scientific Computing
Dynamical Statistical Shape Priors for Level Set Based Tracking
Image Denoising in the Wavelet Domain Using Wiener Filtering
Graduate School of Information Sciences, Tohoku University
Historic Document Image De-Noising using Principal Component Analysis (PCA) and Local Pixel Grouping (LPG) Han-Yang Tang1, Azah Kamilah Muda1, Yun-Huoy.
Wavelet-Based Denoising Using Hidden Markov Models
Mark Kalman Isaac Keslassy Daniel Wang 12/6/00
Wavelet-Based Denoising Using Hidden Markov Models
A Fast Fixed-Point Algorithm for Independent Component Analysis
Expectation-Maximization & Belief Propagation
LECTURE 15: REESTIMATION, EM AND MIXTURES
Graduate School of Information Sciences, Tohoku University
CS723 - Probability and Stochastic Processes
Graduate School of Information Sciences, Tohoku University
Presentation transcript:

Hidden Markov Tree Model of the Uniform Discrete Curvelet Transform Image for Denoising Yothin Rakvongthai

Introduction Curvelet Transform (Candes&Donoho 1999) Implementation: Fast Discrete Curvelet Transform (FDCT) (Candes et. al 2005) : in frequency domain Contourlet (Do&Vetterli 2005) : in time domain with wavelet-like tree structure Uniform Discrete Curvelet Transform (UDCT) (Nguyen&Chauris 2008) : in frequency domain with wavelet-like tree structure

Implementation

UDCT Marginal Statistics Kurtosis = 23.71 Kurtosis = 24.42 Kurtosis = E[(x-μ)4]/σ4 . Kurtosis of Gaussian = 3

Conditional Distribution (1) On parent (same position in next level) P(X|PX) Bow-tie shape uncorrelated but dependent

Conditional Distribution (2) On parent P(X|PX=px) Kurtosis=3.51 ~Gaussian

Hidden Markov Tree (HMT) Model Conditional distribution is Gaussian X depends on PX  Use HMT to model the coefficients HMT model links between the hidden state variables of parent and children HMT parameters (parameters of the density function) can be trained using the expectation-minimization (EM) algorithm

Tree Structure of UDCT

HMT (1) c(j,k,n) – coefficient in scale j, direction k, position n S(j,k,n) – hidden state taking on values m = “S” or “L” with density function P(S(j,k,n)) Conditioned on S(j,k,n)=m, c(j,k,n) is Gaussian with mean μm(j,k,n) and variance σ2m(j,k,n) (m=Ssmall variance, m=Llarge variance)

HMT (2) The total pdf P(S(j,k,n)), μm(j,k,n), σ2m(j,k,n) can be trained from the EM algorithm (Crouse et al 1998). Define Θ = set of P(S(j,k,n)), μm(j,k,n), σ2m(j,k,n)

Denoising (1) Problem formulation: y = x+w ynoisy coefficients xdenoised coefficients wnoise coefficients with known variance Want to estimate x from the knowledge of y and variance of w

Denoising (2) Obtain Θ from EM algorithm The variance of denoised coefficients is

Denoising (3) The estimate of x

Denoising Results (1) PSNR = Peak Signal to Noise Ratio

Denoising Results (2) SSIM = Structure Similarity Index (Wang et. al 2004)

Denoising Results (3) Original Noisy (14.14dB) Wavelet (25.73dB) (SSIM 0.112) (SSIM 0.561) Contourlet (25.85dB) DT-CWT (26.54dB) UDCT (27.32dB) (SSIM 0.590) (SSIM 0.579) (SSIM 0.676)

Denoising Results (4) Original Noisy (14.14dB) Wavelet (23.38dB) (SSIM 0.184) (SSIM 0.508) Contourlet (22.94dB) DT-CWT (24.15dB) UDCT (24.35dB) (SSIM 0.479) (SSIM 0.557) (SSIM 0.570)

Denoising Results (5) Original Noisy (14.14dB) Wavelet (25.25dB) (SSIM 0.110) (SSIM 0.539) Contourlet (25.51dB) DT-CWT (25.99dB) UDCT (26.51dB) (SSIM 0.555) (SSIM 0.553) (SSIM 0.627)