Applications of Fourier Analysis in Image Recovery Kang Guo TJHSST Computer Systems Lab 2009-2010.

Slides:



Advertisements
Similar presentations
Inferring the kernel: multiscale method Input image Loop over scales Variational Bayes Upsample estimates Use multi-scale approach to avoid local minima:
Advertisements

IPIM, IST, José Bioucas, Convolution Operators Spectral Representation Bandlimited Signals/Systems Inverse Operator Null and Range Spaces Sampling,
Digital Image Processing Lecture 11: Image Restoration Prof. Charlene Tsai.
Deconvolution of Laser Scanning Confocal Microscope Volumes: Empirical determination of the point spread function Eyal Bar-Kochba ENGN2500: Medical Imaging.
EE4H, M.Sc Computer Vision Dr. Mike Spann
Shaojie Zhuo, Dong Guo, Terence Sim School of Computing, National University of Singapore CVPR2010 Reporter: 周 澄 (A.J.) 01/16/2011 Key words: image deblur,
Removing Camera Shake from a Single Photograph 报告人:牟加俊 日期: In ACM SIGGRAPH, 2006.
ECE 472/572 - Digital Image Processing Lecture 8 - Image Restoration – Linear, Position-Invariant Degradations 10/10/11.
EE465: Introduction to Digital Image Processing
The Fourier Transform Jean Baptiste Joseph Fourier.
The Fourier Transform Jean Baptiste Joseph Fourier.
Image Deblurring with Blurred/Noisy Image Pairs Lu Yuan Jian Sun Long Quan Heung-Yeung Shum The Hong Kong University of Science and Technology.
Digital Image Processing Chapter 5: Image Restoration.
DIP Realized by IDL Author: Ying Li Course: computer for imaging science.
CCU VISION LABORATORY Object Speed Measurements Using Motion Blurred Images 林惠勇 中正大學電機系
Image Deblurring with Optimizations Qi Shan Leo Jiaya Jia Aseem Agarwala University of Washington The Chinese University of Hong Kong Adobe Systems, Inc.
Media Cybernetics Deconvolution Approaches and Challenges Jonathan Girroir
Image deblurring Seminar inverse problems April 18th 2007 Willem Dijkstra.
Wireless communication channel
CS448f: Image Processing For Photography and Vision Denoising.
ELE 488 F06 ELE 488 Fall 2006 Image Processing and Transmission ( ) Wiener Filtering Derivation Comments Re-sampling and Re-sizing 1D  2D 10/5/06.
© by Yu Hen Hu 1 ECE533 Digital Image Processing Image Restoration.
Computer Vision - Restoration Hanyang University Jong-Il Park.
Copyright, 1996 © Dale Carnegie & Associates, Inc. Image Restoration Hung-Ta Pai Laboratory for Image and Video Engineering Dept. of Electrical and Computer.
EE4328, Section 005 Introduction to Digital Image Processing Linear Image Restoration Zhou Wang Dept. of Electrical Engineering The Univ. of Texas.
Yu-Wing Tai, Hao Du, Michael S. Brown, Stephen Lin CVPR’08 (Longer Version in Revision at IEEE Trans PAMI) Google Search: Video Deblurring Spatially Varying.
CS654: Digital Image Analysis
ENEE631 Digital Image Processing (Spring'04) Image Restoration Spring ’04 Instructor: Min Wu ECE Department, Univ. of Maryland, College Park  
CS654: Digital Image Analysis Lecture 22: Image Restoration - II.
Image Restoration.
Digital Image Processing Lecture : Image Restoration
8-1 Chapter 8: Image Restoration Image enhancement: Overlook degradation processes, deal with images intuitively Image restoration: Known degradation processes;
Vincent DeVito Computer Systems Lab The goal of my project is to take an image input, artificially blur it using a known blur kernel, then.
IMAGE RECONSTRUCTION. ALGORITHM-A SET OF RULES OR DIRECTIONS FOR GETTING SPECIFIC OUTPUT FROM SPECIFIC INPUT.
Typical Types of Degradation: Motion Blur.
Stopping Criteria Image Restoration Alfonso Limon Claremont Graduate University.
Digital Image Processing CSC331 Image restoration 1.
Digital Image Processing Lecture 11: Image Restoration March 30, 2005 Prof. Charlene Tsai.
ELE 488 F06 ELE 488 Fall 2006 Image Processing and Transmission Image Restoration distortion noise Inverse Filtering Wiener Filtering Ref: Jain,
University of Ioannina - Department of Computer Science Filtering in the Frequency Domain (Application) Digital Image Processing Christophoros Nikou
Non-linear Filters Non-linear filter (nelineární filtr) –spatial non-linear operator that produces the output image array g(x,y) from the input image array.
Frequency Domain By Dr. Rajeev Srivastava. Image enhancement in the frequency domain is straightforward. We simply compute the Fourier transform of the.
November 5, 2013Computer Vision Lecture 15: Region Detection 1 Basic Steps for Filtering in the Frequency Domain.
Blind Inverse Gamma Correction (Hany Farid, IEEE Trans. Signal Processing, vol. 10 no. 10, October 2001) An article review Merav Kass January 2003.
Vincent DeVito Computer Systems Lab The goal of my project is to take an image input, artificially blur it using a known blur kernel, then.
" Fitting methods with direct convolution for shear measurements." STEP Workshop August 2007 M. Shmakova.
Cycle Detection and Removal in Electricity Markets “Lunch at Lab” Presentation Matt Lyle Department of mathematics&statistics University of Calgary, Alberta.
Today Defocus Deconvolution / inverse filters. Defocus.
6/10/20161 Digital Image Processing Lecture 09: Image Restoration-I Naveed Ejaz.
ECE 533 Project Tribute By: Justin Shepard & Jesse Fremstad.
The Frequency Domain Digital Image Processing – Chapter 8.
A VQ-Based Blind Image Restoration Algorithm
Heechul Han and Kwanghoon Sohn
Degradation/Restoration Model
Image Deblurring and noise reduction in python
Deconvolution , , Computational Photography
The Chinese University of Hong Kong
Image Restoration and Denoising
Vincent DeVito Computer Systems Lab
Image De-blurring Defying logic
Applications of Fourier Analysis in Image Recovery
Typical Types of Degradation: Motion Blur.
Intensity Transformation
Advanced deconvolution techniques and medical radiography
Digital Image Processing Lecture 11: Image Restoration
Deblurring Shaken and Partially Saturated Images
IMAGE DEBLURRING THE END IS NIGH
Presentation transcript:

Applications of Fourier Analysis in Image Recovery Kang Guo TJHSST Computer Systems Lab

Image Blur Common cause of image quality degradation in photography Removing blur from images is a practical application

Fourier Transform Spatial domain to Frequency domain N, N^2 transforms Imaginary numbers, displayed with magnitude o Given a+b i, √(a^2+b^2) e^(iӨ) = cos(Ө)+isin(Ө)

Fast Fourier Transform Speed improvement 2N, N transforms 2 components

Logarithmic Transform Fit all values within the range of 8-bit color values Image without the logarithmic transform

Results Original ImageFourier Transformed Image

Applying a Blur Fourier Transform of Blur Filter must be multiplied with Fourier Transform of the Original Image A Point Spread Function (PSF) is simply the Fourier Transform of the blur filter Different kinds of blur can be modeled with a PSF o e.g. linear, gaussian, etc.

Blurred Image

Linear Blur

Gaussian Blur

Deblur the Image If the PSF is known, then the reverse process can be done to remove the blur That is, instead of multiplying, dividing will result in the inverse process

Deblurred Image ÷

Problems Division by very small Fourier values creates amplified noise

Inverse Filter Goal to reduce/remove noise All values that are determined to be too small are set to a common value, gamma

Inverse Filter Without Inverse FilterWith Inverse Filter Not a large difference, but still helpful at a low cost of efficiency.

Inverse Filter Without Inverse FilterWith Inverse Filter However, in the case of a Gaussian blur, the Inverse Filter is not as helpful.

Regularization Introducing additional information into a problem to allow a proper solution The inverse process (deconvolution), division of blurred image by PSF produces loss of data Regularization → some sort of restriction, forcing final solution to fall in a set boundary of answers

Matlab Implementation Image Processing Toolbox Due to the difficulty of these image processing algorithms and the limited scope of this project, I will be using Matlab to implement regularization, filters, and blind deconvolution deconvblind(), deconvlucy(), deconvreg(), deconvwnr()

Matlab Implementation No RegularizationRegularizationRichardson-Lucy

Conclusion Non-blind deconvolution is relatively simple, but still not perfect Blind deconvolution is much more difficult However, if the blind deconvolution problem is ever solved, it will be a huge step forward for image processing and the general community of photographers

References Q. Shan, J. Jia, and A. Agarwala. ``High-quality Motion Deblurring from a Single Image" ACM Trans. Graph. 27, 3, Article 73 (August 2008). L. Yuan, J. Sun, L. Quan, and H. Shum. ``Image Deblurring With Blurry/Noisy Image Pairs" ACM Trans. Graph. 26, 3, Article 1 (July 2007). R. Fisher, S. Perkins, A. Walker, and E. Wolfart. ``Image Transforms - Fourier Transform", T. Chan and J. Shen. ``Theory and Computation of Variational Image Deblurring" WSPC/Lecture Notes Series (November 2005). S. Allon, M. Debertrand, and B. Sleutjes. ``Fast Deblurring Algorithms", bDeblur/OGO3.2b_2004_Deblur.pdf Y. Fan. ``Deblurring Images: Python, CGI, and Web", G. Kempen and L. Vliet. (2000). ``The influence of the regularization parameter and the first estimate on the performance of Tikhonov regularized non-linear image restoration algorithms", Journal of Microscopy pp Z. Zhao and R. Blahut. ``The Richardson-Lucy Algorithm Based Demodulation Algorithms for the Two-dimensional Intersymbol Interference Channel",