Image Deblurring Using Dark Channel Prior

Slides:



Advertisements
Similar presentations
Inferring the kernel: multiscale method Input image Loop over scales Variational Bayes Upsample estimates Use multi-scale approach to avoid local minima:
Advertisements

Removing blur due to camera shake from images. William T. Freeman Joint work with Rob Fergus, Anat Levin, Yair Weiss, Fredo Durand, Aaron Hertzman, Sam.
Removing Partial Blur in a Single Image Shengyang Dai and Ying Wu EECS Department, Northwestern University, Evanston, IL 60208, USA 2009CVPR.
Automatic Image Annotation Using Group Sparsity
Edge Preserving Image Restoration using L1 norm
L1 sparse reconstruction of sharp point set surfaces
SE263 Video Analytics Course Project Initial Report Presented by M. Aravind Krishnan, SERC, IISc X. Mei and H. Ling, ICCV’09.
Lecture 2: Convolution and edge detection CS4670: Computer Vision Noah Snavely From Sandlot ScienceSandlot Science.
Patch-based Image Deconvolution via Joint Modeling of Sparse Priors Chao Jia and Brian L. Evans The University of Texas at Austin 12 Sep
Shaojie Zhuo, Dong Guo, Terence Sim School of Computing, National University of Singapore CVPR2010 Reporter: 周 澄 (A.J.) 01/16/2011 Key words: image deblur,
Robust Object Tracking via Sparsity-based Collaborative Model
Unnatural L 0 Representation for Natural Image Deblurring Speaker: Wei-Sheng Lai Date: 2013/04/26.
Large-Scale, Real-World Face Recognition in Movie Trailers Week 2-3 Alan Wright (Facial Recog. pictures taken from Enrique Gortez)
Fast Removal of Non-uniform Camera Shake By Michael Hirsch, Christian J. Schuler, Stefan Harmeling and Bernhard Scholkopf Max Planck Institute for Intelligent.
1 Removing Camera Shake from a Single Photograph Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis and William T. Freeman ACM SIGGRAPH 2006, Boston,
Rob Fergus Courant Institute of Mathematical Sciences New York University A Variational Approach to Blind Image Deconvolution.
Optimization & Learning for Registration of Moving Dynamic Textures Junzhou Huang 1, Xiaolei Huang 2, Dimitris Metaxas 1 Rutgers University 1, Lehigh University.
Personal Photo Enhancement using Example Images Neel Joshi Wojciech Matusik, Edward H. Adelson, and David J. Kriegman Microsoft Research, Disney Research,
DISCRIMINATIVE DECORELATION FOR CLUSTERING AND CLASSIFICATION ECCV 12 Bharath Hariharan, Jitandra Malik, and Deva Ramanan.
Supervisor: Prof. Anil Kokaram Co-Supervisor: Dr. David Corrigan Student: Yun feng Wang Deblurring in Atomic Force Microscopy (AFM) images.
Image processing. Image operations Operations on an image –Linear filtering –Non-linear filtering –Transformations –Noise removal –Segmentation.
Optical Flow Methods 2007/8/9.
Optical flow and Tracking CISC 649/849 Spring 2009 University of Delaware.
Announcements Kevin Matzen office hours – Tuesday 4-5pm, Thursday 2-3pm, Upson 317 TA: Yin Lou Course lab: Upson 317 – Card access will be setup soon Course.
1 Image filtering Images by Pawan SinhaPawan Sinha.
Single Image Haze Removal Using Dark Channel Prior Professor : 王聖智 教授 Student : 戴玉書 CVPR Best Paper AwardBest Paper Award Kaiming HeKaiming He, Dept.
Image Deblurring with Optimizations Qi Shan Leo Jiaya Jia Aseem Agarwala University of Washington The Chinese University of Hong Kong Adobe Systems, Inc.
1 Image filtering Hybrid Images, Oliva et al.,
Haze removal using dark channel prior. Preface Guided Image Filter Pros: fast, high-quality Cons: halos,strokes.
Linear Filtering About modifying pixels based on neighborhood. Local methods simplest. Linear means linear combination of neighbors. Linear methods simplest.
CS448f: Image Processing For Photography and Vision Denoising.
Most slides from Steve Seitz
Lecture 1: Images and image filtering CS4670/5670: Intro to Computer Vision Kavita Bala Hybrid Images, Oliva et al.,
Last tuesday, you talked about active shape models Data set of 1,500 hand-labeled faces 20 facial features (eyes, eye brows, nose, mouth, chin) Train 40.
Digital Image Processing Image Enhancement Part IV.
Chapter 7 Case Study 1: Image Deconvolution. Different Types of Image Blur Defocus blur --- Depth of field effects Scene motion --- Objects in the scene.
Accidental pinhole and pinspeck cameras: revealing the scene outside the picture A. Torralba and W. T. Freeman Proceedings of 25 IEEE Conference on Computer.
Yu-Wing Tai, Hao Du, Michael S. Brown, Stephen Lin CVPR’08 (Longer Version in Revision at IEEE Trans PAMI) Google Search: Video Deblurring Spatially Varying.
Image Processing Jitendra Malik. Different kinds of images Radiance images, where a pixel value corresponds to the radiance from some point in the scene.
Mitsubishi Electric Research Labs (MERL) Super-Res from Single Motion Blur PhotoAgrawal & Raskar Amit Agrawal and Ramesh Raskar Mitsubishi Electric Research.
Vincent DeVito Computer Systems Lab The goal of my project is to take an image input, artificially blur it using a known blur kernel, then.
CS 641 Term project Level-set based segmentation algorithms Presented by- Karthik Alavala (under the guidance of Dr. Jundong Liu)
Non-linear Filters Non-linear filter (nelineární filtr) –spatial non-linear operator that produces the output image array g(x,y) from the input image array.
Removing motion blur from a single image
Non-Linear Transformations Michael J. Watts
Vincent DeVito Computer Systems Lab The goal of my project is to take an image input, artificially blur it using a known blur kernel, then.
Image Filtering with GLSL DI1.03 蔡依儒. Outline Convolution Convolution Convolution implementation using GLSL Convolution implementation using GLSL Commonly.
Filtering (II) Dr. Chang Shu COMP 4900C Winter 2008.
Lecture 1: Images and image filtering CS4670/5670: Intro to Computer Vision Noah Snavely Hybrid Images, Oliva et al.,
Jianchao Yang, John Wright, Thomas Huang, Yi Ma CVPR 2008 Image Super-Resolution as Sparse Representation of Raw Image Patches.
Convolutional Neural Networks for Direct Text Deblurring
By: Rachel Yuen, Chad Van De Hey, and Jake Trotman
Phil Morley Haze Removal.
Fast edge-directed single-image super-resolution
Image Deblurring and noise reduction in python
A Neural Approach to Blind Motion Deblurring
Applications of AI Image Processing.
Reconstruction For Rendering distribution Effect
Deconvolution , , Computational Photography
A Comparative Study for Single Image Blind Deblurring
Single Image Haze Removal Using Dark Channel Prior
Fast image deconvolution using Hyper-Laplacian Prior
Towards Understanding the Invertibility of Convolutional Neural Networks Anna C. Gilbert1, Yi Zhang1, Kibok Lee1, Yuting Zhang1, Honglak Lee1,2 1University.
Single Image Rolling Shutter Distortion Correction
Digital Image Processing Week IV
Parallel and Distributed Graph Cuts by Dual Decomposition
FOCUS PRIOR ESTIMATION FOR SALIENT OBJECT DETECTION
Image Filtering with GLSL
Deblurring Shaken and Partially Saturated Images
Lecture 7 Patch based methods: nonlocal means, BM3D, K- SVD, data-driven (tight) frame.
Presentation transcript:

Image Deblurring Using Dark Channel Prior Liang Zhang (lzhang432)

Outline Motivation Solutions Application Future Work Reference Dark Channel Model Optimization Application Future Work Reference

Motivation Recover Blur Image Photos are taken everyday (mobile phone, digital camera, GoPros) Blur Images are undesirable Hard to reproduce the capture moment How to get deblur image without have to retake picture? Example of Blur Image

Motivation Blur Image = Sharp Image * Blur Kernel + Noise[8] Clear Image Blur Kernel Noise Blur Image = Sharp Image * Blur Kernel + Noise[8]

Motivation Blur Image = Sharp Image * Blur Kernel + Noise[8] Clear Image Blur Kernel Noise Blur Image = Sharp Image * Blur Kernel + Noise[8]

Outline Motivation Solutions Application Future Work Reference Dark Channel Model Optimization Application Future Work Reference

Convolution Convolution: Weighted average of a patch 50 10 120 30 180 120 30 180 25 90 60 2 20 75 3 80 15 5 12 300 200 150 1/9 Blur Kernel Clear Image

Convolution Convolution: Weighted average of a patch 50 10 120 30 180 120 30 180 25 90 60 2 20 75 3 80 15 5 12 300 200 150 1/9 45 Blur Kernel Clear Image

Convolution Dark Channel: Convolution: >= The lowest value among a patch Convolution: Weighted average of a patch 50 10 120 30 180 25 90 60 2 20 75 3 80 15 5 12 300 200 150 1/9 45 >= Blur Kernel Clear Image

Convolution and Dark Channel Image Dark channel of blurred image are less sparse than the dark channel of sharp image Dark Channel Clear Image Blurred Image

Deblur Approach Image Dark Channel Clear Image Blurred Image

Outline Motivation Solutions Application Future Work Reference Dark Channel Model Optimization Application Future Work Reference

Model Based of fact that the dark channel of sharp image have more number of zero-intensity pixels [8]

Model Based of fact that the dark channel of sharp image have more number of zero-intensity pixels [8] Data Fitting

Model Blur Kernel Regularization Based of fact that the dark channel of sharp image have more number of zero-intensity pixels [8] Blur Kernel Regularization

Model Gradients of Image Sparsity Based of fact that the dark channel of sharp image have more number of zero-intensity pixels [8] Gradients of Image Sparsity

This term is used to measure the sparsity of dark channel Model Based of fact that the dark channel of sharp image have more number of zero-intensity pixels [8] L0 norm Non-linear min operator This term is used to measure the sparsity of dark channel

Non-linear Operation D(I) = MI M D(I): vectorized of D(I) M: indicator matrix of dark channel I: vectorized latent image [8] M Latent Image Dark Channel

Non-linear Operation D(I) = MI M D(I): vectorized of D(I) M: indicator matrix of dark channel I: vectorized latent image [8] M Latent Image Dark Channel

Non-linear Operation D(I) = MI M D(I): vectorized of D(I) M: indicator matrix of dark channel I: vectorized latent image [8] M Latent Image Dark Channel

Blur Kernel and Clear Image Dark Channel of Latent Image Blur Kernel Clear Image

Outline Motivation Solutions Application Future Work Reference Dark Channel Model Optimization Application Future Work Reference

Application Run with paper’s data set

Application Run with paper’s data set

Application Run with our own data set (blur images are download from google)

Outline Motivation Solutions Application Future Work Reference Dark Channel Model Optimization Application Future Work Reference

Future Work Parallel computing implementation to accelerate deblur computing Implement the dark channel on mobile phone Improve the dark channel methods

Outline Motivation Solutions Application Future Work Reference Dark Channel Model Optimization Application Future Work Reference

Reference [1]  L.B.Lucy. An iterative technique for the rectification of observed distributions. Astronomy Journal, 79(6):745-754, 1974. [2]  T, Chan anc C.Wong. Total variation blind deconvolution.. IEEE TIP, 7(3):370-375, 1998. [3]  R.Fergus, B.Singh, A.Hertzmann, S.T.Roweis, and W.T.Freeman. Removing camera shake from a single photograph. ACM SIGGRAPH, 25(3):787-794, 2006.

Reference [4]  Y.Hacohen, E. Shechtman, and D.Lischinski. Deblurring by example using dense correspondence. In ICCV, pages2384-2391, 2013 [5]  D.Krishnan, T.Tay, and R.Fergus. Blind deconvolution using a normalized sparsit measure. In CVPR, pages2657-2664, 2011 [6]  T.Michaeli and M.Irani Blind deblurring using internal patch recurrence. In ECCV, pages783-798, 2014

Reference [7]  K.He, J.Sun, and X.Tang Single image haze removal using dark channel prior. In CVPR, pages1956-1963, 2009 [8]  Jinshan Pan, Deqing Sun, Hanspeter Pfister, and Ming-Hsuan Yang Blind Image Deblurring Using Dark Channel Prior. In CVPR, 2016 [9]https://sites.google.com/site/jspanhomepage/ [10]https://www.youtube.com/watch?v=dl1_592iDUY [11]https://www.google.com/search?q=blur+image&espv=2&source=lnms&tbm=isch&sa=X&ved=0ahUKEwjfntK7vrzTAhUo_IMKHRnfAm4Q_AUIBigB&biw=1074&bih=709&dpr=1

Thanks

Q & A

Backup slides