04/12/10SIAM Imaging Science Superresolution and Blind Deconvolution of Images and Video Institute of Information Theory and Automation Academy of Sciences of the Czech Republic Prague Filip Šroubek, Jan Flusser, and Michal Šorel

04/12/10SIAM Imaging Science Traffic surveillance Can we read license plates?

04/12/10SIAM Imaging Science Empirical observation One image is not enough –ill-posed problem Solution –strong prior knowledge of blurs and/or the original image OR –more images –techniques how to combine them

04/12/10SIAM Imaging Science Outline Mathematical model Algorithm Examples Extension to the space-variant case

04/12/10SIAM Imaging Science original image u(x)u(x) +nk(x)+nk(x) + noise acquired images = z k (x) Multichannel Acquisition Model channel K channel 2 channel 1 D[u * h k ](x)

04/12/10SIAM Imaging Science Multichannel Deconvolution Super-resolution

04/12/10SIAM Imaging Science Misregistration

04/12/10SIAM Imaging Science Misregistration Incorporating between-image shift original imagePSFdegraded image

04/12/10SIAM Imaging Science Superresolution & Blind Deconv. Acquisition model Optimization problem Data term Image regularization term Blur Regularization term

04/12/10SIAM Imaging Science Regularization Terms

04/12/10SIAM Imaging Science u h2h2 * uuh1h1 * ==z1z1 z2z2 z1z1 h2h2 ** uh1h1 =h2h2 * z2z2 * h1h1 h2h2 u * =h1h1 * PSF Regularization

04/12/10SIAM Imaging Science Alternating minimizations of F(u,{h k }) Input: blurred LR images and estimation of PSF size Output: HR image and PSFs Blind deconvolution in the SR framework AM Algorithm

04/12/10SIAM Imaging Science Blind Deconvolution

04/12/10SIAM Imaging Science

04/12/10SIAM Imaging Science Superresolved image (2x) Optical zoom (ground truth) rough registration Superresolution

04/12/10SIAM Imaging Science Space-variant Case

04/12/10SIAM Imaging Science Space-variant Case Video with local motion Space-variant PSFs and/or misregistered images

interpolated SR

interpolated SR tt+1t+2t-2t-1

interpolated SR SR + masking tt+1t+2t-2t-1

04/12/10SIAM Imaging Science Out-of-focus Blur

04/12/10SIAM Imaging Science Camera-motion Blur

04/12/10SIAM Imaging Science Space-variant Superresolution

04/12/10SIAM Imaging Science

04/12/10SIAM Imaging Science Close-up Input LR Space-variant Reconstruction Original Space-invariant Reconstruction

04/12/10SIAM Imaging Science Misregistered Images

04/12/10SIAM Imaging Science Misregistered Images - Results Space-variant Space-invariant

04/12/10SIAM Imaging Science MATLAB Application zoi.utia.cas.cz/download

04/12/10SIAM Imaging Science Thank You for Your Attention