1. 04/12/10SIAM Imaging Science 20101 Superresolution and Blind Deconvolution of Images and Video Institute of Information Theory and Automation Academy of Sciences of the Czech Republic Prague Filip Šroubek, Jan Flusser, and Michal Šorel

2. 04/12/10SIAM Imaging Science 20102 Traffic surveillance Can we read license plates?

3. 04/12/10SIAM Imaging Science 20103 Empirical observation One image is not enough –ill-posed problem Solution –strong prior knowledge of blurs and/or the original image OR –more images –techniques how to combine them

4. 04/12/10SIAM Imaging Science 20104 Outline Mathematical model Algorithm Examples Extension to the space-variant case

5. 04/12/10SIAM Imaging Science 20105 original image u(x)u(x) +nk(x)+nk(x) + noise acquired images = z k (x) Multichannel Acquisition Model channel K channel 2 channel 1 D[u * h k ](x)

6. 04/12/10SIAM Imaging Science 20106 Multichannel Deconvolution Super-resolution

7. 04/12/10SIAM Imaging Science 20107 Misregistration

8. 04/12/10SIAM Imaging Science 20108 Misregistration Incorporating between-image shift original imagePSFdegraded image

9. 04/12/10SIAM Imaging Science 20109 Superresolution & Blind Deconv. Acquisition model Optimization problem Data term Image regularization term Blur Regularization term

10. 04/12/10SIAM Imaging Science 201010 Regularization Terms

11. 04/12/10SIAM Imaging Science 201011 0 u h2h2 * uuh1h1 * ==z1z1 z2z2 z1z1 h2h2 ** uh1h1 =h2h2 * z2z2 * h1h1 h2h2 u * =h1h1 * PSF Regularization

12. 04/12/10SIAM Imaging Science 201012 Alternating minimizations of F(u,{h k }) Input: blurred LR images and estimation of PSF size Output: HR image and PSFs Blind deconvolution in the SR framework AM Algorithm

13. 04/12/10SIAM Imaging Science 201013 Blind Deconvolution

14. 04/12/10SIAM Imaging Science 201014

15. 04/12/10SIAM Imaging Science 201015 Superresolved image (2x) Optical zoom (ground truth) rough registration Superresolution

16. 04/12/10SIAM Imaging Science 201016 Space-variant Case

17. 04/12/10SIAM Imaging Science 201017 Space-variant Case Video with local motion Space-variant PSFs and/or misregistered images

18. interpolated SR

19. interpolated SR tt+1t+2t-2t-1

20. interpolated SR SR + masking tt+1t+2t-2t-1

21. 04/12/10SIAM Imaging Science 201021 Out-of-focus Blur

22. 04/12/10SIAM Imaging Science 201022 Camera-motion Blur

23. 04/12/10SIAM Imaging Science 201023 Space-variant Superresolution

24. 04/12/10SIAM Imaging Science 201024

25. 04/12/10SIAM Imaging Science 201025 Close-up Input LR Space-variant Reconstruction Original Space-invariant Reconstruction

26. 04/12/10SIAM Imaging Science 201026 Misregistered Images

27. 04/12/10SIAM Imaging Science 201027 Misregistered Images - Results Space-variant Space-invariant

28. 04/12/10SIAM Imaging Science 201028 MATLAB Application zoi.utia.cas.cz/download

29. 04/12/10SIAM Imaging Science 201029 Thank You for Your Attention