1. Instructor: Yonina Eldar Teaching Assistant: Tomer Michaeli Spring 2009 Modern Sampling Methods 049033

2. 2 Sampling: “Analog Girl in a Digital World…” Judy Gorman 99 Digital worldAnalog world Signal processing Denoising Image analysis … Reconstruction D2A Sampling A2D (Interpolation)

3. 3 Applications Sampling Rate Conversion Common audio standards: 8 KHz (VOIP, wireless microphone, …) 11.025 KHz (MPEG audio, …) 16 KHz (VOIP, …) 22.05 KHz (MPEG audio, …) 32 KHz (miniDV, DVCAM, DAT, NICAM, …) 44.1 KHz (CD, MP3, …) 48 KHz (DVD, DAT, …) …

4. 4 Lens distortion correction Image scaling Applications Image Transformations

5. 5 Applications CT Scans

6. 6 Applications Spatial Superresolution

7. 7 Applications Temporal Superresolution

8. 8

9. 9 Our Point-Of-View The field of sampling was traditionally associated with methods implemented either in the frequency domain, or in the time domain Sampling can be viewed in a broader sense of projection onto any subspace or union of subspaces Can choose the subspaces to yield interesting new possibilities (below Nyquist sampling of sparse signals, pointwise samples of non bandlimited signals, perfect compensation of nonlinear effects …)

10. 10 Cauchy (1841): Whittaker (1915) - Shannon (1948): A. J. Jerri, “The Shannon sampling theorem - its various extensions and applications: A tutorial review”, Proc. IEEE, pp. 1565-1595, Nov. 1977. Bandlimited Sampling Theorems

11. 11 Limitations of Shannon’s Theorem Input bandlimited Impractical reconstruction (sinc) Ideal sampling Towards more robust DSPs: General inputs Nonideal sampling: general pre-filters, nonlinear distortions Simple interpolation kernels

12. 12 Generalized anti- aliasing filter Sampling Process Linear Distortion Sampling functions Electrical circuit Local averaging

13. 13 Replace Fourier analysis by functional analysis, Hilbert space algebra, and convex optimization Original + Initial guess Reconstructed signal Sampling Process Nonlinear Distortion Nonlinear distortion Linear distortion

14. 14 Employ estimation techniques Sampling Process Noise

15. 15 Signal Priors x(t) bandlimited x(t) piece-wise linear Different priors lead to different reconstructions

16. 16 Shift invariant subspace: General subspace in a Hilbert space Signal Priors Subspace Priors Common in communication: pulse amplitude modulation (PAM) Bandlimited Spline spaces

17. 17 Two key ideas in bandlimited sampling: Avoid aliasing Fourier domain analysis Beyond Bandlimited Misleading concepts! Suppose that with Signal is clearly not bandlimited Aliasing in frequency and time Perfect reconstruction possible from samples Aliasing is not the issue …

18. 18 Signal Priors Smoothness Priors

19. 19 Signal Priors Stochastic Priors Original ImageBicubic InterpolationMatern Interpolation

20. 20 Signal Priors Sparsity Priors Wavelet transform of images is commonly sparse STFT transform of speech signals is commonly sparse Fourier transform of radio signals is commonly sparse

21. 21 Reconstruction Constraints Unconstrained Schemes SamplingReconstruction

22. 22 Reconstruction Constraints Predefined Kernel SamplingReconstructionPredefined Minimax methods Consistency requirement

23. 23 Reconstruction Constraints Dense Grid InterpolationPredefined (e.g. linear interpolation) To improve performance: Increase reconstruction rate

24. 24 Reconstruction Constraints Dense Grid Interpolation Bicubic InterpolationSecond Order Approximation to Matern Interpolation with K=2 Optimal Dense Grid Matern Interpolation with K=2

25. 25 Course Outline (Subject to change without further notice) Motivating introduction after which you will all want to take this course (1 lesson) Crash course on linear algebra (basically no prior knowledge is assumed but strong interest in algebra is highly recommended) (~3 lessons) Subspace sampling (sampling of nonbandlimited signals, interpolation methods) (~2 lessons) Nonlinear sampling (~1 lesson) Minimax recovery techniques (~1 lesson) Constrained reconstruction: minimax and consistent methods (~2 lessons) Sampling sparse signals (1 lesson) Sampling random signals (1 lesson)