Ter Haar Romeny, MICCAI 2008 Regularization and scale-space.

Slides:



Advertisements
Similar presentations
Lecture on Numerical Analysis Dr.-Ing. Michael Dumbser
Advertisements

Image Enhancement by Regularization Methods Andrey S. Krylov, Andrey V. Nasonov, Alexey S. Lukin Moscow State University Faculty of Computational Mathematics.
Ter Haar Romeny, FEV Scale-time. ter Haar Romeny, FEV Time measurements can essentially be processed in two ways: as pre-recorded frames or instances,
Ter Haar Romeny, EMBS Berder 2004 Deblurring with a scale-space approach.
Ter Haar Romeny, TU/e Mathematical Models of Contextual Operators Eindhoven University of Technology Department of Biomedical Engineering Markus van Almsick,
Ter Haar Romeny, EMBS Berder 2004 Gaussian derivative kernels The algebraic expressions for the first 4 orders:
Ter Haar Romeny, FEV Geometry-driven diffusion: nonlinear scale-space – adaptive scale-space.
Ter Haar Romeny, EMBS Berder 2004 How can we find a dense optic flow field from a motion sequence in 2D and 3D? Many approaches are taken: - gradient based.
Ter Haar Romeny, ICPR 2010 Introduction to Scale-Space and Deep Structure.
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean Hall 5409 T-R 10:30am – 11:50am.
Johann Radon Institute for Computational and Applied Mathematics: 1/38 Mathematische Grundlagen in Vision & Grafik ( ) more.
Various Regularization Methods in Computer Vision Min-Gyu Park Computer Vision Lab. School of Information and Communications GIST.
Edge Preserving Image Restoration using L1 norm
Variational Pairing of Image Segmentation and Blind Restoration Leah Bar Nir Sochen* Nahum Kiryati School of Electrical Engineering *Dept. of Applied Mathematics.
Ter Haar Romeny, Computer Vision 2014 Geometry-driven diffusion: nonlinear scale-space – adaptive scale-space.
Johann Radon Institute for Computational and Applied Mathematics: 1/39 The Gaussian Kernel, Regularization.
CSE554Extrinsic DeformationsSlide 1 CSE 554 Lecture 9: Extrinsic Deformations Fall 2012.
Signal- und Bildverarbeitung, 323
Data mining and statistical learning - lecture 6
MATH 685/ CSI 700/ OR 682 Lecture Notes
Chapter 18 Interpolation The Islamic University of Gaza
1 Chapter 4 Interpolation and Approximation Lagrange Interpolation The basic interpolation problem can be posed in one of two ways: The basic interpolation.
EARS1160 – Numerical Methods notes by G. Houseman
Image Segmentation and Active Contour
On Constrained Optimization Approach To Object Segmentation Chia Han, Xun Wang, Feng Gao, Zhigang Peng, Xiaokun Li, Lei He, William Wee Artificial Intelligence.
Contour evolution scheme for variational image segmentation and smoothing S. Mahmoodi and B.S. Sharif.
Instructor : Dr. Saeed Shiry
1 Image filtering Hybrid Images, Oliva et al.,
Modern Sampling Methods Summary of Subspace Priors Spring, 2009.
Data smoothing Raymond Cuijpers. Index The moving average Convolution The difference operator Fourier transforms Gaussian smoothing Butterworth filters.
Purely evidence-based multi-scale cardiac tracking using optic flow Hans van Assen 1, Luc Florack 1, Avan Suinesiaputra 2, Jos Westenberg 2, Bart ter Haar.
REGULARIZATION THEORY OF INVERSE PROBLEMS - A BRIEF REVIEW - Michele Piana, Dipartimento di Matematica, Università di Genova.
EE565 Advanced Image Processing Copyright Xin Li Different Frameworks for Image Processing Statistical/Stochastic Models: Wiener’s MMSE estimation.
Geometry-driven Diffusion.
Johann Radon Institute for Computational and Applied Mathematics: 1/49 Signal- und Bildverarbeitung, silently converted to:
Advanced Image Processing Image Relaxation – Restoration and Feature Extraction 02/02/10.
Recursive Bilateral Filtering F Reference Yang, Qingxiong. "Recursive bilateral filtering." ECCV Deriche, Rachid. "Recursively implementating.
Johann Radon Institute for Computational and Applied Mathematics: 1/48 Mathematische Grundlagen in Vision & Grafik ( ) more.
Section 2: Finite Element Analysis Theory
Basis beeldverwerking (8D040) dr. Andrea Fuster Prof.dr. Bart ter Haar Romeny dr. Anna Vilanova Prof.dr.ir. Marcel Breeuwer Convolution.
1 PATTERN COMPARISON TECHNIQUES Test Pattern:Reference Pattern:
Image Processing Edge detection Filtering: Noise suppresion.
Course 13 Curves and Surfaces. Course 13 Curves and Surface Surface Representation Representation Interpolation Approximation Surface Segmentation.
Basis Expansions and Regularization Part II. Outline Review of Splines Wavelet Smoothing Reproducing Kernel Hilbert Spaces.
Effective Optical Flow Estimation
Course 2 Image Filtering. Image filtering is often required prior any other vision processes to remove image noise, overcome image corruption and change.
Axioms Arjan Kuijper Axioms; PhD course on Scale Space, Cph 1-5 Dec Axioms of measurements and scale I1I2I3O KYBL1F1APN L2F2 Convolution.
Offenbach Semi-Implicit Time Integration (NH Schemes of the Next Generation) J. Steppeler, DWD.
Fourier Transform.
MA2213 Lecture 2 Interpolation.
Deblurring with a scale-space approach. Gaussian degradation occurs in a large number of situations. the point-spread-function of the human lens e.g.
MA5238 Fourier Analysis Wayne Lawton Department of Mathematics S ,
Machine Vision Edge Detection Techniques ENT 273 Lecture 6 Hema C.R.
Gholamreza Anbarjafari, PhD Video Lecturers on Digital Image Processing Digital Image Processing Spatial Domain Filtering: Part I.
Basis Expansions and Generalized Additive Models Basis expansion Piecewise polynomials Splines Generalized Additive Model MARS.
Interpolation - Introduction
Chapter 2. Mathematical Expression of Conduction
Chapter 3, Interpolation and Extrapolation
A Gentle Introduction to Bilateral Filtering and its Applications
Chapter 23.
Today’s class Multiple Variable Linear Regression
Graduate School of Information Sciences Tohoku University, Japan
Active Contours (“Snakes”)
Non-local Means Filtering
Basis Expansions and Generalized Additive Models (2)
Adaptive Cooperative Systems Chapter 6 Markov Random Fields
30 m 2000 m 30 m 2000 m. 30 m 2000 m 30 m 2000 m.
Lecture 7 Spatial filtering.
Shape from Shading and Texture
Overview June 9- B-Spline Curves June 16- NURBS Curves
Presentation transcript:

ter Haar Romeny, MICCAI 2008 Regularization and scale-space

ter Haar Romeny, MICCAI 2008 Regularization is the technique to make data behave well when an operator is applied to them. A small variation of the input data should lead to small change in the output data. Differentiation is a notorious function with 'bad behaviour'. Some functions that can not be differentiated.

ter Haar Romeny, MICCAI 2008 In mathematical terms it is said that the operation of differentiation is ill-posed, the opposite of well-posed. Jacques Hadamard (1865–1963) stated the conditions for well-posedness: The solution must exist; The solution must be uniquely determined; The solution must depend continuously on the initial or boundary data. In other words, the solution should be stable.

ter Haar Romeny, MICCAI 2008 smoothing the data, convolution with some extended kernel, like a 'running average filter' or the Gaussian; interpolation, by a polynomial (multidimensional) function; energy minimization, of a cost function under constraints fitting a function to the data (e.g. splines). The cubic splines are named so because they fit to third order; graduated convexity [Blake1987]; deformable templates ('snakes') [McInerney1996]; thin plates splines [Bookstein1989]; Tikhonov regularization.

ter Haar Romeny, MICCAI 2008 The formal mathematical method to solve the problems of ill- posed differentiation was given by Laurent Schwartz: A regular tempered distribution associated with an image is defined by the action of a smooth test function on the image. The derivative is:

ter Haar Romeny, MICCAI 2008 Fields Medal 1950 for his work on the theory of distributions. Schwartz has received a long list of prizes, medals and honours in addition to the Fields Medal. He received prizes from the Paris Academy of Sciences in 1955, 1964 and In 1972 he was elected a member of the Academy. He has been awarded honorary doctorates from many universities including Humboldt (1960), Brussels (1962), Lund (1981), Tel-Aviv (1981), Montreal (1985) and Athens (1993). Laurent Schwartz ( )

ter Haar Romeny, MICCAI 2008

Relation regularization - Gaussian scale-space An essential result in scale-space theory was shown by Mads Nielsen (Copenhagen University). He proved that Tikhonov regularization is essentially equivalent to convolution with a Gaussian kernel. minimize this function for g, given the constraint that the derivative behaves well. Euler-Lagrange:

ter Haar Romeny, MICCAI 2008 In the Fourier domain the expressions are easier:

ter Haar Romeny, MICCAI 2008 In the spatial domain: Filter proposed by Castan, 1990

ter Haar Romeny, MICCAI 2008 Including the second order derivative: Function proposed by Deriche (1987) Etc.

ter Haar Romeny, MICCAI 2008 Taylor expansion of the Gaussian in the Fourier domain: By recursion: Tikhonov regularization is equivalent to Gaussian blurring

ter Haar Romeny, MICCAI 2008 Older implementations are approximations of the Gaussian kernel: