IMI 1 Approximation Theory Metric: Complicated Function Signal Image Solution to PDE Simple Function Polynomials Splines Rational Func.

Slides:



Advertisements
Similar presentations
Quantum t-designs: t-wise independence in the quantum world Andris Ambainis, Joseph Emerson IQC, University of Waterloo.
Advertisements

Vector Spaces A set V is called a vector space over a set K denoted V(K) if is an Abelian group, is a field, and For every element vV and K there exists.
5.1 Real Vector Spaces.
Shortest Vector In A Lattice is NP-Hard to approximate
Generalization and Specialization of Kernelization Daniel Lokshtanov.
Computer vision: models, learning and inference Chapter 13 Image preprocessing and feature extraction.
Chapter 2: Second-Order Differential Equations
MRA basic concepts Jyun-Ming Chen Spring Introduction MRA (multi- resolution analysis) –Construct a hierarchy of approximations to functions in.
Multiscale Representations for Point Cloud Data Andrew Waters Manjari Narayan Richard Baraniuk Luke Owens Ron DeVore.
Extensions of wavelets
Data mining and statistical learning - lecture 6
MATH 685/ CSI 700/ OR 682 Lecture Notes
Selected from presentations by Jim Ramsay, McGill University, Hongliang Fei, and Brian Quanz Basis Basics.
Basis Expansion and Regularization Presenter: Hongliang Fei Brian Quanz Brian Quanz Date: July 03, 2008.
1 Chapter 4 Interpolation and Approximation Lagrange Interpolation The basic interpolation problem can be posed in one of two ways: The basic interpolation.
Methods of Pattern Recognition chapter 5 of: Statistical learning methods by Vapnik Zahra Zojaji.
Signal , Weight Vector Spaces and Linear Transformations
Signal , Weight Vector Spaces and Linear Transformations
Chapter 7 Wavelets and Multi-resolution Processing.
Bivariate B-spline Outline Multivariate B-spline [Neamtu 04] Computation of high order Voronoi diagram Interpolation with B-spline.
Wavelet Packets For Wavelets Seminar at Haifa University, by Eugene Mednikov.
Paul Heckbert Computer Science Department Carnegie Mellon University
Basic Concepts and Definitions Vector and Function Space. A finite or an infinite dimensional linear vector/function space described with set of non-unique.
Multi-Resolution Analysis (MRA)
Representation and Compression of Multi-Dimensional Piecewise Functions Dror Baron Signal Processing and Systems (SP&S) Seminar June 2009 Joint work with:
CS Subdivision I: The Univariate Setting Peter Schröder.
ORDINARY DIFFERENTIAL EQUATION (ODE) LAPLACE TRANSFORM.
Wei Wang Xi’an Jiaotong University Generalized Spectral Characterization of Graphs: Revisited Shanghai Conference on Algebraic Combinatorics (SCAC), Shanghai,
MAT 4725 Numerical Analysis Section 8.2 Orthogonal Polynomials and Least Squares Approximations (Part II)
Artificial Neural Networks Shreekanth Mandayam Robi Polikar …… …... … net k   
Cs: compressed sensing
Section 4.1 Vectors in ℝ n. ℝ n Vectors Vector addition Scalar multiplication.
Extrapolation Models for Convergence Acceleration and Function ’ s Extension David Levin Tel-Aviv University MAIA Erice 2013.
Model-Based Compressive Sensing Presenter: Jason David Bonior ECE / CMR Tennessee Technological University November 5, 2010 Reading Group (Richard G. Baraniuk,
7.6 Rational Zero Theorem Algebra II w/ trig. RATIONAL ZERO THEOREM: If a polynomial has integer coefficients, then the possible rational zeros must be.
Partial Fraction Decompositions Rational Functions Partial Fraction Decompositions Finding Partial Fractions Decompositions Integrating Partial Fraction.
Discontinuous Galerkin Methods Li, Yang FerienAkademie 2008.
Basis Expansions and Regularization Part II. Outline Review of Splines Wavelet Smoothing Reproducing Kernel Hilbert Spaces.
Image Denoising Using Wavelets
The Discrete Wavelet Transform
Section 5.1 Length and Dot Product in ℝ n. Let v = ‹v 1­­, v 2, v 3,..., v n › and w = ‹w 1­­, w 2, w 3,..., w n › be vectors in ℝ n. The dot product.
Geometry of Shape Manifolds
linear  2.3 Newton’s Method ( Newton-Raphson Method ) 1/12 Chapter 2 Solutions of Equations in One Variable – Newton’s Method Idea: Linearize a nonlinear.
Section 5.5 The Real Zeros of a Polynomial Function.
Coarse-to-Fine Image Reconstruction Rebecca Willett In collaboration with Robert Nowak and Rui Castro.
MA4229 Lectures 9, 10 Weeks 5-7 Sept 7 - Oct 1, 2010 Chapter 7 The theory of minimax approximation Chapter 8 The exchange algorithm.
FINDING A POLYNOMIAL PASSING THROUGH A POINT. Review: the Linear Factorization Theorem If where n > 1 and a n ≠ 0 then Where c 1, c 2, … c n are complex.
FOCM 2002 QUESTION What is ‘foundations of computational mathematics’?
OR Integer Programming ( 정수계획법 ). OR
1 Chapter 4 Interpolation and Approximation Lagrange Interpolation The basic interpolation problem can be posed in one of two ways: The basic interpolation.
Giansalvo EXIN Cirrincione unit #4 Single-layer networks They directly compute linear discriminant functions using the TS without need of determining.
Dimensions of Neural Networks Ali Akbar Darabi Ghassem Mirroshandel Hootan Nokhost.
Wavelets Chapter 7 Serkan ERGUN. 1.Introduction Wavelets are mathematical tools for hierarchically decomposing functions. Regardless of whether the function.
MAT 4725 Numerical Analysis Section 8.2 Orthogonal Polynomials and Least Squares Approximations (Part II)
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 1: INTRODUCTION.
CSCI480/582 Lecture 9 Chap.2.2 Cubic Splines – Hermit and Bezier Feb, 11, 2009.
Charles University Charles University STAKAN III
Piecewise Polynomials and Splines
Computation of the solutions of nonlinear polynomial systems
INTEGRATION & TECHNIQUES OF INTEGRATION
Basic Definitions and Terminology
First order non linear pde’s
Multiscale Likelihood Analysis and Image Reconstruction
Linear Transformations
Spline Interpolation Class XVII.
Numerical Analysis Lecture 26.
Lecture 21: B Spline Curve
PPT2: B-spline Basics Functions
Lecture 8: Image alignment
Presentation transcript:

IMI 1 Approximation Theory Metric: Complicated Function Signal Image Solution to PDE Simple Function Polynomials Splines Rational Func

IMI 2 1. Linear space of dimension n. 2. Nonlinear manifold of dimension n. 3. Highly nonlinear: Highly redundant dictionary. Functions g chosen from:

IMI 3 Examples: (i) -- Alg. poly. of degree. (ii) -- Trig. poly. of degree. (iii) Splines -- piecewise poly. of degree r, pieces. (iv) span, CONS 0 1 Linear: 1, 2,..., n,

IMI 4 Nonlinear : n dimensional manifold (i) : Rational function. (ii) Splines with (iii) - term approximation CONS free knots. 0 1 pieces I N

IMI 5 Highly Nonlinear, arbitrary, Bases B 1, B 2,... B m,... BjBj best n-term choose best basis choose n-term approximation

IMI 6 Main Question Characterize We shall restrict ourselves to approximation by piecewise constants in what follows.

IMI 7 Linear Theorem (DeVore-Richards) Fix Piecewise Constants 0 1 1/n. close to

IMI 8 Theorem (DeVore-Richards),, for.

IMI 9 Noninear Theorem (Kahane). Linear Nonlinear Know (Petrushev).

IMI 10 n - term Haar Basis Dyadic Interval I 0 1

IMI 11 CONS

IMI 12 Theorem (DeVore-Jawerth-Popov) known. Simple strategy: Choose n terms where largest.

IMI 13 Linear Nonlinear

IMI 14 Application Image Compression Piecewise constant function (Haar) Threshold Problem: Need to encode positions. Dominate Bits Image

IMI 15 Tree Approximation Cohen-Dahmen-Daubechies-DeVore: are almost the same requirements.

IMI 16 Generate tree as follows: 1) Threshold: 2) Complete to Tree: 3) Encode the subtree: (Each bit tells whether the child is in the tree.)

IMI 17 Progressive Universal Optimal Burn In Features of Tree Encoder

IMI 18 Encoder P B B B BBB P P P k = Position Bits of B { bit b jk = j of, }

IMI 19 Cohen-Dahmen-DeVore Elliptic Equation Wavelet transform gives - positive definite. - has decay properties. CDD gives an adaptive algorithm

IMI 20 Theorem If, then using n computations the adaptive algorithm produces : Theorem If, then the adaptive algorithm produces :

IMI 21 Error: “ Error Indicators ”: Refinement: Let be the smallest set of indices such that residual Define new set.