Geology 6600/7600 Signal Analysis 26 Oct 2015 © A.R. Lowry 2015 Last time: Wiener Filtering Digital Wiener Filtering seeks to design a filter h for a linear.

Slides:



Advertisements
Similar presentations
State Space Models. Let { x t :t T} and { y t :t T} denote two vector valued time series that satisfy the system of equations: y t = A t x t + v t (The.
Advertisements

ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The Linear Prediction Model The Autocorrelation Method Levinson and Durbin.
CHAPTER 3 CHAPTER 3 R ECURSIVE E STIMATION FOR L INEAR M ODELS Organization of chapter in ISSO –Linear models Relationship between least-squares and mean-square.
AGC DSP AGC DSP Professor A G Constantinides©1 Modern Spectral Estimation Modern Spectral Estimation is based on a priori assumptions on the manner, the.
Adaptive Filters S.B.Rabet In the Name of GOD Class Presentation For The Course : Custom Implementation of DSP Systems University of Tehran 2010 Pages.
CY3A2 System identification Modelling Elvis Impersonators Fresh evidence that pop stars are more popular dead than alive. The University of Missouri’s.
OPTIMUM FILTERING.
ELE Adaptive Signal Processing
AGC DSP AGC DSP Professor A G Constantinides©1 A Prediction Problem Problem: Given a sample set of a stationary processes to predict the value of the process.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Newton’s Method Application to LMS Recursive Least Squares Exponentially-Weighted.
Single-Channel Speech Enhancement in Both White and Colored Noise Xin Lei Xiao Li Han Yan June 5, 2002.
The agenda: 1. The Kalman theory 2. Break for 20 minuts 3. More theory 4. Simulation of the filter. 5. Further discussion and exercises The Scalar Kalman.
Goals of Adaptive Signal Processing Design algorithms that learn from training data Algorithms must have good properties: attain good solutions, simple.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
1 Speech Enhancement Wiener Filtering: A linear estimation of clean signal from the noisy signal Using MMSE criterion.
EE513 Audio Signals and Systems Wiener Inverse Filter Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Adaptive Signal Processing
Normalised Least Mean-Square Adaptive Filtering
Linear Prediction Problem: Forward Prediction Backward Prediction
RLSELE Adaptive Signal Processing 1 Recursive Least-Squares (RLS) Adaptive Filters.
Random Processes and LSI Systems What happedns when a random signal is processed by an LSI system? This is illustrated below, where x(n) and y(n) are random.
© by Yu Hen Hu 1 ECE533 Digital Image Processing Image Restoration.
Week 2ELE Adaptive Signal Processing 1 STOCHASTIC PROCESSES AND MODELS.
1 Part 5 Response of Linear Systems 6.Linear Filtering of a Random Signals 7.Power Spectrum Analysis 8.Linear Estimation and Prediction Filters 9.Mean-Square.
Deconvolution, Deblurring and Restoration T , Biomedical Image Analysis Seminar Presentation Seppo Mattila & Mika Pollari.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
1 Linear Prediction. 2 Linear Prediction (Introduction) : The object of linear prediction is to estimate the output sequence from a linear combination.
1 Linear Prediction. Outline Windowing LPC Introduction to Vocoders Excitation modeling  Pitch Detection.
CHAPTER 4 Adaptive Tapped-delay-line Filters Using the Least Squares Adaptive Filtering.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Definitions Random Signal Analysis (Review) Discrete Random Signals Random.
Unit-V DSP APPLICATIONS. UNIT V -SYLLABUS DSP APPLICATIONS Multirate signal processing: Decimation Interpolation Sampling rate conversion by a rational.
Adv DSP Spring-2015 Lecture#9 Optimum Filters (Ch:7) Wiener Filters.
EE513 Audio Signals and Systems
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Derivation Computational Simplifications Stability Lattice Structures.
Robotics Research Laboratory 1 Chapter 7 Multivariable and Optimal Control.
Chapter 11 Filter Design 11.1 Introduction 11.2 Lowpass Filters
Estimation Method of Moments (MM) Methods of Moment estimation is a general method where equations for estimating parameters are found by equating population.
Dept. E.E./ESAT-STADIUS, KU Leuven
An Introduction To The Kalman Filter By, Santhosh Kumar.
Geology 5600/6600 Signal Analysis 16 Sep 2015 © A.R. Lowry 2015 Last time: A process is ergodic if time averages equal ensemble averages. Properties of.
K. Ensor, STAT Spring 2005 Estimation of AR models Assume for now mean is 0. Estimate parameters of the model, including the noise variace. –Least.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Normal Equations The Orthogonality Principle Solution of the Normal Equations.
Geology 6600/7600 Signal Analysis 04 Nov 2015 © A.R. Lowry 2015 Last time(s): Discussed Becker et al. (in press):  Wavelength-dependent squared correlation.
Recursive Least-Squares (RLS) Adaptive Filters
Nonlinear State Estimation
Geology 6600/7600 Signal Analysis 28 Sep 2015 © A.R. Lowry 2015 Last time: Energy Spectral Density; Linear Systems given (deterministic) finite-energy.
Geology 5600/6600 Signal Analysis 14 Sep 2015 © A.R. Lowry 2015 Last time: A stationary process has statistical properties that are time-invariant; a wide-sense.
Geology 6600/7600 Signal Analysis 30 Sep 2015 © A.R. Lowry 2015 Last time: The transfer function relating linear SISO input & output signals is given by.
Impulse Response Measurement and Equalization Digital Signal Processing LPP Erasmus Program Aveiro 2012 Digital Signal Processing LPP Erasmus Program Aveiro.
Geology 6600/7600 Signal Analysis 15 Oct 2015 © A.R. Lowry 2015 Last time(s): PSE The Kirby approach to wavelet transformation (the fan wavelet) preserves.
Geology 6600/7600 Signal Analysis Last time: Linear Systems Uncorrelated additive noise in the output signal, y = v + n, of a SISO system can be estimated.
Geology 6600/7600 Signal Analysis 23 Oct 2015
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory.
Geology 6600/7600 Signal Analysis 05 Oct 2015 © A.R. Lowry 2015 Last time: Assignment for Oct 23: GPS time series correlation Given a discrete function.
Linear Prediction.
Geology 5600/6600 Signal Analysis 11 Sep 2015 © A.R. Lowry 2015 Last time: The Central Limit theorem : The sum of a sequence of random variables tends.
Geology 6600/7600 Signal Analysis 28 Oct 2015 © A.R. Lowry 2015 Last time: Kalman Filtering Kalman Filtering uses recursion ; designs a filter h to extract.
DSP-CIS Part-III : Optimal & Adaptive Filters Chapter-9 : Kalman Filters Marc Moonen Dept. E.E./ESAT-STADIUS, KU Leuven
Statistics 350 Lecture 2. Today Last Day: Section Today: Section 1.6 Homework #1: Chapter 1 Problems (page 33-38): 2, 5, 6, 7, 22, 26, 33, 34,
ELG5377 Adaptive Signal Processing Lecture 13: Method of Least Squares.
Geology 6600/7600 Signal Analysis Last time: Linear Systems The Frequency Response or Transfer Function of a linear SISO system can be estimated as (Note.
CWR 6536 Stochastic Subsurface Hydrology Optimal Estimation of Hydrologic Parameters.
Locating a Shift in the Mean of a Time Series Melvin J. Hinich Applied Research Laboratories University of Texas at Austin
STATISTICAL ORBIT DETERMINATION Kalman (sequential) filter
ECE 7251: Signal Detection and Estimation
Linear Prediction.
Modern Spectral Estimation
Image and Video Processing
Linear Prediction.
Wiener Filtering: A linear estimation of clean signal from the noisy signal Using MMSE criterion.
Presentation transcript:

Geology 6600/7600 Signal Analysis 26 Oct 2015 © A.R. Lowry 2015 Last time: Wiener Filtering Digital Wiener Filtering seeks to design a filter h for a linear SISO system producing an optimal output y that “looks like” a desired signal d Applications include smoothing, prediction … To design this type of filter, seek to minimize the mean-square difference between the predicted and desired signals by setting that difference (the “error”, orthogonal to the input signal: That yields: For smoothing, ~ ~

Going forward: I currently plan to cover Kalman filtering (today) Variograms, optimal interpolation (“kriging”) and likelihood functions Fourier domain approximation of potential field modeling (including continuation; applications) Deconvolution applications in flexural analysis and receiver function analysis These were chosen primarily for relevance to Brent’s research topic… If there is interest or need for additional topics let me know !

Kalman Filtering: Kalman Filtering is an optimal approach to recursive estimation of a signal x[n] from noisy measurements y[n]. Assume the following model: ~~ + a D c + Autoregressive (AR) Model of a Random Signal Measurement Model

Assume that both the input signal w and the measurement noise v are zero-mean, white noise processes: Then what are the statistical properties of x[n] ? Note that: So:

For other lags of the autocorrelation function, And so on. So in general, Note that this signal can only exist for |a| < 1. (Why?)

Designing an Estimator for x[n] : Assume a recursive estimator of the form: Here, the first term in the new estimate represents a weighted previous estimate, and the second term is the weighted current measurement sample. We want to determine the two weight parameters a[n] and b[n] (note these are time-varying!) based on minimization of the mean-square error, represented by “error power” p[n] :

Similar to the approach taken for Wiener filtering, we set derivatives (WRT unknown weights) equal to zero: The first eqn can be rewritten: And substituting y[n] = cx[n] + v[n], ~~~

Thus we have: Substituting and noting that, we get: or: By evaluating  p  n  b  n , it can be shown that the filter gain (referred to as kalman gain ) b[n] and the mean-square error power p[n] are given by: ~~~

We can substitute these into our original estimation equation: to get: where the first term is the estimate without new data, and the second is the correction incorporating new data. The filter gain can be rewritten: where Then the mean-squared error can be rewritten as: These equations constitute the scalar kalman filter.