Geology 6600/7600 Signal Analysis Last time: Linear Systems The Frequency Response or Transfer Function of a linear SISO system can be estimated as (Note.

Slides:



Advertisements
Similar presentations
Dates for term tests Friday, February 07 Friday, March 07
Advertisements

General Linear Model With correlated error terms  =  2 V ≠  2 I.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The Linear Prediction Model The Autocorrelation Method Levinson and Durbin.
MIMO Communication Systems
SOLUTION OF STATE EQUATION
1 12. Principles of Parameter Estimation The purpose of this lecture is to illustrate the usefulness of the various concepts introduced and studied in.
OPTIMUM FILTERING.
The General Linear Model. The Simple Linear Model Linear Regression.
AGC DSP AGC DSP Professor A G Constantinides©1 A Prediction Problem Problem: Given a sample set of a stationary processes to predict the value of the process.
Systems of Linear Equations
Jonathan Richard Shewchuk Reading Group Presention By David Cline
Chapter 4 Multiple Regression.
Linear and generalised linear models
Control Systems and Adaptive Process. Design, and control methods and strategies 1.
1 Adjoint Method in Network Analysis Dr. Janusz A. Starzyk.
Linear and generalised linear models
Basics of regression analysis
EE513 Audio Signals and Systems Wiener Inverse Filter Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Linear regression models in matrix terms. The regression function in matrix terms.
Linear Prediction Problem: Forward Prediction Backward Prediction
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Adaptive Noise Cancellation ANC W/O External Reference Adaptive Line Enhancement.
Lecture 10: Inner Products Norms and angles Projection Sections 2.10.(1-4), Sections 2.2.3, 2.3.
MIMO Multiple Input Multiple Output Communications © Omar Ahmad
Managerial Economics Managerial Economics = economic theory + mathematical eco + statistical analysis.
Numerical Computations in Linear Algebra. Mathematically posed problems that are to be solved, or whose solution is to be confirmed on a digital computer.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Introduction SNR Gain Patterns Beam Steering Shading Resources: Wiki:
Multivariate Statistics Matrix Algebra II W. M. van der Veld University of Amsterdam.
1 BIEN425 – Lecture 8 By the end of the lecture, you should be able to: –Compute cross- /auto-correlation using matrix multiplication –Compute cross- /auto-correlation.
1 Linear Prediction. 2 Linear Prediction (Introduction) : The object of linear prediction is to estimate the output sequence from a linear combination.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Signal and Noise Models SNIR Maximization Least-Squares Minimization MMSE.
CHAPTER 4 Adaptive Tapped-delay-line Filters Using the Least Squares Adaptive Filtering.
EE 6332, Spring, 2014 Wireless Communication Zhu Han Department of Electrical and Computer Engineering Class 11 Feb. 19 th, 2014.
Vector Norms and the related Matrix Norms. Properties of a Vector Norm: Euclidean Vector Norm: Riemannian metric:
Adv DSP Spring-2015 Lecture#9 Optimum Filters (Ch:7) Wiener Filters.
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology Principles of Parameter Estimation.
EE513 Audio Signals and Systems
Geology 5670/6670 Inverse Theory 21 Jan 2015 © A.R. Lowry 2015 Read for Fri 23 Jan: Menke Ch 3 (39-68) Last time: Ordinary Least Squares Inversion Ordinary.
Chapter 11 Filter Design 11.1 Introduction 11.2 Lowpass Filters
A Semi-Blind Technique for MIMO Channel Matrix Estimation Aditya Jagannatham and Bhaskar D. Rao The proposed algorithm performs well compared to its training.
Basic Image Processing February 1. Homework Second homework set will be online Friday (2/2). First programming assignment will be online Monday (2/5).
Geology 6600/7600 Signal Analysis 02 Sep 2015 © A.R. Lowry 2015 Last time: Signal Analysis is a set of tools used to extract information from sequences.
Correlation & Regression Analysis
State Observer (Estimator)
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Normal Equations The Orthogonality Principle Solution of the Normal Equations.
Autoregressive (AR) Spectral Estimation
Linear Filters. denote a bivariate time series with zero mean. Let.
Geology 6600/7600 Signal Analysis 21 Sep 2015 © A.R. Lowry 2015 Last time: The Cross-Power Spectrum relating two random processes x and y is given by:
Discrete-time Random Signals
Geology 6600/7600 Signal Analysis 28 Sep 2015 © A.R. Lowry 2015 Last time: Energy Spectral Density; Linear Systems given (deterministic) finite-energy.
Multivariate Time Series Analysis
Geology 6600/7600 Signal Analysis 15 Oct 2015 © A.R. Lowry 2015 Last time(s): PSE The Kirby approach to wavelet transformation (the fan wavelet) preserves.
Yi Jiang MS Thesis 1 Yi Jiang Dept. Of Electrical and Computer Engineering University of Florida, Gainesville, FL 32611, USA Array Signal Processing in.
Geology 6600/7600 Signal Analysis Last time: Linear Systems Uncorrelated additive noise in the output signal, y = v + n, of a SISO system can be estimated.
Geology 6600/7600 Signal Analysis 23 Oct 2015
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory.
5 minutes Warm-Up Solve. 2) 1).
Section 2.1 Determinants by Cofactor Expansion. THE DETERMINANT Recall from algebra, that the function f (x) = x 2 is a function from the real numbers.
Linear Prediction.
MathematicalMarketing Slide 5.1 OLS Chapter 5: Ordinary Least Square Regression We will be discussing  The Linear Regression Model  Estimation of the.
Geology 6600/7600 Signal Analysis 26 Oct 2015 © A.R. Lowry 2015 Last time: Wiener Filtering Digital Wiener Filtering seeks to design a filter h for a linear.
Geology 5670/6670 Inverse Theory 12 Jan 2015 © A.R. Lowry 2015 Read for Wed 14 Jan: Menke Ch 2 (15-37) Last time: Course Introduction (Cont’d) Goal is.
Computacion Inteligente Least-Square Methods for System Identification.
Coherence spectrum (coherency squared)  = 0.1, 0.05, 0.01 X is the Fourier Transform Cross-spectral power density Confidence level: = running mean or.
We will be looking for a solution to the system of linear differential equations with constant coefficients.
Linear Prediction.
Solve System by Linear Combination / Addition Method
Unit 3: Matrices
Linear Filters.
16. Mean Square Estimation
Presentation transcript:

Geology 6600/7600 Signal Analysis Last time: Linear Systems The Frequency Response or Transfer Function of a linear SISO system can be estimated as (Note this differs from deconvolution, in which an unknown signal or response function is found by dividing amplitudes by a known convolved function or signal) Frequency response estimated in this way is unaffected by additive noise in the output, y = v + n, because S xy = S xv The output power spectrum is S yy = S vv + S nn, and the coherence is: So the signal power and the noise power can be estimated… 19 Oct 2015 © A.R. Lowry 2015

Now consider a case where there is additive noise on both the measured input and output signals: We measure x (corrupted by input noise m ) and y ( + n ). We’ll again assume uncorrelated noise (with each other and with the signals). Then + +

The coherence in this case is: Recalling that: Then: The estimate of the transfer function will be: (And for this approach cannot independently derive input noise!)

Consider however that there are two different ways we could estimate the transfer function: (1)From the autospectrum : Note that this estimate biases upward or downward depending on relative SNR… Autospectra always include noise spectra. (2) From the cross-spectrum : This estimate is biased only by the input noise, and has the property of minimizing the mean-square error between measured and predicted output. Note the implication that different combinations can be used to bound H and the noise spectra!

We have: These relations tell us that we can also bound the signal-to-noise ratios of both the input and the output signals! (But since these are not independent equations, we can’t estimate them). (This estimate can be biased upward or downward) (This estimate is ≤ H, so a lower- bound) ( ≥ H, so an upper-bound!)

+ Now consider a multiple input, single output system: Here: (in vector notation:)

To find the spectrum of the output, multiply by the complex conjugate: (vector notation) (here superscript H denotes the Hermitian, or transpose of the complex conjugate) Recall the power spectrum represents The expected value (assuming that x i and n are uncorrelated): where S ij = S xixj

How can we calculate the frequency responses in this case? If we multiply Y by the complex conjugates of the input frequencies, X i *, This gives us a set of N equations in which we can solve for the N unknown frequency responses using the measured cross-power spectra! In matrix form: Note that this is equivalent to the minimum least-squares solution. Further note that a solution cannot be found if any of the inputs are perfectly correlated (the matrix determinant in that case will be zero because the rank of the matrix will be < N ). Thus, one should examine the coherence of the individual input signals to identify possible problem frequencies…. or