1 BIEN425 – Lecture 8 By the end of the lecture, you should be able to: –Compute cross- /auto-correlation using matrix multiplication –Compute cross- /auto-correlation.

Slides:



Advertisements
Similar presentations
DFT & FFT Computation.
Advertisements

ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The Linear Prediction Model The Autocorrelation Method Levinson and Durbin.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Periodograms Bartlett Windows Data Windowing Blackman-Tukey Resources:
DFT/FFT and Wavelets ● Additive Synthesis demonstration (wave addition) ● Standard Definitions ● Computing the DFT and FFT ● Sine and cosine wave multiplication.
ELEC 303 – Random Signals Lecture 20 – Random processes
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The FIR Adaptive Filter The LMS Adaptive Filter Stability and Convergence.
Chapter 8: The Discrete Fourier Transform
MM3FC Mathematical Modeling 3 LECTURE 3
Lecture #17 INTRODUCTION TO THE FAST FOURIER TRANSFORM ALGORITHM Department of Electrical and Computer Engineering Carnegie Mellon University Pittsburgh,
FFT-based filtering and the Short-Time Fourier Transform (STFT) R.C. Maher ECEN4002/5002 DSP Laboratory Spring 2003.
MM3FC Mathematical Modeling 3 LECTURE 6 Times Weeks 7,8 & 9. Lectures : Mon,Tues,Wed 10-11am, Rm.1439 Tutorials : Thurs, 10am, Rm. ULT. Clinics : Fri,
Systems: Definition Filter
Normalised Least Mean-Square Adaptive Filtering
Random Process The concept of random variable was defined previously as mapping from the Sample Space S to the real line as shown below.
Introduction to Fourier Processing A spectrum of possibilities…
DISCRETE-TIME SIGNALS and SYSTEMS
TELECOMMUNICATIONS Dr. Hugh Blanton ENTC 4307/ENTC 5307.
1 Part 5 Response of Linear Systems 6.Linear Filtering of a Random Signals 7.Power Spectrum Analysis 8.Linear Estimation and Prediction Filters 9.Mean-Square.
Digital Signal Processing – Chapter 10
Decimation-in-frequency FFT algorithm The decimation-in-time FFT algorithms are all based on structuring the DFT computation by forming smaller and smaller.
Mathematical Preliminaries. 37 Matrix Theory Vectors nth element of vector u : u(n) Matrix mth row and nth column of A : a(m,n) column vector.
Finite-Length Discrete Transform
Correlated and Uncorrelated Signals Problem: we have two signals and. How “close” are they to each other? Example: in a radar (or sonar) we transmit a.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Definitions Random Signal Analysis (Review) Discrete Random Signals Random.
1 © 2010 Cengage Learning Engineering. All Rights Reserved. 1 Introduction to Digital Image Processing with MATLAB ® Asia Edition McAndrew ‧ Wang ‧ Tseng.
The Discrete Fourier Transform 主講人:虞台文. Content Introduction Representation of Periodic Sequences – DFS (Discrete Fourier Series) Properties of DFS The.
Technion, CS department, SIPC Spring 2014 Tutorials 12,13 discrete signals and systems 1/39.
Zhongguo Liu_Biomedical Engineering_Shandong Univ. Chapter 8 The Discrete Fourier Transform Zhongguo Liu Biomedical Engineering School of Control.
Hossein Sameti Department of Computer Engineering Sharif University of Technology.
Fourier Analysis of Discrete Time Signals
Lecture 6: DFT XILIANG LUO 2014/10. Periodic Sequence  Discrete Fourier Series For a sequence with period N, we only need N DFS coefs.
Convolution in Matlab The convolution in matlab is accomplished by using “conv” command. If “u” is a vector with length ‘n’ and “v” is a vector with length.
Chapter 5 Finite-Length Discrete Transform
7- 1 Chapter 7: Fourier Analysis Fourier analysis = Series + Transform ◎ Fourier Series -- A periodic (T) function f(x) can be written as the sum of sines.
revision Transfer function. Frequency Response
Lecture#10 Spectrum Estimation
DSP-CIS Part-IV : Filter Banks & Subband Systems Chapter-12 : Frequency Domain Filtering Marc Moonen Dept. E.E./ESAT-STADIUS, KU Leuven
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Normal Equations The Orthogonality Principle Solution of the Normal Equations.
Linear filtering based on the DFT
Discrete-time Random Signals
and shall lay stress on CORRELATION
Geology 6600/7600 Signal Analysis 28 Sep 2015 © A.R. Lowry 2015 Last time: Energy Spectral Density; Linear Systems given (deterministic) finite-energy.
DTFT continue (c.f. Shenoi, 2006)  We have introduced DTFT and showed some of its properties. We will investigate them in more detail by showing the associated.
Geology 5600/6600 Signal Analysis 14 Sep 2015 © A.R. Lowry 2015 Last time: A stationary process has statistical properties that are time-invariant; a wide-sense.
Fast Fourier Transforms. 2 Discrete Fourier Transform The DFT pair was given as Baseline for computational complexity: –Each DFT coefficient requires.
The Discrete Fourier Transform
Outline Carrier design Embedding and extraction for single tile and Multi-tiles (improving the robustness) Parameter α selection and invisibility Moment.
Geology 6600/7600 Signal Analysis 23 Oct 2015
University of Ioannina - Department of Computer Science Filtering in the Frequency Domain (Circulant Matrices and Convolution) Digital Image Processing.
EE345S Real-Time Digital Signal Processing Lab Fall 2006 Lecture 17 Fast Fourier Transform Prof. Brian L. Evans Dept. of Electrical and Computer Engineering.
Digital Image Processing Lecture 8: Image Enhancement in Frequency Domain II Naveed Ejaz.
بسم الله الرحمن الرحيم Digital Signal Processing Lecture 14 FFT-Radix-2 Decimation in Frequency And Radix -4 Algorithm University of Khartoum Department.
Geology 6600/7600 Signal Analysis Last time: Linear Systems The Frequency Response or Transfer Function of a linear SISO system can be estimated as (Note.
1 Chapter 8 The Discrete Fourier Transform (cont.)
EE611 Deterministic Systems Examples and Discrete Systems Descriptions Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Digital Image Processing Lecture 8: Fourier Transform Prof. Charlene Tsai.
DIGITAL SIGNAL PROCESSING ELECTRONICS
FFT-based filtering and the
Fast Fourier Transform
All about convolution.
Random Process The concept of random variable was defined previously as mapping from the Sample Space S to the real line as shown below.
4.1 DFT In practice the Fourier components of data are obtained by digital computation rather than by analog processing. The analog values have to be.
Digital Image Processing
Lecture 17 DFT: Discrete Fourier Transform
LECTURE 18: FAST FOURIER TRANSFORM
Digital Image Processing Week IV
Fast Fourier Transform
CE Digital Signal Processing Fall Discrete Fourier Transform (DFT)
copyright Robert J. Marks II
LECTURE 18: FAST FOURIER TRANSFORM
Presentation transcript:

1 BIEN425 – Lecture 8 By the end of the lecture, you should be able to: –Compute cross- /auto-correlation using matrix multiplication –Compute cross- /auto-correlation using DFT and Matlab –Relate auto-correlation of white noise with its average power –Extract periodic signal from noise

2 Recall: Convolution Is a filter operation that computes the zero-state output corresponding to an input x(k) Matlab code: conv.m As denoted by * If h(i) is a L-point signal, and x(k) is a M-point signal then the convolution has length L+M-1

3 Circular convolution Let h(k) and x(k) be N-point signals and x p (k) be the periodic extension of x(k). Circular convolution is defined as Very simply y c (k) = C(x)h, where C(x) is defined as:

4 Note that circular convolution is more efficient (faster) However, it cannot be used directly to compute zero- state response Also needs to assume h(k) and x(k) have the same length. Another problem is with periodicity We can solve this using zero-padding. But the zero-state response is not periodic

5 Zero padding Pad both h(k) and x(k) to be length N = L+M-1, now denoted as h z (k) and x z (k) Now, y = C(x z )h z y is now M+L-1 in length

6 Example Matlab example

7 Fast convolution Convolution in the time domain maps into multiplication in the frequency domain using Z- transform. We may substitute circular for linear convolution; DFT for Z-transform

8 Now if enough zeros are padded to h(k) and x(k) so that they both have length N≥L+M-1 where N = 2 r This is called fast linear convolution We get H z (i) and X z (i) Zero pad FFT IFFT h(k) x(k) y(k) x z (k) h z (k)

9 Cross-correlation Measures the degree to which a pattern of L-point signal y(k) is similar to the pattern of an M-point signal x(k) This definition works fine for deterministic signals. To generalize it to include stochastic signals: For example: on next slide

10

11 Again, it can be computed using matrix formulation: Example 4.8, the index corresponding to the largest r xy (k) represents the optimal delay.

12 This shows optimal delay for y is 3 samples

13 Normalized linear cross-correlation So that it takes on values [-1, 1] This allows us to measure the amount of “significance” that is independent on the scaling or amplitude of the signal

14 We can have a fixed threshold to determine if two signals are significantly similar.

15 Fast correlation Again, similar to fast convolution, we could utilize properties of FFT to achieve a fast version of correlation Block diagram: Zero pad FFT FFT * IFFT /L x(k) y(k) r xy (k) y z (k) x z (k)

16 Auto-correlation For special case where y(k) = x(k) It can be expressed in terms of expected values For the special case of white noise v(k),

17 Relating auto-correlation and PSD If we apply the same principle of circular convolution to correlation, circular-correlation c xy (k) can be obtained Notice here (–k)

18 Extracting periodic signals from noise Let’s say y(k) = x(k) + v(k), 0≤ k <N and the period M<N. Therefore, for k≠0, c yy (k) = c xx (k) Motivation? x(k) is periodic M (but we didn’t know that from the beginning Because correlation of noise with any other signal is 0!

19 Auto-correlation averages the noise out! Also note that c xx (k) is periodic Therefore, the period of x(k) can be estimated by examining the peaks and valleys in c yy (k)

20 Once the period of a noise-corrupted signal is determined, we can estimate the original periodic signal Let L = floor (N/M) We define delta function of period M 0 ≤ k < M By definition Because L = floor of (N/M)

21 Now the second term approaches 0 for large L Therefore Because x is period M

22 Block diagram Circular cross correlation y(k) x(k) v(k)  (k) N/L