Wiener Filtering & Basis Functions Nov 4th 2004 Jukka Parviainen T-61.181 Biomedical Signal Processing Sections 4.4 - 4.5.2.

Slides:



Advertisements
Similar presentations
Noise in Radiographic Imaging
Advertisements

ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The Linear Prediction Model The Autocorrelation Method Levinson and Durbin.
Environmental Data Analysis with MatLab Lecture 8: Solving Generalized Least Squares Problems.
SPM 2002 C1C2C3 X =  C1 C2 Xb L C1 L C2  C1 C2 Xb L C1  L C2 Y Xb e Space of X C1 C2 Xb Space X C1 C2 C1  C3 P C1C2  Xb Xb Space of X C1 C2 C1 
Digital Image Processing Lecture 11: Image Restoration Prof. Charlene Tsai.
Environmental Data Analysis with MatLab Lecture 23: Hypothesis Testing continued; F-Tests.
Environmental Data Analysis with MatLab Lecture 11: Lessons Learned from the Fourier Transform.
ECE 472/572 - Digital Image Processing Lecture 8 - Image Restoration – Linear, Position-Invariant Degradations 10/10/11.
Environmental Data Analysis with MatLab Lecture 12: Power Spectral Density.
Environmental Data Analysis with MatLab Lecture 5: Linear Models.
Biomedical signal processing: Wavelets Yevhen Hlushchuk, 11 November 2004.
Single-Channel Speech Enhancement in Both White and Colored Noise Xin Lei Xiao Li Han Yan June 5, 2002.
CSCE 641 Computer Graphics: Fourier Transform Jinxiang Chai.
Image Fourier Transform Faisal Farooq Q: How many signal processing engineers does it take to change a light bulb? A: Three. One to Fourier transform the.
A Quick Practical Guide to PCA and ICA Ted Brookings, UCSB Physics 11/13/06.
Some Statistics Stuff (A.K.A. Shamelessly Stolen Stuff)
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
Matched Filters By: Andy Wang.
Environmental Data Analysis with MatLab Lecture 7: Prior Information.
Spectra of random processes Signal, noise, smoothing and filters.
Systems: Definition Filter
RLSELE Adaptive Signal Processing 1 Recursive Least-Squares (RLS) Adaptive Filters.
Goals For This Class Quickly review of the main results from last class Convolution and Cross-correlation Discrete Fourier Analysis: Important Considerations.
Image Restoration using Iterative Wiener Filter --- ECE533 Project Report Jing Liu, Yan Wu.
Instrument Components Signal Generator (Energy Source) Analytical Signal Transducer Signal Processor Display Can you identify these components in the following.
CMPT 365 Multimedia Systems
ENG4BF3 Medical Image Processing Image Enhancement in Frequency Domain.
ENEE631 Digital Image Processing (Spring'04) Image Restoration Spring ’04 Instructor: Min Wu ECE Department, Univ. of Maryland, College Park  
CHEE825 Fall 2005J. McLellan1 Spectral Analysis and Input Signal Design.
Chapter 6 Spectrum Estimation § 6.1 Time and Frequency Domain Analysis § 6.2 Fourier Transform in Discrete Form § 6.3 Spectrum Estimator § 6.4 Practical.
Modern Navigation Thomas Herring MW 11:00-12:30 Room
EE565 Advanced Image Processing Copyright Xin Li Image Denoising Theory of linear estimation Spatial domain denoising techniques Conventional Wiener.
8-1 Chapter 8: Image Restoration Image enhancement: Overlook degradation processes, deal with images intuitively Image restoration: Known degradation processes;
CHAPTER 5 SIGNAL SPACE ANALYSIS
BCS547 Neural Decoding. Population Code Tuning CurvesPattern of activity (r) Direction (deg) Activity
BCS547 Neural Decoding.
Digital Image Processing Lecture 11: Image Restoration March 30, 2005 Prof. Charlene Tsai.
ELE 488 F06 ELE 488 Fall 2006 Image Processing and Transmission Image Restoration distortion noise Inverse Filtering Wiener Filtering Ref: Jain,
Basic Image Processing February 1. Homework Second homework set will be online Friday (2/2). First programming assignment will be online Monday (2/5).
3.7 Adaptive filtering Joonas Vanninen Antonio Palomino Alarcos.
Correlation and Spectral Analysis
Discrete-time Random Signals
Stochastic Process Theory and Spectral Estimation Bijan Pesaran Center for Neural Science New York University.
Stochastic Process Theory and Spectral Estimation
Geology 6600/7600 Signal Analysis Last time: Linear Systems Uncorrelated additive noise in the output signal, y = v + n, of a SISO system can be estimated.
Geology 6600/7600 Signal Analysis 23 Oct 2015
Colorado Center for Astrodynamics Research The University of Colorado 1 STATISTICAL ORBIT DETERMINATION Kalman Filter with Process Noise Gauss- Markov.
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory.
Dr. Ali Saad modified from Dr. Carlos Davila Southe. metho univ 1 EEG Brain signal measurement and analysis 414BMT Dr Ali Saad, College of Applied medical.
CS654: Digital Image Analysis Lecture 11: Image Transforms.
Environmental Data Analysis with MatLab 2 nd Edition Lecture 14: Applications of Filters.
Environmental Data Analysis with MatLab 2 nd Edition Lecture 22: Linear Approximations and Non Linear Least Squares.
The Frequency Domain Digital Image Processing – Chapter 8.
Biointelligence Laboratory, Seoul National University
LECTURE 30: SYSTEM ANALYSIS USING THE TRANSFER FUNCTION
The general linear model and Statistical Parametric Mapping
Outline Introduction Signal, random variable, random process and spectra Analog modulation Analog to digital conversion Digital transmission through baseband.
Image Analysis Image Restoration.
Outline Linear Shift-invariant system Linear filters
Outline Linear Shift-invariant system Linear filters
CSCE 643 Computer Vision: Image Sampling and Filtering
Image Restoration and Denoising
The general linear model and Statistical Parametric Mapping
9.4 Enhancing the SNR of Digitized Signals
Chapter 8 The Discrete Fourier Transform
Example: Earth Rotation
Chapter 8 The Discrete Fourier Transform
Digital Image Processing Lecture 11: Image Restoration
Signals and Systems Using MATLAB Luis F. Chaparro
Combination of Feature and Channel Compensation (1/2)
Presentation transcript:

Wiener Filtering & Basis Functions Nov 4th 2004 Jukka Parviainen T Biomedical Signal Processing Sections

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 2 Outline a posteriori Wiener filter (Sec 4.4) –removing noise by linear filtering in optimal (mean-square error) way –improving ensemble averaging single-trial analysis using basis functions (Sec 4.5) –only one or few evoked potentials –e.g. Fourier analysis

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 3 Wiener - example in 2D model x = f(s)+v, where f(.) is a linear blurring effect (in the example) target: find an estimate s’ = g(x) an inverse filter to blurring value of SNR can be controlled Matlab example: ipexdeconvwnr

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 4 Part I - Wiener in EEG improving ensemble averages by incorporating correlation information, similar to weights earlier in Sec. 4.3 model: x_i(n) = s(n) + v_i(n) ensemble average of M records target: good s’(n) from x_i(n)

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 5 Wiener filter in EEG a priori Wiener filter: power spectra of signal (s) and noise (v) are F-transforms of correlation functions r(k)

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 6 Interpretation of Wiener if ”no noise”, then H=1 if ”no signal”, then H=0 for stationary processes always 0 < H < 1 see Fig 4.22

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 7 Wiener in theory design H(z), so that mean-square error E[(s(n)-s’(n))^2] minimized Wiener-Hopf equations of noncausal IIR filter lead to H(e j ) filter gain 0 < H < 1 implies underestimation (bias) bias/variance dilemma

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 8 A posteriori Wiener filters time-invariant a posteriori filtering estimates for signal and noise spectra from data afterwards two estimates in the book: improvements: clipping & spectral smoothing, see Fig 4.23

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 9 Limitations of APWFs contradictionary results due to modalities: BAEP+VEP ok, SEP not bad results with low SNRs, see Fig 4.24 APWF supposes stationary signals if/when not, time-varying Wiener filters developed

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 10 APWF - What was learnt? authors: ”serious limitations”, ”important to be aware of possible pitfalls”, especially when ”the assumpition of stationarity is incorporated into a signal model”

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 11 Part II - Basis functions often no repititions of EPs available or possible therefore no averaging etc. prior information incorporated in the model mutually orthonormal basis func.:

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 12 Orthonormal basis func. data is modelled using a set of weight vectors and orthonormal basic functions example: Fourier-series/transform

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 13 Lowpass modelling basis functions divided to two sets, ”truncating” the model  s are to be saved, size N x K  v are to be ignored (regarded as high-freq. noise), size N x (N-K)

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 14 Demo: Fourier-series rapid changes - high frequency value K? transients cannot be modelled nicely using cosines/sines

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 15 Summary I: Wiener originally by Wiener in 40’s with evoked potentials in 60’s and 70’s by Walker and Doyle lots of research in 70’s and 80’s (time-varying filtering by de Weerd) probably a baseline technique?

Nov 4th 2004T Biomedical Signal Processing - Jukka Parviainen 16 Summary II: Basis f. signal can be modelled using as a sum of products of weight vectors and basis functions high-frequency components considered as noise to be continued in the following presentation