ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Signal and Noise Models SNIR Maximization Least-Squares Minimization MMSE.

Slides:



Advertisements
Similar presentations
Pattern Recognition and Machine Learning
Advertisements

Component Analysis (Review)
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Microphone Array Post-filter based on Spatially- Correlated Noise Measurements for Distant Speech Recognition Kenichi Kumatani, Disney Research, Pittsburgh.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: The FIR Adaptive Filter The LMS Adaptive Filter Stability and Convergence.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Newton’s Method Application to LMS Recursive Least Squares Exponentially-Weighted.
1/44 1. ZAHRA NAGHSH JULY 2009 BEAM-FORMING 2/44 2.
Principal Component Analysis
Motion Analysis Slides are from RPI Registration Class.
3/24/2006Lecture notes for Speech Communications Multi-channel speech enhancement Chunjian Li DICOM, Aalborg University.
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
Introduction to Cognitive radios Part two HY 539 Presented by: George Fortetsanakis.
دانشگاه صنعتي اصفهان دانشكده برق و كامپيوتر Various Beamformer Structures Suitable For Smart Antennas ارائه کننده: آرش میرزایی ( ) ارائه مقاله تحقيقي.
Performance of Adaptive Array Antennas in Mobile Fading Environment by: Amin Al-Ka’bi, M. Bialkowski and John Homer School of Information Technology &
Adaptive FIR Filter Algorithms D.K. Wise ECEN4002/5002 DSP Laboratory Spring 2003.
EE513 Audio Signals and Systems Wiener Inverse Filter Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
Adaptive Signal Processing
Normalised Least Mean-Square Adaptive Filtering
Dept. E.E./ESAT-STADIUS, KU Leuven homes.esat.kuleuven.be/~moonen/
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Adaptive Noise Cancellation ANC W/O External Reference Adaptive Line Enhancement.
For 3-G Systems Tara Larzelere EE 497A Semester Project.
Summarized by Soo-Jin Kim
Probability of Error Feature vectors typically have dimensions greater than 50. Classification accuracy depends upon the dimensionality and the amount.
Algorithm Taxonomy Thus far we have focused on:
Effect of Mutual Coupling on the Performance of Uniformly and Non-
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Introduction SNR Gain Patterns Beam Steering Shading Resources: Wiki:
Rake Reception in UWB Systems Aditya Kawatra 2004EE10313.
By Asst.Prof.Dr.Thamer M.Jamel Department of Electrical Engineering University of Technology Baghdad – Iraq.
Eigenstructure Methods for Noise Covariance Estimation Olawoye Oyeyele AICIP Group Presentation April 29th, 2003.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
Modern Navigation Thomas Herring
Digital Audio Signal Processing Lecture-2: Microphone Array Processing - Fixed Beamforming - Marc Moonen Dept. E.E./ESAT-STADIUS, KU Leuven
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 3: LINEAR MODELS FOR REGRESSION.
CHAPTER 4 Adaptive Tapped-delay-line Filters Using the Least Squares Adaptive Filtering.
Nico De Clercq Pieter Gijsenbergh.  Problem  Solutions  Single-channel approach  Multichannel approach  Our assignment Overview.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Conjugate Priors Multinomial Gaussian MAP Variance Estimation Example.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Definitions Random Signal Analysis (Review) Discrete Random Signals Random.
ECE 8443 – Pattern Recognition LECTURE 10: HETEROSCEDASTIC LINEAR DISCRIMINANT ANALYSIS AND INDEPENDENT COMPONENT ANALYSIS Objectives: Generalization of.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: ML and Simple Regression Bias of the ML Estimate Variance of the ML Estimate.
An Introduction to Blind Source Separation Kenny Hild Sept. 19, 2001.
ECE 8443 – Pattern Recognition LECTURE 08: DIMENSIONALITY, PRINCIPAL COMPONENTS ANALYSIS Objectives: Data Considerations Computational Complexity Overfitting.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition Objectives: Reestimation Equations Continuous Distributions.
EE513 Audio Signals and Systems
Generalised method of moments approach to testing the CAPM Nimesh Mistry Filipp Levin.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Derivation Computational Simplifications Stability Lattice Structures.
Study of Broadband Postbeamformer Interference Canceler Antenna Array Processor using Orthogonal Interference Beamformer Lal C. Godara and Presila Israt.
Digital Audio Signal Processing Lecture-2 Microphone Array Processing
A Semi-Blind Technique for MIMO Channel Matrix Estimation Aditya Jagannatham and Bhaskar D. Rao The proposed algorithm performs well compared to its training.
Discriminant Analysis
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Supervised Learning Resources: AG: Conditional Maximum Likelihood DP:
1  The Problem: Consider a two class task with ω 1, ω 2   LINEAR CLASSIFIERS.
Professors: Eng. Diego Barral Eng. Mariano Llamedo Soria Julian Bruno
Smart antenna Smart antennas use an array of low gain antenna elements which are connected by a combining network. Smart antennas provide enhanced coverage.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Normal Equations The Orthogonality Principle Solution of the Normal Equations.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 12: Advanced Discriminant Analysis Objectives:
Autoregressive (AR) Spectral Estimation
Dongxu Yang, Meng Cao Supervisor: Prabin.  Review of the Beamformer  Realization of the Beamforming Data Independent Beamforming Statistically Optimum.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: MLLR For Two Gaussians Mean and Variance Adaptation MATLB Example Resources:
Single Correlator Based UWB Receiver Implementation through Channel Shortening Equalizer By Syed Imtiaz Husain and Jinho Choi School of Electrical Engineering.
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 10: PRINCIPAL COMPONENTS ANALYSIS Objectives:
ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition Objectives: Bayes Rule Mutual Information Conditional.
Geology 6600/7600 Signal Analysis Last time: Linear Systems The Frequency Response or Transfer Function of a linear SISO system can be estimated as (Note.
LECTURE 09: BAYESIAN ESTIMATION (Cont.)
Optimum Passive Beamforming in Relation to Active-Passive Data Fusion
LECTURE 07: TIME-DELAY ESTIMATION AND ADPCM
Techniques for studying correlation and covariance structure
By Viput Subharngkasen
5.2 Least-Squares Fit to a Straight Line
Principal Component Analysis
Presentation transcript:

ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Signal and Noise Models SNIR Maximization Least-Squares Minimization MMSE Adaptation Griffiths Adaptive Beamformer Griffiths-Jim Adaptive Beamformer Resources: ICU: Wireless Communications Arraycom: Adaptive Antennae Andrea: Microphone Arrays SVC: Steerable Loudspeaker Arrays ICU: Wireless Communications Arraycom: Adaptive Antennae Andrea: Microphone Arrays SVC: Steerable Loudspeaker Arrays URL:.../publications/courses/ece_8423/lectures/current/lecture_14.ppt.../publications/courses/ece_8423/lectures/current/lecture_14.ppt MP3:.../publications/courses/ece_8423/lectures/current/lecture_14.mp3.../publications/courses/ece_8423/lectures/current/lecture_14.mp3 LECTURE 14: OPTIMAL AND ADAPTIVE ARRAYS

ECE 8423: Lecture 14, Slide 1 Introduction When an array is subjected to directional interferences, or when the measurement noise is correlated between sensors, non-uniform weighting of the sensor outputs can produce superior results to uniform weighting. There are several ways we can optimize these weights:  Maximization of output Signal-to-Noise plus Interference Ratio (SNIR)  Minimization of Mean-Squared Error  Maximum Likelihood  Minimum Noise Variance All four produce results that are typically very similar. The output of the array can be written as (following the complex signal formulation): The array output power is:

ECE 8423: Lecture 14, Slide 2 Noise Characterization The signal component of the output power is: We can write the noise plus interference correlation matrix as: The noise output power is:

ECE 8423: Lecture 14, Slide 3 Maximizing the Signal-to-Noise Plus Interference Ratio We can define the output Signal-to-Noise plus Interference Ratio (SNIR): We can maximize the SNIR using the method of Lagrange multipliers: where k is a complex constant. To maximize J, we need the following identity: We can differentiate J with respect to w: This is in the form of an eigenvalue problem where the eigenvalues are the values of the SNIR and the eigenvectors are the array weights. There are N distinct eigenvalues of A, and the largest, max, maximizes the SNIR. The corresponding eigenvector, w sn, represents the array weights.

ECE 8423: Lecture 14, Slide 4 Solving for the Weights We can derive an expression for the weights as follows:

ECE 8423: Lecture 14, Slide 5 Example: Broadside Signal Assume a broadside signal and sensors corrupted by uncorrelated noise: This confirms our result for the delay and sum beamformer in the case of a broadside signal.

ECE 8423: Lecture 14, Slide 6 Least-Squares Minimization We can derive an alternate solution by minimizing the mean-square error. However, we need to use a pilot signal (the desired signal). Define the error as usual: We can differentiate with respect to w and show: For our narrowband signal, we can show: These solutions are different by a constant.

ECE 8423: Lecture 14, Slide 7 Griffiths Adaptive Beamformer The simplest adaptive beamforming approach is to use MMSE: This has the usual solution: Application of LMS to beamforming not as straightforward because the desired signal, d(n), contains no explicit spatial information. The Griffiths Adaptive Beamformer operates directly on delayed versions of the sensor outputs: The vector g, is just the steering vector, which requires knowledge of the direction of the desired signal, which can be estimated heuristically.

ECE 8423: Lecture 14, Slide 8 The Griffiths-Jim Adaptive Beamformer

ECE 8423: Lecture 14, Slide 9 Introduced a method for optimizing the weights of an array to maximize the SNIR. Compared this to a least squares solution. Introduced the Griffiths adaptive beamformer that requires knowledge of the direction of arrival of the signal. Introduced a modification of this known as the Griffiths-Lim beamformer that is a generalization that decouples the problems of beamforming to enhance the signal and side-lobe cancellation to suppress the noise. Summary