Manifold Sparse Beamforming

Slides:



Advertisements
Similar presentations
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Advertisements

Minimum Redundancy MIMO Radar Chun-Yang Chen and P. P. Vaidyanathan California Institute of Technology Electrical Engineering/DSP Lab ISCAS 2008.
Spectral envelope analysis of TIMIT corpus using LP, WLSP, and MVDR Steve Vest Matlab implementation of methods by Tien-Hsiang Lo.
Pattern Recognition and Machine Learning
Experimental Design, Response Surface Analysis, and Optimization
AGC DSP AGC DSP Professor A G Constantinides©1 Modern Spectral Estimation Modern Spectral Estimation is based on a priori assumptions on the manner, the.
Fast Bayesian Matching Pursuit Presenter: Changchun Zhang ECE / CMR Tennessee Technological University November 12, 2010 Reading Group (Authors: Philip.
Portfolio Diversity and Robustness. TOC  Markowitz Model  Diversification  Robustness Random returns Random covariance  Extensions  Conclusion.
Microphone Array Post-filter based on Spatially- Correlated Noise Measurements for Distant Speech Recognition Kenichi Kumatani, Disney Research, Pittsburgh.
Exploiting Sparse Markov and Covariance Structure in Multiresolution Models Presenter: Zhe Chen ECE / CMR Tennessee Technological University October 22,
Graph Laplacian Regularization for Large-Scale Semidefinite Programming Kilian Weinberger et al. NIPS 2006 presented by Aggeliki Tsoli.
Chapter 2: Lasso for linear models
A novel supervised feature extraction and classification framework for land cover recognition of the off-land scenario Yan Cui
Joint MIMO Radar Waveform and Receiving Filter Optimization Chun-Yang Chen and P. P. Vaidyanathan California Institute of Technology Electrical Engineering/DSP.
Volkan Cevher, Marco F. Duarte, and Richard G. Baraniuk European Signal Processing Conference 2008.
Pattern Recognition and Machine Learning
Classification Problem 2-Category Linearly Separable Case A- A+ Malignant Benign.
1 Adaptive error estimation of the Trefftz method for solving the Cauchy problem Presenter: C.-T. Chen Co-author: K.-H. Chen, J.-F. Lee & J.-T. Chen BEM/MRM.
Goals of Adaptive Signal Processing Design algorithms that learn from training data Algorithms must have good properties: attain good solutions, simple.
Estimation and the Kalman Filter David Johnson. The Mean of a Discrete Distribution “I have more legs than average”
A Multipath Sparse Beamforming Method
OPEN THALES UK Ltd. SSPD 2014, Edinburgh, Sep © THALES UK LTD AND/OR ITS SUPPLIERS. THIS INFORMATION CARRIER CONTAINS PROPRIETARY.
Adaptive Signal Processing
Normalised Least Mean-Square Adaptive Filtering
Sparsity-Aware Adaptive Algorithms Based on Alternating Optimization and Shrinkage Rodrigo C. de Lamare* + and Raimundo Sampaio-Neto * + Communications.
RLSELE Adaptive Signal Processing 1 Recursive Least-Squares (RLS) Adaptive Filters.
Kalman filter and SLAM problem
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Introduction SNR Gain Patterns Beam Steering Shading Resources: Wiki:
Eigenstructure Methods for Noise Covariance Estimation Olawoye Oyeyele AICIP Group Presentation April 29th, 2003.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Signal and Noise Models SNIR Maximization Least-Squares Minimization MMSE.
STRUCTURED SPARSE ACOUSTIC MODELING FOR SPEECH SEPARATION AFSANEH ASAEI JOINT WORK WITH: MOHAMMAD GOLBABAEE, HERVE BOURLARD, VOLKAN CEVHER.
Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization Julio Martin Duarte-Carvajalino, and Guillermo Sapiro.
AGC DSP AGC DSP Professor A G Constantinides©1 Eigenvector-based Methods A very common problem in spectral estimation is concerned with the extraction.
Outline Transmitters (Chapters 3 and 4, Source Coding and Modulation) (week 1 and 2) Receivers (Chapter 5) (week 3 and 4) Received Signal Synchronization.
Study of Broadband Postbeamformer Interference Canceler Antenna Array Processor using Orthogonal Interference Beamformer Lal C. Godara and Presila Israt.
A Semi-Blind Technique for MIMO Channel Matrix Estimation Aditya Jagannatham and Bhaskar D. Rao The proposed algorithm performs well compared to its training.
NCAF Manchester July 2000 Graham Hesketh Information Engineering Group Rolls-Royce Strategic Research Centre.
The Restricted Matched Filter for Distributed Detection Charles Sestok and Alan Oppenheim MIT DARPA SensIT PI Meeting Jan. 16, 2002.
Matrix Notation for Representing Vectors
Dept. E.E./ESAT-STADIUS, KU Leuven
Beamformer dimensionality ScalarVector Features1 optimal source orientation selected per location. Wrong orientation choice may lead to missed sources.
Smart antenna Smart antennas use an array of low gain antenna elements which are connected by a combining network. Smart antennas provide enhanced coverage.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Normal Equations The Orthogonality Principle Solution of the Normal Equations.
Autoregressive (AR) Spectral Estimation
Matlab Tutorial for State Space Analysis and System Identification
Recursive Least-Squares (RLS) Adaptive Filters
Optimal Reverse Prediction: Linli Xu, Martha White and Dale Schuurmans ICML 2009, Best Overall Paper Honorable Mention A Unified Perspective on Supervised,
Yi Jiang MS Thesis 1 Yi Jiang Dept. Of Electrical and Computer Engineering University of Florida, Gainesville, FL 32611, USA Array Signal Processing in.
Chance Constrained Robust Energy Efficiency in Cognitive Radio Networks with Channel Uncertainty Yongjun Xu and Xiaohui Zhao College of Communication Engineering,
Spatial vs. Blind Approaches for Speaker Separation: Structural Differences and Beyond Julien Bourgeois RIC/AD.
Data Communications to Train From High-Altitude Platforms
Massive Support Vector Regression (via Row and Column Chunking) David R. Musicant and O.L. Mangasarian NIPS 99 Workshop on Learning With Support Vectors.
SemiBoost : Boosting for Semi-supervised Learning Pavan Kumar Mallapragada, Student Member, IEEE, Rong Jin, Member, IEEE, Anil K. Jain, Fellow, IEEE, and.
Super-resolution MRI Using Finite Rate of Innovation Curves Greg Ongie*, Mathews Jacob Computational Biomedical Imaging Group (CBIG) University of Iowa.
Presented by : PARAMANAND SHARMA Roll No. : 207EE104
Müjdat Çetin Stochastic Systems Group, M.I.T.
Optimum Passive Beamforming in Relation to Active-Passive Data Fusion
Outlier Processing via L1-Principal Subspaces
Department of Civil and Environmental Engineering
Robust Multipath Channel Identification
Local Gain Analysis of Nonlinear Systems
Modern Spectral Estimation
Optimum Passive Beamforming in Relation to Active-Passive Data Fusion
Master Thesis Presentation
By Viput Subharngkasen
Singular Value Decomposition SVD
Multivariate Methods Berlin Chen
Unfolding with system identification
16. Mean Square Estimation
Sebastian Semper1 and Florian Roemer1,2
Presentation transcript:

Manifold Sparse Beamforming Volkan cevher Joint work with: baran gözcü, afsaneh asaei

outline Array acquisition model Spatial linear prediction Minimum variance distortion-less response (MVDR) Regularization Manifold Sparse Beamforming Atomic Norm Minimization Numerical results Concluding remarks

Acquisition model where Sensor array acquisition forward model for input signal where θs Δ=λ/2 xM x1 x2 x. x. x.

Spatial filtering Objective: Prediction of s given the observation x and through spatial linear filter The steering vectors are obtained via minimization of the expected prediction risk: θs Δ xM x1 x2 x. x. x. w? WM W. W. W. W2 W1 Σ

Optimum weights Assumptions: Signal is uncorrelated with the the interferers and noise Prediction risk minimization This is MVDR ! (Minimum variance distortionless (c=1) response)

DIAGONAL LOADING MVDR in practice: Sample covariance matrix: ISSUE: Array covariance matrix is rank-deficient  diagonal loading This corresponds to Tikhonov regularization: Unique solution !

Prior art H. Cox, R. M. Zeskind, and M. H. Owen, “Robust adaptive beamforming” IEEE Transactions on Acoustic, Speech, and Signal Processing, vol. 35, 1987. Diagonal Loading … S. A. Vorobyov, “Principles of minimum variance robust adaptive beamforming design” Signal Processing, Special Issue: Advances in Sensor Array Processing, 2013. Eigen-space projection Worst case optimization over an uncertainty bound Iterative refinement using sequential quadratic programming

A New regularization: Manifold sparsity We claim that the optimum weights accept an S-sparse linear sum of manifold vectors: A heuristic justification: If interferer angles are random, optimum weights lies in S=M-K+1 dimensional subspace. Hence this set of equations has a solution when K+1≤M-K+1 i.e. when K≤M/2. Therefore if then error is minimized. Plugging in the S-sparse linear combination above, we have the following linear system:

ATOMIC NORM To enforce a sparse linear combination of manifold vectors, we introduce the following norm: where A is the infinite set of manifold vectors : grid-free !

atomic norm when atoms are sinusoids Application to line spectral estimation: Dual problem Bhaskar, Badri Narayan, and Benjamin Recht. "Atomic norm denoising with applications to line spectral estimation." Communication, Control, and Computing (Allerton), 2011 49th Annual Allerton Conference on. IEEE, 2011.

Manifold sparse beamforming Proposed regularization is equivalent to SDP! where t is a real number and T is the map that makes a Hermitian Toeplitz matrix out of its input vector

NUMERICAL EXPERIMENTS We would like to compare the two optimization problems: versus Parameters: (Diagonal Loading) (Manifold Sparse) Number of snaphots: T=80 Number of sensors: M=8 SIR levels= -10, 0, 10, and 20 dB SNR levels= 20db and no noise

SIMULATION procedure FOR 8 sources ✕ 4 SIRs ✕ 2 SNRs ✕ 2500 runs Choose random DOAs and take T snapshots on the sensor array Select a lambda in [1, 2] for oracle tuning 1- Find a good initial point by grid search 2- Use fmincon to find a finer optimum lambda Solve the two optimization problem by CVX using that lambda and evaluate the errors END

Numerical Results Error gain versus number of interferers:

conclusions Novel sparsity regularized beamforming Solution obtained by semi-definite optimization of atomic norm Manifold sparsity assumption yields up to 2-dB gain in signal estimation over diagonal loading Semidefinite formulation enables grid-free estimation Further extensions Regularization parameter selection Learning theoretic study of regularized beamforming Gridless source localization

thank you! Questions?