Non-negative Matrix Factorization (NMF)

Slides:



Advertisements
Similar presentations
Current techniques for measuring
Advertisements

Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Medical Image Registration Kumar Rajamani. Registration Spatial transform that maps points from one image to corresponding points in another image.
Modulation Spectrum Factorization for Robust Speech Recognition Wen-Yi Chu 1, Jeih-weih Hung 2 and Berlin Chen 1 Presenter : 張庭豪.
Tensors and Component Analysis Musawir Ali. Tensor: Generalization of an n-dimensional array Vector: order-1 tensor Matrix: order-2 tensor Order-3 tensor.
Image Denoising using Locally Learned Dictionaries Priyam Chatterjee Peyman Milanfar Dept. of Electrical Engineering University of California, Santa Cruz.
Data mining and statistical learning - lecture 6
Principal Component Analysis
Linear Transformations
Symmetric Matrices and Quadratic Forms
Real-time Combined 2D+3D Active Appearance Models Jing Xiao, Simon Baker,Iain Matthew, and Takeo Kanade CVPR 2004 Presented by Pat Chan 23/11/2004.
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 20 Solution of Linear System of Equations - Iterative Methods.
Face Recognition Based on 3D Shape Estimation
Face Recognition Jeremy Wyatt.
Chapter 3 Determinants and Matrices
Basic Concepts and Definitions Vector and Function Space. A finite or an infinite dimensional linear vector/function space described with set of non-unique.
6 1 Linear Transformations. 6 2 Hopfield Network Questions.
Tutorial 10 Iterative Methods and Matrix Norms. 2 In an iterative process, the k+1 step is defined via: Iterative processes Eigenvector decomposition.
Statistical Color Models (SCM) Kyungnam Kim. Contents Introduction Trivariate Gaussian model Chromaticity models –Fixed planar chromaticity models –Zhu.
Section 8.3 – Systems of Linear Equations - Determinants Using Determinants to Solve Systems of Equations A determinant is a value that is obtained from.
SINGLE CHANNEL SPEECH MUSIC SEPARATION USING NONNEGATIVE MATRIXFACTORIZATION AND SPECTRAL MASKS Jain-De,Lee Emad M. GraisHakan Erdogan 17 th International.
Summarized by Soo-Jin Kim
Hyperspectral Imaging Alex Chen 1, Meiching Fong 1, Zhong Hu 1, Andrea Bertozzi 1, Jean-Michel Morel 2 1 Department of Mathematics, UCLA 2 ENS Cachan,
SPECTRO-TEMPORAL POST-SMOOTHING IN NMF BASED SINGLE-CHANNEL SOURCE SEPARATION Emad M. Grais and Hakan Erdogan Sabanci University, Istanbul, Turkey  Single-channel.
Non Negative Matrix Factorization
Blue: Histogram of normalised deviation from “true” value; Red: Gaussian fit to histogram Presented at ESA Hyperspectral Workshop 2010, March 16-19, Frascati,
Texture analysis Team 5 Alexandra Bulgaru Justyna Jastrzebska Ulrich Leischner Vjekoslav Levacic Güray Tonguç.
Linear Image Reconstruction Bart Janssen 13-11, 2007 Eindhoven.
Estimation of Number of PARAFAC Components
Mingyang Zhu, Huaijiang Sun, Zhigang Deng Quaternion Space Sparse Decomposition for Motion Compression and Retrieval SCA 2012.
CCN COMPLEX COMPUTING NETWORKS1 This research has been supported in part by European Commission FP6 IYTE-Wireless Project (Contract No: )
NONNEGATIVE MATRIX FACTORIZATION WITH MATRIX EXPONENTIATION Siwei Lyu ICASSP 2010 Presenter : 張庭豪.
4.8 Using matrices to solve systems! 2 variable systems – by hand 3 or more variables – using calculator!
Principal Component Analysis (PCA).
Affine Registration in R m 5. The matching function allows to define tentative correspondences and a RANSAC-like algorithm can be used to estimate the.
Non-negative Matrix Factor Deconvolution; Extraction of Multiple Sound Sources from Monophonic Inputs C.G. Puntonet and A. Prieto (Eds.): ICA 2004 Presenter.
Independent Component Analysis features of Color & Stereo images Authors: Patrik O. Hoyer Aapo Hyvarinen CIS 526: Neural Computation Presented by: Ajay.
Visual Cryptography Given By: Moni Naor Adi Shamir Presented By: Anil Vishnoi (2005H103017)
CSE 554 Lecture 8: Alignment
Spectral Methods for Dimensionality
-42 Impact of signal non-repeatability on spectral CT images
Digital Image Processing Lecture 16: Segmentation: Detection of Discontinuities Prof. Charlene Tsai.
Motion Segmentation with Missing Data using PowerFactorization & GPCA
Outline Peter N. Belhumeur, Joao P. Hespanha, and David J. Kriegman, “Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection,”
PCA vs ICA vs LDA.
Principal Nested Spheres Analysis
Historic Document Image De-Noising using Principal Component Analysis (PCA) and Local Pixel Grouping (LPG) Han-Yang Tang1, Azah Kamilah Muda1, Yun-Huoy.
Outline S. C. Zhu, X. Liu, and Y. Wu, “Exploring Texture Ensembles by Efficient Markov Chain Monte Carlo”, IEEE Transactions On Pattern Analysis And Machine.
Example of PCR, interpretation of calibration equations
Introduction To Wavelets
Bayesian belief networks 2. PCA and ICA
Aim of the project Take your image Submit it to the search engine
4. DIGITAL IMAGE TRANSFORMS 4.1. Introduction
Principal Component Analysis (PCA)
Lial/Hungerford/Holcomb/Mullins: Mathematics with Applications 11e Finite Mathematics with Applications 11e Copyright ©2015 Pearson Education, Inc. All.
A Digital Watermarking Scheme Based on Singular Value Decomposition
1.3 Vector Equations.
Parallelization of Sparse Coding & Dictionary Learning
Course 7 Motion.
X.6 Non-Negative Matrix Factorization
Symmetric Matrices and Quadratic Forms
第 四 章 VQ 加速運算與編碼表壓縮 4-.
4.4 Objectives Day 1: Find the determinants of 2  2 and 3  3 matrices. Day 2: Use Cramer’s rule to solve systems of linear equations. Vocabulary Determinant:
TWO DIMENSIONAL TRANSFORMATION
Emad M. Grais Hakan Erdogan
NON-NEGATIVE COMPONENT PARTS OF SOUND FOR CLASSIFICATION Yong-Choon Cho, Seungjin Choi, Sung-Yang Bang Wen-Yi Chu Department of Computer Science &
Fig. 1 CFHT photometry converted into spectral reflectivity obtained on UT (Universal Time) 22 and 25 October 2014, is shown in comparison to the VLT reflectivity.
Symmetric Matrices and Quadratic Forms
Marios Mattheakis and Pavlos Protopapas
Outline Sparse Reconstruction RIP Condition
Presentation transcript:

Non-negative Matrix Factorization NMF Non-negative Tensor Factorization NTF

Non-negative Matrix Factorization (NMF) Given a data matrix F = {Fij}mxn, non-negative matrix factorization refers to the decomposition of the matrix F into matrices W and H of size nxr and rxm, respectively, such that: F= WH Where the elements in W and H are all positive values. From this decomposition, a reduced representation is achieved by choosing r such that r<n and r<m.

NMF where So is the original spectrum, and W and H are 2D non-negative matrixes. NMF the following iterative learning rules are used to find the linear decomposition: (3)

Results r = 2; r = 3; r = 1; r = 5; r = 81; original

Non-negative Tensor Factorization (NTF) The basic approach of NTF is to find a solution for the problem:

NTF Although NTF is originally 3D, one domain can be neglected, since the data is only two-dimensional, the first domain is the spectral domain and the second domain consists of the large number of spectra n. The iteration step to update all i values is defined as following:

Results m = 1; m = 5; m = 10; m = 50; m = 100; original

Experiments Structure of the performed experiments: Tested spectra (Natural):

Results of the experiments Reconstruction bases for Natural set for PCA, NMF, and PCA for used light sources.

Conclusion The obtained results show that the reconstruction bases are strongly affected by light source. The properties of the applied lights surfaces are clearly reflected in the corresponding bases. Smooth lights give smooth bases. Peaks arise in the corresponding bases in a same order.

Searching Method NTF and PCA take spectra domain basis from each spectral image. Those basis defines as spectral color features. Similarity measures (Euclidian distance, goodness of fit coefficient (GFC) and peak signal-to-noise ratio (PSNR) ) are calculated between spectra color features.

107 spectral images were used. Experiments 107 spectral images were used.

Results

Results