1. Non-Negative Matrix Factorization （ NMF ） Reportor: MaPeng Paper :D.D.Lee andS.Seung,”Learning the parts of objects by non-negative matrix factorization” Nature,vol.401,pp.788-791,1999

2. 作者的相关信息 Daniel D. Lee, Ph.D. Associate Professor Dept. of Electrical and Systems Engineering Dept. of Bioengineering (Secondary) GRASP (General Robotics, Automation, Sensing, Perception) Lab 203B Moore/6314 University of Pennsylvania 200 S. 33rd Street Philadelphia, PA 19104 215-898-8112 215-573-2068(FAX) Email: ddlee@seas.upenn.eduddlee@seas.upenn.edu http://www.seas.upenn.edu/~ddlee/

3. H. Sebastian Seung Professor of Computational Neuroscience, MIT Investigator, Howard Hughes Medical Institute MIT, 46-5065 43 Vassar St. Cambridge, MA 02139 voice: 617-252-1693 seung@mit.edu seung@mit.edu Administrative assistant: Amy Dunn voice: 617-452-2694 fax: 617-452-2913 adunn@mit.edu adunn@mit.edu http://hebb.mit.edu/people/seung/

4. Problem Statement Given a set of images: 1. Create a set of basis images that can be linearly combined to create new images 2. Find the set of weights to reproduce every input image from the basis images 3. Dimension reduction

5. PCA NMF LNMF FNMF WNMF Mainly Discuss

6. PCA Find a set of orthogonal basis images The reconstructed image is a linear combination of the basis images

7. What don’t we like about PCA? PCA involves adding up some basis images then subtracting others Basis images aren ’ t physically intuitive Subtracting doesn ’ t make sense in context of some applications How do you subtract a face? What does subtraction mean in the context of document classification? back

8. Non-negative Matrix Factorization Like PCA, except the coefficients in the linear combination cannot be negative

9. Non-negative matrix factorization (NMF) (Lee & Seung - 2001) NMF gives Part based representation (Lee & Seung – Nature 1999)

10. NMF is based on Gradient Descent NMF: V  WH s.t. W i,d,H d,j  0 Let C be a given cost function, then update the parameters according to:

11. The idea behind multiplicative updates Positive term Negative term

12. The NMF decomposition is not unique NMF only unique when data adequately spans the positive orthant (Donoho & Stodden - 2004)

13. NMF Basis Imagesnmf_basis nmf_basis Only allowing adding of basis images makes intuitive sense – Has physical analogue in neurons Forcing the reconstruction coefficients to be positive leads to nice basis images – To reconstruct images, all you can do is add in more basis images – This leads to basis images that represent parts

15. Faces Training set: 2429 examples First 25 examples shown at right Set consists of 19x19 centered face images

16. Faces Basis Images: – Rank: 49 – Iterations: 50

17. Faces x = Original

18. Faces x = back

19. Example

20. Local non-negative matrix factorization

21. Letting LNMF is aimed at learning local features by imposing the following three additional constraints on the NMF basis:

23. back LNMF_basis

24. Fisher non-negative matrix factorization

25. back

26. Weighted NMF

28. back

29. 结论及未来工作 综上所述，非负矩阵分解是一种的提取 图像局部特征信息的有效的方法，目前 在很多领域得到广泛应用，值得我们关 注。 问题 （ 1 ）非平衡样本集识别率低的问题 （ 2 ）权重选取问题

30. 参考文献 [1]D.D.Lee and H.S.Seung,“Learning the parts of objects by non-negative matrix factorization”, Nature,vol.401,pp.788-791,1999 [2]D.D.Lee and H.S.Seung“Algorithms for non-negative Matrix factorization ” ， in Proceedings of Neural Information Processing Systems,2000. [3]S.Z.Li,X.Hou,H.J.Zhang,andQ.Cheng,“Learning spatially localized,parts- based representation”,Proc.IEEE Int.Conf.Computer Vision and Pattern Recognition,2001,pp.207-212 [4]J.Lu andY.-P.Tan,“Doubly weighted nonnegative matrix factorization for imbalanced face recognition”,Proc.IEEE Int.Conf.Acoustics,Speech,andSignalProcessing,2009,pp.877¨C880