Multi-View Discriminant Analysis 多视判别分析

Slides:



Advertisements
Similar presentations
Loris Bazzani*, Marco Cristani*†, Alessandro Perina*, Michela Farenzena*, Vittorio Murino*† *Computer Science Department, University of Verona, Italy †Istituto.
Advertisements

Component Analysis (Review)
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
KE CHEN 1, SHAOGANG GONG 1, TAO XIANG 1, CHEN CHANGE LOY 2 1. QUEEN MARY, UNIVERSITY OF LONDON 2. THE CHINESE UNIVERSITY OF HONG KONG CUMULATIVE ATTRIBUTE.
1 Welcome to the Kernel-Class My name: Max (Welling) Book: There will be class-notes/slides. Homework: reading material, some exercises, some MATLAB implementations.
3D M otion D etermination U sing µ IMU A nd V isual T racking 14 May 2010 Centre for Micro and Nano Systems The Chinese University of Hong Kong Supervised.
Intelligent Systems Lab. Recognizing Human actions from Still Images with Latent Poses Authors: Weilong Yang, Yang Wang, and Greg Mori Simon Fraser University,
Extended Sparse Linear Model for Face Recognition
São Paulo Advanced School of Computing (SP-ASC’10). São Paulo, Brazil, July 12-17, 2010 Looking at People Using Partial Least Squares William Robson Schwartz.
Discriminative and generative methods for bags of features
One-Shot Multi-Set Non-rigid Feature-Spatial Matching
Face Recognition Under Varying Illumination Erald VUÇINI Vienna University of Technology Muhittin GÖKMEN Istanbul Technical University Eduard GRÖLLER Vienna.
Subspace and Kernel Methods April 2004 Seong-Wook Joo.
Principal Component Analysis
Face Recognition using PCA (Eigenfaces) and LDA (Fisherfaces)
OCFS: Optimal Orthogonal Centroid Feature Selection for Text Categorization Jun Yan, Ning Liu, Benyu Zhang, Shuicheng Yan, Zheng Chen, and Weiguo Fan et.
Face Recognition: A Comparison of Appearance-Based Approaches
Foundation of High-Dimensional Data Visualization
Performance Evaluation of Grouping Algorithms Vida Movahedi Elder Lab - Centre for Vision Research York University Spring 2009.
Jinhui Tang †, Shuicheng Yan †, Richang Hong †, Guo-Jun Qi ‡, Tat-Seng Chua † † National University of Singapore ‡ University of Illinois at Urbana-Champaign.
Summarized by Soo-Jin Kim
Presented By Wanchen Lu 2/25/2013
Person-Specific Domain Adaptation with Applications to Heterogeneous Face Recognition (HFR) Presenter: Yao-Hung Tsai Dept. of Electrical Engineering, NTU.
What’s Making That Sound ?
1 Graph Embedding (GE) & Marginal Fisher Analysis (MFA) 吳沛勳 劉冠成 韓仁智
Mining Discriminative Components With Low-Rank and Sparsity Constraints for Face Recognition Qiang Zhang, Baoxin Li Computer Science and Engineering Arizona.
Modal Shape Analysis beyond Laplacian (CAGP 2012) Klaus Hildebrandt, Christian Schulz, Christoph von Tycowicz, Konrad Polthier (brief) Presenter: ShiHao.Wu.
Feature extraction 1.Introduction 2.T-test 3.Signal Noise Ratio (SNR) 4.Linear Correlation Coefficient (LCC) 5.Principle component analysis (PCA) 6.Linear.
General Tensor Discriminant Analysis and Gabor Features for Gait Recognition by D. Tao, X. Li, and J. Maybank, TPAMI 2007 Presented by Iulian Pruteanu.
IEEE TRANSSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE
Using Support Vector Machines to Enhance the Performance of Bayesian Face Recognition IEEE Transaction on Information Forensics and Security Zhifeng Li,
Deformable Part Model Presenter : Liu Changyu Advisor : Prof. Alex Hauptmann Interest : Multimedia Analysis April 11 st, 2013.
Transfer Learning for Image Classification Group No.: 15 Group member : Feng Cai Sauptik Dhar Sauptik.
Local Fisher Discriminant Analysis for Supervised Dimensionality Reduction Presented by Xianwang Wang Masashi Sugiyama.
Geodesic Flow Kernel for Unsupervised Domain Adaptation Boqing Gong University of Southern California Joint work with Yuan Shi, Fei Sha, and Kristen Grauman.
A DISTRIBUTION BASED VIDEO REPRESENTATION FOR HUMAN ACTION RECOGNITION Yan Song, Sheng Tang, Yan-Tao Zheng, Tat-Seng Chua, Yongdong Zhang, Shouxun Lin.
Manifold learning: MDS and Isomap
Shuai Zheng TNT group meeting 1/12/2011.  Paper Tracking  Robust view transformation model for gait recognition.
Paper Reading Dalong Du Nov.27, Papers Leon Gu and Takeo Kanade. A Generative Shape Regularization Model for Robust Face Alignment. ECCV08. Yan.
Image Classification for Automatic Annotation
A Convergent Solution to Tensor Subspace Learning.
PCA vs ICA vs LDA. How to represent images? Why representation methods are needed?? –Curse of dimensionality – width x height x channels –Noise reduction.
Adaptive Multi-view Clustering via Cross Trace Lasso
June 25-29, 2006ICML2006, Pittsburgh, USA Local Fisher Discriminant Analysis for Supervised Dimensionality Reduction Masashi Sugiyama Tokyo Institute of.
Jenn-Jier James Lien (連震杰)
Principal Component Analysis and Linear Discriminant Analysis for Feature Reduction Jieping Ye Department of Computer Science and Engineering Arizona State.
2D-LDA: A statistical linear discriminant analysis for image matrix
Multi-label Prediction via Sparse Infinite CCA Piyush Rai and Hal Daume III NIPS 2009 Presented by Lingbo Li ECE, Duke University July 16th, 2010 Note:
WLD: A Robust Local Image Descriptor Jie Chen, Shiguang Shan, Chu He, Guoying Zhao, Matti Pietikäinen, Xilin Chen, Wen Gao 报告人:蒲薇榄.
Zhiming Liu and Chengjun Liu, IEEE. Introduction Algorithms and procedures Experiments Conclusion.
Facial Smile Detection Based on Deep Learning Features Authors: Kaihao Zhang, Yongzhen Huang, Hong Wu and Liang Wang Center for Research on Intelligent.
1 Bilinear Classifiers for Visual Recognition Computational Vision Lab. University of California Irvine To be presented in NIPS 2009 Hamed Pirsiavash Deva.
Canonical Correlation Analysis (CCA). CCA This is it! The mother of all linear statistical analysis When ? We want to find a structural relation between.
Principal Component Analysis (PCA)
BRAIN Alliance Research Team Annual Progress Report (Jul – Feb
Deeply learned face representations are sparse, selective, and robust
Automatically Collect Ground Control Points from Online Aerial Maps
Jinbo Bi Joint work with Jiangwen Sun, Jin Lu, and Tingyang Xu
Recognition with Expression Variations
Supervised Time Series Pattern Discovery through Local Importance
Unsupervised Riemannian Clustering of Probability Density Functions
Machine Learning Basics
Unsupervised Face Alignment by Robust Nonrigid Mapping
Outline Peter N. Belhumeur, Joao P. Hespanha, and David J. Kriegman, “Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection,”
Outline S. C. Zhu, X. Liu, and Y. Wu, “Exploring Texture Ensembles by Efficient Markov Chain Monte Carlo”, IEEE Transactions On Pattern Analysis And Machine.
CS 2750: Machine Learning Support Vector Machines
Paper Reading Dalong Du April.08, 2011.
Introduction to Object Tracking
Learning Incoherent Sparse and Low-Rank Patterns from Multiple Tasks
Presentation transcript:

Multi-View Discriminant Analysis 多视判别分析 阚美娜 中国科学院计算技术研究所 kanmeina@ict.ac.cn

Outline Motivation Multi-view Discriminant Analysis (MvDA) Experiments Conclusions [1] Meina Kan, Shiguang Shan, Haihong Zhang, Shihong Lao, Xilin Chen. Multi-view Discriminant Analysis. European Conference on Computer Vision (ECCV), 2012. [2] Meina Kan, Shiguang Shan,Haihong Zhang, Shihong Lao, and Xilin Chen. Multi- view Discriminant Analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2015.

Cross-view/Heterogeneous Recognition Problem: matching between views Subjects→heterogeneous sensors→heterogeneous images Challenge: Large Discrepancy between views Different pose, lighting, resolution, feature…. … View 1 View 2 View 3

Cross-view/Heterogeneous Recognition Problem: matching between views Subjects→heterogeneous sensors→heterogeneous images Challenge: Large Discrepancy between views Different pose, lighting, resolution, feature…. vs. vs. vs.

Existing Solutions Problem & Challenge z: subjects Problem: x: observation superscript: view

Existing Solutions Problem & Challenge z: subjects Problem: x: observation superscript: view Goal:

Unsupervised vs. Supervised Two-view vs. Multi-view Existing Solutions Project two or more views to a common subspace Canonical Correlation Analysis (CCA) [H. Hotelling 1936] Partial Least Square (PLS) [A. Sharma 11] Multi-view Canonical Correlation Analysis (MCCA) [J. Rupnik 10] Common Discriminant Feature Extraction (CDFE) [D. Lin 06] Coupled Spectral Regression (CSR) [Z. Lei 09] Generalized Multi-view Analysis (GMA) [A. Sharma 12] Transform from one view Pseudo-Sketch Synthesis [Q. Liu 05] CCA [H. Hotelling 1936]:最大化两个视图间correlation MCCA [J. Rupnik 10] :最大化所有视图间correlation CDFE [D. Lin 06] :利用视图之间的判别性信息 CSR [Z. Lei 09] : Label当做共同子空间 PLS [A. Sharma 11] : Partial Least Square GMA [A. Sharma 12] : Generalized Multi-view Analysis Unsupervised vs. Supervised Two-view vs. Multi-view

= Existing Solutions Unsupervised Methods Canonical Correlation Analysis (CCA) [Hotelling 1936] =

= Existing Solutions Unsupervised Methods Canonical Correlation Analysis (CCA) [Hotelling 1936] =

Existing Solutions Unsupervised Methods Supervised Methods Canonical Correlation Analysis (CCA) [Hotelling 1936] Supervised Methods Generalized Multiview Analysis (GMA) [Sharma 2012] CCA: GMA:

Existing Solutions Unsupervised Methods Supervised Methods Canonical Correlation Analysis (CCA) [Hotelling 1936] Supervised Methods Generalized Multiview Analysis (GMA) [Sharma 2012] CDFE, supervised GMA, supervised CCA, unsupervised

Existing Solutions Multi-view Methods via pair-wise strategy Multiple common subspaces

Existing Solutions Multi-view Methods Single common subspace

Existing Solutions Multi-view Methods Unsupervised: MCCA[Nielsen 2002] Supervised: GMA[Sharma 2012] MCCA: GMA:

Existing Solutions Multi-view Methods Unsupervised: MCCA[Nielsen 2002] Supervised: GMA[Sharma 2012] MCCA: GMA:

Existing Solutions vs. Ours Limitations Pair-wise strategy for multi-view , many parameters, terms, etc Discriminancy only from intra-view or inter-view CDFE & GMA

Existing Solutions vs. Ours Limitations Pair-wise strategy for multi-view , many parameters, terms, etc Discriminancy only from intra-view or inter-view Ours CDFE & GMA

Multi-view Discriminant Analysis (MvDA) Basic Idea Project all views into one common subspace Discriminancy from both intra-view & inter-view Discriminant Common Space Class 1 Class c . . . Class 2 w 1 𝑇 x 𝑖1𝑘 ⇓ y 𝑖1𝑘 w 2 𝑇 x 𝑖2𝑘 y 𝑖2𝑘 w 3 𝑇 x 𝑖3𝑘 y 𝑖3𝑘

Multi-view Discriminant Analysis (MvDA) Basic Idea Project all views into one common subspace Discriminancy from both intra-view & inter-view Project each view to the common subspace Discriminant Common Space Class 1 Class c . . . Class 2 w 1 𝑇 x 𝑖1𝑘 ⇓ y 𝑖1𝑘 w 2 𝑇 x 𝑖2𝑘 y 𝑖2𝑘 w 3 𝑇 x 𝑖3𝑘 y 𝑖3𝑘

Multi-view Discriminant Analysis (MvDA) Basic Idea Project all views into one common subspace Discriminancy from both intra-view & inter-view Project each view to the common subspace Discriminancy of all views in common space Discriminant Common Space Class 1 Class c . . . Class 2 w 1 𝑇 x 𝑖1𝑘 ⇓ y 𝑖1𝑘 w 2 𝑇 x 𝑖2𝑘 y 𝑖2𝑘 w 3 𝑇 x 𝑖3𝑘 y 𝑖3𝑘

Multi-view Discriminant Analysis (MvDA) Basic Idea Project all views into one common subspace Discriminancy from both intra-view & inter-view Project each view to the common subspace Discriminancy of all views in common space

Multi-view Discriminant Analysis (MvDA) Basic Idea Project all views into one common subspace Discriminancy from both intra-view & inter-view Project each view to the common subspace Discriminancy of all views in common space

Multi-view Discriminant Analysis (MvDA) Formulation Project each view to the common subspace Discriminancy of all views in common space Advantages Unified framework for multi-view More discriminancy: intra-view & inter-view No parameter

Multi-view Discriminant Analysis (MvDA) Analytical Solution of MvDA The within-class scatter matrix can be reformulated as follows:

Multi-view Discriminant Analysis (MvDA) Analytical Solution of MvDA The between-class scatter matrix can be reformulated as follows:

Multi-view Discriminant Analysis (MvDA) Analytical Solution of MvDA The objective of the MvDA can be reformulated as: which can be reformulated as a more tractable form: can be solved by resorting to the generalized eigenvalue decomposition

MvDA with View-consistency Extension: view-consistency (VC-MvDA) Consistency in kernel space → primary space Representer Theorem

MvDA with View-consistency Extension: view-consistency (VC-MvDA) Structures of two views are same or similar … … Representer Theorem: Projection of samples: View Structure Consistency: View 1 View 2

MvDA with View-consistency Extension: view-consistency (VC-MvDA) Structures of two views are same or similar

Multi-view Discriminant Analysis (MvDA) Visualization of the common space The 2D embeddings of Euclidean space, common space from MCCA and MvDA for the samples from 7 views on Multi-PIE dataset. Different classes are denoted in different colors and shapes.

Multi-view Discriminant Analysis (MvDA) Experiments MutliPIE: 7 poses CCA FLD CDFE U-FLD GMA MvDA VC-MvDA 82.1% 89.0% 88.8% 84.3% 92.0% 95.0% 96.3%

Multi-view Discriminant Analysis (MvDA) Experiments MutliPIE: 7 poses CCA FLD CDFE U-FLD GMA MvDA VC-MvDA 82.1% 89.0% 88.8% 84.3% 92.0% 95.0% 96.3%

Multi-view Discriminant Analysis (MvDA) Experiments MutliPIE: 7 poses CCA FLD CDFE U-FLD GMA MvDA VC-MvDA 82.1% 89.0% 88.8% 84.3% 92.0% 95.0% 96.3% -45° -30° -15° 0° 15° 30° 45° - 1% 4% 12% 10% 8% 0% 2% 3% 7% 9% 6% 16% 5% Improvement of VC-MvDA compared to GMA

Multi-view Discriminant Analysis (MvDA) Experiments Methods CCA U-FLD CDFE GMA MvDA VC-MvDA HFB NIR-VIS 36.7% 39.1% 40.8% 47.5% 53.3% 59.2% VIS-NIR 30.0% 40.0% 45.0% 50.0% Methods CCA U-FLD CDFE GMA MvDA VC-MvDA CUFSF Photo-Sketch 45.5% 46.8% 45.6% - 53.4% 56.3% Sketch-Photo 47.5% 47.6% 55.5% 61.5%

Multi-view Discriminant Analysis (MvDA) Summary A unified framework for multi-view Multi-view strategy for both projection and objective Variations from both inter-view and intra-view No parameter for MvDA, one parameter for VC-MvDA Analytical solution Much better performance

Matlab Code is available online! Thanks ! Matlab Code is available online! http://vipl.ict.ac.cn/members/mnkan