Presentation is loading. Please wait.

Presentation is loading. Please wait.

Nonlinear Learning Using Local Coordinate Coding K. Yu, T. Zhang and Y. Gong, NIPS 2009 Improved Local Coordinate Coding Using Local Tangents K. Yu and.

Similar presentations


Presentation on theme: "Nonlinear Learning Using Local Coordinate Coding K. Yu, T. Zhang and Y. Gong, NIPS 2009 Improved Local Coordinate Coding Using Local Tangents K. Yu and."— Presentation transcript:

1 Nonlinear Learning Using Local Coordinate Coding K. Yu, T. Zhang and Y. Gong, NIPS 2009 Improved Local Coordinate Coding Using Local Tangents K. Yu and T. Zhang, ICML 2010 Locality-Constrained Linear Coding for Image Classification J. Wang, J. Yang, K. Yu, F. Lv, T. Huang and Y. Gong, CVPR2010 Presented by: Mingyuan Zhou Duke University, ECE September 17, 2010

2 Local Coordinate Coding: Theory Nonlinear Learning Using Local Coordinate Coding

3 Local Coordinate Coding: Practice Sparse coding: LLC: Nonlinear Learning Using Local Coordinate Coding

4 Experiments: linear ridge regression based on the sparse codes or LCC Nonlinear Learning Using Local Coordinate Coding

5 Experiments: linear ridge regression Nonlinear Learning Using Local Coordinate Coding

6 Experiments: Handwritten Digit Recognition Nonlinear Learning Using Local Coordinate Coding

7 Experiments: Handwritten Digit Recognition Nonlinear Learning Using Local Coordinate Coding

8 Conclusion Nonlinear Learning Using Local Coordinate Coding

9 Improved Local Coordinate Coding Using Local Tangents Motivation For smooth but highly nonlinear function, local linear approximation may not necessarily be optimal, which means that many anchor points are needed to achieve accurate approximation. The improved LCC has better approximation of high dimensional nonlinear functions when the underlying data manifold is locally relatively flat. It significantly reduces the number of anchor points, leading to reduced computational complexity and improved prediction.

10 Improved Local Coordinate Coding Using Local Tangents VQ, LCC and Improved LCC VQ

11 Improved Local Coordinate Coding Using Local Tangents VQ, LCC and Improved LCC Support: Coding:(Extended LCC) (LCC with local Tangents)

12 Improved Local Coordinate Coding Using Local Tangents Algorithm

13 Improved Local Coordinate Coding Using Local Tangents Experiments The feature dimension is increased from |C| to |C|(1+m) for LCC with local Tangents.

14 Locality-Constrained Linear Coding for Image Classification Introduction VQ + SPM + Nonlinear SVM SC + SPM + Linear SVM LLC + SPM + Linear SVM

15 Locality-Constrained Linear Coding for Image Classification Objective functions VQ SC LLC

16 Locality-Constrained Linear Coding for Image Classification Properties of LLC Better reconstruction Local smooth sparsity Analytical solution Approximate solution with KNN constraint

17 Locality-Constrained Linear Coding for Image Classification Codebook Optimization

18 Locality-Constrained Linear Coding for Image Classification Experiments

19 Locality-Constrained Linear Coding for Image Classification Experiments


Download ppt "Nonlinear Learning Using Local Coordinate Coding K. Yu, T. Zhang and Y. Gong, NIPS 2009 Improved Local Coordinate Coding Using Local Tangents K. Yu and."

Similar presentations


Ads by Google