1. BrainStorming 樊艳波 2015-7-20

2. Outline Several papers on icml15 & cvpr15 PALM Information Theory Learning.

3. Multi-view Sparse Co-clustering via Proximal Alternating Linearized Minimization(CVPR15) Single view rank-one approximation.

4. Multi-view co-clustering Objective Function. Optimization: PALM.

5. Proximal Alternating Linearized Minimization for Nonconvex and Nonsmooth Problems(Bolte, Mathematical Programming14) General nonconvex nonsmooth function Example:

6. Coordinate descent methods Gauss-Seidel iteration scheme: –Drawback: strict convexity assumption. Proximal regularization of the Gauss-Seidel scheme: –Existing problems: Hard to optimize each step exactly.

7. Proposed PALM method Idea: linear expansion

8. Proposed PALM method Algorithm.

9. An example: Sparse NMF Generate

10. Entropic Graph-based Posterior Regularization. MaxwellW Libbrecht(ICML15) Objective Function. R: regularization term over, Existing ways ： L0, L1, L2...

11. Posterior Regularization Posterior regularization: –Nearby variables have simple posterior distributions. –More nature. Formulation.

12. Optimation & Simulations EM-like algorithm. has closed form.

13. Unsupervised Simultaneous Orthogonal Basis Clustering Feature Selection.(CVPR15) Regularized regression model: Proposed Model. B: latent cluster center. E: encoding matrix. each row of E has only one non-zero term.

15. Just for Insights

16. Optimal Graph Learning with Partial Tags and Multiple Features for Image and Video Annotation.(CVPR15) Extensions: out of sample annotation; noise label information.

17. Information-Theoretic Dictionary Learning for Image Classification(TPAMI14) Traditional Dictionary learning. ITL based Dictionary learning. –D^{0}: initialization by k-svd or others. –Dictionary compactness: –Dictionary discrimination: –Dictionary representation: Optimization: gauss process, kernel density estimates...