R ECONSTRUCTION ON S MOOTH M ANIFOLDS Bhuwan Dhingra Dual Degree Student Electrical Engineering IIT Kanpur.

Slides:

Advertisements

Similar presentations

Robust spectral 3D-bodypart segmentation along time Fabio Cuzzolin, Diana Mateus, Edmond Boyer, Radu Horaud Perception project meeting 24/4/2007 Submitted.

Advertisements

Non-linear Dimensionality Reduction by Locally Linear Inlaying Presented by Peng Zhang Tianjin University, China Yuexian Hou, Peng Zhang, Xiaowei Zhang,

The Build-up of the Red Sequence at z

Manifold Learning Techniques: So which is the best?

Surface Reconstruction From Unorganized Point Sets

Richard G. Baraniuk Chinmay Hegde Sriram Nagaraj Go With The Flow A New Manifold Modeling and Learning Framework for Image Ensembles Aswin C. Sankaranarayanan.

Manifold Learning Dimensionality Reduction. Outline Introduction Dim. Reduction Manifold Isomap Overall procedure Approximating geodesic dist. Dijkstra’s.

Presented by: Mingyuan Zhou Duke University, ECE April 3, 2009

A novel supervised feature extraction and classification framework for land cover recognition of the off-land scenario Yan Cui

Non-linear Dimensionality Reduction CMPUT 466/551 Nilanjan Ray Prepared on materials from the book Non-linear dimensionality reduction By Lee and Verleysen,

Watching Unlabeled Video Helps Learn New Human Actions from Very Few Labeled Snapshots Chao-Yeh Chen and Kristen Grauman University of Texas at Austin.

University of Joensuu Dept. of Computer Science P.O. Box 111 FIN Joensuu Tel fax Isomap Algorithm.

“Random Projections on Smooth Manifolds” -A short summary

Manifold Bootstrapping for SVBRDF Capture

LLE and ISOMAP Analysis of Robot Images Rong Xu. Background Intuition of Dimensionality Reduction Linear Approach –PCA(Principal Component Analysis) Nonlinear.

Image Manifolds : Learning-based Methods in Vision Alexei Efros, CMU, Spring 2007 © A.A. Efros With slides by Dave Thompson.

Three Algorithms for Nonlinear Dimensionality Reduction Haixuan Yang Group Meeting Jan. 011, 2005.

Linear View Synthesis Using a Dimensionality Gap Light Field Prior

A Global Geometric Framework for Nonlinear Dimensionality Reduction Joshua B. Tenenbaum, Vin de Silva, John C. Langford Presented by Napat Triroj.

Atul Singh Junior Undergraduate CSE, IIT Kanpur.  Dimension reduction is a technique which is used to represent a high dimensional data in a more compact.

N u v P(0,0) P(4,1) Orthographic (parallel) projection: Finding the starting point of the ray P(0,0): origin of image plane P(4,1): image pixel at i=4,

NonLinear Dimensionality Reduction or Unfolding Manifolds Tennenbaum|Silva|Langford [Isomap] Roweis|Saul [Locally Linear Embedding] Presented by Vikas.

Lightseminar: Learned Representation in AI An Introduction to Locally Linear Embedding Lawrence K. Saul Sam T. Roweis presented by Chan-Su Lee.

Random Projections of Signal Manifolds Michael Wakin and Richard Baraniuk Random Projections for Manifold Learning Chinmay Hegde, Michael Wakin and Richard.

Nonlinear Dimensionality Reduction by Locally Linear Embedding Sam T. Roweis and Lawrence K. Saul Reference: "Nonlinear dimensionality reduction by locally.

Nonlinear Dimensionality Reduction Approaches. Dimensionality Reduction The goal: The meaningful low-dimensional structures hidden in their high-dimensional.

Manifold learning: Locally Linear Embedding Jieping Ye Department of Computer Science and Engineering Arizona State University

Richard Baraniuk Chinmay Hegde Marco Duarte Mark Davenport Rice University Michael Wakin University of Michigan Compressive Learning and Inference.

Dimensionality reduction: Some Assumptions High-dimensional data often lies on or near a much lower dimensional, curved manifold. A good way to represent.

O UT - OF -S AMPLE E XTENSION AND R ECONSTRUCTION ON M ANIFOLDS Bhuwan Dhingra Final Year (Dual Degree) Dept of Electrical Engg.

THE MANIFOLDS OF SPATIAL HEARING Ramani Duraiswami | Vikas C. Raykar Perceptual Interfaces and Reality Lab University of Maryland, College park.

Computer Vision Lab. SNU Young Ki Baik Nonlinear Dimensionality Reduction Approach (ISOMAP, LLE)

1 Applications Shmuel Peleg and Joshua Herman, “Panoramic Mosaics by Manifold Projection”, Computer Vision and Pattern Recognition (CVPR), 1997 Wolfgang.

ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane.

GRASP Learning a Kernel Matrix for Nonlinear Dimensionality Reduction Kilian Q. Weinberger, Fei Sha and Lawrence K. Saul ICML’04 Department of Computer.

Dimensionality Reduction

Manifold learning: MDS and Isomap

Non-Isometric Manifold Learning Analysis and an Algorithm Piotr Dollár, Vincent Rabaud, Serge Belongie University of California, San Diego.

CSC2535: Computation in Neural Networks Lecture 12: Non-linear dimensionality reduction Geoffrey Hinton.

Nonlinear Dimensionality Reduction Approach (ISOMAP)

Data Mining Course 0 Manifold learning Xin Yang. Data Mining Course 1 Outline Manifold and Manifold Learning Classical Dimensionality Reduction Semi-Supervised.

THE VAN PERSIE PROBLEM Anurag Misra © Garuna Productions MENTOR: DR. AMITABHA MUKHERJEE Anurag Misra

Tony Jebara, Columbia University Advanced Machine Learning & Perception Instructor: Tony Jebara.

CSC321: Lecture 25: Non-linear dimensionality reduction Geoffrey Hinton.

Nonlinear Dimension Reduction: Semi-Definite Embedding vs. Local Linear Embedding Li Zhang and Lin Liao.

CSC321: Extra Lecture (not on the exam) Non-linear dimensionality reduction Geoffrey Hinton.

Manifold Learning JAMES MCQUEEN – UW DEPARTMENT OF STATISTICS.

Spectral Methods for Dimensionality

Nonlinear Dimensionality Reduction

Manifold Learning Student: Ali Taalimi 05/05/2012.

Unsupervised Riemannian Clustering of Probability Density Functions

How Signals are Sampled: ADC

Machine Learning Basics

Dimensionality Reduction

Feb. 19, 2002 Kinh Tieu on LLE presentation

ISOMAP TRACKING WITH PARTICLE FILTERING

Outline Nonlinear Dimension Reduction Brief introduction Isomap LLE

Dimensionality Reduction

Object Modeling with Layers

Lecture 21 SVD and Latent Semantic Indexing and Dimensional Reduction

On a small neighborhood The function is approximately linear

Goodfellow: Chapter 14 Autoencoders

Diffusion Curves Dr. Scott Schaefer.

Orthographic (parallel) projection:

Lecture 7: Simple Classifier (KNN)

Video Analysis via Nonlinear Dimensionality Reduction Technique

Spatial Interpolation (Discrete Point Data)

Nonlinear Dimension Reduction:

NonLinear Dimensionality Reduction or Unfolding Manifolds

Maximum likelihood estimation of intrinsic dimension

Presentation transcript:

R ECONSTRUCTION ON S MOOTH M ANIFOLDS Bhuwan Dhingra Dual Degree Student Electrical Engineering IIT Kanpur

I NTRODUCTION A lot of high-dimensional datasets lie on or near a smooth low-dimensional manifold Ex: Disk Images Each image lies on a 2-dimensional manifold in a 100x100x3 space

D IMENSION R EDUCTION Non-Linear methods (ISOMAP, LLE etc.) find a low-dimensional embedding of the sampled points on the manifold Out-of-Sample reconstruction – construct the high-dimensional images for new test points, given the training point images

L OCAL L INEAR I NTERPOLATION Specifically, can we improve over simple linear interpolation in a local neighborhood on the manifold? Linear interpolation: Find k -nearest neighbors of new point Minimize Reconstruction

T ANGENT S PACE P ARAMETERIZATION (T YAGI, V URAL AND F ROSSARD )

T ANGENT S PACE R ECONSTRUCTION

T ANGENT S PACE E STIMATION

L INEAR R EGRESSION ON T ANGENT S PACE Red circle shows the interpolated test point on the tangent space

Q UADRATIC R EGRESSION ON H IGHER C OMPONENTS

T ANGENT S PACE V L INEAR R ECONSTRUCTION Actual Data Tangent Space Linear

V IDEO F RAME I NTERPOLATION Foreman video sequence ISOMAP used to embed into m = 1 dimensional space

T HANK Y OU