Neighbourhood relation preservation (NRP) A rank-based data visualisation quality assessment criterion Jigang Sun PhD studies finished in July 2011 PhD.

Slides:

Advertisements

Similar presentations

8.2 Kernel And Range.

Advertisements

Face Recognition and Biometric Systems Eigenfaces (2)

Efficient And Accurate Ranking of Multidimensional Drug Profiling Data by Graph-Based Algorithm Dorit S. Hochbaum Chun-nan Hsu Yan T. Yang.

7-6 Similarity Transformations

Locating in fingerprint space: wireless indoor localization with little human intervention. Proceedings of the 18th annual international conference on.

Presented by: Mingyuan Zhou Duke University, ECE April 3, 2009

Multimedia DBs. Multimedia dbs A multimedia database stores text, strings and images Similarity queries (content based retrieval) Given an image find.

Non-linear Dimensionality Reduction CMPUT 466/551 Nilanjan Ray Prepared on materials from the book Non-linear dimensionality reduction By Lee and Verleysen,

University of Joensuu Dept. of Computer Science P.O. Box 111 FIN Joensuu Tel fax Isomap Algorithm.

High Performance Dimension Reduction and Visualization for Large High-dimensional Data Analysis Jong Youl Choi, Seung-Hee Bae, Judy Qiu, and Geoffrey Fox.

Two Technique Papers on High Dimensionality Allan Rempel December 5, 2005.

ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.

LLE and ISOMAP Analysis of Robot Images Rong Xu. Background Intuition of Dimensionality Reduction Linear Approach –PCA(Principal Component Analysis) Nonlinear.

Multivariate Data Analysis Chapter 10 - Multidimensional Scaling

Dimension reduction : PCA and Clustering Slides by Agnieszka Juncker and Chris Workman.

1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.

Extending metric multidimensional scaling with Bregman divergences

Dimension reduction : PCA and Clustering Christopher Workman Center for Biological Sequence Analysis DTU.

INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.

A Global Geometric Framework for Nonlinear Dimensionality Reduction Joshua B. Tenenbaum, Vin de Silva, John C. Langford Presented by Napat Triroj.

NonLinear Dimensionality Reduction or Unfolding Manifolds Tennenbaum|Silva|Langford [Isomap] Roweis|Saul [Locally Linear Embedding] Presented by Vikas.

Lightseminar: Learned Representation in AI An Introduction to Locally Linear Embedding Lawrence K. Saul Sam T. Roweis presented by Chan-Su Lee.

Nonlinear Dimensionality Reduction by Locally Linear Embedding Sam T. Roweis and Lawrence K. Saul Reference: "Nonlinear dimensionality reduction by locally.

Dimension Reduction and Visualization of Large High-Dimensional Data via Interpolation Seung-Hee Bae, Jong Youl Choi, Judy Qiu, and Geoffrey Fox School.

Nonlinear Dimensionality Reduction Approaches. Dimensionality Reduction The goal: The meaningful low-dimensional structures hidden in their high-dimensional.

Manifold learning: Locally Linear Embedding Jieping Ye Department of Computer Science and Engineering Arizona State University

The Tutorial of Principal Component Analysis, Hierarchical Clustering, and Multidimensional Scaling Wenshan Wang.

Enhancing Tensor Subspace Learning by Element Rearrangement

What is an image? f(x,y):2 

University of Joensuu Dept. of Computer Science P.O. Box 111 FIN Joensuu Tel fax Speech and.

Presented by: Sarah Wong Orthoptist II Orthoptic Unit QA 2011.

Basics of Digital Audio Outline  Introduction  Digitization of Sound  MIDI: Musical Instrument Digital Interface.

Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology Adaptive nonlinear manifolds and their applications to pattern.

Data Reduction. 1.Overview 2.The Curse of Dimensionality 3.Data Sampling 4.Binning and Reduction of Cardinality.

Computer Vision Lab. SNU Young Ki Baik Nonlinear Dimensionality Reduction Approach (ISOMAP, LLE)

Multidimensional Scaling Vuokko Vuori Based on: Data Exploration Using Self-Organizing Maps, Samuel Kaski, Ph.D. Thesis, 1997 Multivariate Statistical.

Scale Drawing - a two dimensional drawing that is similar to the object it represents. Scale Model - a three-dimensional model that is similar to the object.

Slide 14.1 Nonmetric Scaling MathematicalMarketing Chapter 14 Nonmetric Scaling Measurement, perception and preference are the main themes of this section.

Validation studies : project using French data Assessing the consistency of ESeC with theoretical framework “à la Goldthorpe” Pointing out using ISCO as.

ISOMAP TRACKING WITH PARTICLE FILTER Presented by Nikhil Rane.

GRASP Learning a Kernel Matrix for Nonlinear Dimensionality Reduction Kilian Q. Weinberger, Fei Sha and Lawrence K. Saul ICML’04 Department of Computer.

Manifold learning: MDS and Isomap

Nonlinear Dimensionality Reduction Approach (ISOMAP)

Jan Kamenický.  Many features ⇒ many dimensions  Dimensionality reduction ◦ Feature extraction (useful representation) ◦ Classification ◦ Visualization.

Non-Linear Dimensionality Reduction

Making Time: Pseudo Time-Series for the Temporal Analysis of Cross-Section Data Emma Peeling, Allan Tucker Centre for Intelligent Data Analysis Brunel.

Tony Jebara, Columbia University Advanced Machine Learning & Perception Instructor: Tony Jebara.

Data Mining Course 2007 Eric Postma Clustering. Overview Three approaches to clustering 1.Minimization of reconstruction error PCA, nlPCA, k-means clustering.

Datum and Projections.

1 E.V. Myasnikov 2007 Digital image collection navigation based on automatic classification methods Samara State Aerospace University RCDL 2007Интернет-математика.

Multidimensional Scaling and Correspondence Analysis © 2007 Prentice Hall21-1.

Math 285 Project Diffusion Maps Xiaoyan Chong Department of Mathematics and Statistics San Jose State University.

Extending metric multidimensional scaling with Bregman divergences Mr. Jigang Sun Supervisor: Prof. Colin Fyfe Nov 2009.

Multidimensional Scaling

FastMap : Algorithm for Indexing, Data- Mining and Visualization of Traditional and Multimedia Datasets.

CS654: Digital Image Analysis Lecture 11: Image Transforms.

CSC321: Extra Lecture (not on the exam) Non-linear dimensionality reduction Geoffrey Hinton.

Out of sample extension of PCA, Kernel PCA, and MDS WILSON A. FLORERO-SALINAS DAN LI MATH 285, FALL

High Dimensional Probabilistic Modelling through Manifolds

Singular Value Decomposition and its applications

Curvilinear Component Analysis and Bregman divergences

An Adept Edge Detection Algorithm for Human Knee Osteoarthritis Images

Multidimensional Scaling

Multidimensional Scaling

Multidimensional Scaling

Video Analysis via Nonlinear Dimensionality Reduction Technique

Physics 451/551 Theoretical Mechanics

NonLinear Dimensionality Reduction or Unfolding Manifolds

Capacity Dimension of The Hénon Attractor

INTRODUCTION TO Machine Learning

Presentation transcript:

Neighbourhood relation preservation (NRP) A rank-based data visualisation quality assessment criterion Jigang Sun PhD studies finished in July 2011 PhD Supervisor : Colin Fyfe, Malcolm Crowe University of the West of Scotland

outline Multidimensional Scaling (MDS); The need for a common quality measure for data visualisation; Local continuity meta-criterion (LCMC); Definition of neighbourhood relation preservation (NRP); Illustration of LCMC and NRP on mappings of data sets created by different methods;

Multidimensional Scaling (MDS) A group of information visualisation methods that projects data points from high dimensional data space to low, typically two dimensional, latent space in which the structure of the original data set can be identified by eye. For example…

By LeftSammon, using graph distances, k=20 Samples of high dimensional data (each image is 28*28=784 dimensions) 2 dimensional projection

Various methods The classical MDS, the stress function to be minimised is defined to be  Sammon Mapping (1969) Each method has its own criterion

Instead of we use base function My insight: 1. The above can be performed very efficiently. 2. The higher order Taylor series terms are better for analysis. to create LeftSammon mapping Various methods

Each method has its own criterion.

Mappings of open box By Sammon’s mapping By LeftSammon mapping Mappings can be assessed by eye

By CMDS By LeftExp By RightExp By Isomap Mappings of open box

by Sammon's mappingby LeftSammon mapping Sammon vs LeftSammon mapping Assessing mapping quality by eye is usually difficult

Local continuity meta-criterion (LCMC) Problem: loose constraints

Rank based quality measures Traditional rank is used in trustworthiness and continuity (T&C ) Problem 1: change of intermediate points is not considered p is mapped perfectly since rank of p does not change Rank is discrete; distance is continuous

Rank based quality measures Problem 2: angle constraint is not considered

Neighbourhood relation preservation (NRP)

Assessment to mappings of open box

Mappings of MNIST digits By CMDS By Isomap By LeftExp By RightExp

Assessment of mappings of digits

Conclusions Multidimensional Scaling (MDS); List of objective function of some MDS methods; The need for a common quality measure for data visualisation; Local continuity meta-criterion (LCMC); Definition of Neighbourhood relation preservation (NRP); Comparison of LCMC and NRP on mappings of data sets created by different methods; Thank you! Any questions?