Presentation is loading. Please wait.

Presentation is loading. Please wait.

Optimized Nearest Neighbor Methods Cam Weighted Distance vs. Statistical Confidence Robert R. Puckett.

Published byEllen Cooper Modified over 9 years ago

Similar presentations

Presentation on theme: "Optimized Nearest Neighbor Methods Cam Weighted Distance vs. Statistical Confidence Robert R. Puckett."— Presentation transcript:

1 Optimized Nearest Neighbor Methods Cam Weighted Distance vs. Statistical Confidence Robert R. Puckett

2 Cam-Weighted Distance Deforms the distribution by transformation Simulates strengthening and weakening effects between prototypes. k-nearest neighbors used to estimate parameters of the distribution Inverse transform used to provide a “cam weighted distance”

3 Statistical Confidence Confidence proportional majority value of neighbors. On low confidence choose bigger k An alternative to globally increasing the k value. Algorithm selectively increases the k- value only when the confidence is below some threshold.

4 Goals Implement NN-Base System Cam-NN Add-on Statistical Confidence Add-on Create hybrid method Test against dataset

5 Schedule Main Milestones Software development Dataset generation Analysis Report Writing Schedule

6 References Duda, R. O., P. E. Hart, et al. (2001). Pattern classification. New York, Wiley. Wang, J., P. Neskovic, et al. (2006). "Neighborhood size selection in the k-nearest- neighbor rule using statistical confidence." Pattern Recognition 39 (3): 417-423. Zhou, C. Y. and Y. Q. Chen (2006). "Improving nearest neighbor classification with cam weighted distance." Pattern Recognition 39 (4): 635-645.

Download ppt "Optimized Nearest Neighbor Methods Cam Weighted Distance vs. Statistical Confidence Robert R. Puckett."

Similar presentations

Nonparametric Methods: Nearest Neighbors

Nonparametric Methods: Nearest Neighbors
Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?

Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
DIMENSIONALITY REDUCTION: FEATURE EXTRACTION & FEATURE SELECTION Principle Component Analysis.

DIMENSIONALITY REDUCTION: FEATURE EXTRACTION & FEATURE SELECTION Principle Component Analysis.
K-NEAREST NEIGHBORS AND DECISION TREE Nonparametric Supervised Learning.

K-NEAREST NEIGHBORS AND DECISION TREE Nonparametric Supervised Learning.
© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/2004 1 Other Classification Techniques 1.Nearest Neighbor Classifiers 2.Support Vector Machines.

© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/ Other Classification Techniques 1.Nearest Neighbor Classifiers 2.Support Vector Machines.
An Introduction of Support Vector Machine

An Introduction of Support Vector Machine
2 1 Discrete Markov Processes (Markov Chains) 3 1 First-Order Markov Models.

2 1 Discrete Markov Processes (Markov Chains) 3 1 First-Order Markov Models.
2 – In previous chapters: – We could design an optimal classifier if we knew the prior probabilities P(wi) and the class- conditional probabilities P(x|wi)

2 – In previous chapters: – We could design an optimal classifier if we knew the prior probabilities P(wi) and the class- conditional probabilities P(x|wi)
G. Folino, A. Forestiero, G. Spezzano Swarming Agents for Discovering Clusters in Spatial Data Second International.

G. Folino, A. Forestiero, G. Spezzano Swarming Agents for Discovering Clusters in Spatial Data Second International.
CHAPTER 8 A NNEALING- T YPE A LGORITHMS Organization of chapter in ISSO –Introduction to simulated annealing –Simulated annealing algorithm Basic algorithm.

CHAPTER 8 A NNEALING- T YPE A LGORITHMS Organization of chapter in ISSO –Introduction to simulated annealing –Simulated annealing algorithm Basic algorithm.
Data preprocessing before classification In Kennedy et al.: “Solving data mining problems”

Data preprocessing before classification In Kennedy et al.: “Solving data mining problems”
電腦視覺 Computer and Robot Vision I Chapter2: Binary Machine Vision: Thresholding and Segmentation Instructor: Shih-Shinh Huang 1.

電腦視覺 Computer and Robot Vision I Chapter2: Binary Machine Vision: Thresholding and Segmentation Instructor: Shih-Shinh Huang 1.
Contour Based Approaches for Visual Object Recognition Jamie Shotton University of Cambridge Joint work with Roberto Cipolla, Andrew Blake.

Contour Based Approaches for Visual Object Recognition Jamie Shotton University of Cambridge Joint work with Roberto Cipolla, Andrew Blake.
Discriminative and generative methods for bags of features

Discriminative and generative methods for bags of features
Instance Based Learning

Instance Based Learning
Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?

Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
OUTLINE Course description, What is pattern recognition, Cost of error, Decision boundaries, The desgin cycle.

OUTLINE Course description, What is pattern recognition, Cost of error, Decision boundaries, The desgin cycle.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.

Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.

1-NN Rule: Given an unknown sample X decide if for That is, assign X to category if the closest neighbor of X is from category i.
Optimal Bandwidth Selection for MLS Surfaces

Optimal Bandwidth Selection for MLS Surfaces

Similar presentations

Ads by Google