Presentation is loading. Please wait.

Presentation is loading. Please wait.

Chapter 1: Introduction to Pattern Recognition

Published byAnna McKinney Modified over 9 years ago

Similar presentations

Presentation on theme: "Chapter 1: Introduction to Pattern Recognition"— Presentation transcript:

1 Chapter 1: Introduction to Pattern Recognition
Machine Perception An example Pattern Recognition Systems The Design Cycle Learning and Adaptation Conclusion All materials used in this course were taken from the textbook “Pattern Classification” by Duda et al., John Wiley & Sons, 2001 with the permission of the authors and the publisher

2 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Machine Perception Build a machine that can recognize patterns: Speech recognition Fingerprint identification OCR (Optical Character Recognition) DNA sequence identification Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 1

3 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
An Example “Sorting incoming Fish on a conveyor according to species using optical sensing” Sea bass Species Salmon Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

4 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Problem Analysis Set up a camera and take some sample images to extract features Length Lightness Width Number and shape of fins Position of the mouth, etc… This is the set of all suggested features to explore for use in our classifier! Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

5 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Preprocessing Use a segmentation operation to isolate fishes from one another and from the background Information from a single fish is sent to a feature extractor whose purpose is to reduce the data by measuring certain features The features are passed to a classifier Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

6 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

7 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Classification Select the length of the fish as a possible feature for discrimination Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

8 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

9 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
The length is a poor feature alone! Select the lightness as a possible feature. Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

10 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

11 Threshold decision boundary and cost relationship
Move our decision boundary toward smaller values of lightness in order to minimize the cost (reduce the number of sea bass that are classified salmon!) Task of decision theory Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

12 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Adopt the lightness and add the width of the fish Fish x = [x1, x2] Lightness Width Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

13 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

14 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
We might add other features that are not correlated with the ones we already have. A precaution should be taken not to reduce the performance by adding such “noisy features” Ideally, the best decision boundary should be the one which provides an optimal performance such as in the following figure: Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

15 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

16 Issue of generalization!
However, our satisfaction is premature because the central aim of designing a classifier is to correctly classify novel input Issue of generalization! Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

17 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 2

18 Pattern Recognition Systems
Sensing Use of a transducer (camera or microphone) PR system depends of the bandwidth, the resolution sensitivity distortion of the transducer Segmentation and grouping Patterns should be well separated and should not overlap Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 3

19 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 3

20 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Feature extraction Discriminative features Invariant features with respect to translation, rotation and scale. Classification Use a feature vector provided by a feature extractor to assign the object to a category Post Processing Exploit context input dependent information other than from the target pattern itself to improve performance Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 3

21 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
The Design Cycle Data collection Feature Choice Model Choice Training Evaluation Computational Complexity Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 4

22 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 4

23 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Data Collection How do we know when we have collected an adequately large and representative set of examples for training and testing the system? Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 4

24 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Feature Choice Depends on the characteristics of the problem domain. Simple to extract, invariant to irrelevant transformation insensitive to noise. Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 4

25 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Model Choice Unsatisfied with the performance of our fish classifier and want to jump to another class of model Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 4

26 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Training Use data to determine the classifier. Many different procedures for training classifiers and choosing models Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 4

27 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Evaluation Measure the error rate (or performance and switch from one set of features to another one Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 4

28 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Computational Complexity What is the trade off between computational ease and performance? (How an algorithm scales as a function of the number of features, patterns or categories?) Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 4

29 Learning and Adaptation
Supervised learning A teacher provides a category label or cost for each pattern in the training set Unsupervised learning The system forms clusters or “natural groupings” of the input patterns Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 5

30 CSE 616 Applied Pattern Recognition, Chapter 1, Section 1.
Conclusion Reader seems to be overwhelmed by the number, complexity and magnitude of the sub-problems of Pattern Recognition Many of these sub-problems can indeed be solved Many fascinating unsolved problems still remain Dr. Djamel Bouchaffra CSE 616 Applied Pattern Recognition, Chapter 1, Section 1. 6

Download ppt "Chapter 1: Introduction to Pattern Recognition"

Similar presentations

Introduction to Machine Learning BITS C464/BITS F464

Introduction to Machine Learning BITS C464/BITS F464
Perceptron Learning Rule

Perceptron Learning Rule
Road-Sign Detection and Recognition Based on Support Vector Machines Saturnino, Sergio et al. Yunjia Man ECG 782 Dr. Brendan.

Road-Sign Detection and Recognition Based on Support Vector Machines Saturnino, Sergio et al. Yunjia Man ECG 782 Dr. Brendan.
ECE 8443 – Pattern Recognition Objectives: Course Introduction Typical Applications Resources: Syllabus Internet Books and Notes D.H.S: Chapter 1 Glossary.

ECE 8443 – Pattern Recognition Objectives: Course Introduction Typical Applications Resources: Syllabus Internet Books and Notes D.H.S: Chapter 1 Glossary.
Chapter 2: Bayesian Decision Theory (Part 2) Minimum-Error-Rate Classification Classifiers, Discriminant Functions and Decision Surfaces The Normal Density.

Chapter 2: Bayesian Decision Theory (Part 2) Minimum-Error-Rate Classification Classifiers, Discriminant Functions and Decision Surfaces The Normal Density.
Pattern Classification, Chapter 2 (Part 2) 0 Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R.

Pattern Classification, Chapter 2 (Part 2) 0 Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R.
Pattern Classification, Chapter 2 (Part 2) 0 Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R.

Pattern Classification, Chapter 2 (Part 2) 0 Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.

Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
CS292 Computational Vision and Language Pattern Recognition and Classification.

CS292 Computational Vision and Language Pattern Recognition and Classification.
OUTLINE Course description, What is pattern recognition, Cost of error, Decision boundaries, The desgin cycle.

OUTLINE Course description, What is pattern recognition, Cost of error, Decision boundaries, The desgin cycle.
Chapter 5: Linear Discriminant Functions

Chapter 5: Linear Discriminant Functions
Chapter 4 (Part 1): Non-Parametric Classification

Chapter 4 (Part 1): Non-Parametric Classification
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.

Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
Chapter 2: Bayesian Decision Theory (Part 1) Introduction Bayesian Decision Theory–Continuous Features All materials used in this course were taken from.

Chapter 2: Bayesian Decision Theory (Part 1) Introduction Bayesian Decision Theory–Continuous Features All materials used in this course were taken from.
Pattern Classification, Chapter 1 1 Basic Probability.

Pattern Classification, Chapter 1 1 Basic Probability.
Chapter 2 (part 3) Bayesian Decision Theory Discriminant Functions for the Normal Density Bayes Decision Theory – Discrete Features All materials used.

Chapter 2 (part 3) Bayesian Decision Theory Discriminant Functions for the Normal Density Bayes Decision Theory – Discrete Features All materials used.
Chapter 6: Multilayer Neural Networks

Chapter 6: Multilayer Neural Networks
Chapter 3 (part 3): Maximum-Likelihood and Bayesian Parameter Estimation Hidden Markov Model: Extension of Markov Chains All materials used in this course.

Chapter 3 (part 3): Maximum-Likelihood and Bayesian Parameter Estimation Hidden Markov Model: Extension of Markov Chains All materials used in this course.
Chapter 4 (part 2): Non-Parametric Classification

Chapter 4 (part 2): Non-Parametric Classification
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.

Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.

Similar presentations

Ads by Google