Pattern Recognition 9/23/2008 Instructor: Wen-Hung Liao, Ph.D.

Slides:



Advertisements
Similar presentations
1 Image Classification MSc Image Processing Assignment March 2003.
Advertisements

Image classification Given the bag-of-features representations of images from different classes, how do we learn a model for distinguishing them?
Detecting Faces in Images: A Survey
Computer and Robot Vision I

Neural NetworksNN 11 Neural Networks Teacher: Elena Marchiori R4.47 Assistant: Kees Jong S2.22
Region labelling Giving a region a name. Image Processing and Computer Vision: 62 Introduction Region detection isolated regions Region description properties.
Chapter 1: Introduction to Pattern Recognition
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
OUTLINE Course description, What is pattern recognition, Cost of error, Decision boundaries, The desgin cycle.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
1 Artificial Neural Networks: An Introduction S. Bapi Raju Dept. of Computer and Information Sciences, University of Hyderabad.
Machine Vision and Dig. Image Analysis 1 Prof. Heikki Kälviäinen C50A6100 Lectures 12: Object Recognition Professor Heikki Kälviäinen Machine Vision and.
Computer Architecture Instructor: Wen-Hung Liao Office: 大仁樓三樓 Office hours: TBA Course web page:
Smart Traveller with Visual Translator for OCR and Face Recognition LYU0203 FYP.
Pattern Recognition. Introduction. Definitions.. Recognition process. Recognition process relates input signal to the stored concepts about the object.
ICA Alphan Altinok. Outline  PCA  ICA  Foundation  Ambiguities  Algorithms  Examples  Papers.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
An Introduction to Pattern Recognition
Introduction to machine learning
Statistical Natural Language Processing. What is NLP?  Natural Language Processing (NLP), or Computational Linguistics, is concerned with theoretical.
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley.
Revision Michael J. Watts
Introduction to Pattern Recognition
嵌入式視覺 Pattern Recognition for Embedded Vision Template matching Statistical / Structural Pattern Recognition Neural networks.
Introduction Mohammad Beigi Department of Biomedical Engineering Isfahan University
Pattern Recognition Vidya Manian Dept. of Electrical and Computer Engineering University of Puerto Rico INEL 5046, Spring 2007
: Chapter 1: Introduction 1 Montri Karnjanadecha ac.th/~montri Principles of Pattern Recognition.
This week: overview on pattern recognition (related to machine learning)
1 Introduction Shyh-Kang Jeng Department of Electrical Engineering/ Graduate Institute of Communication/ Graduate Institute of Networking and Multimedia,
TINONS1 Nonlinear SP and Pattern recognition
Teuvo Kohonen Dr. Eng., Emeritus Professor of the Academy of Finland; Academician Since the 1960s, Professor Kohonen has introduced several new concepts.
Perception Introduction Pattern Recognition Image Formation
Explorations in Neural Networks Tianhui Cai Period 3.
Chapter 9 Neural Network.
Machine Learning in Spoken Language Processing Lecture 21 Spoken Language Processing Prof. Andrew Rosenberg.
COMMON EVALUATION FINAL PROJECT Vira Oleksyuk ECE 8110: Introduction to machine Learning and Pattern Recognition.
Computational Intelligence II Lecturer: Professor Pekka Toivanen Exercises: Nina Rogelj
Compiled By: Raj G Tiwari.  A pattern is an object, process or event that can be given a name.  A pattern class (or category) is a set of patterns sharing.
Lecture 10: 8/6/1435 Machine Learning Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Machine Learning Using Support Vector Machines (Paper Review) Presented to: Prof. Dr. Mohamed Batouche Prepared By: Asma B. Al-Saleh Amani A. Al-Ajlan.
Image Classification 영상분류
1 Pattern Recognition Pattern recognition is: 1. A research area in which patterns in data are found, recognized, discovered, …whatever. 2. A catchall.
Statistical Pattern Recognition: A Review
Chapter 12 Object Recognition Chapter 12 Object Recognition 12.1 Patterns and pattern classes Definition of a pattern class:a family of patterns that share.
Signature Verification
Data Mining and Decision Support
CPE542: Pattern Recognition Course Introduction Dr. Gheith Abandah د. غيث علي عبندة.
3.Learning In previous lecture, we discussed the biological foundations of of neural computation including  single neuron models  connecting single neuron.
Neural Networks Si Wu Dept. of Informatics PEV III 5c7 Spring 2008.
Pattern Recognition NTUEE 高奕豪 2005/4/14. Outline Introduction Definition, Examples, Related Fields, System, and Design Approaches Bayesian, Hidden Markov.
Pattern Recognition. What is Pattern Recognition? Pattern recognition is a sub-topic of machine learning. PR is the science that concerns the description.
Supervised Learning – Network is presented with the input and the desired output. – Uses a set of inputs for which the desired outputs results / classes.
Machine Learning Artificial Neural Networks MPλ ∀ Stergiou Theodoros 1.
Artificial Neural Networks By: Steve Kidos. Outline Artificial Neural Networks: An Introduction Frank Rosenblatt’s Perceptron Multi-layer Perceptron Dot.
Introduction to Pattern Recognition Kama Jambi
Machine Learning for Computer Security
Pattern Classification Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John Wiley & Sons, 2000 Dr. Ding Yuxin Pattern Recognition.
Introduction Machine Learning 14/02/2017.
IMAGE PROCESSING RECOGNITION AND CLASSIFICATION
Chapter 12 Object Recognition
Neural Networks for Machine Learning Lecture 1e Three types of learning Geoffrey Hinton with Nitish Srivastava Kevin Swersky.
Pattern Recognition Sergios Theodoridis Konstantinos Koutroumbas
Data Mining: Concepts and Techniques Course Outline
What is Pattern Recognition?
Introduction to Pattern Recognition
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
Introduction to Pattern Recognition
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
Review of Statistical Pattern Recognition
Presentation transcript:

Pattern Recognition 9/23/2008 Instructor: Wen-Hung Liao, Ph.D.

Administrative Information Office: 大仁樓三樓 Office hours: TBA Course web page: Textbook: Pattern Classification, 2 nd Edition by Duda, Hart and Stork. ( 歐亞書局 )

Definition Pattern recognition is the study of how machines can - observe the environment, - learn to distinguish patterns of interest, - make decisions about the categories of the patterns.

What is a pattern? Watanabe defines a pattern “as opposite of chaos; it is an entity, vaguely defined, that could be given a name”. Examples: - fingerprint, - handwritten cursive word, - a human face, - a speech signal... Examples

Types of recognition Supervised classification: input pattern is identified as a member of a pre-defined class. Unsupervised classification: input pattern is assigned to a hitherto unknown class.

Applications

Applications (2)

Components of a PR System Data acquisition and pre-processing Data representation Decision making

Pattern Recognition Methods Template matching Statistical approach Syntactic approach Neural networks

Template Matching A template (typically a 2D shape) or a prototype of the pattern to be recognized is available. Compute the similarity between the template and the pattern to be matched. Take into account pose(rotation, translation) and scale changes.

Issues of concern Choice of template Computational complexity Rigidity assumption (use deformable template models)

Statistical Approach Each pattern is represented in terms of d features, and is viewed as a point in a d- dimensional space The goal is to choose those features that allow pattern vectors belonging to different categories to occupy compact and disjoint regions in a d-dimensional feature space.

Syntactic Approach Use hierarchical structures to represent complex patterns. The simplest unit is called: primitives Complex pattern is represented in terms of the interrelationships (grammars) between the primitives. Grammatical rules can be learned by training.

Issues of concern Can be used in situations where the patterns have a definite structure such as EKG waveforms, shape analysis of contours. However, it’s usually difficult to segment noisy patterns and infer grammar from the training set. May yield a combinatorial explosions of possibilities to be investigated.

Neural Networks Massively parallel computing systems consisting of an extremely large number of simple processors with many interconnections. Can learn complex non-linear input-output relationships. Feed-forward networks such as multilayer perceptron and Radial Basis Function network are useful for pattern classification.

Pattern Recognition Models

Reference A.K. Jain, R.P.W. Duin and J. Mao, “Statistical Pattern Recognition: A Review”, IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), Vol. 22, No. 1, pp. 4-37, Jan