ECE – Pattern Recognition Midterm Review

Slides:

Advertisements

Similar presentations

An Overview of Machine Learning

Advertisements

Supervised and Unsupervised learning and application to Neuroscience Cours CA6b-4.

Lecture 20 Object recognition I

Classification and risk prediction

Methods in Medical Image Analysis Statistics of Pattern Recognition: Classification and Clustering Some content provided by Milos Hauskrecht, University.

This week: overview on pattern recognition (related to machine learning)

COMMON EVALUATION FINAL PROJECT Vira Oleksyuk ECE 8110: Introduction to machine Learning and Pattern Recognition.

Machine Learning Lecture 11 Summary G53MLE | Machine Learning | Dr Guoping Qiu1.

Introduction to machine learning and data mining 1 iCSC2014, Juan López González, University of Oviedo Introduction to machine learning Juan López González.

Principal Component Analysis Machine Learning. Last Time Expectation Maximization in Graphical Models – Baum Welch.

ECE 471/571 – Lecture 2 Bayesian Decision Theory 08/25/15.

ECE 471/571 – Lecture 6 Dimensionality Reduction – Fisher’s Linear Discriminant 09/08/15.

Speech Lab, ECE, State University of New York at Binghamton  Classification accuracies of neural network (left) and MXL (right) classifiers with various.

Final Exam Review CS479/679 Pattern Recognition Dr. George Bebis 1.

ECE 471/571 - Lecture 19 Review 11/12/15. A Roadmap 2 Pattern Classification Statistical ApproachNon-Statistical Approach SupervisedUnsupervised Basic.

Meta-learning for Algorithm Recommendation Meta-learning for Algorithm Recommendation Background on Local Learning Background on Algorithm Assessment Algorithm.

METU Informatics Institute Min720 Pattern Classification with Bio-Medical Applications Part 9: Review.

ECE 471/571 – Lecture 21 Syntactic Pattern Recognition 11/19/15.

ECE 8443 – Pattern Recognition ECE 8527 – Introduction to Machine Learning and Pattern Recognition LECTURE 10: PRINCIPAL COMPONENTS ANALYSIS Objectives:

ECE 471/571 – Lecture 3 Discriminant Function and Normal Density 08/27/15.

SUPERVISED AND UNSUPERVISED LEARNING Presentation by Ege Saygıner CENG 784.

Supervise Learning. 2 What is learning? “Learning denotes changes in a system that... enable a system to do the same task more efficiently the next time.”

Part 3: Estimation of Parameters. Estimation of Parameters Most of the time, we have random samples but not the densities given. If the parametric form.

1 C.A.L. Bailer-Jones. Machine Learning. Data exploration and dimensionality reduction Machine learning, pattern recognition and statistical data modelling.

Use Neural Networks for Pattern Recognition 03/29/17

Clustering (1) Clustering Similarity measure Hierarchical clustering

Data Mining, Machine Learning, Data Analysis, etc. scikit-learn

Syntactic Pattern Recognition 04/28/17

ECE 471/571 - Lecture 19 Review 02/24/17.

Nonparametric Density Estimation – k-nearest neighbor (kNN) 02/20/17

LECTURE 09: BAYESIAN ESTIMATION (Cont.)

Performance Evaluation 02/15/17

Dimensionality reduction

ECE 471/571 – Lecture 18 Classifier Fusion 04/12/17.

Unsupervised Learning - Clustering 04/03/17

Basic machine learning background with Python scikit-learn

Machine Learning Basics

Special Topics in Data Mining Applications Focus on: Text Mining

Unsupervised Learning - Clustering

ECE 599/692 – Deep Learning Lecture 6 – CNN: The Variants

ECE 599/692 – Deep Learning Lecture 2 - Background

Pattern Recognition CS479/679 Pattern Recognition Dr. George Bebis

Course Outline MODEL INFORMATION COMPLETE INCOMPLETE

ECE 599/692 – Deep Learning Lecture 1 - Introduction

ECE 471/571 – Lecture 12 Perceptron.

ECE 599/692 – Deep Learning Lecture 9 – Autoencoder (AE)

ECE 599/692 – Deep Learning Lecture 4 – CNN: Practical Issues

ECE 599/692 – Deep Learning Lecture 5 – CNN: The Representative Power

Hairong Qi, Gonzalez Family Professor

ECE 471/571 – Review 1.

Parametric Estimation

Hairong Qi, Gonzalez Family Professor

INTRODUCTION TO Machine Learning

Data Mining, Machine Learning, Data Analysis, etc. scikit-learn

Data Mining, Machine Learning, Data Analysis, etc. scikit-learn

ECE – Pattern Recognition Lecture 16: NN – Back Propagation

ECE – Pattern Recognition Lecture 15: NN - Perceptron

ECE – Pattern Recognition Lecture 13 – Decision Tree

Hairong Qi, Gonzalez Family Professor

Machine Learning – a Probabilistic Perspective

Hairong Qi, Gonzalez Family Professor

ECE – Lecture 1 Introduction.

ECE – Pattern Recognition Lecture 10 – Nonparametric Density Estimation – k-nearest-neighbor (kNN) Hairong Qi, Gonzalez Family Professor Electrical.

Bayesian Decision Theory

Hairong Qi, Gonzalez Family Professor

ECE – Pattern Recognition Lecture 8 – Performance Evaluation

ECE – Pattern Recognition Lecture 4 – Parametric Estimation

Hairong Qi, Gonzalez Family Professor

ECE – Pattern Recognition Lecture 14 – Gradient Descent

Presentation transcript:

ECE471-571 – Pattern Recognition Midterm Review Hairong Qi, Gonzalez Family Professor Electrical Engineering and Computer Science University of Tennessee, Knoxville http://www.eecs.utk.edu/faculty/qi Email: hqi@utk.edu

Pattern Classification Statistical Approach Non-Statistical Approach Supervised Unsupervised Decision-tree Basic concepts: Baysian decision rule (MPP, LR, Discri.) Basic concepts: Distance Agglomerative method Syntactic approach Parameter estimate (ML, BL) k-means Non-Parametric learning (kNN) Winner-takes-all LDF (Perceptron) Kohonen maps NN (BP) Mean-shift Support Vector Machine Deep Learning (DL) Dimensionality Reduction FLD, PCA Performance Evaluation ROC curve (TP, TN, FN, FP) cross validation Stochastic Methods local opt (GD) global opt (SA, GA) Classifier Fusion majority voting NB, BKS

Q&A What is the common feature of statistical pattern classification? What is supervised pattern classification? How is it different from unsupervised classification? When performing classification, what is the general rule that Baysian decision methods follow? (MPP, Discriminant function) What are the differences between the three cases of discriminant function? What’s the difference between Euclidean distance and Mahalanobis distance? What is the difference between parametric classification and non-parametric classification? Understand behavior/characteristics of m-D Gaussian What is maximum likelihood estimation? Both FLD and PCA reduce the dimension of a dataset. However, different projection directions are generated from the two approaches. Comment on the fundamental differences. How to quantify error in representation in PCA?

Q&A Can you verbally describe kNN? And possible improvements? Performance evaluation Learn to plot and use and explain an ROC curve Be familiar with the relationship between TP, FP, TN, FN, precision, recall, specificity, sensitivity, and accuracy What is cross validation?

Forming Objective Functions Maximum a-posteriori probability Maximum likelihood estimate Fisher’s linear discriminant Principal component analysis kNN ROC curve

Distance Metrics Euclidean distance Mahalanobis distance Minkowski distance Manhattan distance (city-block distance)

Review Materials HW1, 2 Proj 1, 2 Lectures 1-10