Machine Learning  Up until now: how to reason in a model and how to make optimal decisions  Machine learning: how to acquire a model on the basis of.

Slides:



Advertisements
Similar presentations
Projects Project 3 average: Project 4 due on 4/18.
Advertisements

Basics of Statistical Estimation
Classification Classification Examples
Particle Filtering Sometimes |X| is too big to use exact inference
Naïve Bayes. Bayesian Reasoning Bayesian reasoning provides a probabilistic approach to inference. It is based on the assumption that the quantities of.
CPSC 502, Lecture 15Slide 1 Introduction to Artificial Intelligence (AI) Computer Science cpsc502, Lecture 15 Nov, 1, 2011 Slide credit: C. Conati, S.
Probability: Review The state of the world is described using random variables Probabilities are defined over events –Sets of world states characterized.
Bayes Rule The product rule gives us two ways to factor a joint probability: Therefore, Why is this useful? –Can get diagnostic probability P(Cavity |
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 10: The Bayesian way to fit models Geoffrey Hinton.
What is Statistical Modeling
Probabilistic inference
Bayes Rule How is this rule derived? Using Bayes rule for probabilistic inference: –P(Cause | Evidence): diagnostic probability –P(Evidence | Cause): causal.
CS 188: Artificial Intelligence Spring 2007 Lecture 19: Perceptrons 4/2/2007 Srini Narayanan – ICSI and UC Berkeley.
Announcements  Project proposal is due on 03/11  Three seminars this Friday (EB 3105) Dealing with Indefinite Representations in Pattern Recognition.
CS 188: Artificial Intelligence Fall 2009 Lecture 21: Speech Recognition 11/10/2009 Dan Klein – UC Berkeley TexPoint fonts used in EMF. Read the TexPoint.
CS 188: Artificial Intelligence Fall 2009
Introduction to Machine Learning course fall 2007 Lecturer: Amnon Shashua Teaching Assistant: Yevgeny Seldin School of Computer Science and Engineering.
Generative Models Rong Jin. Statistical Inference Training ExamplesLearning a Statistical Model  Prediction p(x;  ) Female: Gaussian distribution N(
CS 188: Artificial Intelligence Fall 2009 Lecture 23: Perceptrons 11/17/2009 Dan Klein – UC Berkeley TexPoint fonts used in EMF. Read the TexPoint manual.
Thanks to Nir Friedman, HU
Review Rong Jin. Comparison of Different Classification Models  The goal of all classifiers Predicating class label y for an input x Estimate p(y|x)
Jeff Howbert Introduction to Machine Learning Winter Classification Bayesian Classifiers.
Review: Probability Random variables, events Axioms of probability
Crash Course on Machine Learning
Bayesian Decision Theory Making Decisions Under uncertainty 1.
Advanced Multimedia Text Classification Tamara Berg.
Methods in Medical Image Analysis Statistics of Pattern Recognition: Classification and Clustering Some content provided by Milos Hauskrecht, University.
Made by: Maor Levy, Temple University  Up until now: how to reason in a give model  Machine learning: how to acquire a model on the basis of.
CS 188: Artificial Intelligence Spring 2007 Lecture 18: Classification: Part I Naïve Bayes 03/22/2007 Srini Narayanan – ICSI and UC Berkeley.
ECE 5984: Introduction to Machine Learning Dhruv Batra Virginia Tech Topics: –Classification: Naïve Bayes Readings: Barber
CSE 511a: Artificial Intelligence Spring 2013
Classification: Feature Vectors
CS 188: Artificial Intelligence Spring 2006 Lecture 9: Naïve Bayes 2/14/2006 Dan Klein – UC Berkeley Many slides from either Stuart Russell or Andrew Moore.
Empirical Research Methods in Computer Science Lecture 7 November 30, 2005 Noah Smith.
Empirical Research Methods in Computer Science Lecture 6 November 16, 2005 Noah Smith.
Classification Techniques: Bayesian Classification
CSE 446: Naïve Bayes Winter 2012 Dan Weld Some slides from Carlos Guestrin, Luke Zettlemoyer & Dan Klein.
Naïve Bayes Classifier Ke Chen Modified and extended by Longin Jan Latecki
CSE 473: Artificial Intelligence Spring 2012 Bayesian Networks - Learning Dan Weld Slides adapted from Jack Breese, Dan Klein, Daphne Koller, Stuart Russell,
CSE 473: Artificial Intelligence Spring 2012 Bayesian Networks - Learning Dan Weld Slides adapted from Jack Breese, Dan Klein, Daphne Koller, Stuart Russell,
Review: Probability Random variables, events Axioms of probability Atomic events Joint and marginal probability distributions Conditional probability distributions.
CHAPTER 5 Probability Theory (continued) Introduction to Bayesian Networks.
CHAPTER 6 Naive Bayes Models for Classification. QUESTION????
CSE 473: Artificial Intelligence Autumn 2010 Machine Learning: Naive Bayes and Perceptron Luke Zettlemoyer Many slides over the course adapted from Dan.
Announcements  Project 5  Due Friday 4/10 at 5pm  Homework 9  Released soon, due Monday 4/13 at 11:59pm.
Recap: General Naïve Bayes  A general naïve Bayes model:  Y: label to be predicted  F 1, …, F n : features of each instance Y F1F1 FnFn F2F2 This slide.
Naïve Bayes Classification Material borrowed from Jonathan Huang and I. H. Witten’s and E. Frank’s “Data Mining” and Jeremy Wyatt and others.
Naïve Bayes Classifier April 25 th, Classification Methods (1) Manual classification Used by Yahoo!, Looksmart, about.com, ODP Very accurate when.
CS 541: Artificial Intelligence Lecture IX: Supervised Machine Learning Slides Credit: Peter Norvig and Sebastian Thrun.
CS 541: Artificial Intelligence Lecture IX: Supervised Machine Learning Slides Credit: Peter Norvig and Sebastian Thrun.
CS 541: Artificial Intelligence Lecture IX: Supervised Machine Learning Slides Credit: Peter Norvig and Sebastian Thrun.
CSC321: Lecture 8: The Bayesian way to fit models Geoffrey Hinton.
Naïve Bayes Classification Recitation, 1/25/07 Jonathan Huang.
LEARNING FROM EXAMPLES AIMA CHAPTER 18 (4-5) CSE 537 Spring 2014 Instructor: Sael Lee Slides are mostly made from AIMA resources, Andrew W. Moore’s tutorials:
CAP 5636 – Advanced Artificial Intelligence
Naïve Bayes Classifiers
CS 188: Artificial Intelligence Fall 2006
Artificial Intelligence
Perceptrons Lirong Xia.
CS 188: Artificial Intelligence Fall 2008
CS 188: Artificial Intelligence Fall 2008
CS 4/527: Artificial Intelligence
Naïve Bayes Classifiers
CS 188: Artificial Intelligence Spring 2006
Speech recognition, machine learning
CS 188: Artificial Intelligence
CS 188: Artificial Intelligence Fall 2007
Naïve Bayes Classifiers
Perceptrons Lirong Xia.
Speech recognition, machine learning
Presentation transcript:

Machine Learning  Up until now: how to reason in a model and how to make optimal decisions  Machine learning: how to acquire a model on the basis of data / experience  Learning parameters (e.g. probabilities)  Learning structure (e.g. BN graphs)  Learning hidden concepts (e.g. clustering) This slide deck courtesy of Dan Klein at UC Berkeley

Example: Spam Filter  Input:  Output: spam/ham  Setup:  Get a large collection of example s, each labeled “spam” or “ham”  Note: someone has to hand label all this data!  Want to learn to predict labels of new, future s  Features: The attributes used to make the ham / spam decision  Words: FREE!  Text Patterns: $dd, CAPS  Non-text: SenderInContacts  … Dear Sir. First, I must solicit your confidence in this transaction, this is by virture of its nature as being utterly confidencial and top secret. … TO BE REMOVED FROM FUTURE MAILINGS, SIMPLY REPLY TO THIS MESSAGE AND PUT "REMOVE" IN THE SUBJECT. 99 MILLION ADDRESSES FOR ONLY $99 Ok, Iknow this is blatantly OT but I'm beginning to go insane. Had an old Dell Dimension XPS sitting in the corner and decided to put it to use, I know it was working pre being stuck in the corner, but when I plugged it in, hit the power nothing happened.

Example: Digit Recognition  Input: images / pixel grids  Output: a digit 0-9  Setup:  Get a large collection of example images, each labeled with a digit  Note: someone has to hand label all this data!  Want to learn to predict labels of new, future digit images  Features: The attributes used to make the digit decision  Pixels: (6,8)=ON  Shape Patterns: NumComponents, AspectRatio, NumLoops  … ??

Other Classification Tasks  In classification, we predict labels y (classes) for inputs x  Examples:  Spam detection (input: document, classes: spam / ham)  OCR (input: images, classes: characters)  Medical diagnosis (input: symptoms, classes: diseases)  Automatic essay grader (input: document, classes: grades)  Fraud detection (input: account activity, classes: fraud / no fraud)  Customer service routing  … many more  Classification is an important commercial technology!

Important Concepts  Data: labeled instances, e.g. s marked spam/ham  Training set  Held out set  Test set  Features: attribute-value pairs which characterize each x  Experimentation cycle  Learn parameters (e.g. model probabilities) on training set  (Tune hyperparameters on held-out set)  Compute accuracy of test set  Very important: never “peek” at the test set!  Evaluation  Accuracy: fraction of instances predicted correctly  Overfitting and generalization  Want a classifier which does well on test data  Overfitting: fitting the training data very closely, but not generalizing well Training Data Held-Out Data Test Data

Bayes Nets for Classification  One method of classification:  Use a probabilistic model!  Features are observed random variables F i  Y is the query variable  Use probabilistic inference to compute most likely Y  You already know how to do this inference

Simple Classification  Simple example: two binary features M SF direct estimate Bayes estimate (no assumptions) Conditional independence +

General Naïve Bayes  A general naive Bayes model:  We only specify how each feature depends on the class  Total number of parameters is linear in n Y F1F1 FnFn F2F2 |Y| parameters n x |F| x |Y| parameters |Y| x |F| n parameters

Inference for Naïve Bayes  Goal: compute posterior over causes  Step 1: get joint probability of causes and evidence  Step 2: get probability of evidence  Step 3: renormalize +

General Naïve Bayes  What do we need in order to use naïve Bayes?  Inference (you know this part)  Start with a bunch of conditionals, P(Y) and the P(F i |Y) tables  Use standard inference to compute P(Y|F 1 …F n )  Nothing new here  Estimates of local conditional probability tables  P(Y), the prior over labels  P(F i |Y) for each feature (evidence variable)  These probabilities are collectively called the parameters of the model and denoted by   Up until now, we assumed these appeared by magic, but…  …they typically come from training data: we’ll look at this now

A Digit Recognizer  Input: pixel grids  Output: a digit 0-9

Naïve Bayes for Digits  Simple version:  One feature F ij for each grid position  Possible feature values are on / off, based on whether intensity is more or less than 0.5 in underlying image  Each input maps to a feature vector, e.g.  Here: lots of features, each is binary valued  Naïve Bayes model:  What do we need to learn?

Examples: CPTs

Parameter Estimation  Estimating distribution of random variables like X or X | Y  Empirically: use training data  For each outcome x, look at the empirical rate of that value:  This is the estimate that maximizes the likelihood of the data  Elicitation: ask a human!  Usually need domain experts, and sophisticated ways of eliciting probabilities (e.g. betting games)  Trouble calibrating rgg

A Spam Filter  Naïve Bayes spam filter  Data:  Collection of s, labeled spam or ham  Note: someone has to hand label all this data!  Split into training, held- out, test sets  Classifiers  Learn on the training set  (Tune it on a held-out set)  Test it on new s Dear Sir. First, I must solicit your confidence in this transaction, this is by virture of its nature as being utterly confidencial and top secret. … TO BE REMOVED FROM FUTURE MAILINGS, SIMPLY REPLY TO THIS MESSAGE AND PUT "REMOVE" IN THE SUBJECT. 99 MILLION ADDRESSES FOR ONLY $99 Ok, Iknow this is blatantly OT but I'm beginning to go insane. Had an old Dell Dimension XPS sitting in the corner and decided to put it to use, I know it was working pre being stuck in the corner, but when I plugged it in, hit the power nothing happened.

Naïve Bayes for Text  Bag-of-Words Naïve Bayes:  Predict unknown class label (spam vs. ham)  Assume evidence features (e.g. the words) are independent  Warning: subtly different assumptions than before!  Generative model  Tied distributions and bag-of-words  Usually, each variable gets its own conditional probability distribution P(F|Y)  In a bag-of-words model  Each position is identically distributed  All positions share the same conditional probs P(W|C)  Why make this assumption? Word at position i, not i th word in the dictionary!

Example: Spam Filtering  Model:  What are the parameters?  Where do these tables come from? the : to : and : of : you : a : with: from: the : to : of : : with: from: and : a : ham : 0.66 spam: 0.33

Spam Example WordP(w|spam)P(w|ham)Tot SpamTot Ham (prior) Gary would you like to lose weight while you sleep P(spam | w) = 98.9

Example: Overfitting 2 wins!!

Example: Overfitting  Posteriors determined by relative probabilities (odds ratios): south-west : inf nation : inf morally : inf nicely : inf extent : inf seriously : inf... What went wrong here? screens : inf minute : inf guaranteed : inf $ : inf delivery : inf signature : inf...

Generalization and Overfitting  Relative frequency parameters will overfit the training data!  Just because we never saw a 3 with pixel (15,15) on during training doesn’t mean we won’t see it at test time  Unlikely that every occurrence of “minute” is 100% spam  Unlikely that every occurrence of “seriously” is 100% ham  What about all the words that don’t occur in the training set at all?  In general, we can’t go around giving unseen events zero probability  As an extreme case, imagine using the entire as the only feature  Would get the training data perfect (if deterministic labeling)  Wouldn’t generalize at all  Just making the bag-of-words assumption gives us some generalization, but isn’t enough  To generalize better: we need to smooth or regularize the estimates

Estimation: Smoothing  Problems with maximum likelihood estimates:  If I flip a coin once, and it’s heads, what’s the estimate for P(heads)?  What if I flip 10 times with 8 heads?  What if I flip 10M times with 8M heads?  Basic idea:  We have some prior expectation about parameters (here, the probability of heads)  Given little evidence, we should skew towards our prior  Given a lot of evidence, we should listen to the data

Estimation: Smoothing  Relative frequencies are the maximum likelihood estimates  In Bayesian statistics, we think of the parameters as just another random variable, with its own distribution ????

Estimation: Laplace Smoothing  Laplace’s estimate:  Pretend you saw every outcome once more than you actually did  Can derive this as a MAP estimate with Dirichlet priors HHT

Estimation: Laplace Smoothing  Laplace’s estimate (extended):  Pretend you saw every outcome k extra times  What’s Laplace with k = 0?  k is the strength of the prior  Laplace for conditionals:  Smooth each condition independently: HHT