Presented by: Karen Miller

Slides:



Advertisements
Similar presentations
Week 11 Review: Statistical Model A statistical model for some data is a set of distributions, one of which corresponds to the true unknown distribution.
Advertisements

Psychology 290 Special Topics Study Course: Advanced Meta-analysis April 7, 2014.
A Brief Introduction to Bayesian Inference Robert Van Dine 1.
Hypothesis Testing: One Sample Mean or Proportion
Chapter 7 Sampling and Sampling Distributions
Lecture II.  Using the example from Birenens Chapter 1: Assume we are interested in the game Texas lotto (similar to Florida lotto).  In this game,
Conditional Probability and Independence If A and B are events in sample space S and P(B) > 0, then the conditional probability of A given B is denoted.
BUSINESS MATHEMATICS AND STATISTICS THE ADDITION AND THE MULTIPLICATION THEOREM OF PROBABILITY A PRESENTATION ON.
Bayesian Inference, Basics Professor Wei Zhu 1. Bayes Theorem Bayesian statistics named after Thomas Bayes ( ) -- an English statistician, philosopher.
Harrison B. Prosper Workshop on Top Physics, Grenoble Bayesian Statistics in Analysis Harrison B. Prosper Florida State University Workshop on Top Physics:
1 Sampling Distributions Lecture 9. 2 Background  We want to learn about the feature of a population (parameter)  In many situations, it is impossible.
Lecture 5a: Bayes’ Rule Class web site: DEA in Bioinformatics: Statistics Module Box 1Box 2Box 3.
Bayesian vs. frequentist inference frequentist: 1) Deductive hypothesis testing of Popper--ruling out alternative explanations Falsification: can prove.
Uncertainty Uncertain Knowledge Probability Review Bayes’ Theorem Summary.
Mehdi Ghayoumi MSB rm 132 Ofc hr: Thur, a Machine Learning.
Chapter 12 Probability © 2008 Pearson Addison-Wesley. All rights reserved.
Week 21 Conditional Probability Idea – have performed a chance experiment but don’t know the outcome (ω), but have some partial information (event A) about.
Probability 2.0. Independent Events Events can be "Independent", meaning each event is not affected by any other events. Example: Tossing a coin. Each.
Topic 2: Intro to probability CEE 11 Spring 2002 Dr. Amelia Regan These notes draw liberally from the class text, Probability and Statistics for Engineering.
Mathematics Conditional Probability Science and Mathematics Education Research Group Supported by UBC Teaching and Learning Enhancement Fund
Making sense of randomness
SECTION 11-3 Conditional Probability; Events Involving “And” Slide
Week 21 Rules of Probability for all Corollary: The probability of the union of any two events A and B is Proof: … If then, Proof:
HL2 Math - Santowski Lesson 93 – Bayes’ Theorem. Bayes’ Theorem  Main theorem: Suppose we know We would like to use this information to find if possible.
+ The Practice of Statistics, 4 th edition – For AP* STARNES, YATES, MOORE Chapter 8: Estimating with Confidence Section 8.1 Confidence Intervals: The.
Bayes’ Theorem Suppose we have estimated prior probabilities for events we are concerned with, and then obtain new information. We would like to a sound.
CHAPTER 7 SAMPLING DISTRIBUTIONS Prem Mann, Introductory Statistics, 7/E Copyright © 2010 John Wiley & Sons. All right reserved.
Now it’s time to look at…
Chapter 8: Estimating with Confidence
One-Sample Tests of Hypothesis
Chapter 8: Estimating with Confidence
Sampling Distributions
The Pigeonhole Principle
Probability Axioms and Formulas
Virtual University of Pakistan
Chapter 4 Probability Concepts
What is Probability? Quantification of uncertainty.
SAMPLING DISTRIBUTIONS
Overview and Basics of Hypothesis Testing
Statistics for 8th Edition Chapter 3 Probability
Learn to let go. That is the key to happiness. ~Jack Kornfield
One-Sample Tests of Hypothesis
Probability Probability underlies statistical inference - the drawing of conclusions from a sample of data. If samples are drawn at random, their characteristics.
Bayesian Inference, Basics
Now it’s time to look at…
Chapter 10: Estimating with Confidence
Chapter 8: Estimating with Confidence
Keller: Stats for Mgmt & Econ, 7th Ed Sampling Distributions
Chapter 8: Estimating with Confidence
Wellcome Trust Centre for Neuroimaging
EQT 272 PROBABILITY AND STATISTICS ROHANA BINTI ABDUL HAMID
Chapter 8: Estimating with Confidence
Bayes for Beginners Luca Chech and Jolanda Malamud
SAMPLING DISTRIBUTIONS
Now it’s time to look at…
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
SAMPLING DISTRIBUTIONS
Lecture Slides Elementary Statistics Twelfth Edition
Chapter 8: Estimating with Confidence
Section 12.6 OR and AND Problems
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Interval Estimation Download this presentation.
Mathematical Foundations of BME Reza Shadmehr
Chapter 5: Sampling Distributions
Presentation transcript:

Presented by: Karen Miller Bayes Theorem Presented by: Karen Miller Look for games for class online Look for pictures of bayes Picture of laplace

Outline Thomas Bayes Published Background Probabilities Bayes Theorem Applications

Thomas Bayes Born in 1702 London, England Little childhood information Presbyterian Minister In 1742, elected fellow by the Royal Society of London Retired in 1752 Died in April of 1761

Written Work Only two works published during his life Divine Benevolence (1731) Introduction to the Doctrine of Fluxions (1736) However, he never published his mathematical works He focused in the areas of probability and statistics “The probability of any event is the ratio between the value at which an expectation depending on the happening of the event ought to be computed, and the chance of the thing expected upon it’s happening.”

Before Bayes, probability was assumed to have a discrete parameter space. “Bayes invented a new physical model with continuously varying probability of success… He thus gave a geometrical definition of probability as the ratio of two areas.”

Publishing of Bayes Theorem Richard Price examined Bayes’ work after his death Responsible for the communication to the Royal Society on Baye’s work An Essay Toward Solving a Problem in the Doctrine of Chances Intro for essay… spoke highly….

An Essay Toward Solving a Problem in the Doctrine of Chances In this essay one can find Another version of what becomes Bayes Theorem Explanation of the binomial distribution 1st section: Conditional Probability If P (B) > 0, the conditional probability of A given B, denoted by P (A | B), is P(A | B) =

Suppose 70% of students at Saint Joseph’s College pass Core 6, 55% pass Core 8 and 45% percent pass both. If a randomly selected student passed Core 8, what is the probability he or she also passed Core 6? P(pass 8 | pass 6) = P(pass 8 and 6)/P(pass 6) = .45 / .7 .6429 or 64.29% We want prob of pass 6 given 8… so prob both / prob pass 6

An Essay Toward Solving a Problem in the Doctrine of Chances The essay demonstrates the estimation of future occurrences of an event, given information of the history of the event. The probability of future occurrences of an event can be solved using this formula, A generalization of this formula constructs the present form of Bayes Theorem.

Pierre Simon Laplace French mathematician Responsible for current form of Bayes Theorem Bayes found the probability that x is between two values given a number of successes and failures Laplace found an expression for the probability of a number of future successes and future failures given the number of successes and failures. Didn’t acknowledge bayes right away

Bayes – P( | p successes and In other words, Bayes – P( | p successes and q failures ) Laplace – P(m future successes and n future failures | p successes and q failures ) Richard von Mises states, “We owe Bayes only the statement of the problem and the principle of the solution. The theorem itself was first formulated by Laplace.”

Law of Total Probability Sometimes it is not possible to calculate the probability of an occurrence of an event A however, it may be possible to find P (A | B) and P (A | Bc) for some event B. Let B be an event with P (B) > 0 and P (Bc) > 0. Then for any event A, P (A) = P (A | B)P (B) + P (A | Bc)P (Bc)

We know that P (A) = P (AB) + P (ABc) Substitute in the conditional probability P (AB) = P (A | B)P (B) P (ABc) = P (A | Bc)P (Bc) The Law of Total Probability remains P (A) = P (A | B)P (B) + P (A | Bc)P (Bc)

Applying this to the problem of an insurance company that rents 40% of the cars for its customers from agency I and 60% from agency II. If 6% of the cars from agency I and 5% of the cars from agency II break down, what is the probability that a car rented by this company breaks down? P(car breaks down from the insurance company) = (.06)(.4) + (.05)(.6) = .054 or 5.4%

Bayes Theorem Let {B1, B2, …, Bn} be a subset of the sample space S of an experiment. If for i = 1, 2, …, n, P (Bi) > 0, then for any event A of S with P (A) > 0, P (Bk | A) = P(B) is the prior probability and P(B | A) is the posterior probability

Proof is very simple P(A | B) = , conditional probability Rearranged becomes: P (AB) = P (B) P (A | B) P (BA) = P (A) P (B | A) Therefore P (B)P (A | B) = P (A)P (B | A) Solve for the P (B | A) P (B | A) =

A box contains seven red and thirteen blue balls A box contains seven red and thirteen blue balls. Two balls are selected at random and are discarded without their colors being seen. If a third ball is drawn randomly and observed to be red, what is the probability that both of the discarded balls were blue? Solve P (BB | R) =

Applications Classification scale in classroom A simple classification divides a population in two categories Mastering Non-mastering A test would determine which category a student falls in. The Probabilities can be collected and the result would show mastered skills and others that need attention.

Applications Diagnostic testing Tests identify if a person has a particular disease or not Tests are not always 100% positive Bayes Theorem estimates if a person tests positive for a disease if he or she truly has the disease A cancer is found in 1 in every 2000 people. If a person has the disease there is a 90% the test will result positive. If a person does not have the disease, the test will result in a false positive 1% of the time. The probability that a person with a positive test actually has the cancer is, P (C | P) =

Introduction to Bayesian Statistical Inference Statistical inference is used to draw conclusions from known data in samples to populations for which data is unknown. Inference problems are often found in decision problems There are two different ways to approach probability Frequentist Subjective, or Bayesian

Frequentist – can be applied to events found through a random process Frequentists work on problems associated with collective and not individual events. Bayesian – has no one correct probability Depends on prior and observed data Finding the probability of an American man’s height is over 1.75 meters, the result would depend on if we know anything about the man.

If no information is known, the probability is based on the proportion of American men taller than 1.75 meters. Frequentist approach However, if we have prior knowledge about the man, it must be factor into the probability If he plays basketball, the probability will be larger than population proportion Bayesian approach

The End