MAS2317- Introduction to Bayesian Statistics

Slides:



Advertisements
Similar presentations
Lecture 4A: Probability Theory Review Advanced Artificial Intelligence.
Advertisements

Review of Probability. Definitions (1) Quiz 1.Let’s say I have a random variable X for a coin, with event space {H, T}. If the probability P(X=H) is.
Binomial Distribution & Bayes’ Theorem. Questions What is a probability? What is the probability of obtaining 2 heads in 4 coin tosses? What is the probability.
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 10: The Bayesian way to fit models Geoffrey Hinton.
Bayesian Wrap-Up (probably). 5 minutes of math... Marginal probabilities If you have a joint PDF:... and want to know about the probability of just one.
Parameter Estimation using likelihood functions Tutorial #1
Bayesian learning finalized (with high probability)
C4: DISCRETE RANDOM VARIABLES CIS 2033 based on Dekking et al. A Modern Introduction to Probability and Statistics Longin Jan Latecki.
Thanks to Nir Friedman, HU
P(Y≤ 0.4) P(Y < 0.4) P(0.1 < Y ≤ 0.15)
Binomial & Geometric Random Variables §6-3. Goals: Binomial settings and binomial random variables Binomial probabilities Mean and standard deviation.
Let’s flip a coin. Making Data-Based Decisions We’re going to flip a coin 10 times. What results do you think we will get?
Binomial Distributions Calculating the Probability of Success.
The Binomial Distribution. Binomial Experiment.
1. Population Versus Sample 2. Statistic Versus Parameter 3. Mean (Average) of a Sample 4. Mean (Average) of a Population 5. Expected Value 6. Expected.
4.1 Probability Distributions. Do you remember? Relative Frequency Histogram.
Chapter 5.1 Probability Distributions.  A variable is defined as a characteristic or attribute that can assume different values.  Recall that a variable.
Copyright © 1998, Triola, Elementary Statistics Addison Wesley Longman 1 Binomial Experiments Section 4-3 & Section 4-4 M A R I O F. T R I O L A Copyright.
Binomial Experiment A binomial experiment (also known as a Bernoulli trial) is a statistical experiment that has the following properties:
Probability Distributions BINOMIAL DISTRIBUTION. Binomial Trials There are a specified number of repeated, independent trials There are a specified number.
VOCABULARY CHECK Prerequisite Skills Copy and complete using a review word from the list: data, mean, median, range, outcome, probability of an event.
Consistency An estimator is a consistent estimator of θ, if , i.e., if
5.1 Probability in our Daily Lives.  Which of these list is a “random” list of results when flipping a fair coin 10 times?  A) T H T H T H T H T H 
Simulating Experiments Introduction to Random Variable.
AP STATISTICS Section 7.1 Random Variables. Objective: To be able to recognize discrete and continuous random variables and calculate probabilities using.
Introduction to Probability – Experimental Probability.
Week 31 The Likelihood Function - Introduction Recall: a statistical model for some data is a set of distributions, one of which corresponds to the true.
Bayesian Approach Jake Blanchard Fall Introduction This is a methodology for combining observed data with expert judgment Treats all parameters.
16-3 The Binomial Probability Theorem. Let’s roll a die 3 times Look at the probability of getting a 6 or NOT getting a 6. Let’s make a tree diagram.
Introduction: Metropolis-Hasting Sampler Purpose--To draw samples from a probability distribution There are three steps 1Propose a move from x to y 2Accept.
Business Statistics, A First Course (4e) © 2006 Prentice-Hall, Inc. Chap 5-1 Chapter 5 Some Important Discrete Probability Distributions Business Statistics,
Random Variables If  is an outcome space with a probability measure and X is a real-valued function defined over the elements of , then X is a random.
Probability. We use the word probably when there is some level of ignorance as to what an outcome will be.
Probability Distribution. Probability Distributions: Overview To understand probability distributions, it is important to understand variables and random.
1. 2 At the end of the lesson, students will be able to (c)Understand the Binomial distribution B(n,p) (d) find the mean and variance of Binomial distribution.
AP STATISTICS LESSON AP STATISTICS LESSON PROBABILITY MODELS.
Introductory Statistics. Probability Heads or Tails Parents Getting a Girl Blood Type Getting Brown Eyes Rolling a Seven in a game of monopoly Probability.
Bayesian Estimation and Confidence Intervals Lecture XXII.
Negative Binomial Experiment
Expected values of games
4.3 Introduction to Probability
CS 2750: Machine Learning Density Estimation
Ch3: Model Building through Regression
PROBABILITY The probability of an event is a value that describes the chance or likelihood that the event will happen or that the event will end with.
Binomial Distribution & Bayes’ Theorem
Making Data-Based Decisions
Statistics 1: Elementary Statistics
Chi square.
Advanced Placement Statistics Section 7.2: Means & Variance of a
Probability And Expected Value ————————————
Probability Trees By Anthony Stones.
Introduction to: PROBABILITY.
The Binomial and Geometric Distributions
Advanced Artificial Intelligence
Expected Value.
6.2/6.3 Probability Distributions and Distribution Mean
Statistics 1: Elementary Statistics
Statistical Analysis Chi-Square.
Warm Up Imagine a family has three children. 1) What is the probability the family has: 3 girls and 0 boys 2 girls and 1 boy 1 girl and 2 boys 0 girls.
Chi2 (A.K.A X2).
Probability And Expected Value ————————————
MATH 2311 Section 3.3.
Bayes for Beginners Luca Chech and Jolanda Malamud
CS 594: Empirical Methods in HCC Introduction to Bayesian Analysis
Expected Value.
Fun… Tree Diagrams… Probability.
Chi square.
Homework Due Tomorrow mrsfhill.weebly.com.
Hypothesis Testing for the mean. The general procedure.
Presentation transcript:

MAS2317- Introduction to Bayesian Statistics Ryan Doran

Question 15) Richard plays “flip to win” with a student They flip a coin If the coin lands heads up, the student gets £5 If the coin lands tails, the student must buy Richard a pint Five students play this game with Richard and only one head is observed.

Let 𝑋 be the number of heads observed; then 𝑋~𝐵𝑖𝑛(5, 𝜃) Find the likelihood function 𝑓(𝑥=1|𝜃) The outcomes are an observation on the random variable 𝑋|𝜃~𝐵𝑖𝑛(5, 𝜃) So, 𝑓 𝑥=1 𝜃 = 5 1 𝜃 1 1−𝜃 4 =5𝜃 1−𝜃 4

𝜃 is a probability, and so 0≤𝜃≤1 Recall that: 𝑓 𝑥=1 𝜃 =5𝜃 1−𝜃 4 The students are suspicious of Richard’s coin. Daniel specifies a 𝐵𝑒𝑡𝑎 6,46 distribution as a prior for 𝜃 b) Why might this be a sensible prior distribution in light of these suspicions? 𝜃 is a probability, and so 0≤𝜃≤1 Recall that: 𝑓 𝑥=1 𝜃 =5𝜃 1−𝜃 4 Which is maximised when 𝜃= 1 5

We can work out the expectation of the 𝐵𝑒𝑡𝑎 6,46 distribution 6 6+46 = 3 23 =0.130434……..

c) Obtain the posterior distribution for 𝜃, 𝜋 𝜃| 𝑥=1 𝜋 𝜃| 𝑥 α 𝜋 𝜃 𝑓 𝑋 𝑥|𝜃 In this case: 𝜋 𝜃 ~𝐵𝑒𝑡𝑎(6,46) and 𝑓 𝑥=1 𝜃 =5𝜃 1−𝜃 4 So 𝜋 𝜃 𝑥=1 α 𝜃 5 1−𝜃 45 𝐵 6,46 ∙5𝜃 1−𝜃 4 = 5 𝐵(6,46) 𝜃 6 1−𝜃 49 α θ 7−1 1−𝜃 50−1

𝜋 𝜃 𝑥=1 α θ 7−1 1−𝜃 50−1 So our posterior is 𝜃|(𝑥=1) ~ 𝐵𝑒(7, 50) We can check: 𝐸 𝜃|𝑥=1 = 7 50+7 =0.1228…… Richard cheating?!