Law of Total Probability and Bayes’ Rule

Slides:



Advertisements
Similar presentations
The Law of Total Probability
Advertisements

Chapter 2 Probability. 2.1 Sample Spaces and Events.
COUNTING AND PROBABILITY
© 2002 Prentice-Hall, Inc.Chap 4-1 Statistics for Managers Using Microsoft Excel (3 rd Edition) Chapter 4 Basic Probability and Discrete Probability Distributions.
Revision Sheet 1.
Special Type of Conditional Probability
1 Chapter 6: Probability— The Study of Randomness 6.1The Idea of Probability 6.2Probability Models 6.3General Probability Rules.
5.3 The Multiplication Rule
Elementary Probability Theory
Chapter 4 Probability.
Chapter 2: Probability.
Visualizing Events Contingency Tables Tree Diagrams Ace Not Ace Total Red Black Total
PROBABILITY MODELS. 1.1 Probability Models and Engineering Probability models are applied in all aspects of Engineering Traffic engineering, reliability,
Chapter 4: Probability (Cont.) In this handout: Total probability rule Bayes’ rule Random sampling from finite population Rule of combinations.
Today Today: Some more counting examples; Start Chapter 2 Important Sections from Chapter 1: ; Please read Reading: –Assignment #2 is up.
Conditional Probability and Independent Events. Conditional Probability if we have some information about the result…use it to adjust the probability.
Bayes’ Theorem.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 2 Probability.
6 Probability Chapter6 p Operations on events and probability An event is the basic element to which probability can be applied. Notations Event:
Probability and Counting Rules
Elementary Probability Theory
Probability and Sample space
Math 409/409G History of Mathematics
Math The Multiplication Rule for P(A and B)
Lecture 5a: Bayes’ Rule Class web site: DEA in Bioinformatics: Statistics Module Box 1Box 2Box 3.
MA-250 Probability and Statistics Nazar Khan PUCIT Lecture 21.
1 Probability. 2 Today’s plan Probability Notations Laws of probability.
Chapter 1 Probability Spaces 主講人 : 虞台文. Content Sample Spaces and Events Event Operations Probability Spaces Conditional Probabilities Independence of.
Probability(C14-C17 BVD) C14: Introduction to Probability.
Probability Theory 1.Basic concepts 2.Probability 3.Permutations 4.Combinations.
Ch Counting Techniques Product Rule If the first element or object of an ordered pair can be used in n 1 ways, and for each of these n1 ways.
Random Experiment Random Variable: Continuous, Discrete Sample Space: S Event: A, B, E Null Event Complement of an Event A’ Union of Events (either, or)
Chapter 3:Basic Probability Concepts Probability: is a measure (or number) used to measure the chance of the occurrence of some event. This number is between.
1 TABLE OF CONTENTS PROBABILITY THEORY Lecture – 1Basics Lecture – 2 Independence and Bernoulli Trials Lecture – 3Random Variables Lecture – 4 Binomial.
2-1 Sample Spaces and Events Random Experiments Figure 2-1 Continuous iteration between model and physical system.
2-1 Sample Spaces and Events Random Experiments Figure 2-1 Continuous iteration between model and physical system.
Chapter 4 Probability ©. Sample Space sample space.S The possible outcomes of a random experiment are called the basic outcomes, and the set of all basic.
Chapter 12 Probability © 2008 Pearson Addison-Wesley. All rights reserved.
Week 21 Conditional Probability Idea – have performed a chance experiment but don’t know the outcome (ω), but have some partial information (event A) about.
Chapter 2: Probability · An Experiment: is some procedure (or process) that we do and it results in an outcome. A random experiment: is an experiment we.
Probability 2.0. Independent Events Events can be "Independent", meaning each event is not affected by any other events. Example: Tossing a coin. Each.
Probability Definition: Probability: the chance an event will happen. # of ways a certain event can occur # of possible events Probability =  Probability.
SECTION 11-3 Conditional Probability; Events Involving “And” Slide
Topic 2 – Probability Basic probability - pages Conditional probability and independence - pages Bayes rule - pages 72 -
Probability Rules. We start with four basic rules of probability. They are simple, but you must know them. Rule 1: All probabilities are numbers between.
Education as a Signaling Device and Investment in Human Capital Topic 3 Part I.
Some Common Discrete Random Variables. Binomial Random Variables.
Chapter 14: From Randomness to Probability Sami Sahnoune Amin Henini.
Chapter 2. Conditional Probability Weiqi Luo ( 骆伟祺 ) School of Data & Computer Science Sun Yat-Sen University :
Psychology 202a Advanced Psychological Statistics September 24, 2015.
Chapter 7 Section 5.  Binomial Distribution required just two outcomes (success or failure).  Multinomial Distribution can be used when there are more.
Chapter 3:Basic Probability Concepts Probability: is a measure (or number) used to measure the chance of the occurrence of some event. This number is between.
Week 21 Rules of Probability for all Corollary: The probability of the union of any two events A and B is Proof: … If then, Proof:
2.5 Additive Rules: Theorem 2.10: If A and B are any two events, then: P(A  B)= P(A) + P(B)  P(A  B) Corollary 1: If A and B are mutually exclusive.
Experiments, Outcomes and Events. Experiment Describes a process that generates a set of data – Tossing of a Coin – Launching of a Missile and observing.
STAT 240 PROBLEM SOLVING SESSION #2. Conditional Probability.
Chapter 6 Probability Mohamed Elhusseiny
Conditional Probability, Bayes Theorem, Independence and Repetition of Experiments Chris Massa.
Chapter 15 Probability Rules!.
Probability Theory Basic concepts Probability Permutations
Bayes’ Theorem.
Probability Axioms and Formulas
How can the likelihood of an event be measured?
Probability and Sample space
Section 7.6 Bayes’ Theorem.
Chapter 2: Probability · An Experiment: is some procedure (or process) that we do and it results in an outcome. A random experiment: is an experiment we.
STAT 203 Tree Diagrams and Bayes’ Rule
COUNTING AND PROBABILITY
Chapter 4 Probability 4.2 Basic Concepts of Probability
Conditional Probability, Bayes Theorem, Independence and Repetition of Experiments Chris Massa.
Presentation transcript:

Law of Total Probability and Bayes’ Rule

“Event-composition method” Understand the experiment and sample points. Using set notation, express the event of interest in terms of events for which the probability is known. Applying probability rules, combine the known probabilities to determine the probability of the specified event.

Problem 2.86 In a factory, 40% of items produced come from Line 1 and others from Line 2. Line 1 has a defect rate of 8%. Line 2 has a defect rate of 10%. For randomly selected item, find probability the item is not defective. A: the selected item is not defective

Problem 2.86 A: the selected item is not defective. B1: item came from Line 1. B2: item came from Line 2.

Problem 2.86 So we may write Since this is the union of disjoint sets, the Additive Law yields Or, in terms of conditional probabilities

The Decision Tree defective Line 1 not defective defective Line 2

Problem 2.94 Must find blood donor for an accident victim in the next 8 minutes or else… Checking blood types of potential donors requires 2 minutes each and may only be tested one at a time. 40% of the potential donors have the required blood type. What is the probability a satisfactory blood donor is identified in time to save the victim?

Finding a Donor A: blood donor is found within 8 minutes Some sample points: “B bad, G good” A = { (G), (B,G), (B,B,G), (B,B,B,G) } Let Ai: ith donor has correct blood type 4 mutually exclusive events

Finding a Donor Trials are independent and each P(Ai) = 0.40, and so

Finding a Donor saved! saved! saved! saved! too late!

Problem 2.96 Of 6 refrigerators, 2 don’t work. The refrigerators are tested one at a time. When tested, it’s clear whether it works! What is the probability the last defective refrigerator is found on the 4th test? What is the probability no more than 4 need to be tested to identify both defective refrigerators?

Problem 2.96 Given that exactly one defective refrigerator was found during the first 2 tests, what is the probability the other one is found on the 3rd or 4th test?

Partition of the Sample Space … B1 B2 Bk

Union of Disjoint Sets S A … B1 B2 Bk

Recall Problem 2.86 A: the selected item is not defective. B1: item came from Line 1. B2: item came from Line 2.

Law of Total Probability S A … B1 B2 Bk

Total Probability P(A|B1)P(B1) B1 P(A|B2)P(B2) B2 B3 P(A|B3)P(B3)

Bayes’ Theorem follows…

Bayes’ B1 B2 B3 P(A|B1)P(B1) P(A|B2)P(B2) P(A|B3)P(B3)

Making Resistors Three machines M1, M2, and M3 produce “1000-ohm” resistors. M1 produces 80% of resistors accurate to within 50 ohms, M2 produces 90% to within 50 ohms, and M3 produces 60% to within 50 ohms. Each hour, M1 produces 3000 resistors, M2 produces 4000, and M3 produces 3000. If all of the resistors are mixed together and shipped in a single container, what is the probability a selected resistor is accurate to within 50 ohms?

Making Resistors Define A: resistor is accurate to within 50 ohms. M1 produces 80% of resistors accurate to within 50 ohms, M2 produces 90% to within 50 ohms, and M3 produces 60% to within 50 ohms. Each hour, M1 produces 3000 resistors, M2 produces 4000, and M3 produces 3000.

Using Total Probability That is, 78 % are expected to be accurate to within 50 ohms.

The Tree (0.8)(0.3) M1 (0.9)(0.4) M2 M3 (0.6)(0.3)

…given it’s within 50 ohms… Determine the probability that, given a selected resistor is accurate to within 50 ohms, it was produced by M1. P( M1 | A) = ? Determine the probability that, given a selected resistor is accurate to within 50 ohms, it was produced by M3. P( M3 | A) = ?

Given A… (0.8)(0.3) M1 (0.9)(0.4) M2 M3 (0.6)(0.3)

Arthritis A test detects a particular type of arthritis for individuals over 50 years old. 10% of this age group suffers from this arthritis. For individuals in this age group known to have the arthritis, the test is correct 85% of the time. For individuals in this age group known to NOT have the arthritis, the test indicates arthritis (incorrectly!) 4% of the time. P( has arthritis | tests positive ) = ?

Arthritis 10% of this age group suffers from this arthritis. P(have arthritis) = 0.10 For individuals in this age group known to have the arthritis, the test is correct 85% of the time. P( tests positive | have arthritis ) = 0.85 For individuals in this age group known to NOT have the arthritis, the test indicates arthritis (incorrectly!) 4% of the time. P(tests positive | no arthritis ) = 0.04 P( have arthritis | tests positive ) = ?

0.85 positive Has arthritis negative 0.1 0.9 No arthritis 0.04 positive negative

The 3 Urns Three urns contain colored balls. Urn Red White Blue 1 3 4 1 2 1 2 3 3 4 3 2 An urn is selected at random and one ball is randomly selected from the urn. Given that the ball is red, what is the probability it came from urn #2 ?

The Lost Labels A large stockpile of cases of light bulbs, 100 bulbs to a box, have lost their labels. The boxes of bulbs come in 3 levels of quality: high, medium, and low. It’s known 50% of the boxes were high quality, 25% medium, and 25% low. Two bulbs will be tested from a box to check if they’re defective.

Lost Labels… The likelihood of finding defective bulbs is dependent on the bulb quality: Number of defects Low Medium High 0 .49 .64 .81 1 .42 .32 .18 2 .09 .04 .01 Given neither bulb is found to be defective, what is the probability the bulbs came from a box of high quality bulbs?