Day 16 More on conditional probability, independence and total probability formula.

Slides:



Advertisements
Similar presentations
0 0 Review Probability Axioms –Non-negativity P(A)≥0 –Additivity P(A U B) =P(A)+ P(B), if A and B are disjoint. –Normalization P(Ω)=1 Independence of two.
Advertisements

1 Chapter 3 Probability 3.1 Terminology 3.2 Assign Probability 3.3 Compound Events 3.4 Conditional Probability 3.5 Rules of Computing Probabilities 3.6.
Sets: Reminder Set S – sample space - includes all possible outcomes
SI485i : NLP Day 2 Probability Review. Introduction to Probability Experiment (trial) Repeatable procedure with well-defined possible outcomes Outcome.
Conditional Probability and Independence. Learning Targets 1. I can calculate conditional probability using a 2-way table. 2. I can determine whether.
Copyright © Cengage Learning. All rights reserved.
McGraw-Hill Ryerson Copyright © 2011 McGraw-Hill Ryerson Limited. Adapted by Peter Au, George Brown College.
Probability Sample Space Diagrams.
We like to think that we have control over our lives. But in reality there are many things that are outside our control. Everyday we are confronted by.
1 Introduction to Stochastic Models GSLM Outline  course outline course outline  Chapter 1 of the textbook.
HW 5_solutions. Problem 1 Let’s modify Problem 7 (page 23) to a more general test. Assume a test has a probability p of indicating the disease among patients.
1 Probability Part 1 – Definitions * Event * Probability * Union * Intersection * Complement Part 2 – Rules Part 1 – Definitions * Event * Probability.
For Thursday, Feb. 20 Bring Conditional Probability Worksheet to class Exam #1:March 4 Project Presentations Start March 6 Team Homework #4 due Feb. 25.
Dependent and Independent Events. If you have events that occur together or in a row, they are considered to be compound events (involve two or more separate.
Independent Events Let A and B be two events. It is quite possible that the percentage of B embodied by A is the same as the percentage of S embodied by.
CONDITIONAL PROBABILITY and INDEPENDENCE In many experiments we have partial information about the outcome, when we use this info the sample space becomes.
Machine Learning Group University College Dublin Statistics Overview Probability Conditional Probability Probability Density Functions.
Probability Concepts and Applications
Bell Work: Factor x – 6x – Answer: (x – 8)(x + 2)
Conditional Probability
Expected Value (Mean), Variance, Independence Transformations of Random Variables Last Time:
Probability.
“PROBABILITY” Some important terms Event: An event is one or more of the possible outcomes of an activity. When we toss a coin there are two possibilities,
Simple Mathematical Facts for Lecture 1. Conditional Probabilities Given an event has occurred, the conditional probability that another event occurs.
1 Probability. 2 Today’s plan Probability Notations Laws of probability.
Special Topics. General Addition Rule Last time, we learned the Addition Rule for Mutually Exclusive events (Disjoint Events). This was: P(A or B) = P(A)
©The McGraw-Hill Companies, Inc. 2008McGraw-Hill/Irwin A Survey of Probability Concepts Chapter 5.
Stats Exam Prep. Dr. Lin Lin. WARNING The goal of this workshop is to go over some basic concepts in probability and statistic theories required for IS.
Let’s consider this problem… The table below gives the proportion of time that the gerbil spends in each compartment. Compartment Proportion A 0.25 B 0.20.
 P(A c ∩ B) + P(A ∩ B)=P(B)  P(A c ∩ B) and P(A ∩ B) are called joint probability.  P(A) and P(B) are called marginal probability.  P(A|B) and P(B|A)
C4, L1, S1 Chapter 3 Probability. C4, L1, S2 I am offered two lotto cards: –Card 1: has numbers –Card 2: has numbers Which card should I take so that.
Conditional Probability Objective: I can find the probability of a conditional event.
7.4 Probability of Independent Events 4/17/ What is the number of unique 4-digit ATM PIN codes if the first number cannot be 0? The numbers to.
Lesson 6 – 3b General Probability Rules Taken from
Copyright © Cengage Learning. All rights reserved. Elementary Probability Theory 5.
PROBABILITY, PROBABILITY RULES, AND CONDITIONAL PROBABILITY
ELEC 303, Koushanfar, Fall’09 ELEC 303 – Random Signals Lecture 3 – Conditional probability Farinaz Koushanfar ECE Dept., Rice University Sept 1, 2009.
12/7/20151 Math b Conditional Probability, Independency, Bayes Theorem.
Math I.  Probability is the chance that something will happen.  Probability is most often expressed as a fraction, a decimal, a percent, or can also.
Introduction to Probability 1. What is the “chance” that sales will decrease if the price of the product is increase? 2. How likely that the Thai GDP will.
(c) 2007 IUPUI SPEA K300 (4392) Probability Likelihood (chance) that an event occurs Classical interpretation of probability: all outcomes in the sample.
How likely is it that…..?. The Law of Large Numbers says that the more times you repeat an experiment the closer the relative frequency of an event will.
Probability. What is probability? Probability discusses the likelihood or chance of something happening. For instance, -- the probability of it raining.
STT 315 This lecture note is based on Chapter 3
9-7Independent and Dependent Events 9-7 Independent and Dependent Events (pg ) Indicator: D7.
Independent and Dependent Events. Independent Events Two events are independent if the outcome of one event does not affect the outcome of a second event.
Probability Experiments Problem Solving Sample Spaces Theoretical vs Experimental Compound Events Independent and Dependent Events.
Chapter 4 Probability Concepts Events and Probability Three Helpful Concepts in Understanding Probability: Experiment Sample Space Event Experiment.
Probability. Randomness When we produce data by randomized procedures, the laws of probability answer the question, “What would happen if we did this.
PROBABILITY AND BAYES THEOREM 1. 2 POPULATION SAMPLE PROBABILITY STATISTICAL INFERENCE.
2.5 Additive Rules: Theorem 2.10: If A and B are any two events, then: P(A  B)= P(A) + P(B)  P(A  B) Corollary 1: If A and B are mutually exclusive.
3.2-Conditional Probability The probability of an event occurring given another event has already occurred. P(B|A) = “Probability of B, given A” # outcomes.
Chance We will base on the frequency theory to study chances (or probability).
Concepts of Probability Introduction to Probability & Statistics Concepts of Probability.
Chapter 15 Probability Rules!.
Chapter 3: Probability Topics
Multiplication Rule and Conditional Probability
Independent and Dependent Events
CSCI 5832 Natural Language Processing
Probability Principles of Engineering
Probability Principles of Engineering
General Probability Rules
Probability “What will Be?”.
WARM - UP After an extensive review of weather related accidents an insurance company concluded the following results: An accident has a 70% chance of.
General Probability Rules
Probability Principles of Engineering
Probability True or False?.
Mutually Exclusive Events
Probability Multiplication law for dependent events
Chapter 5 – Probability Rules
Presentation transcript:

Day 16 More on conditional probability, independence and total probability formula

Conditional Probability and Independence Example: Roll a fair die twice, the first roll is 6 and the second roll is also 6. Let A={first roll is 6} and B={second roll is 6} we can see that since two rolls are independent, P(A ∩ B)=P(A) P(B|A), but P(B|A)=P(B), therefore, For independent events: P(A ∩ B) =P(A)P(B)

Independence Intuitively, if knowing the probability of one event, A, does not help us get the probability of the other event, B, we call the events A and B independent. P(A|B)=P(A) (NOT P(B) !!!) P(B|A)=P(B) P(A∩B)=P(A)P(B)

Some more exercises on conditional probability According to the survey on longevity, nowadays, 95% people will live past 20 years and 50% people will live past 65. Tom just had his twentieth birthday on Sept 22nd, what is his chance of living past 65? A={past 20} and B={past 65} Here, we want P(B|A)=P(A∩B)/P(A) Think about P(A∩B)…

More on conditional Let A={ it will rain today }, B={ it will rain tomorrow }. We know that P(A)=0.4, P(B)=0.5 and P(A∩B)=0.3. Given that is rains today, what is the chance that it also rains tomorrow? (greater or less than P(B) ?) Which probability are we looking for? P(B|A) P(B|A)=P(A∩B)/P(A)=0.3/0.4=0.75

Rain problem contd. If it does not rain today, what is the chance that it rains tomorrow? The probability we look for is? P(B|Ac) P(B|Ac)=P(Ac∩B)/P(Ac)

Some equalities P(Ac∩B) + P(A∩B) = P(B) P(Ac|B) + P(A|B) = 1

Keep pushing on the rain problem Let A={ it rains on Saturday }, B={ I will go to Turkey Run state park}. I know that if it does not rain, I have a 80% chance going, if it rains, I may still go with 20% chance. If the chance of rain on Saturday is 60%, what is my total chance of going?

Total Probability Formula If the outcome of an event, A, depends on the outcome of another event, B. The chance of A happening is: P(A)=P(B1)P(A|B1)+ P(B2)P(A|B2)+…+ P(Bk)P(A|Bk), B1, B2, …, Bk are the outcomes of B.

Example Suppose you want to catch an early flight at Indy airport. You have the following plans: 1. Let your friend drive you to the airport, with 20% chance of missing the flight. 2. Taking the Lafayette Limo with a 25% chance of missing the flight. 3. Hitch hike yourself with 50% of missing the flight. If your preference is 40% taking Lafayette Limo, 35% hitch hike and 25% asking your friend to drive, what is your chance of missing the flight.

Another Example A product is manufactured over three separate machines: A, B and C. Machine A has 4% defective rate, machine B has 2% defective rate and machine C has 6% defective rate. If the percentages of products by machine are: 50%, 30% and 20%, what will be your defective rate?

A summary example Toss a coin twice. For each toss P{H}=0.7 and P{T}=0.3. Find: 1. P{two heads}; 2. P{two tails}

Summary example (contd) 3. P{one head and one tail}

Yet another example Someone is shooting at a target. If it is windy, he has a 40% chance hitting the target. If there is no wind, his chance is 70%. A. If there is a 12% chance of being windy, what is his chance of hitting the target? B. If he hits the target, what is the chance of it being windy???

Question B can only be solved using a new technique Bayes theorem: Bayes theorem deals with another type of question. Think about conditional probability: it answers the question: if A happens then what is the chance for B to happen? ( A is a condition for B) Bayes theorem answers another question: If B happens, what is the chance of A happening. (A is still a condition for B )

Formula Think about total probability formula (two events case) P(A)=P(B1)P(A|B1)+P(B2)P(A|B2) Now we want to know P(B1|A)

Bayes’ Theorem P(B1|A) P(B2|A) = P(B1)P(A|B1) / [P(B1)P(A|B1)+P(B2)P(A|B2)] = P(B1)P(A|B1) / P(A) P(B2|A) = P(B2)P(A|B2) / [P(B1)P(A|B1)+P(B2)P(A|B2)] = P(B2)P(A|B2) / P(A)