1 Bernoulli and Binomial Distributions. 2 Bernoulli Random Variables Setting: –finite population –each subject has a categorical response with one of.

Slides:

Advertisements

Similar presentations

NORMAL OR GAUSSIAN DISTRIBUTION Chapter 5. General Normal Distribution Two parameter distribution with a pdf given by:

Advertisements

Estimation of Means and Proportions

“Students” t-test.

Hypothesis Testing. To define a statistical Test we 1.Choose a statistic (called the test statistic) 2.Divide the range of possible values for the test.

CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.

Week11 Parameter, Statistic and Random Samples A parameter is a number that describes the population. It is a fixed number, but in practice we do not know.

Sampling: Final and Initial Sample Size Determination

Statistics review of basic probability and statistics.

Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 5-1 Chapter 5 Some Important Discrete Probability Distributions Basic Business Statistics.

ELEC 303 – Random Signals Lecture 18 – Statistics, Confidence Intervals Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 10, 2009.

1 Point and Interval Estimates Examples with z and t distributions Single sample; two samples Result: Sums (and differences) of normally distributed RV.

Descriptive statistics Experiment  Data  Sample Statistics Sample mean Sample variance Normalize sample variance by N-1 Standard deviation goes as square-root.

1 Midterm Review Econ 240A. 2 The Big Picture The Classical Statistical Trail Descriptive Statistics Inferential Statistics Probability Discrete Random.

1 Introduction to Biostatistics (PUBHLTH 540) Multiple Random Variables.

1 Chap 5 Sums of Random Variables and Long-Term Averages Many problems involve the counting of number of occurrences of events, computation of arithmetic.

Chapter 7 Sampling and Sampling Distributions

CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Statistical inference (Sec. )

Descriptive statistics Experiment  Data  Sample Statistics Experiment  Data  Sample Statistics Sample mean Sample mean Sample variance Sample variance.

Correlation. Two variables: Which test? X Y Contingency analysis t-test Logistic regression Correlation Regression.

1 Introduction to Biostatistics (PUBHLTH 540) Estimating Parameters Which estimator is best? Study possible samples, determine Expected values, bias, variance,

1 Introduction to Biostatistics (PUBHLTH 540) Sampling.

Chap 5-1 Copyright ©2012 Pearson Education, Inc. publishing as Prentice Hall Chap 5-1 Chapter 5 Discrete Probability Distributions Basic Business Statistics.

Inferences About Process Quality

1 Inference About a Population Variance Sometimes we are interested in making inference about the variability of processes. Examples: –Investors use variance.

Statistical Inference Lab Three. Bernoulli to Normal Through Binomial One flip Fair coin Heads Tails Random Variable: k, # of heads p=0.5 1-p=0.5 For.

BCOR 1020 Business Statistics Lecture 18 – March 20, 2008.

5-3 Inference on the Means of Two Populations, Variances Unknown

The Neymann-Pearson Lemma Suppose that the data x 1, …, x n has joint density function f(x 1, …, x n ;  ) where  is either  1 or  2. Let g(x 1, …,

Statistical Inference for Two Samples

One Sample  M ean μ, Variance σ 2, Proportion π Two Samples  M eans, Variances, Proportions μ1 vs. μ2 σ12 vs. σ22 π1 vs. π Multiple.

Ch 10 Comparing Two Proportions Target Goal: I can determine the significance of a two sample proportion. 10.1b h.w: pg 623: 15, 17, 21, 23.

Probability theory: (lecture 2 on AMLbook.com)

1 Tests with two+ groups We have examined tests of means for a single group, and for a difference if we have a matched sample (as in husbands and wives)

Multinomial Distribution

Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.

ENGR 610 Applied Statistics Fall Week 3 Marshall University CITE Jack Smith.

Chapter 7 Sampling and Sampling Distributions ©. Simple Random Sample simple random sample Suppose that we want to select a sample of n objects from a.

ELEC 303 – Random Signals Lecture 18 – Classical Statistical Inference, Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 4, 2010.

Quick and Simple Statistics Peter Kasper. Basic Concepts Variables & Distributions Variables & Distributions Mean & Standard Deviation Mean & Standard.

Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 9-1 Review and Preview.

Data Analysis for Two-Way Tables. The Basics Two-way table of counts Organizes data about 2 categorical variables Row variables run across the table Column.

Selecting Input Probability Distribution. Simulation Machine Simulation can be considered as an Engine with input and output as follows: Simulation Engine.

Stat 13 Lecture 19 discrete random variables, binomial A random variable is discrete if it takes values that have gaps : most often, integers Probability.

The final exam solutions. Part I, #1, Central limit theorem Let X1,X2, …, Xn be a sequence of i.i.d. random variables each having mean μ and variance.

Review of Probability. Important Topics 1 Random Variables and Probability Distributions 2 Expected Values, Mean, and Variance 3 Two Random Variables.

CLASSICAL NORMAL LINEAR REGRESSION MODEL (CNLRM )

Chapter 5 Joint Probability Distributions and Random Samples  Jointly Distributed Random Variables.2 - Expected Values, Covariance, and Correlation.3.

1 Math 4030 – 10b Inferences Concerning Proportions.

Week 111 Review - Sum of Normal Random Variables The weighted sum of two independent normally distributed random variables has a normal distribution. Example.

Module 25: Confidence Intervals and Hypothesis Tests for Variances for One Sample This module discusses confidence intervals and hypothesis tests.

Objectives (BPS chapter 12) General rules of probability 1. Independence : Two events A and B are independent if the probability that one event occurs.

Lecture 22 Dustin Lueker.  Similar to testing one proportion  Hypotheses are set up like two sample mean test ◦ H 0 :p 1 -p 2 =0  Same as H 0 : p 1.

The Chi-Square Distribution  Chi-square tests for ….. goodness of fit, and independence 1.

Chapter 6 Sampling and Sampling Distributions

Log-linear Models Please read Chapter Two. We are interested in relationships between variables White VictimBlack Victim White Prisoner151 (151/160=0.94)

Chi Square Test of Homogeneity. Are the different types of M&M’s distributed the same across the different colors? PlainPeanutPeanut Butter Crispy Brown7447.

Sampling and Sampling Distributions

Lecture #24 Thursday, November 10, 2016 Textbook: 13.1 through 13.6

Chapter 6 Inferences Based on a Single Sample: Estimation with Confidence Intervals Slides for Optional Sections Section 7.5 Finite Population Correction.

Chapter 4. Inference about Process Quality

STAT 312 Chapter 7 - Statistical Intervals Based on a Single Sample

Chapter 5 Joint Probability Distributions and Random Samples

Sample Mean Distributions

Module 22: Proportions: One Sample

Tests for Two Means – Normal Populations

SA3202 Statistical Methods for Social Sciences

Review of Hypothesis Testing

CHAPTER 6 Statistical Inference & Hypothesis Testing

Statistical Inference for the Mean: t-test

Presentation transcript:

1 Bernoulli and Binomial Distributions

2 Bernoulli Random Variables Setting: –finite population –each subject has a categorical response with one of 2 possible values (0/1) –pick a simple random sample of n=1 subject Y random variable representing response (a Bernoulli random variable) Prob(Y=1)

3 Bernoulli Random Variables Example: Finite population of 100 subjects, where 40 are normal weight and 60 are overweight. Response: 0 normal weight 1 overweight Population Parameters: Mean Variance

4 Bernoulli Random Variables Example: Finite population of 100 subjects, where 40 are normal weight and 60 are overweight. Values: 0 normal weight 1 overweight Population Parameters: Mean Variance Pick a single subject at random: a Bernoulli Random Variable

5 Bernoulli Random Variables Example: Finite population of 100 subjects, where 40 are normal weight and 60 are overweight. Values: 0 normal weight 1 overweight Probability a Bernoulli Random Variable EventyP(y) Normal01-p Overwt1p Total 1 events are mutually exclusive exhaustive probabilities sum to 1

6 Bernoulli Random Variables Example: Finite population of 100 subjects, where 40 are normal weight and 60 are overweight. Values: 0 normal weight 1 overweight a Bernoulli Random Variable EventyP(y) Normal01-p Overwt1p Total 1

7 Bernoulli Random Variables Example: Finite population of 100 subjects, where 40 are normal weight and 60 are overweight. Values: 0 normal weight 1 overweight a Bernoulli Random Variable Simple random sample of n=1

8 Binomial Random Variable Binomial Random Variable: The sum of independent identically distributed Bernoulli random variables. Example: Finite population of 100 subjects, where 40 are normal weight and 60 are overweight. Values: 0 normal weight 1 overweight Select a simple random sample of size n with replacement –the random variable representing each selection is a Bernoulli Random variables –the random variables are independent –the random variables are identically distributed iid = independent and identically distributed (always occurs for random variables representing selections using simple random sampling with replacement) a Binomial Random Variable

9 Independent Variables Are the two random variables independent? first selection in a sample second selection in a sample (with Rep) Two random variables are independent if for any realized value of the first random variable, the probability is unchanged for any realized value of the second random variable.

10 Independent Variables Are the two random variables independent? first selection in a sample second selection in a sample (with Rep) Suppose Conclusion: The RV’s are independent

11 Independent Variables Are the two random variables independent? first selection in a sample second selection in a sample (without Rep) a Bernoulli Random Variable

12 Independent Variables Are the two random variables independent? first selection in a sample second selection in a sample (without Rep) Suppose Conclusion: The RV’s are not independent

13 Binomial Random Variable Binomial Random Variable: The sum of independent identically distributed (iid) Bernoulli random variables. a Binomial Random Variable a vector of Random Variables

14 Expected Value and Variance of a Vector of Random Variables a vector of Random Variables

15 Expected Value and Variance of a Vector of Random Variables a vector of independent Random Variables a vector of independent and identically distributed (iid)Random Variables zero covariances identity matrix

16 Expected Value and Variance of a Linear Combination of Random Variables a Binomial Random Variable a vector of independent and identically distributed Bernoulli Random Variables In general

17 Variance of a Binomal Random Variables

18 Expected Value and Variance of a Binomal Random Variable a Binomial Random Variable a vector of independent and identically distributed Bernoulli Random Variables

19 Binomial Distribution see table A.1 in Appendix of Text nk=X0.4=p X=x

20 Binomial Distribution see table A.1 in Appendix of Text nk

21 SRS with rep: Seasons Study With Seasons Study, define High Total Cholesterol: TC>240 Select SRS with replacement: Run SAS program: ejs09b540p46.sas Example: Change Program to get 5 samples of size n=10 For each, calculate total TC>240

22 Binomial Distribution What if 10,000 Samples were selected?

23 Binomial Distribution P(X=x=# with TC>240)= =(# ways of ways of picking samples with x)Pr(x ‘success’)P(n-x ‘failures’)

24 Binomial Distribution Likelihood We select a srs with replacement of n=10 and observe x=4. What is p? This is a function of p

25 Binomial Distribution Likelihood We select a srs with replacement of n=10 and observe x=4. What is p? Likelihood: Use table to find values for p: pL(p)p etc

26 Binomial Distribution Maximum Likelihood Likelihood: pL(p)p etc Maximum Likelihood

27 Binomial Distribution- Differences in Use Mean Usually report “total” instead of “mean”. Total Estimate Variance Estimated Variance Use Normal CLT

28 Binomial Distribution- Differences in Use MeanTotal Use Normal Dist for Interval Estimates Approximation good when and

29 Binomial Distribution- Differences in Use Use hypothesized p for variance when and

30 Binomial Distribution- CI for Difference in Prop. Diff in Means (Proportions see 14.6)

31 Binomial Distribution- Hyp. Test for Difference in Prop. Pooled prob

32 Chi-Square Distribution Hyp. Test for Difference in Prop. Under the null hypothesis, this statistic follows a chi-square distribution with 1 degree of freedom.