USC3002 Picturing the World Through Mathematics Wayne Lawton Department of Mathematics S14-04-04, 65162749 Theme for Semester I, 2008/09.

Slides:



Advertisements
Similar presentations
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 9 Inferences Based on Two Samples.
Advertisements

Week11 Parameter, Statistic and Random Samples A parameter is a number that describes the population. It is a fixed number, but in practice we do not know.
Inferential Statistics
STATISTICAL INFERENCE PART V
Chapter 7: Statistical Applications in Traffic Engineering
Business 205. Review Sampling Continuous Random Variables Central Limit Theorem Z-test.
10-1 Introduction 10-2 Inference for a Difference in Means of Two Normal Distributions, Variances Known Figure 10-1 Two independent populations.
9-1 Hypothesis Testing Statistical Hypotheses Statistical hypothesis testing and confidence interval estimation of parameters are the fundamental.
Topic 2: Statistical Concepts and Market Returns
Inferences About Means of Single Samples Chapter 10 Homework: 1-6.
Lecture Inference for a population mean when the stdev is unknown; one more example 12.3 Testing a population variance 12.4 Testing a population.
T-test.
Hypothesis Testing for Population Means and Proportions
Inference about a Mean Part II
T-Tests Lecture: Nov. 6, 2002.
Copyright © 2014, 2013, 2010 and 2007 Pearson Education, Inc. Chapter Hypothesis Tests Regarding a Parameter 10.
Inferences About Process Quality
Chapter 9 Hypothesis Testing.
BCOR 1020 Business Statistics Lecture 20 – April 3, 2008.
Statistics 270– Lecture 25. Cautions about Z-Tests Data must be a random sample Outliers can distort results Shape of the population distribution matters.
5-3 Inference on the Means of Two Populations, Variances Unknown
“There are three types of lies: Lies, Damn Lies and Statistics” - Mark Twain.
Chapter 9 Hypothesis Testing II. Chapter Outline  Introduction  Hypothesis Testing with Sample Means (Large Samples)  Hypothesis Testing with Sample.
Hypothesis Testing and T-Tests. Hypothesis Tests Related to Differences Copyright © 2009 Pearson Education, Inc. Chapter Tests of Differences One.
Chapter 9 Title and Outline 1 9 Tests of Hypotheses for a Single Sample 9-1 Hypothesis Testing Statistical Hypotheses Tests of Statistical.
Statistical Inference for Two Samples
Hypothesis Testing:.
Hypothesis Testing with Two Samples
1/2555 สมศักดิ์ ศิวดำรงพงศ์
STAT 5372: Experimental Statistics Wayne Woodward Office: Office: 143 Heroy Phone: Phone: (214) URL: URL: faculty.smu.edu/waynew.
Sampling Theory Determining the distribution of Sample statistics.
Estimation Basic Concepts & Estimation of Proportions
More About Significance Tests
Topics: Statistics & Experimental Design The Human Visual System Color Science Light Sources: Radiometry/Photometry Geometric Optics Tone-transfer Function.
Hypothesis Testing. Steps for Hypothesis Testing Fig Draw Marketing Research Conclusion Formulate H 0 and H 1 Select Appropriate Test Choose Level.
10-1 Introduction 10-2 Inference for a Difference in Means of Two Normal Distributions, Variances Known Figure 10-1 Two independent populations.
Chapter 9: Testing Hypotheses
9-1 Hypothesis Testing Statistical Hypotheses Definition Statistical hypothesis testing and confidence interval estimation of parameters are.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
Ch9. Inferences Concerning Proportions. Outline Estimation of Proportions Hypothesis concerning one Proportion Hypothesis concerning several proportions.
1 10 Statistical Inference for Two Samples 10-1 Inference on the Difference in Means of Two Normal Distributions, Variances Known Hypothesis tests.
USC3002 Picturing the World Through Mathematics Wayne Lawton Department of Mathematics S , Theme for Semester I, 2007/08.
Warsaw Summer School 2011, OSU Study Abroad Program Difference Between Means.
EMIS 7300 SYSTEMS ANALYSIS METHODS FALL 2005 Dr. John Lipp Copyright © Dr. John Lipp.
Introduction to the Practice of Statistics Fifth Edition Chapter 6: Introduction to Inference Copyright © 2005 by W. H. Freeman and Company David S. Moore.
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
Reasoning in Psychology Using Statistics Psychology
Inen 460 Lecture 2. Estimation (ch. 6,7) and Hypothesis Testing (ch.8) Two Important Aspects of Statistical Inference Point Estimation – Estimate an unknown.
Review of Statistics.  Estimation of the Population Mean  Hypothesis Testing  Confidence Intervals  Comparing Means from Different Populations  Scatterplots.
Inferences Concerning Variances
Statistical Inference Drawing conclusions (“to infer”) about a population based upon data from a sample. Drawing conclusions (“to infer”) about a population.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
Understanding Basic Statistics Fourth Edition By Brase and Brase Prepared by: Lynn Smith Gloucester County College Chapter Nine Hypothesis Testing.
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
Chapter 8 Estimation ©. Estimator and Estimate estimator estimate An estimator of a population parameter is a random variable that depends on the sample.
Sample Size Needed to Achieve High Confidence (Means)
Sampling Theory Determining the distribution of Sample statistics.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Evaluating Hypotheses. Outline Empirically evaluating the accuracy of hypotheses is fundamental to machine learning – How well does this estimate its.
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 7 Inferences Concerning Means.
Evaluating Hypotheses. Outline Empirically evaluating the accuracy of hypotheses is fundamental to machine learning – How well does this estimate accuracy.
Hypothesis Testing. Steps for Hypothesis Testing Fig Draw Marketing Research Conclusion Formulate H 0 and H 1 Select Appropriate Test Choose Level.
Chapter Nine Hypothesis Testing.
Hypothesis Testing: One-Sample Inference
Chapter 9 Hypothesis Testing.
Chapter 4. Inference about Process Quality
Math 4030 – 10b Inferences Concerning Variances: Hypothesis Testing
CONCEPTS OF HYPOTHESIS TESTING
Chapter 9 Hypothesis Testing.
Presentation transcript:

USC3002 Picturing the World Through Mathematics Wayne Lawton Department of Mathematics S , Theme for Semester I, 2008/09 : The Logic of Evolution, Mathematical Models of Adaptation from Darwin to Dawkins

1.Populations and Samples 2.Sample Population Statistics 3.Statistical Hypothesis 4. Test Statistics for Gaussian Hypotheses Sample Mean for Parameter Estimation z-Test and t-Test Statistics Rejection/Critical Region for z-Test Statistic Hypothesis Test for Mean Height 5. General Hypotheses Tests Type I and Type II Errrors Null and Alternative Hypotheses 6. Assign Tutorial Problems PLAN FOR LECTURE

Population - a specified collection of quantities: e.g. heights of males in a country, glucose levels of a collection of blood samples, batch yields of an industrial compound for a chemical plant over a specified time with and without the use of a catalyst Sample Population – a population from which samples are taken to be used for statistical inference Sample - the subset of the sample population consisting of the samples that are taken. POPULATIONS AND SAMPLES

Sample SAMPLE POPULATION PARAMETERS Sample Size Sample Parameters Sample Mean Sample Variance Sample Standard Deviation

Theorem 1 The variance of a population is related to its mean and average squared values by SAMPLE POPULATION PARAMETERS Proof Since Question How can the proof be completed ? Why ?

are assertions about a population that describe some statistical properties of the population. STATISTICAL HYPOTHESES For Gaussian distributions there are four possibilities: Typically, statistical hypotheses assert that a population consists of independent samples of a random variable that has a certain type of distribution and some of the parameters that describe this distribution may be specified. Neither the mean nor the variance is specified. Only the variance is specified. Only the mean is specified. Both the mean and the variance are specified.

The sample mean for TEST STATISTICS for Hypothesis with Gaussian Distributions unknown, is Gaussian with mean 0 and variance 1/n. Proof (Outline) We let denote the mean of a random variable Y. Then clearly known Independence and Theorem 1 gives where

The sample mean for PARAMETER ESTIMATION for Hypothesis with Gaussian Distributions unknown, can be used to estimate the mean since the estimate error known is unbiased and converges in the statistical sense that as

The One Sample z-Test for MORE TEST STATISTICS for Hypothesis with Gaussian Distributions known is a Gaussian random variable with mean 0,variance 1. The One Sample t-Test for known, unknown is a t-distributed random variable with n-1 degrees of freedom.

z-TEST STATISTIC ALPHAS

CRITICAL REGION FOR alpha=0.05

HEIGHT HISTOGRAMS

HYPOTHESIS TEST FOR MEAN HEIGHT You suspect that the height of males in a country has increased due to diet or a Martian conspiracy, you aim to support your Alternative Hypothesis by testing the Null Hypothesis You compute a sample mean using 20 samples then compute If the Null Hypothesis is true the probability that is Question Should the Null Hypothesis be rejected ?

GENERAL HYPOTHESES TESTS and more complicated test statistics, such as the One Sample t-Test statistic, whose distribution is determined even though the distributions of the Gaussian random samples, used to compute it, is not. Type I Error: prob rejecting null hypothesis if its true, also called the significance level Type II Error: prob failing to reject null hypothesis if its false, also called the power of a test, requires an Alternative Hypothesis that determines the distribution of the test statistic. involve

Homework 5. Due Monday where and are the same as for the null hypothesis and 20 samples are used and the significance 1. Compute the power of a hypothesis test whose null hypothesis is that in vufoil #13, the alternative hypothesis asserts that heights are normally distributed Suggestion: if the alternative hypothesis is true, what What is the probability that is the distribution of test statistic with 2. Use a t-statistic table to describe how to test the null hypothesis that heights are normal with mean and unknown variance based on 20 samples.

EXTRA TOPIC: CONFIDENCE INTERVALS Given a sample meanfor largewe can assume, by the central limit theorem that it is Gaussian with We say that where p(x) is the probability density of a Gaussian meanmean of the original population and variance Furthermore, variance of the original population. sample variance and if the with confidence with meanand standard deviation Theorem If is a random variable unif. on [-L,L] then Bayes Theorem  population is {0,1}-valued

EXTRA TOPIC: TWO SAMPLE TESTS A null hypothesis may assert a that two populations have the same means, a special case for {0,1}-valued populations asserts equalily of population proportions. Under these assumptions and if the variances of both populations are known, hypothesis testing uses the Two-Sample z-Test Statistic whereis the sample mean, variance, and sample size for one population, tilde’s for the other. For unkown variances and other cases consult:

EXTRA TOPIC: CHI-SQUARED TESTS are used to determine goodness-or-fit for various distributions. They employ test statistics of the form where observations & null hyp.  expected value Answer: The expected values are 250, 750, 750, 2250 Example [1,p.216] A geneticist claims that four species of fruit flies should appear in the ratio 1:3:3:9. Suppose that the sample of 4000 flies contained 226, 764, 733, and 2277 flies of each species, respectively. For alpha =.1, is there sufficient evidence to reject the geneticist’s claim ? are independent and chi-squared distrib. with d-1 degrees of freedom. hence NO since 3 deg. freed. & alpha =.1 

EXTRA TOPIC: POISSON APPROXIMATION The Binomial Distribution It has mean is the probability that k-events happen in n-trials if Ifthen The right side is the Poisson Distribution and variance and

REFERENCES 1.Martin Sternstein, Statistics, Barrows College Review Series, New York, Survey textbook covers probability distributions, hypotheses tests, populations,samples, chi-squared analysis, regression. 3. J.Neyman and E.S. Pearson, Joint Statistical Papers, Cambridge University Press, Source materials. 2. E. L. Lehmann, Testing Statistical Hypotheses, New York, Detailed development of the Neyman-Pearson theory of hypotheses testing. 4. Jan von Plato, Creating Modern Probability, Cambridge University Press, Charts the history and development of modern probability theory.