PSY 307 – Statistics for the Behavioral Sciences

Slides:



Advertisements
Similar presentations
Confidence Intervals, Effect Size and Power
Advertisements

Stats 95.
CONFIDENCE INTERVALS n point estimate: estimate exact value – precise – likely to be wrong n interval estimate: range of values – less precise – less.
Ethan Cooper (Lead Tutor)
1. Estimation ESTIMATION.
Chapter Seventeen HYPOTHESIS TESTING
PSY 307 – Statistics for the Behavioral Sciences
Behavioural Science II Week 1, Semester 2, 2002
Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.
Statistics for Managers Using Microsoft Excel, 4e © 2004 Prentice-Hall, Inc. Chap 7-1 Chapter 7 Confidence Interval Estimation Statistics for Managers.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Basic Business Statistics 10 th Edition.
Evaluating Hypotheses Chapter 9 Homework: 1-9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics ~
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 9: Hypothesis Tests for Means: One Sample.
Statistics for the Social Sciences Psychology 340 Fall 2006 Review For Exam 1.
Chapter 8 Estimation: Single Population
PSY 1950 Confidence and Power December, Requisite Quote “The picturing of data allows us to be sensitive not only to the multiple hypotheses that.
Chapter Topics Confidence Interval Estimation for the Mean (s Known)
CONFIDENCE INTERVALS What is the Purpose of a Confidence Interval?
PSY 307 – Statistics for the Behavioral Sciences
The one sample t-test November 14, From Z to t… In a Z test, you compare your sample to a known population, with a known mean and standard deviation.
PSY 307 – Statistics for the Behavioral Sciences
PSY 307 – Statistics for the Behavioral Sciences
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 8 Introduction to the t Test.
Chapter 7 Confidence Intervals and Sample Sizes
Chapter 13 – 1 Chapter 12: Testing Hypotheses Overview Research and null hypotheses One and two-tailed tests Errors Testing the difference between two.
8 - 1 © 2003 Pearson Prentice Hall Chi-Square (  2 ) Test of Variance.
1/2555 สมศักดิ์ ศิวดำรงพงศ์
Significance Tests …and their significance. Significance Tests Remember how a sampling distribution of means is created? Take a sample of size 500 from.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.
Population All members of a set which have a given characteristic. Population Data Data associated with a certain population. Population Parameter A measure.
Estimation in Sampling!? Chapter 7 – Statistical Problem Solving in Geography.
Instructor Resource Chapter 5 Copyright © Scott B. Patten, Permission granted for classroom use with Epidemiology for Canadian Students: Principles,
Estimating a Population Proportion
1 Estimation From Sample Data Chapter 08. Chapter 8 - Learning Objectives Explain the difference between a point and an interval estimate. Construct and.
Biostatistics Class 6 Hypothesis Testing: One-Sample Inference 2/29/2000.
3.11 Using Statistics To Make Inferences 3 Summary Review the normal distribution Z test Z test for the sample mean t test for the sample mean Wednesday,
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7-1 Review and Preview.
PSY 307 – Statistics for the Behavioral Sciences Chapter 9 – Sampling Distribution of the Mean.
Introduction to Inference: Confidence Intervals and Hypothesis Testing Presentation 8 First Part.
Introduction to Inference: Confidence Intervals and Hypothesis Testing Presentation 4 First Part.
Estimating a Population Mean
1 CHAPTER 4 CHAPTER 4 WHAT IS A CONFIDENCE INTERVAL? WHAT IS A CONFIDENCE INTERVAL? confidence interval A confidence interval estimates a population parameter.
Chapter 9: Testing Hypotheses Overview Research and null hypotheses One and two-tailed tests Type I and II Errors Testing the difference between two means.
Stats Lunch: Day 3 The Basis of Hypothesis Testing w/ Parametric Statistics.
Review I A student researcher obtains a random sample of UMD students and finds that 55% report using an illegally obtained stimulant to study in the past.
© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 8. Parameter Estimation Using Confidence Intervals.
Aron, Aron, & Coups, Statistics for the Behavioral and Social Sciences: A Brief Course (3e), © 2005 Prentice Hall Chapter 7 Making Sense of Statistical.
T Test for Two Independent Samples. t test for two independent samples Basic Assumptions Independent samples are not paired with other observations Null.
Various Topics of Interest to the Inquiring Orthopedist Richard Gerkin, MD, MS BGSMC GME Research.
Sampling and Statistical Analysis for Decision Making A. A. Elimam College of Business San Francisco State University.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
Lesoon Statistics for Management Confidence Interval Estimation.
1 Probability and Statistics Confidence Intervals.
Chapter 8 Single Sample Tests Part II: Introduction to Hypothesis Testing Renee R. Ha, Ph.D. James C. Ha, Ph.D Integrative Statistics for the Social &
Descriptive and Inferential Statistics Descriptive statistics The science of describing distributions of samples or populations Inferential statistics.
Hypothesis Testing and Statistical Significance
CHAPTER 7: TESTING HYPOTHESES Leon-Guerrero and Frankfort-Nachmias, Essentials of Statistics for a Diverse Society.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Chapter 9 Introduction to the t Statistic
Chapter 8 Confidence Interval Estimation Statistics For Managers 5 th Edition.
Inference: Conclusion with Confidence
STAT 312 Chapter 7 - Statistical Intervals Based on a Single Sample
INTRODUCTORY STATISTICS FOR CRIMINAL JUSTICE Test Review: Ch. 7-9
Chapter Review Problems
Problems: Q&A chapter 6, problems Chapter 6:
Statistics Confidence Intervals
Hypothesis Testing.
Chapter 13 - Confidence Intervals - The Basics
Chapter 8: Estimating With Confidence
Chapter 14 - Confidence Intervals: The Basics
Presentation transcript:

PSY 307 – Statistics for the Behavioral Sciences Chapter 11-12 – Confidence Intervals, Effect Size, Power

Point Estimates The best estimate of a population mean is the sample mean. When we use a sample to estimate parameters of the population, it is called a point estimate. How accurate is our point estimate? The sampling distribution of the mean is used to evaluate this.

Confidence Interval The range around the sample mean within which the true population mean is likely to be found. It consists of a range of values. The upper and lower values are the confidence limits. The range is determined by how confident you wish to be that the true mean falls between the values.

What is a Confidence Interval? A confidence interval for the mean is based on three elements:  The value of the statistic (e.g., the mean, m).   The standard error (SE) of the measure (sx).  The desired width of the confidence interval (e.g., 95% or 99%, 1.96 for z). To calculate for z: m ± (zconf)(sx)

Levels of Confidence A 95% confidence interval means that if a series of confidence intervals were constructed around different means, about 95% of them would include the true population mean. When you use 99% as your confidence interval, then 99% would include the true pop mean.

Demos http://www.stat.sc.edu/~west/javahtml/ConfidenceInterval.html http://www.ruf.rice.edu/~lane/stat_sim/conf_interval/

Calculating Different Levels For 95% use the critical values for z scores that cutoff 5% in the tails: 533 ± (1.96)(11) = 554.56 & 511.44 where M = 533 and sM = 11 For 99% use the critical values that cutoff 1% in the tails: 533 ± (2.58)(11) = 561.38 & 504.62

Sample Size Increasing the sample size decreases the variability of the sampling distribution of the mean:

Effect of Sample Size Because larger sample sizes produce a smaller standard error of the mean: The larger the sample size, the narrower and more precise the confidence interval will be. Sample size for a confidence interval, unlike a hypothesis test, can never be too large.

Other Confidence Intervals Confidence intervals can be calculated for a variety of statistics, including r and variance. Later in the course we will calculate confidence intervals for t and for differences between means. Confidence intervals for percents or proportions frequently appear as the margin of error of a poll.

Effect Size Effect size is a measure of the difference between two populations. One population is the null population assumed by the null hypothesis. The other population is the population to which the sample belongs. For easy comparison, this difference is converted to a z-score by dividing it by the pop std deviation, s.

Effect Size Effect Size X1 X2

A Significant Effect Effect Size X1 X2 Critical Value Critical Value

Calculating Effect Size Subtract the means and divide by the null population std deviation: Interpreting Cohen’s d: Small = .20 Medium = .50 Large = .80

Comparisons Across Studies The main value of calculating an effect size is when comparing across studies. Meta-analysis – a formal method for combining and analyzing the results of multiple studies. Samples sizes vary and affect significance in hypothesis tests, so test statistics (z, t, F) cannot be compared.

Probabilities of Error Probability of a Type I error is a. Most of the time a = .05 A correct decision exists .95 of the time (1 - .05 = .95). Probability of a Type II error is b. When there is a large effect, b is very small. When there is a small effect, b can be large, making a Type II error likely.

When there is no effect… a = .05 Sample means that produce a type I error Hypothesized and true distributions coincide .05 COMMON 1.65

Effect Size and Distribution Overlap Cohen’s d is a measure of effect size. The bigger the d, the bigger the difference in the means. http://www.bolderstats.com/gallery/normal/cohenD.html

Power The probability of producing a statistically significant result if the alternative hypothesis (H1) is true. Ability to detect an effect. 1- b (where b is the probability of making a Type II error)

Small Effects Have Low Power Effect Size X1 X2 Critical value

Large Effects Have More Power Effect Size X1 X2 Critical Value Critical Value

Calculating Power Most researchers use special purpose software or internet power calculators to determine power. This requires input of: Population mean, sample mean Population standard deviation Sample size Significance level, 1 or 2-tailed test http://www.stat.ubc.ca/~rollin/stats/ssize/n2.html

Sample Power Graph 1

Sample Power Graph 2

How Power Changes with N WISE Demo http://wise.cgu.edu/powermod/exercise1b.asp

Effect of Larger Sample Size Larger samples produce smaller standard deviations. Smaller standard deviations mean less overlap between two distributions.

b Decreases with Larger N’s Note: This is for an effect in the negative direction (H0 is the red curve on the right).

Increasing Power Strengthen the effect by changing your manipulation (how the study is done). Decrease the population’s standard deviation by decreasing noise and error (do the study well, use a within subject design). Increase sample size. Change the significance level.