Statistical control of variability. Dr. Tom’s Elixir to Improve Performance(of IQ, for example) Select victims (oops, subjects) Collect baseline data.

Slides:



Advertisements
Similar presentations
Comparing Two Means: One-sample & Paired-sample t-tests Lesson 12.
Advertisements

Independent t -test Features: One Independent Variable Two Groups, or Levels of the Independent Variable Independent Samples (Between-Groups): the two.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Prentice-Hall, Inc.Chap 10-1 Statistics for Managers Using Microsoft® Excel 5th Edition Chapter.
1 Matched Samples The paired t test. 2 Sometimes in a statistical setting we will have information about the same person at different points in time.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Dependent t-Test CJ 526 Statistical Analysis in Criminal Justice.
Using Statistics in Research Psych 231: Research Methods in Psychology.
The research process Psych 231: Research Methods in Psychology.
Inferential Stats for Two-Group Designs. Inferential Statistics Used to infer conclusions about the population based on data collected from sample Do.
Copyright (c) Bani Mallick1 STAT 651 Lecture 10. Copyright (c) Bani Mallick2 Topics in Lecture #10 Comparing two population means using rank tests Comparing.
The research process Psych 231: Research Methods in Psychology.
The research process Psych 231: Research Methods in Psychology.
AP Statistics Section 12.1 A. Now that we have looked at the principles of testing claims, we proceed to practice. We begin by dropping the unrealistic.
S519: Evaluation of Information Systems
Biostatistics in Research Practice: Non-parametric tests Dr Victoria Allgar.
5-3 Inference on the Means of Two Populations, Variances Unknown
Sample Size Determination
Comparing Population Parameters (Z-test, t-tests and Chi-Square test) Dr. M. H. Rahbar Professor of Biostatistics Department of Epidemiology Director,
Objective: To test claims about inferences for two sample means, under specific conditions.
Statistical Analysis. Purpose of Statistical Analysis Determines whether the results found in an experiment are meaningful. Answers the question: –Does.
Hypothesis Testing and T-Tests. Hypothesis Tests Related to Differences Copyright © 2009 Pearson Education, Inc. Chapter Tests of Differences One.
Basic Statistics Michael Hylin. Scientific Method Start w/ a question Gather information and resources (observe) Form hypothesis Perform experiment and.
Things that I think are important Chapter 1 Bar graphs, histograms Outliers Mean, median, mode, quartiles of data Variance and standard deviation of.
AP STATISTICS LESSON 11 – 2 (DAY 1) Comparing Two Means.
Dependent Samples: Hypothesis Test For Hypothesis tests for dependent samples, we 1.list the pairs of data in 2 columns (or rows), 2.take the difference.
The Hypothesis of Difference Chapter 10. Sampling Distribution of Differences Use a Sampling Distribution of Differences when we want to examine a hypothesis.
GROUP DIFFERENCES: THE SEQUEL. Last time  Last week we introduced a few new concepts and one new statistical test:  Testing for group differences 
Comparing Two Population Means
Comparing Means: t-tests Wednesday 22 February 2012/ Thursday 23 February 2012.
Hypothesis Testing CSCE 587.
Chapter 10 Comparing Two Means Target Goal: I can use two-sample t procedures to compare two means. 10.2a h.w: pg. 626: 29 – 32, pg. 652: 35, 37, 57.
Much of the meaning of terms depends on context. 1.
SPSS Part 2 Kin 260 Jackie Kiwata. Overview Review Comparing Sets of Data Correlation T-Tests.
Statistics Psych 231: Research Methods in Psychology.
Chapter 25 Paired Samples and Blocks. Example Measure effectiveness of exercise program in lowering blood cholesterol levels. SRS of men from a population.
AP Statistics Section 13.1 A. Which of two popular drugs, Lipitor or Pravachol, helps lower bad cholesterol more? 4000 people with heart disease were.
Statistics (cont.) Psych 231: Research Methods in Psychology.
Evaluating Impacts of MSP Grants Hilary Rhodes, PhD Ellen Bobronnikov February 22, 2010 Common Issues and Recommendations.
Analysis of Variance 1 Dr. Mohammed Alahmed Ph.D. in BioStatistics (011)
Experimental Psychology PSY 433 Appendix B Statistics.
Analyzing the Results of an Experiment… -not straightforward.. –Why not?
Evaluating Impacts of MSP Grants Ellen Bobronnikov Hilary Rhodes January 11, 2010 Common Issues and Recommendations.
University of Durham D Dr Robert Coe University of Durham School of Education Tel: (+44 / 0) Fax: (+44 / 0)
Evaluating Impacts of MSP Grants Ellen Bobronnikov January 6, 2009 Common Issues and Potential Solutions.
DTC Quantitative Methods Bivariate Analysis: t-tests and Analysis of Variance (ANOVA) Thursday 14 th February 2013.
Statistical analysis Why?? (besides making your life difficult …)  Scientists must collect data AND analyze it  Does your data support your hypothesis?
CH 25 Paired Samples and Blocks. Paired Data 1. Observations that are collected in pairs (data on age differences between husbands and wives, for instance).
Week 6. Statistics etc. GRS LX 865 Topics in Linguistics.
Hypothesis test flow chart frequency data Measurement scale number of variables 1 basic χ 2 test (19.5) Table I χ 2 test for independence (19.9) Table.
The research process Psych 231: Research Methods in Psychology.
Statistics (cont.) Psych 231: Research Methods in Psychology.
Testing Differences in Means (t-tests) Dr. Richard Jackson © Mercer University 2005 All Rights Reserved.
The research process Psych 231: Research Methods in Psychology.
Objectives (BPS chapter 12) General rules of probability 1. Independence : Two events A and B are independent if the probability that one event occurs.
Statistics (cont.) Psych 231: Research Methods in Psychology.
AP Statistics Chapter 11 Section 2. TestConfidence IntervalFormulasAssumptions 1-sample z-test mean SRS Normal pop. Or large n (n>40) Know 1-sample t-test.
S519: Evaluation of Information Systems Social Statistics Inferential Statistics Chapter 9: t test.
Inferential Statistics Psych 231: Research Methods in Psychology.
Inferential Statistics Psych 231: Research Methods in Psychology.
When the means of two groups are to be compared (where each group consists of subjects that are not related) then the excel two-sample t-test procedure.
CJ 526 Statistical Analysis in Criminal Justice
Reasoning in Psychology Using Statistics
Reasoning in Psychology Using Statistics
Psych 231: Research Methods in Psychology
A paired-samples t-test compares the means of two related sets of data to see if they differ statistically. IQ Example We may want to compare the IQ scores.
Methodology Week 5.
Psych 231: Research Methods in Psychology
Reasoning in Psychology Using Statistics
Principles of Experimental Design
Presentation transcript:

Statistical control of variability

Dr. Tom’s Elixir to Improve Performance(of IQ, for example) Select victims (oops, subjects) Collect baseline data on IQ Give Snake Oil supplement (subject to rigorous QC and QA standards) After six weeks retest subjects Test for “significant” improvement in IQ

Raw Data

Graph the data first!

Is there an improvement? A lot of “noise” is in the data Pre vs. Post seems to show a slight improvement All subjects showed some degree of improvement Need significant p-value for Marketing!

Some dependency appears in data due to repeated measurements on each subject

What would a two-sample t-test show? A two sample t-test gives a p-value of.8458 Therefore this difference is likely due to chance  But everyone improved!! Call a Statistician!

Statistical consultant notes: The design was correct The analysis did not take into account that the data was paired One should analyze the differences instead of individual values We take all major credit cards

New improved analysis:

Practical vs. Statistical Significance A study can always be designed to pick up “small” differences. Practical Significance is typically evaluated by looking at the ES or Effect Size. The ES is the Mean Improvement divided by the Standard Deviation (of the population, not differences). If the Standard Deviation of a typical IQ instrument is about 10, then the ES that was observed is about.0889, which would be considered very small in the Psychometric literature.