Analyzing Statistical Inferences How to Not Know Null.

Slides:



Advertisements
Similar presentations
Lecture (11,12) Parameter Estimation of PDF and Fitting a Distribution Function.
Advertisements

Statistical Issues in Research Planning and Evaluation
Research Methods for Counselors COUN 597 University of Saint Joseph Class # 8 Copyright © 2015 by R. Halstead. All rights reserved.
5/15/2015Slide 1 SOLVING THE PROBLEM The one sample t-test compares two values for the population mean of a single variable. The two-sample test of a population.
Inference1 Data Analysis Inferential Statistics Research Methods Gail Johnson.
Statistical Significance What is Statistical Significance? What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant?
One way-ANOVA Analysis of Variance Let’s say we conduct this experiment: effects of alcohol on memory.
HYPOTHESIS TESTING Four Steps Statistical Significance Outcomes Sampling Distributions.
Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.
Statistical Significance What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant? How Do We Know Whether a Result.
Lecture 11 Psyc 300A. Null Hypothesis Testing Null hypothesis: the statistical hypothesis that there is no relationship between the variables you are.
Evaluating Hypotheses Chapter 9 Homework: 1-9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics ~
Understanding Statistics in Research
T-Tests Lecture: Nov. 6, 2002.
PY 427 Statistics 1Fall 2006 Kin Ching Kong, Ph.D Lecture 6 Chicago School of Professional Psychology.
Today Concepts underlying inferential statistics
Hypothesis Testing Using The One-Sample t-Test
Chapter 14 Inferential Data Analysis
Richard M. Jacobs, OSA, Ph.D.
Descriptive Statistics
Inferential Statistics
Chapter 12 Inferential Statistics Gay, Mills, and Airasian
Statistical hypothesis testing – Inferential statistics I.
Inferential Statistics
INFERENTIAL STATISTICS – Samples are only estimates of the population – Sample statistics will be slightly off from the true values of its population’s.
Choosing Statistical Procedures
Statistics for the Social Sciences
AM Recitation 2/10/11.
Statistics 11 Hypothesis Testing Discover the relationships that exist between events/things Accomplished by: Asking questions Getting answers In accord.
Hypothesis Testing:.
Overview of Statistical Hypothesis Testing: The z-Test
Testing Hypotheses I Lesson 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics n Inferential Statistics.
© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 9. Hypothesis Testing I: The Six Steps of Statistical Inference.
HYPOTHESIS TESTING Dr. Aidah Abu Elsoud Alkaissi
Statistical inference: confidence intervals and hypothesis testing.
Tuesday, September 10, 2013 Introduction to hypothesis testing.
Chapter 8 Introduction to Hypothesis Testing
Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc Chapter 24 Statistical Inference: Conclusion.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Inferential Statistics.
Copyright © 2008 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 22 Using Inferential Statistics to Test Hypotheses.
Hypothesis Testing: One Sample Cases. Outline: – The logic of hypothesis testing – The Five-Step Model – Hypothesis testing for single sample means (z.
The Argument for Using Statistics Weighing the Evidence Statistical Inference: An Overview Applying Statistical Inference: An Example Going Beyond Testing.
Chapter 8 Introduction to Hypothesis Testing
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
S519: Evaluation of Information Systems Social Statistics Inferential Statistics Chapter 8: Significantly significant.
Inference and Inferential Statistics Methods of Educational Research EDU 660.
Introduction to Inferential Statistics Statistical analyses are initially divided into: Descriptive Statistics or Inferential Statistics. Descriptive Statistics.
Chapter 9 Three Tests of Significance Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.
Educational Research Chapter 13 Inferential Statistics Gay, Mills, and Airasian 10 th Edition.
1 Chapter 8 Introduction to Hypothesis Testing. 2 Name of the game… Hypothesis testing Statistical method that uses sample data to evaluate a hypothesis.
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
Education 793 Class Notes Decisions, Error and Power Presentation 8.
Inferential Statistics. The Logic of Inferential Statistics Makes inferences about a population from a sample Makes inferences about a population from.
Chapter 10 The t Test for Two Independent Samples
Chapter 10 Copyright © Allyn & Bacon 2008 This multimedia product and its contents are protected under copyright law. The following are prohibited by law:
Analyzing Statistical Inferences July 30, Inferential Statistics? When? When you infer from a sample to a population Generalize sample results to.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
PART 2 SPSS (the Statistical Package for the Social Sciences)
Chapter 13 Understanding research results: statistical inference.
BIOL 582 Lecture Set 2 Inferential Statistics, Hypotheses, and Resampling.
Chapter 7: Hypothesis Testing. Learning Objectives Describe the process of hypothesis testing Correctly state hypotheses Distinguish between one-tailed.
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Educational Research Inferential Statistics Chapter th Chapter 12- 8th Gay and Airasian.
Inferential Statistics Psych 231: Research Methods in Psychology.
NURS 306, Nursing Research Lisa Broughton, MSN, RN, CCRN RESEARCH STATISTICS.
Chapter 9 Introduction to the t Statistic
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 11: Between-Subjects Designs 1.
15 Inferential Statistics.
Significance and t testing
Understanding Statistical Inferences
Presentation transcript:

Analyzing Statistical Inferences How to Not Know Null

Agenda Inferential stats –Descriptive vs. Inferential –Ramifications of hypothesis testing –Tests of significance Action Research –Dissect Sanna paper –Outline paper –Discuss presentations

Teacher Salary Example Descriptive Stats –Range of salary distributions –Mean –Percentages of teachers with different levels of experience and degrees

Teacher Salary Example What kinds of questions would we ask if we wanted to compare these 2 groups of teachers? Inferential Statistics

Understand the need for using inferential statistics to estimate likely conclusions What Are Inferential Statistics? –Inferential statistics refer to certain procedures that allow researchers to make inferences about a population based on data obtained from a sample. –The term “probability,” as used in research, refers to the predicted relative frequency with which a given event will occur (e.g., p- value).

Descriptive vs. Inferential Stats Describe the data. Means, variances, frequencies. Important precursor to inferential stats Infer from a sample what is true of a population. Rely on descriptive stats. Ultimate goal - to draw accurate conclusions about the population DescriptiveInferential

The Notorious Null What is it?? –A statement about a relationship –No differences between groups –No relationships between variables What assumption should you always make about the null? Assume the null is accurate

Null hypothesis differs in most instances from the research hypothesis –which states that one method is expected to be more effective than another Rejecting the null hypothesis provides evidence (but not proof) that the intervention had an effect The Notorious Null

Hypothesis Testing Tests of significance ask this question: Could these observations really have occurred by chance? Example of Jury Selection p <

Probability Level of significance or p = probability of being wrong to reject the null (to state there is a true difference, but in reality the difference is from chance) In general, research should be p <.05 to be considered significant.

The decision a researcher must make is: –whether to accept the null hypothesis or to reject it There are four possibilities…

Decisions concerning rejecting the null hypothesis… The true status of the null hypothesis… TrueFalse The researcher’s decision about the null hypothesis… True False Correct Type II Error (β) Type I Error ( α) Correct

Consider an example from a kitchen… You probably have a smoke alarm where you live. You have probably made microwave popcorn or toast that set off your alarm though you had no fire. TYPE I error

If you ever took the batteries out of your smoke alarm because you got so annoyed,… You ran the risk of having a fire but no alarm. TYPE II error

If you had a fire, but your alarm worked, you’re ok. If you had no fire, and no alarm, you’re also ok. Hence…

Put in cooking terms… The true status of the kitchen… No FireFire The status of the smoke alarm… No Alarm Correct Type II Error (β) Type I Error ( α) Correct

Back to the null hypothesis… The true status of the null hypothesis… TrueFalse The researcher’s decision about the null hypothesis… True False Correct Type II Error (β) Type I Error ( α) Correct

Your Turn for Statistical Fun Create a null hypothesis regarding the effectiveness of 2 methods of instruction on student achievement. Using the chart on the previous slide, state what is occurring with this particular hypothesis. What are ramifications of incorrect decisions?

Probability Level of significance or p = probability of being wrong to reject the null (to state there is a true difference, but in reality the difference is from chance) In general, research should be p <.05 to be considered significant.

Things that effect p Difference between 2 groups Sampling and/or measurement error Size of the sample

Steps in using inferential statistics 1. Select the test of significance 2. Determine whether significance test will be two-tailed or one tailed 3. Select α (alpha), the probability level (usually <.05) 4. Compute the test of significance 5. Consult table to determine the significance of the results

How to determine p Tests of Significance

Statistical formulas that enable the researcher to determine if there was a real difference between the sample means Examples –t test –ANOVA –Chi-square

t test Used to determine whether two means are significantly different at a selected probability level Adjusts for the fact that the distribution of scores for small samples becomes increasingly different from the normal distribution as sample sizes become increasingly smaller Sample t-tableSample t-tableSample t-tableSample t-table

t test If the t value is equal to or greater than the table value, then the null hypothesis is rejected because the difference is greater than would be expected due to chance

Reminder… Don’t forget the purpose. You are going through this statistical rigmarole because you want to know Could these observations really have occurred by chance?

ANOVA A comparison of the means for two or more groups Example - Do the mean scores differ for the groups using co-operative group, lecture, or web-based instruction? The assumption is that randomly formed groups of participants are chosen and are essentially the same at the beginning of a study on a measure of the dependent variable

ANOVA F value of ANOVA is similar to t-value in t-test. If F value is significant, you know there is a difference somewhere, but have to do post hoc tests to figure out where.

Chi-Square Tests differences in frequencies across different categories –Do mothers and fathers differ in their support of a year-round school calendar? –Do the percentages of undergraduate, graduate, and doctoral students differ in terms of their support for the new class attendance policy?

significance Some words about significance “Statistical significance” is a term that refers to some statistical criterion, usually the numerical value of some formula or calculation. “Practical significance” means its utility, and that is in the eyes of the beholder. What may be impractical to you or me may be very practical to someone else.

Practical Significance An Example – A new reading program shows improved comprehension scores that are statistically significant. However, it takes many hours and dollars to train teachers to use the program. Does it warrant buying the new program? Big Question: Is it practical to use the results?

“There is no magical or purely technical way to decide whether or not a statistically significant difference means you should do something different in your school. There are only tools that assist your judgment. There is no escape from using judgment.” --Gerald W. Bracey Reading Educational Research: How To Avoid Getting Statistically Snookered

Practical Significance Large sample sizes can produce a statistically significant result even though there is limited or no practical importance associated with the finding.

Effect Size Take into account variance, not just the means. Refers to the magnitude of a difference. Levels you should know d ≥.75 = large effect d ~.5 = moderate effect d ~.3 = small effect Good website on Effect Size

Evaluation Criteria Basic descriptive statistics are needed to evaluate the inferential results Inferential analyses report statistical significance, not practical significance Inferential analyses do not indicate internal or external validity The results depend on sample sizes

Evaluation Criteria The appropriate statistical procedures are used The level of significance is interpreted correctly