Now What?: I’ve Found Nothing

Slides:



Advertisements
Similar presentations
Inferential Statistics and t - tests
Advertisements

Small differences. Two Proportion z-Interval and z-Tests.
Reliability & Validity.  Limits all inferences that can be drawn from later tests  If reliable and valid scale, can have confidence in findings  If.
Statistical Techniques I EXST7005 Lets go Power and Types of Errors.
T-tests Computing a t-test  the t statistic  the t distribution Measures of Effect Size  Confidence Intervals  Cohen’s d.
PSY 307 – Statistics for the Behavioral Sciences
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Chapter 6 Hypotheses texts. Central Limit Theorem Hypotheses and statistics are dependent upon this theorem.
Lecture 2: Basic steps in SPSS and some tests of statistical inference
Using Statistics in Research Psych 231: Research Methods in Psychology.
Hypothesis Testing Is It Significant?. Questions What is a statistical hypothesis? What is the null hypothesis? Why is it important for statistical tests?
The Data Analysis Plan. The Overall Data Analysis Plan Purpose: To tell a story. To construct a coherent narrative that explains findings, argues against.
Means Tests Hypothesis Testing Assumptions Testing (Normality)
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 17 Inferential Statistics.
Section 9.2 Testing the Mean  9.2 / 1. Testing the Mean  When  is Known Let x be the appropriate random variable. Obtain a simple random sample (of.
Reliability Chapter 3. Classical Test Theory Every observed score is a combination of true score plus error. Obs. = T + E.
Reliability Chapter 3.  Every observed score is a combination of true score and error Obs. = T + E  Reliability = Classical Test Theory.
Copyright © 2012 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 19 Process of Quantitative Data Analysis and Interpretation.
Statistics (cont.) Psych 231: Research Methods in Psychology.
Hypothesis Testing A procedure for determining which of two (or more) mutually exclusive statements is more likely true We classify hypothesis tests in.
Inference and Inferential Statistics Methods of Educational Research EDU 660.
Measurement Models: Exploratory and Confirmatory Factor Analysis James G. Anderson, Ph.D. Purdue University.
1 Inferences About The Pearson Correlation Coefficient.
Elementary statistics for foresters Lecture 5 Socrates/Erasmus WAU Spring semester 2005/2006.
Introduction to Hypothesis Testing: the z test. Testing a hypothesis about SAT Scores (p210) Standard error of the mean Normal curve Finding Boundaries.
Constructing hypotheses & research design. The definition of a hypothesis A tentative proposition. Its validity is unknown. It specifies a relationship.
Inferences Concerning Variances
URBDP 591 I Lecture 4: Research Question Objectives How do we define a research question? What is a testable hypothesis? How do we test an hypothesis?
“Significance” in Strategic Management Research Steve Werner Department of Management Bauer College of Business University of Houston.
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
Review: Stages in Research Process Formulate Problem Determine Research Design Determine Data Collection Method Design Data Collection Forms Design Sample.
T tests comparing two means t tests comparing two means.
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 10: Correlational Research 1.
Regression. Why Regression? Everything we’ve done in this class has been regression: When you have categorical IVs and continuous DVs, the ANOVA framework.
Ex St 801 Statistical Methods Part 2 Inference about a Single Population Mean (HYP)
Chapter Nine Hypothesis Testing.
Statistical Significance
Psych 231: Research Methods in Psychology
Introduction to Hypothesis Test – Part 2
Hypothesis Testing Is It Significant?.
Constructing hypotheses & research design
Two-Sample Hypothesis Testing
Hypothesis Testing I The One-sample Case
INTRODUCTORY STATISTICS FOR CRIMINAL JUSTICE
STA 291 Spring 2010 Lecture 18 Dustin Lueker.
Understanding Results
Hypothesis testing March 20, 2000.
© LOUIS COHEN, LAWRENCE MANION AND KEITH MORRISON
Hypothesis Testing Is It Significant?.
Regression.
Hypothesis Testing: Hypotheses
Making Sense of Advanced Statistical Procedures in Research Articles
Scales & Indices.
Example Problem 3.24 Complete analysis.
Chapter Nine Part 1 (Sections 9.1 & 9.2) Hypothesis Testing
Hypothesis Tests for Proportions
Psych 231: Research Methods in Psychology
Introduction to Hypothesis Testing
Psych 231: Research Methods in Psychology
Psych 231: Research Methods in Psychology
Power Section 9.7.
Doing t-tests by hand.
Chapter 8 Hypothesis Tests
Chapter 8 Making Sense of Statistical Significance: Effect Size, Decision Errors, and Statistical Power.
Psych 231: Research Methods in Psychology
Inference for Sampling
Psych 231: Research Methods in Psychology
STA 291 Summer 2008 Lecture 18 Dustin Lueker.
Hypotheses.
UCLA Department of Medicine
Presentation transcript:

Now What?: I’ve Found Nothing Steve Werner Department of Management Bauer College of Business University of Houston

Overview So What? Re-evaluate your data Re-evaluate your measures Re-evaluate your analyses Re-evaluate your sample Re-evaluate your study design Re-evaluate your hypotheses Re-evaluate your theory Conclusion

So What? Publication bias against no results. Something’s wrong. Bias against null hypotheses (well-deserved).

Re-evaluate Your Data Look for entry errors. Look for non-normality. Look for outliers. Look for excessive missing data. Look for suspicious patterns.

Re-evaluate Your Measures Look at reliability: a. errors in reverse scoring. b. bad items. c. too few items. Look at the dimensionality of the measure. Look at combining measures. Look at difference score measures. Look at single item measures. Consider new measures, variables, and constructs.

Re-evaluate Your Analyses Over-specified model? Under-specified model? Suppressor variables? Multi-collinearity? Consider different techniques.

Re-evaluate Your Sample Look at sub-samples. Range restriction? Consider increasing sample size.

Re-evaluate Your Study Design Do a power analysis Increase sample size Relax alpha 1-tailed significance tests Any way to reduce error variance?

Re-evaluate Your Hypotheses Consider rewording hypotheses to make testing easier. Consider moderator hypotheses. Eliminate main effect hypotheses. Consider mediator hypotheses.

Re-evaluate Your Theory Consider theory boundaries. Consider alternative theories. Consider theory limitations.

Conclusion So What? Re-evaluate your data Re-evaluate your measures Re-evaluate your analyses Re-evaluate your sample Re-evaluate your study design Re-evaluate your hypotheses Re-evaluate your theory Conclusion