“Significance” in Strategic Management Research Steve Werner Department of Management Bauer College of Business University of Houston.

Slides:

Advertisements

Similar presentations

Introduction to Hypothesis Testing

Advertisements

Topics

Significance Testing.  A statistical method that uses sample data to evaluate a hypothesis about a population  1. State a hypothesis  2. Use the hypothesis.

Statistics 101 Class 8. Overview Hypothesis Testing Hypothesis Testing Stating the Research Question Stating the Research Question –Null Hypothesis –Alternative.

Ch. 21 Practice.

6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.

Confidence Intervals, Effect Size and Power

Decision Errors and Statistical Power Overview –To understand the different kinds of errors that can be made in a significance testing context –To understand.

Behavioural Science II Week 1, Semester 2, 2002

Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.

Mean for sample of n=10 n = 10: t = 1.361df = 9Critical value = Conclusion: accept the null hypothesis; no difference between this sample.

I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=

Statistics 101 Class 9. Overview Last class Last class Our FAVORATE 3 distributions Our FAVORATE 3 distributions The one sample Z-test The one sample.

I.1 ii.2 iii.3 iv.4 1+1=. i.1 ii.2 iii.3 iv.4 1+1=

Independent Sample T-test Classical design used in psychology/medicine N subjects are randomly assigned to two groups (Control * Treatment). After treatment,

“There are three types of lies: Lies, Damn Lies and Statistics” - Mark Twain.

Significance Tests for Proportions Presentation 9.2.

Introduction to Testing a Hypothesis Testing a treatment Descriptive statistics cannot determine if differences are due to chance. A sampling error occurs.

Inferential Statistics

+ Quantitative Statistics: Chi-Square ScWk 242 – Session 7 Slides.

1/2555 สมศักดิ์ ศิวดำรงพงศ์

Learning Objectives In this chapter you will learn about the t-test and its distribution t-test for related samples t-test for independent samples hypothesis.

S519: Evaluation of Information Systems Social Statistics Inferential Statistics Chapter 8: Significantly significant.

Normal Distr Practice Major League baseball attendance in 2011 averaged 30,000 with a standard deviation of 6,000. i. What percentage of teams had between.

8.1.4 Can it still be factored? Factoring Completely I can factor out a common factor.

Smith/Davis (c) 2005 Prentice Hall Chapter Nine Probability, the Normal Curve, and Sampling PowerPoint Presentation created by Dr. Susan R. Burns Morningside.

Population Marginal Means Inference Two factor model with replication Two factor model with replication.

METHODS IN BEHAVIORAL RESEARCH NINTH EDITION PAUL C. COZBY Copyright © 2007 The McGraw-Hill Companies, Inc.

What Is The Average Hours You Spend On Your Phone Daily? Cristian Barrios Jacky Cortez Maria Canongo Period 2 Year ( )

Copyright © 2011 Pearson Education, Inc. Putting Statistics to Work.

Ex St 801 Statistical Methods Inference about a Single Population Mean.

Power and Sample Size Anquan Zhang presents For Measurement and Statistics Club.

Comparing Two Proportions. A new twist on some old ideas… When combining proportions we treat proportions and standard errors in much the same way as.

Hypothesis Testing Errors. Hypothesis Testing Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean.

Introduction to Testing a Hypothesis Testing a treatment Descriptive statistics cannot determine if differences are due to chance. Sampling error means.

European Patients’ Academy on Therapeutic Innovation The Purpose and Fundamentals of Statistics in Clinical Trials.

Descriptive and Inferential Statistics Descriptive statistics The science of describing distributions of samples or populations Inferential statistics.

Major Steps. 1.State the hypotheses.  Be sure to state both the null hypothesis and the alternative hypothesis, and identify which is the claim. H0H0.

T tests comparing two means t tests comparing two means.

Chapter 13 Understanding research results: statistical inference.

Hypothesis Testing Steps for the Rejection Region Method State H 1 and State H 0 State the Test Statistic and its sampling distribution (normal or t) Determine.

Hypothesis Testing. Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean μ = 120 and variance σ.

Chapter ?? 7 Statistical Issues in Research Planning and Evaluation C H A P T E R.

Chapter 9: Hypothesis Tests for One Population Mean 9.2 Terms, Errors, and Hypotheses.

7/27/03Copyright Ed Lipinski and Mesa Community College, All rights reserved. 1 Research Methods Summer 2009 Using Inferential Statistics.

 Confidence Intervals  Around a proportion  Significance Tests  Not Every Difference Counts  Difference in Proportions  Difference in Means.

AP Statistics Part IV – Inference: Conclusions with Confidence Chapter 10: Introduction to Inference 10.1Estimating with Confidence To make an inference.

Hypothesis Tests Large Sample Mean

Section 8.4 Day 2.

Hypothesis testing March 20, 2000.

Inferences On Two Samples

Section 11.2: Carrying Out Significance Tests

Chapter Review Problems

Chapter 6 Making Sense of Statistical Significance: Decision Errors, Effect Size and Statistical Power Part 1: Sept. 18, 2014.

Section 12.2: Tests about a Population Proportion

Statistical Inference

An overview to this point

Types of Control I. Measurement Control II. Statistical Control

Statistical Inference for Managers

Hypothesis tests in linear regression

Now What?: I’ve Found Nothing

Chapter 12 Power Analysis.

More About Tests Notes from

Chapter 7: Statistical Issues in Research planning and Evaluation

Hypothesis Testing and Confidence Intervals (Part 2): Cohen’s d, Logic of Testing, and Confidence Intervals Lecture 9 Justin Kern April 9, 2018.

Chapter 8 Making Sense of Statistical Significance: Effect Size, Decision Errors, and Statistical Power.

Sample Mean Compared to a Given Population Mean

Sample Mean Compared to a Given Population Mean

ESTIMATION OF THE MEAN AND PROPORTION

Part IV of AP Statistics

Presentation transcript:

“Significance” in Strategic Management Research Steve Werner Department of Management Bauer College of Business University of Houston

Overview The problems of statistical significance. The solutions. Conclusions.

The Problems of Statistical Significance 1. Statistical significance is not practical significance. 2. The conventional cut-offs are arbitrary and misleading. 3. Frequently occurring Type II errors.

Statistical Significance is not Practical Significance a. Practical significance is effect size and importance. b. Related but not the same. c. Statistical significance largely affected by n.

Conventional Cut-offs are Arbitrary and Misleading a. Convention is: i. p<.10 = marginally significant; ii. p<.05 = significant; iii. p<.01 = highly significant; iv. p<.001=very highly significant. b. p<.05 from Fisher (1925). c. Counters classical view of predetermining alpha. d. Simplifies hypothesis testing.

Frequently Occurring Type II Errors a. Studies conclude no relationship because findings not significant. b. Power issues. c. This occurs in 60% of all studies (Hunter, 1997).

The Solutions 1. Solutions to the practical significance problem. 2. Solutions to the conventional cut-offs problem. 3. Solutions to the frequently occurring Type II errors problem.

Solutions to the Practical Significance Problem a. Report confidence intervals. b. Report effect sizes. c. Avoiding using “significance”. d. Many journals still do not report effect sizes. e. SMJ: 98.5% of studies report effect sizes.

Solutions to the Arbitrary Cut-off Problem a. Go back to classical Neyman-Pearson hypothesis testing with researcher pre-determined alphas. b. Report actual p values (Fisher, 1956). c. Easier to accomplish now. d. SMJ: 13.4% (35/262) of studies report some actual p values.

Solutions to the Type II Error Problem a. Increase Power: i. Conduct power analyses; ii. Increase sample size; iii. Increase effect size. b. Relax alpha. c. SMJ: 65.6% (172/262) of studies use p<.10 as cut-off. d. Report actual p values.

Conclusion The problems of statistical significance. The solutions. Report actual p values. Consider p, power, effect size, sample size, and importance when evaluating research findings.