Academic Viva POWER and ERROR T R Wilson. Impact Factor Measure reflecting the average number of citations to recent articles published in that journal.

Slides:



Advertisements
Similar presentations
Type I & Type II errors Brian Yuen 18 June 2013.
Advertisements

Anthony Greene1 Simple Hypothesis Testing Detecting Statistical Differences In The Simplest Case:  and  are both known I The Logic of Hypothesis Testing:
Inference Sampling distributions Hypothesis testing.
INT 506/706: Total Quality Management Lec #9, Analysis Of Data.
Chapter 8 Hypothesis Testing I. Significant Differences  Hypothesis testing is designed to detect significant differences: differences that did not occur.
Fundamentals of Hypothesis Testing. Identify the Population Assume the population mean TV sets is 3. (Null Hypothesis) REJECT Compute the Sample Mean.
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Sample size computations Petter Mostad
Cal State Northridge  320 Ainsworth Sampling Distributions and Hypothesis Testing.
PSY 1950 Confidence and Power December, Requisite Quote “The picturing of data allows us to be sensitive not only to the multiple hypotheses that.
Independent Sample T-test Often used with experimental designs N subjects are randomly assigned to two groups (Control * Treatment). After treatment, the.
Incidence, Prevalence and 95% Confidence Intervals Tom Walker and Matt Newman.
Independent Sample T-test Classical design used in psychology/medicine N subjects are randomly assigned to two groups (Control * Treatment). After treatment,
Chapter 9 Hypothesis Testing II. Chapter Outline  Introduction  Hypothesis Testing with Sample Means (Large Samples)  Hypothesis Testing with Sample.
AM Recitation 2/10/11.
Testing Hypotheses I Lesson 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics n Inferential Statistics.
Overview Definition Hypothesis
Sampling Distributions and Hypothesis Testing. 2 Major Points An example An example Sampling distribution Sampling distribution Hypothesis testing Hypothesis.
Section 9.1 Introduction to Statistical Tests 9.1 / 1 Hypothesis testing is used to make decisions concerning the value of a parameter.
1/2555 สมศักดิ์ ศิวดำรงพงศ์
1 Today Null and alternative hypotheses 1- and 2-tailed tests Regions of rejection Sampling distributions The Central Limit Theorem Standard errors z-tests.
Jan 17,  Hypothesis, Null hypothesis Research question Null is the hypothesis of “no relationship”  Normal Distribution Bell curve Standard normal.
1 Power and Sample Size in Testing One Mean. 2 Type I & Type II Error Type I Error: reject the null hypothesis when it is true. The probability of a Type.
Health and Disease in Populations 2001 Sources of variation (2) Jane Hutton (Paul Burton)
Topics: Statistics & Experimental Design The Human Visual System Color Science Light Sources: Radiometry/Photometry Geometric Optics Tone-transfer Function.
Chapter 8 Hypothesis Testing I. Chapter Outline  An Overview of Hypothesis Testing  The Five-Step Model for Hypothesis Testing  One-Tailed and Two-Tailed.
Hypothesis Testing: One Sample Cases. Outline: – The logic of hypothesis testing – The Five-Step Model – Hypothesis testing for single sample means (z.
Hypothesis testing Chapter 9. Introduction to Statistical Tests.
Inferential Statistics 2 Maarten Buis January 11, 2006.
Instructor Resource Chapter 5 Copyright © Scott B. Patten, Permission granted for classroom use with Epidemiology for Canadian Students: Principles,
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
The Practice of Statistics Third Edition Chapter 10: Estimating with Confidence Copyright © 2008 by W. H. Freeman & Company Daniel S. Yates.
Hypotheses tests for means
1 Chapter 10: Introduction to Inference. 2 Inference Inference is the statistical process by which we use information collected from a sample to infer.
Statistical Hypotheses & Hypothesis Testing. Statistical Hypotheses There are two types of statistical hypotheses. Null Hypothesis The null hypothesis,
Large sample CI for μ Small sample CI for μ Large sample CI for p
S-012 Testing statistical hypotheses The CI approach The NHST approach.
How to read a paper D. Singh-Ranger. Academic viva 2 papers 1 hour to read both Viva on both papers Summary-what is the paper about.
Statistical Inference for the Mean Objectives: (Chapter 9, DeCoursey) -To understand the terms: Null Hypothesis, Rejection Region, and Type I and II errors.
Ch 10 – Intro To Inference 10.1: Estimating with Confidence 10.2 Tests of Significance 10.3 Making Sense of Statistical Significance 10.4 Inference as.
Chapter 8 Parameter Estimates and Hypothesis Testing.
MeanVariance Sample Population Size n N IME 301. b = is a random value = is probability means For example: IME 301 Also: For example means Then from standard.
Copyright © 2011 Pearson Education, Inc. Putting Statistics to Work.
Ex St 801 Statistical Methods Inference about a Single Population Mean.
Lecture & tutorial material prepared by: Dr. Shaffi Shaikh Tutorial presented by: Dr. Rufaidah Dabbagh Dr. Nurah Al-Amro.
Chapter 8 Hypothesis Testing I. Significant Differences  Hypothesis testing is designed to detect significant differences: differences that did not occur.
Monday, October 22 Hypothesis testing using the normal Z-distribution. Student’s t distribution. Confidence intervals.
Chapter 10 The t Test for Two Independent Samples
Hypothesis Testing and the T Test. First: Lets Remember Z Scores So: you received a 75 on a test. How did you do? If I said the mean was 72 what do you.
AP Statistics Chapter 11 Notes. Significance Test & Hypothesis Significance test: a formal procedure for comparing observed data with a hypothesis whose.
Monday, October 21 Hypothesis testing using the normal Z-distribution. Student’s t distribution. Confidence intervals.
Chapter 13 Understanding research results: statistical inference.
Hypothesis Testing. Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean μ = 120 and variance σ.
Ex St 801 Statistical Methods Inference about a Single Population Mean (CI)
Hypothesis Testing and Statistical Significance
Statistical Inference for the Mean Objectives: (Chapter 8&9, DeCoursey) -To understand the terms variance and standard error of a sample mean, Null Hypothesis,
Prof. Robert Martin Southeastern Louisiana University.
Critical Appraisal Course for Emergency Medicine Trainees Module 2 Statistics.
Hypothesis Testing.
Statistics for the Social Sciences
Tests of Significance The reasoning of significance tests
How to read a paper D. Singh-Ranger.
Quantitative Methods PSY302 Quiz Chapter 9 Statistical Significance
Statistical inference
Monday, October 19 Hypothesis testing using the normal Z-distribution.
Hypothesis Testing.
Hypothesis Testing II ?10/10/1977?.
Significance Test for a Mean
Type I and Type II Errors
Statistical inference
Presentation transcript:

Academic Viva POWER and ERROR T R Wilson

Impact Factor Measure reflecting the average number of citations to recent articles published in that journal. For given year, the average number of citations received per paper published from that journal during the two preceding years. E.g. The 2008 impact factor of a journal is Number of times all items published in that journal in 2006 and 2007 were cited by indexed publications during 2008 The total number of "citable items" (not letters or editorials) published by that journal in 2006 and 2007

Concept of sampling We are interested in attribute of a population Can’t measure attribute in everyone Therefore we need a representative sample – Random, Unbiased If representative, attribute in sample → estimation of attribute in population Size of sample is important – ↑ sample size →↑accuracy of estimate

Statistically speaking Measure attribute in sample – → Sample Mean Estimate of population mean – 95% confidence interval (CI) of sample mean – = 95% chance that the population mean lies within the CI Confidence interval depends on size sample – Larger the sample → the smaller the CI – Smaller the CI → more accurate the estimation

Concept statistical testing Interested in difference between an attribute in two populations Take two samples (one from each population) – Measure attribute in each sample – Calculate the difference between the attributes in the two samples – Use this to estimate the difference between the attribute in the two populations – Similarly can produce a statistical estimation of true difference with confidence intervals

Concept Null hypothesis From statistical stand point – Assumption no difference between the groups – (Null hypothesis = H 0 ) In the two samples you will almost always find a difference – Is that difference TRUE? (reject Null hypothesis) – Is there really no difference ? (Don’t Reject H 0 ) Need statistical test → P value

P Value - definition If you assume that there is no difference in the populations, P value = Probability of finding a difference that large in the samples Small P value – Very unlikely that the observed difference in the samples occurred by chance – Therefore likely to be a difference in populations If P < 0.05 (5%) → difference in sample is unlikely to be coincidental = (statistically) significant

P value and Confidence Interval Significant result (p value is <0.05) ≡ 95% CI estimation of population difference will not include 0

Error Statistical testing is not infallible Risk of getting a significant result when there is no difference in the populations – False positive (OPTIMISTIC) – Probability of this = TYPE I Error Risk of not getting a significant result when there really is a difference in the populations – False negative (PESSIMISTIC) – Probability of this = TYPE II Error

Type I ERROR Even if the P value is small (e.g. p=0.001), there is still a chance that you could have seen the same difference in your samples when there really isn’t any difference in the population (e.g. 1 in 1000) If you took 1000 samples of the two populations with the same mean for testing, one of these 1000 tests would be significant TYPE I ERROR = Level of significance

Type II Error TYPE II Error If there is a difference between two populations then 95% CI should exclude 0 If the Sample size is small → the 95%CI for the population difference will be wide and more likely to include 0 giving a false negative result The Type II error can be reduced by increasing the sample size

POWER POWER is opposite of TYPE II ERROR TYPE II ERROR = Probability of not getting a significant result when there really is a difference in the population means POWER = Probability of getting a significant result when there is a difference in the population means POWER = 100 – TYPE II ERROR

Calculating Power Complicated calculation Requires – Sample size (both samples) – Difference in samples – The spread (standard deviation) of (both) samples – Statistical level of significance of test (usually 5%) ↑Power with – ↑Sample size – ↑Difference – ↑ Level Significance – ↓ Standard deviation

Calculating Sample Size Same as equation as for power calculation Requires – Size of difference you want to detect – Estimation of standard deviation in samples – Statistical level of significance of test (usually 5%) – Power that you want test to have (usually 80%) ↑sample size needed for – Small difference – ↑ Standard deviation – ↓ Level Significance (1%) – ↑ Power

Beware Errors TYPE I: If a paper does 20 tests at 5% level on two similar populations one of these is likely to be significant TYPE 2: If the study is underpowered and concludes that there is no difference in the main outcome when it looks like there might be (unlikely) TYPE 2: If paper measures a secondary outcome that it is underpowered to detect and concludes that there is no significant difference when it looks like there might be

Guide for assessing RCTs