Sensitivity, Specificity, and Receiver- Operator Characteristic Curves 10/10/2013.

Slides:



Advertisements
Similar presentations
Unlocking the Mysteries of Hypothesis Testing
Advertisements

Type I & Type II errors Brian Yuen 18 June 2013.
Lecture 3 Validity of screening and diagnostic tests
Anthony Greene1 Simple Hypothesis Testing Detecting Statistical Differences In The Simplest Case:  and  are both known I The Logic of Hypothesis Testing:
Statistics.  Statistically significant– When the P-value falls below the alpha level, we say that the tests is “statistically significant” at the alpha.
 When we perform a hypothesis test, we make a decision to either Reject the Null Hypothesis or Fail to Reject the Null Hypothesis.  There is always the.
Step 3: Critically Appraising the Evidence: Statistics for Diagnosis.
From the homework: Distribution of DNA fragments generated by Micrococcal nuclease digestion mean(nucs) = bp median(nucs) = 110 bp sd(nucs+ = 17.3.
Ch. 21 Practice.
Statistical Decision Making
Statistical Significance What is Statistical Significance? What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant?
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Evaluating Hypotheses Chapter 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics.
Statistical Significance What is Statistical Significance? How Do We Know Whether a Result is Statistically Significant? How Do We Know Whether a Result.
Power. The Four Components to a Statistical Conclusion The number of units (e.g., people) accessible to study The salience of the program relative to.
Chapter 6 Hypotheses texts. Central Limit Theorem Hypotheses and statistics are dependent upon this theorem.
Evaluating Hypotheses Chapter 9 Homework: 1-9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics ~
ROC Curve and Classification Matrix for Binary Choice Professor Thomas B. Fomby Department of Economics SMU Dallas, TX February, 2015.
Descriptive Statistics
Diagnosis Concepts and Glossary. Cross-sectional study The observation of a defined population at a single point in time or time interval. Exposure and.
Overview of Statistical Hypothesis Testing: The z-Test
Testing Hypotheses I Lesson 9. Descriptive vs. Inferential Statistics n Descriptive l quantitative descriptions of characteristics n Inferential Statistics.
Descriptive statistics Inferential statistics
Hypothesis Testing.
Tuesday, September 10, 2013 Introduction to hypothesis testing.
Chapter 8 Introduction to Hypothesis Testing
1/2555 สมศักดิ์ ศิวดำรงพงศ์
Medical decision making. 2 Predictive values 57-years old, Weight loss, Numbness, Mild fewer What is the probability of low back cancer? Base on demographic.
Non-Traditional Metrics Evaluation measures from the Evaluation measures from the medical diagnostic community medical diagnostic community Constructing.
Individual values of X Frequency How many individuals   Distribution of a population.
Screening and Diagnostic Testing Sue Lindsay, Ph.D., MSW, MPH Division of Epidemiology and Biostatistics Institute for Public Health San Diego State University.
MEASURES OF TEST ACCURACY AND ASSOCIATIONS DR ODIFE, U.B SR, EDM DIVISION.
Appraising A Diagnostic Test
CHAPTER 9 Testing a Claim
Sampling and Probability Chapter 5. Sampling & Elections >Problems with predicting elections: Sample sizes are too small Samples are biased (also tied.
HYPOTHESIS TESTING Null Hypothesis and Research Hypothesis ?
Prediction statistics Prediction generally True and false, positives and negatives Quality of a prediction Usefulness of a prediction Prediction goes Bayesian.
26134 Business Statistics Tutorial 11: Hypothesis Testing Introduction: Key concepts in this tutorial are listed below 1. Difference.
26134 Business Statistics Tutorial 12: REVISION THRESHOLD CONCEPT 5 (TH5): Theoretical foundation of statistical inference:
Hypothesis Testing and the T Test. First: Lets Remember Z Scores So: you received a 75 on a test. How did you do? If I said the mean was 72 what do you.
Hypothesis Testing Introduction to Statistics Chapter 8 Feb 24-26, 2009 Classes #12-13.
HYPOTHESIS TESTING Null Hypothesis and Research Hypothesis ?
Laboratory Medicine: Basic QC Concepts M. Desmond Burke, MD.
The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers CHAPTER 9 Testing a Claim 9.2 Tests About a Population.
Chapter 13 Understanding research results: statistical inference.
Hypothesis Testing Steps for the Rejection Region Method State H 1 and State H 0 State the Test Statistic and its sampling distribution (normal or t) Determine.
Chapter 9: Hypothesis Tests for One Population Mean 9.2 Terms, Errors, and Hypotheses.
PTP 560 Research Methods Week 12 Thomas Ruediger, PT.
Handbook for Health Care Research, Second Edition Chapter 11 © 2010 Jones and Bartlett Publishers, LLC CHAPTER 11 Statistical Methods for Nominal Measures.
Hypothesis Testing and Statistical Significance
Diagnostic Likelihood Ratio Presented by Juan Wang.
Diagnosis:Testing the Test Verma Walker Kathy Davies.
CHAPTER 3 Key Principles of Statistical Inference.
Chapter 9 Hypothesis Testing Understanding Basic Statistics Fifth Edition By Brase and Brase Prepared by Jon Booze.
Tutorial 11: Hypothesis Testing
CHAPTER 9 Testing a Claim
Hypothesis Testing I The One-sample Case
Chapter 6 Making Sense of Statistical Significance: Decision Errors, Effect Size and Statistical Power Part 1: Sept. 24, 2013.
Random error, Confidence intervals and P-values
P-value Approach for Test Conclusion
Refining Probability Test Informations Vahid Ashoorion MD. ,MSc,
Chapter 9 Hypothesis Testing
One Way ANOVAs One Way ANOVAs
Sample Mean Compared to a Given Population Mean
Sample Mean Compared to a Given Population Mean
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Testing Hypotheses I Lesson 9.
Statistical Power.
Evidence Based Diagnosis
Presentation transcript:

Sensitivity, Specificity, and Receiver- Operator Characteristic Curves 10/10/2013

Definition Sensitivity: the fraction of all those with the disease who get a positive test result. C/(C+D) Specificity: the fraction of those without the disease who get a negative test result. B/(B+A) Positive predictive value: True positives/All positive results, C/(A+C) Negative predictive value: True negatives/All negative results, B/(B+D) DECISION: ABNORMAL DECISION: NORMAL TEST RESULT TEST RESULT TOTAL Disease absent A B A+B Disease present C D C+D Total A+C B+D A+B+C+D False positive False negative True negative True positive False-positive and false-negative lab results are similar to Type1 and Type II errors in statistical hypothesis testing. DECISION: REJECT DECISION: DO NOT REGECT NULL HYPOTHESIS NULL HYPOTHESIS Null hypothesis is true Type I error Null hypothesis is false Type II error

DECISION:ABNORMAL DECISION: NORMAL TEST RESULT TEST RESULT TOTAL Disease absent 36, , ,900 Disease present Total 37, ,000,000 Expected results of resulting one million people with porphyria test from a population with a prevalence of 0.01%. 82% of patients with porphyria have an abnormal test result; 3.7% of normal people have an abnormal test result. What is the likelihood that a patient has porphyria? (Or positive predictive value) The lower the prevalence of the disease, the lower the ratio of true positives to false positives. 82/37078≈0.002

Relationships between sensitivity and power and specificity and alpha Power or Sensitivity Specificity

Receive Operator Characteristic Curves (ROC) Threshold high low Sensitivity Specificity Sensitivity Specificity Tradeoff between sensitivity and specificity in one diagnostic test The threshold can help to separate a clinical diagnosis of normal from one of abnormal Optimal threshold, how to find? If interested, Please search it on the internet.

Interpreting clinical laboratory tests: One condition: what you know about the clinical context Another condition: what you learn from the lab test

Bayes, Genetic Linkage and Log of Odds (LOD)scores Why do geneticists usually conclude on studies of linkage: if a LOD score equals or exceeds 3, the marker and disease are considered to be linked? if a LOD score is less than or equal to -2, the marker and disease are not linked ? if a LOD score is between -2 and 3, the evidence is not conclusive ? Using Bayesian logic: Posttest odds of linkage=pretest odds of linkage. Likelihood ratio (1)Common definitions of linkage, 2% of randomly selected marker are linked to any particular disease gene. So odds=2%/(1-2%) ≈ (2)If a LOD score=3, converting likelihood ratio=10^3 =1000 (3) The posttest odds of linkage=0.02X1000=20 (4) Converting to possibility =20/(1+20)=20/21≈0.95, that is to say, the probability that the marker and disease are truly linked 95%. There is 95% chance that you will be correct, leaving a 5%chance that you will be wrong