Likelihood 2005/5/22. Likelihood  probability I am likelihood I am probability.

Slides:



Advertisements
Similar presentations
Dichotomous Tests (Tom). Their results change the probability of disease Negative testPositive test Reassurance Treatment Order a Test A good test moves.
Advertisements

DiseaseNo disease 60 people with disease 40 people without disease Total population = 100.
Power and sample size.
Step 3: Critically Appraising the Evidence: Statistics for Diagnosis.
TESTING A TEST Ian McDowell Department of Epidemiology & Community Medicine November, 2004.
Diagnostic Tests Patrick S. Romano, MD, MPH Professor of Medicine and Pediatrics Patrick S. Romano, MD, MPH Professor of Medicine and Pediatrics.
Receiver Operating Characteristic (ROC) Curves
What Happens to the Performance of a Diagnostic Test when the Disease Prevalence and the Cut-Point Change? Pathological scores Healthy scores Healthy population.
CRITICAL APPRAISAL Dr. Cristina Ana Stoian Resident Journal Club
Epidemiology in Medicine Sandra Rodriguez Internal Medicine TTUHSC.
Statistical Fridays J C Horrow, MD, MSSTAT
Making sense of Diagnostic Information Dr Carl Thompson.
Screening for Disease Guan Peng Department of Epidemiology School of Public Health, CMU.
Judgement and Decision Making in Information Systems Diagnostic Modeling: Bayes’ Theorem, Influence Diagrams and Belief Networks Yuval Shahar, M.D., Ph.D.
DIAGNOSTIC TESTS Assist. Prof. E. Çiğdem Kaspar Yeditepe University Faculty of Medicine Department of Biostatistics and Medical Informatics.
Interpreting Diagnostic Tests
Diagnosis Concepts and Glossary. Cross-sectional study The observation of a defined population at a single point in time or time interval. Exposure and.
Statistics in Screening/Diagnosis
BASIC STATISTICS: AN OXYMORON? (With a little EPI thrown in…) URVASHI VAID MD, MS AUG 2012.
Medical decision making. 2 Predictive values 57-years old, Weight loss, Numbness, Mild fewer What is the probability of low back cancer? Base on demographic.
DEB BYNUM, MD AUGUST 2010 Evidence Based Medicine: Review of the basics.
Basic statistics 11/09/13.
Division of Population Health Sciences Royal College of Surgeons in Ireland Coláiste Ríoga na Máinleá in Éirinn Indices of Performances of CPRs Nicola.
Statistics for nMRCGP Jo Kirkcaldy. Curriculum Condensed Knowledge Incidence and prevalence Specificity and sensitivity Positive and negative predictive.
Vanderbilt Sports Medicine How to practice and teach EBM Chapter 3 May 3, 2006.
Session 4: Assessing a Document on Diagnosis Peter Tarczy-Hornoch MD Head and Professor, Division of BHI Professor, Division of Neonatology Adjunct Professor,
Sensitivity Sensitivity answers the following question: If a person has a disease, how often will the test be positive (true positive rate)? i.e.: if the.
Dichotomous Tests Thomas B. Newman, MD, MPH September 27, 2012 Thanks to Josh Galanter and Michael Shlipak 1.
1 Interpreting Diagnostic Tests Ian McDowell Department of Epidemiology & Community Medicine January 2012 Note to readers: you may find the additional.
Evidence Based Medicine Workshop Diagnosis March 18, 2010.
Statistics. Statistics = everything you need to know, but continually want to forget!!!!
Evaluation of Diagnostic Tests
BIOE 301 Lecture Thirteen. Review of Lecture 12 The burden of cancer Contrasts between developed/developing world How does cancer develop? Cell transformation.
Diagnosis: EBM Approach Michael Brown MD Grand Rapids MERC/ Michigan State University.
MEASURES OF TEST ACCURACY AND ASSOCIATIONS DR ODIFE, U.B SR, EDM DIVISION.
Evaluating Diagnostic Tests Payam Kabiri, MD. PhD. Clinical Epidemiologist Tehran University of Medical Sciences.
Appraising A Diagnostic Test
Evidence-Based Medicine Diagnosis Component 2 / Unit 5 1 Health IT Workforce Curriculum Version 1.0 /Fall 2010.
1 Risk Assessment Tests Marina Kondratovich, Ph.D. OIVD/CDRH/FDA March 9, 2011 Molecular and Clinical Genetics Panel for Direct-to-Consumer (DTC) Genetic.
TESTING A TEST Ian McDowell Department of Epidemiology & Community Medicine January 2008.
Prediction statistics Prediction generally True and false, positives and negatives Quality of a prediction Usefulness of a prediction Prediction goes Bayesian.
Screening of diseases Dr Zhian S Ramzi Screening 1 Dr. Zhian S Ramzi.
Positive Predictive Value and Negative Predictive Value
1 Wrap up SCREENING TESTS. 2 Screening test The basic tool of a screening program easy to use, rapid and inexpensive. 1.2.
Predictive values prevalence CK and acute myocardial infarction –sensitivity 70% –specificity 80% –prevalence - 40% –prevalence - 20% –PPV and NPV.
Diagnostic Tests Studies 87/3/2 “How to read a paper” workshop Kamran Yazdani, MD MPH.
Diagnostic Test Characteristics: What does this result mean
Screening.  “...the identification of unrecognized disease or defect by the application of tests, examinations or other procedures...”  “...sort out.
1 Medical Epidemiology Interpreting Medical Tests and Other Evidence.
/ 101 Saudi Diploma in Family Medicine Center of Post Graduate Studies in Family Medicine EBM Diagnostic Tests Dr. Zekeriya Aktürk
Laboratory Medicine: Basic QC Concepts M. Desmond Burke, MD.
Diagnosis Examination(MMSE) in detecting dementia among elderly patients living in the community. Excel.
Timothy Wiemken, PhD MPH Assistant Professor Division of Infectious Diseases Diagnostic Tests.
PTP 560 Research Methods Week 12 Thomas Ruediger, PT.
Diagnostic Likelihood Ratio Presented by Juan Wang.
Biostatistics Board Review Parul Chaudhri, DO Family Medicine Faculty Development Fellow, UPMC St Margaret March 5, 2016.
Critical Appraisal Course for Emergency Medicine Trainees Module 5 Evaluation of a Diagnostic Test.
Diagnostic Test Studies
Sensitivity and Specificity
Introduction to Diagnostic Test Accuracy Prima Conferinta a Societatii Nationale de Metodologie si Statistica Medicala Professor Ario Santini MD,BDS,DDS,PhD,FDS,FFGDP,DGDP(UK),DipFMed,FADM.
Evidence-Based Medicine
Class session 7 Screening, validity, reliability
بسم الله الرحمن الرحيم Clinical Epidemiology
Diagnosis II Dr. Brent E. Faught, Ph.D. Assistant Professor
Refining Probability Test Informations Vahid Ashoorion MD. ,MSc,
کارگاه تکميلی کشوری تربيت مربی آموزش طب مبتنی بر شواهد
Figure 1. Table for calculating the accuracy of a diagnostic test.
Patricia Butterfield & Naomi Chaytor October 18th, 2017
Computation of Post Test Probability
The two-step Fagan's nomogram.
Presentation transcript:

Likelihood 2005/5/22

Likelihood  probability I am likelihood I am probability

Two meaning of likelihood ratio To statistician, likelihood is a mathematical function*: For x successes in n Bernoulli trials To clinican, likelihood is a notion, a ratio, an odds: * LR = [True positive rate]/[False positive rate]

DiseaseNo Disease Positive test Positive Negative test Negative

DiseaseNo Disease Positive test True Positive Negative test True Negative

DiseaseNo Disease Positive test False Positive Negative test False Negative

Validation of the test DiseaseNo Disease Positive test TrueFalse Positive Negative test FalseTrue Negative Known

Sensitivity who have the disease will have a positive test DiseaseNo Disease Positive test TPFP Negative test FNTN Disease Positive test Sensitivity Sn = = TP + FN TP

Specificity who have no disease will have a negative test DiseaseNo Disease Positive test TPFP Negative test FNTN No Disease Negative test Specificity Sp = = FP + TN FP

Clinical setting DiseaseNo Disease Positive test TrueFalse Positive Negative test FalseTrue Negative unknown only the test result is known

DiseaseNo Disease Positive test TPFP Negative test FNTN Disease Positive test Positive Predictive value PPV = = TP + FP TP Positive Predictive Value who have positive test will have disease

Negative Predictive Value who have negative test will not have disease DiseaseNo Disease Positive test TPFP Negative test FNTN No Disease Negative test Negative Predictive Value NPV = = TN + FN

Assumption the prevalence of disease among the population of patient likely to be tested is the same as in the sample

DiseaseNo Disease Positive test TPFP Negative test FNTN Disease Positive test Positive Likelihood LR+ == TP + FP TP Positive Likelihood how a positive test more likely in patient who have disease than who do not have the disease Positive test No Disease FN FP + TN Sensitivity 1- Specificity

DiseaseNo Disease Positive test TPFP Negative test FNTN Disease Negative test Negative Likelihood LR- == TP + TN FN Negative test No Disease FN FP + TN Negative Likelihood how a negative test more likely in patient who have disease than who do not have the disease 1- Sensitivity Specificity

Disease Negative test Negative Likelihood LR- == TP + TN FN Negative test No Disease FN FP + TN Disease Positive test Positive Likelihood LR+ == TP + FP TP Positive test No Disease FN FP + TN What is the advantage of Likelihood? Sensitivity 1- Specificity 1- Sensitivity Specificity One single parameter incorporate Sn and Sp without prevalence!

Disease Negative test Negative Likelihood LR- == TP + TN FN Negative test No Disease FN FP + TN Disease Positive test Positive Likelihood LR+ == TP + FP TP Positive test No Disease FN FP + TN What is the advantage of Likelihood? This is 1/pre-test odds! Post-test Odds only give FN rate, not NPV

Therefore… Pre-test Odds Post-test Odds LR+ ×= Prevalence Post test probability PPV = Odds = p/(1-p) p=odds/(1+ odds)

But the converse is not true Pre-test Odds Post-test Odds LR - ×= Prevalence Post test probability FN rate = This is NOT NPV

DiseaseNo disease Positive Test TPFN Negative Test FPTN Prevalence = = Accuracy TP + FP + TN + FN TP FP Disease + Accurate results TP TN +

Exam paper 2004 June 1 D+D- T T D+D- T T TTT: Sn 0.9, Sp 0.75 TTT2: Sn 0.95, Sp 0.70 Prevalence = 0.4; pre-test odds =0.4/(1-0.4) =0.4/0.6= 2/3 =0.67 B4: LR+ = 0.9/(1-0.75) = 3.6 LR- = (1-0.9)/0.75 = B4: LR+ = 0.95/(1-0.70) = 3.17 LR- = (1-0.95)/0.7 = 0.07 B1: post-test Odds = 0.67 X 3.6 = 2.4 PPV = 2.4/ (2.4+1) = B1’: simply, PPV = 380/( ) =0.68 B2: NPV = 450/(40+450) =0.918 B3: Accuracy = ( )/1000=0.81B3: Accuracy = ( )/1000=0.8

What would happen if prevalence decrease? Examination paper 2003/6/2 B2b B2c

DiseaseNo Disease Positive test TPFP Negative test FNTN DiseaseNo Disease Positive test ab Negative test cd Sn= a a + c Sp= b b + d +PV= a a + b -PV= d c + d p= a + c a + b+ c + d LR+= a a + c d b + d LR-= c a + c d b + d No change

Advantage of Likelihood ratio as a measure of the usefulness of a test 1.comprise both sensitivity and specificity in one single parameter 2.do not depend on the disease prevalence 3.multilevel likelihood ratios enable us summarize the information contained in a test results over all the entire possible values. Test results can be represented by the degree of abnormality, rather than crude presence or absence of it. 4.Calculation of pretest and posttest odds is easier. 5.easier to calculate the overall probability of disease when a series of diagnostic tests is used.

Disadvantage of LR Use of odds instead of probability is more difficult. calculation of post-test probability requires maths or use of nomogram

Why use Odds but not probability? Why use OR but not Relative risk?

Odds Odds ratio is ratio of probability is ratio of Odds is ratio of ratios of probabilities

Odds Grand Round /5/19

Reference elihood.htmlhttp://mathworld.wolfram.com/MaximumLik elihood.html htmlhttp:// html Diagnostic test 4: likelihood ratios, BMJ 2004;329;