Positive Predictive Value and Negative Predictive Value

Slides:



Advertisements
Similar presentations
DiseaseNo disease 60 people with disease 40 people without disease Total population = 100.
Advertisements

Clinical Effectiveness: Interpreting test results Nick Price 17 th October 2006.
Conditional Probability
Step 3: Critically Appraising the Evidence: Statistics for Diagnosis.
TESTING A TEST Ian McDowell Department of Epidemiology & Community Medicine November, 2004.
GP 4001 Lecture Series Dealing with undifferentiated problems in primary care II.
Is it True? Evaluating Research about Diagnostic Tests
Laboratory Training for Field Epidemiologists Sensitivity and specificity Predictive values positive and negative Interpretation of results Sep 2007.
1 Case-Control Study Design Two groups are selected, one of people with the disease (cases), and the other of people with the same general characteristics.
What Happens to the Performance of a Diagnostic Test when the Disease Prevalence and the Cut-Point Change? Pathological scores Healthy scores Healthy population.
TUTORIAL SCREENING Dr. Salwa Tayel, Dr. A. Almazam, Dr Afzal Mahmood
Statistical Fridays J C Horrow, MD, MSSTAT
Baye’s Rule and Medical Screening Tests. Baye’s Rule Baye’s Rule is used in medicine and epidemiology to calculate the probability that an individual.
Statistics for Health Care
(Medical) Diagnostic Testing. The situation Patient presents with symptoms, and is suspected of having some disease. Patient either has the disease or.
What is Screening? Basic Public Health Concepts Sheila West, Ph.D. El Maghraby Professor of Ophthalmology Wilmer Eye Institute Johns Hopkins University.
Random Thoughts 2012 (COMP 066) Jan-Michael Frahm Jared Heinly.
EPIDEMIOLOGY Why is it so damn confusing?. Disease or Outcome Exposure ab cd n.
Information Mastery: A Practical Approach to Evidence-Based Care Course Directors: Allen Shaughnessy, PharmD, MMedEd David Slawson, MD Tufts Health Care.
Diagnosis Concepts and Glossary. Cross-sectional study The observation of a defined population at a single point in time or time interval. Exposure and.
Statistics in Screening/Diagnosis
BASIC STATISTICS: AN OXYMORON? (With a little EPI thrown in…) URVASHI VAID MD, MS AUG 2012.
Lecture 4: Assessing Diagnostic and Screening Tests
Basic statistics 11/09/13.
Statistics for Health Care Biostatistics. Phases of a Full Clinical Trial Phase I – the trial takes place after the development of a therapy and is designed.
Principles and Predictive Value of Screening. Objectives Discuss principles of screening Describe elements of screening tests Calculate sensitivity, specificity.
Statistics for nMRCGP Jo Kirkcaldy. Curriculum Condensed Knowledge Incidence and prevalence Specificity and sensitivity Positive and negative predictive.
Mafs Gareth What do the R & C in RCT mean?  Randomised – equal chance of receiving treatment  Control – there is a control.
Saudi Diploma in Family Medicine / 24 1 Dr. Zekeriya Aktürk Preventive Medicine and Periodic Health Examinations in Primary Care.
Statistics. Statistics = everything you need to know, but continually want to forget!!!!
BIOE 301 Lecture Thirteen. Review of Lecture 12 The burden of cancer Contrasts between developed/developing world How does cancer develop? Cell transformation.
MEASURES OF TEST ACCURACY AND ASSOCIATIONS DR ODIFE, U.B SR, EDM DIVISION.
Appraising A Diagnostic Test
Likelihood 2005/5/22. Likelihood  probability I am likelihood I am probability.
Chris and Abbie’s Vital Statistics. It’s actually quite dull!!! But......It is quite easy if you think it through. Arghhh Statistics...
1. Statistics Objectives: 1.Try to differentiate between the P value and alpha value 2.When to perform a test 3.Limitations of different tests and how.
Screening Puja Myles
SCREENING Dr. Aliya Hisam Community Medicine Dept. Army Medical College, RWP.
Screening and its Useful Tools Thomas Songer, PhD Basic Epidemiology South Asian Cardiovascular Research Methodology Workshop.
/ 131 A. Sattar Khan*, Zekeriya Akturk*, Turan Set** Wonca Europe, September 2008, Istanbul How to value a diagnostic test in family practice * Center.
Practical application. Population A ELISA test is applied to a million people where 1% are infected with HIV. Of the million people, 10,000 would be infected.
Predictive values prevalence CK and acute myocardial infarction –sensitivity 70% –specificity 80% –prevalence - 40% –prevalence - 20% –PPV and NPV.
Assist. Prof. Dr. Memet IŞIK Ataturk University Medical Faculty Department of Family Medicine Class 2:
Unit 15: Screening. Unit 15 Learning Objectives: 1.Understand the role of screening in the secondary prevention of disease. 2.Recognize the characteristics.
Screening.  “...the identification of unrecognized disease or defect by the application of tests, examinations or other procedures...”  “...sort out.
/ 101 Saudi Diploma in Family Medicine Center of Post Graduate Studies in Family Medicine EBM Diagnostic Tests Dr. Zekeriya Aktürk
10 May Understanding diagnostic tests Evan Sergeant AusVet Animal Health Services.
Evaluation of Diagnostic Tests & ROC Curve Analysis PhD Özgür Tosun.
Diagnosis Examination(MMSE) in detecting dementia among elderly patients living in the community. Excel.
Timothy Wiemken, PhD MPH Assistant Professor Division of Infectious Diseases Diagnostic Tests.
Biostatistics: Pre-test Primer Larry Liang, MD University of Texas Southwestern Medical Center.
Diagnosis:Testing the Test Verma Walker Kathy Davies.
Biostatistics Board Review Parul Chaudhri, DO Family Medicine Faculty Development Fellow, UPMC St Margaret March 5, 2016.
Screening Tests: A Review. Learning Objectives: 1.Understand the role of screening in the secondary prevention of disease. 2.Recognize the characteristics.
Critical Appraisal Course for Emergency Medicine Trainees Module 5 Evaluation of a Diagnostic Test.
Is suicide predictable? Paul St John-Smith Short Courses in Psychiatry 15/10/2008.
دکتر حمیدرضا صابری
Diagnostic studies Adrian Boyle.
DR.FATIMA ALKHALEDY M.B.Ch.B;F.I.C.M.S/C.M
Evidence-Based Medicine
بسم الله الرحمن الرحيم Clinical Epidemiology
How do we judge efficacy of a screening test?
Diagnosis II Dr. Brent E. Faught, Ph.D. Assistant Professor
Medical Diagnosis Problem
Refining Probability Test Informations Vahid Ashoorion MD. ,MSc,
Figure 1. Table for calculating the accuracy of a diagnostic test.
Patricia Butterfield & Naomi Chaytor October 18th, 2017
Positive predictive value of screening tests
Evidence Based Diagnosis
Clinical Effectiveness: sensitivity, specificity and PPV
Presentation transcript:

Positive Predictive Value and Negative Predictive Value Study Outcomes Mini-Presentation Created by Thomas Hahn, MD Edited by John Kloke, PhD

Objectives Following this presentation, the learner will be able to: Understand the concepts and calculations for positive predictive value and negative predictive Apply PPV and NPV to patient care Communicate PPV and NPV to patients

UNDERSTAND the CONCEPT

PPV and NPV Positive Predictive Value: Probability that subjects with a positive test have the disease. Negative Predictive Value: Probability that subjects with a negative test do not have the disease.

Positive Predictive Value Positive Predictive Value: Proportion of positive test results that are true positives PPV = True Positives x 100% All Positives

Negative Predictive Value Negative Predictive Value: Proportion of negative test results that are true negatives NPV = True Negatives x 100% All Negatives

You need to know these equations for boards! 2x2 Table You need to know these equations for boards! Disease Present No Disease a (true positive) b (false positive, Type 1 error) c (false negative, Type 2 error) d (true negative) Positive Test PPV = a/(a+b) Negative Test NPV = d/(d+c) Sensitivity and specificity focus on the DISEASE: total number of people with or without the disease makes up the denominator Positive and negative predictive values focus on the TEST: total number of people with positive or negative tests makes up the denominator Sensitivity = a/(a+c) Specificity = d/(d+b) PPV = true positives x100% NPV = true negatives x100% (true positives + false positives) (true negatives + false negatives)

PPV/NPV Characteristics Predictive value is determined by the sensitivity and specificity of a test Sensitivity (low false negatives)  NPV Specificity (low false positives)  PPV Predictive value is determined by the prevalence of a disease in the population Prevalence  PPV, NPV Prevalence  PPV, NPV As prevalence of a disease in a population increases, PPV increases and NPV decreases As prevalence of a disease in a population decreases, PPV decreases and NPV increases Bayes’ theorem connects PPV/NPV with Sn/Sp

Example of Effect of Prevalence on PPV/NPV Hypothetically test 10 people for Lyme disease in Lyme, Connecticut (high prevalence) and Boise, Idaho (low prevalence) Lyme, Connecticut 9/10 positive tests. High likelihood that the tests are truly positive (Prevalence  PPV, NPV) Boise, Idaho 9/10 negative tests. High likelihood that the tests are truly negative (Prevalence  PPV, NPV)

Predictive Value and Low Disease Prevalence How can you increase predictive value of a test when there is a low preclinical disease prevalence? Example: Breast cancer Prevalence is low in the population (about 1% in 2012) To increase PPV, target screening to those at highest risk of developing the disease: women > 50 years old Prevalence data based on about 3 million cases of breast cancer in 2012, when US population was around 314 million.

PPV/NPV vs Sensitivity/Specificity Sensitivity and specificity Focus on the disease Important to epidemiologists and clinicians Positive and negative predictive values Focus on the test Important to patients The denominator in sens/spec is the total number of people w/ and w/out disease The denominator in PPV/NPV is total number of positive and negative tests

2x2 Table Disease Present No Disease a (true positive) b (false positive, Type 1 error) c (false negative, Type 2 error) d (true negative) Positive Test PPV = true positives all positives Negative Test NPV = true negatives all negatives Sensitivity and specificity focus on the DISEASE: total number of people with or without the disease makes up the denominator Positive and negative predictive values focus on the TEST: total number of people with positive or negative tests makes up the denominator Sensitivity = true positives Specificity = true negatives all with disease all without disease

APPLY the OUTCOME

Using Predictive Value A PPV helps to answer the question: “If the patient’s test is positive, what are the chances that the patient has the disease?” Predictive values may make more sense to the patient than sensitivity/specificity Explains how many people with a positive test are truly positive vs how many people with the disease will test positive.

Application Example The negative predictive value of a screening test for Lyme disease is 50%? What does this mean? This is not a good test for ruling out Lyme disease. 50% of people with a negative test will actually have Lyme disease!!!

COMMUNICATE the DATA

Communicating to Patients A patient presents with a tick bite, and you decide to test for Lyme disease using a new serum test. The patient asks you, “How good is this test?” Knowing that the PPV is 85%, how do you answer this question? “If your test is positive, there is an 85% chance that you have the disease.” (test is 85% accurate) “Out of all the positive tests, 85% will be correct.” “If 100 people have a positive test, 85 of those will have the disease and 15 will not have the disease.”

Practice Question A study evaluating a two-tier screening test for Lyme disease in a low prevalence area tested 4723 patients for Lyme disease. Of the patients who had positive tests, 12 had Lyme disease and 58 did not have Lyme disease. What is the positive predictive value of the test in this low prevalence area? A. 17% B. 20% C. 1% D. 15% Disease No Disease Positive Test 12 58 Negative Test 4653 Lantos, P.M. et al. (2015). Poor positive predictive value of lyme disease serologic testing in an area of low disease incidence. Clinical Infectious Diseases, 584. http://www.ncbi.nlm.nih.gov/pubmed/26195017

Practice Question A study evaluating a two-tier screening test for Lyme disease in a low prevalence area tested 4723 patients for Lyme disease. Of the patients who had positive tests, 12 had Lyme disease and 58 did not have Lyme disease. What is the positive predictive value of the test in this low prevalence area? A. 17% (12/70 = PPV) B. 20% (12/58) C. 1% (70/4653) D. 15% http://cid.oxfordjournals.org/content/53/6/541.long#T4 Disease No Disease Positive Test 12 58 Negative Test 4653

The worst predictive value?

References AAFP Family Medicine Board Review Course http://www.ncbi.nlm.nih.gov/pubmed/26195017