Diagnosis:Testing the Test Verma Walker Kathy Davies.

Slides:



Advertisements
Similar presentations
Likelihood ratios Why these are the most thrilling statistics in Emergency Medicine.
Advertisements

Lecture 3 Validity of screening and diagnostic tests
Statistical Analysis and Data Interpretation What is significant for the athlete, the statistician and team doctor? important Will Hopkins
Studying a Study and Testing a Test: Sensitivity Training, “Don’t Make a Good Test Bad”, and “Analyze This” Borrowed Liberally from Riegelman and Hirsch,
Step 3: Critically Appraising the Evidence: Statistics for Diagnosis.
TESTING A TEST Ian McDowell Department of Epidemiology & Community Medicine November, 2004.
Divisional Meeting 15 th January 2009 Streptococcal Pharyngitis: A Systematic Review of the Predictive Value of Signs and Symptoms and the External Validation.
Is it True? Evaluating Research about Diagnostic Tests
1 Case-Control Study Design Two groups are selected, one of people with the disease (cases), and the other of people with the same general characteristics.
Statistics for Health Care
Sample Size Determination
EPIDEMIOLOGY Why is it so damn confusing?. Disease or Outcome Exposure ab cd n.
Interpreting Diagnostic Tests
Diagnosis Concepts and Glossary. Cross-sectional study The observation of a defined population at a single point in time or time interval. Exposure and.
HOW TO READ AN ARTICLE ABOUT A DIAGNOSTIC TEST Chitkara MB, Boykan R, Messina C Stony Brook Long Island Children’s Hospital.
Statistics in Screening/Diagnosis
BASIC STATISTICS: AN OXYMORON? (With a little EPI thrown in…) URVASHI VAID MD, MS AUG 2012.
Multiple Choice Questions for discussion
Stats Tutorial. Is My Coin Fair? Assume it is no different from others (null hypothesis) When will you no longer accept this assumption?
DEB BYNUM, MD AUGUST 2010 Evidence Based Medicine: Review of the basics.
Lecture 4: Assessing Diagnostic and Screening Tests
Statistics for Health Care Biostatistics. Phases of a Full Clinical Trial Phase I – the trial takes place after the development of a therapy and is designed.
EDRN Approaches to Biomarker Validation DMCC Statisticians Fred Hutchinson Cancer Research Center Margaret Pepe Ziding Feng, Mark Thornquist, Yingye Zheng,
Evidence Based Medicine Workshop Diagnosis March 18, 2010.
Screening and Diagnostic Testing Sue Lindsay, Ph.D., MSW, MPH Division of Epidemiology and Biostatistics Institute for Public Health San Diego State University.
EBCP. Random vs Systemic error Random error: errors in measurement that lead to measured values being inconsistent when repeated measures are taken. Ie:
Evaluation of Diagnostic Tests
EVIDENCE ABOUT DIAGNOSTIC TESTS Min H. Huang, PT, PhD, NCS.
1 SCREENING. 2 Why screen? Who wants to screen? n Doctors n Labs n Hospitals n Drug companies n Public n Who doesn’t ?
Advanced Physical therapy Procedures Ahmed alhowimel.
Diagnosis: EBM Approach Michael Brown MD Grand Rapids MERC/ Michigan State University.
MEASURES OF TEST ACCURACY AND ASSOCIATIONS DR ODIFE, U.B SR, EDM DIVISION.
Evaluating Diagnostic Tests Payam Kabiri, MD. PhD. Clinical Epidemiologist Tehran University of Medical Sciences.
Appraising A Diagnostic Test
Likelihood 2005/5/22. Likelihood  probability I am likelihood I am probability.
Evidence-Based Medicine Diagnosis Component 2 / Unit 5 1 Health IT Workforce Curriculum Version 1.0 /Fall 2010.
1. Statistics Objectives: 1.Try to differentiate between the P value and alpha value 2.When to perform a test 3.Limitations of different tests and how.
Statistics for the board September 14 th 2007 Jean-Sebastien Rachoin MD.
TESTING A TEST Ian McDowell Department of Epidemiology & Community Medicine January 2008.
Prediction statistics Prediction generally True and false, positives and negatives Quality of a prediction Usefulness of a prediction Prediction goes Bayesian.
Positive Predictive Value and Negative Predictive Value
Diagnostic Tests Studies 87/3/2 “How to read a paper” workshop Kamran Yazdani, MD MPH.
Unit 15: Screening. Unit 15 Learning Objectives: 1.Understand the role of screening in the secondary prevention of disease. 2.Recognize the characteristics.
Diagnostic Test Characteristics: What does this result mean
Evidence based medicine Diagnostic tests Ross Lawrenson.
Diagnostic Test Characteristics Professor Mobeen Iqbal Shifa College of Medicine.
/ 101 Saudi Diploma in Family Medicine Center of Post Graduate Studies in Family Medicine EBM Diagnostic Tests Dr. Zekeriya Aktürk
BIOSTATISTICS Lecture 2. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and creating methods.
Diagnosis Examination(MMSE) in detecting dementia among elderly patients living in the community. Excel.
PTP 560 Research Methods Week 12 Thomas Ruediger, PT.
Diagnostic Likelihood Ratio Presented by Juan Wang.
Biostatistics Board Review Parul Chaudhri, DO Family Medicine Faculty Development Fellow, UPMC St Margaret March 5, 2016.
© 2010 Jones and Bartlett Publishers, LLC. Chapter 12 Clinical Epidemiology.
Sensitivity, Specificity, and Receiver- Operator Characteristic Curves 10/10/2013.
Screening Tests: A Review. Learning Objectives: 1.Understand the role of screening in the secondary prevention of disease. 2.Recognize the characteristics.
Critical Appraisal Course for Emergency Medicine Trainees Module 5 Evaluation of a Diagnostic Test.
Diagnostic studies Adrian Boyle.
DR.FATIMA ALKHALEDY M.B.Ch.B;F.I.C.M.S/C.M
Diagnostic Test Studies
When is the post-test probability sufficient for decision-making?
Evidence-Based Medicine
How many study subjects are required ? (Estimation of Sample size) By Dr.Shaik Shaffi Ahamed Associate Professor Dept. of Family & Community Medicine.
Principles of Epidemiology E
Diagnosis II Dr. Brent E. Faught, Ph.D. Assistant Professor
Refining Probability Test Informations Vahid Ashoorion MD. ,MSc,
Dr. Hannah Jordan Lecturer in Public Health ScHARR
کارگاه تکميلی کشوری تربيت مربی آموزش طب مبتنی بر شواهد
The two-step Fagan's nomogram.
Evidence Based Diagnosis
Presentation transcript:

Diagnosis:Testing the Test Verma Walker Kathy Davies

Journal of Pediatric Gastroenterology & Nutrition. 35(1):39-43, 2002 Jul. BACKGROUND AND OBJECTIVE: Studies support the accuracy of 13C-urea breath test for diagnosing and confirming cure of Helicobacter pylori infection in children. Three methods are used to assess 13CO2 increment in expired air: mass spectrometry, infrared spectroscopy, and laser-assisted ratio analysis. In this study, the 13C-urea breath test performed with infrared spectroscopy in children and adolescents was evaluated 13 C-urea breath test with infrared spectroscopy for diagnosing helicobacter pylori infection in children and adolescents.

METHODS: Seventy-five patients (6 months to 18 years old) were included. The gold standard for diagnosis was a positive culture or positive histology and a positive rapid urease test. Tests were performed with 50 mg of 13C-urea diluted in 100 mL orange juice in subjects weighing up to 30 kg, or with 75 mg of 13C-urea diluted in 200 mL commercial orange juice for subjects weighing more than 30 kg. Breath samples were collected just before and at 30 minutes after tracer ingestion. The 13C-urea breath test was considered positive when delta over baseline (DOB) was greater than 4.0% RESULTS: Tests were positive for H. pylori in 31 of 75 patients. Sensitivity was 96.8%, specificity was 93.2%, positive predictive value was 90.9%, negative predictive value was 97.6%, and accuracy was 94.7%. CONCLUSIONS: 13C-urea breath test performed with infrared spectroscopy is a reliable, accurate, and noninvasive diagnostic tool for detecting H. pylori infection.

Gold Standard Investigation Positive nNegative n HistologyPositive 280 Negative 344 RUTPositive 300 Negative 144 CulturePositive 220 Negative C-UBTPositive 303 Negative 141

Gold Standard Positive (condition present) Gold Standard Negative (condition absent) Test Result PositiveTrue Positive 30 a False Positive 3 b Test Result Negative 1 c False Negative d 41 True Negative

Sensitivity the proportion of truly diseased persons, as measured by the gold standard, who are identified as diseased by the test under study. True Positives/(True Positives + False Negatives) a/(a+c) Sensitivity = Snout = Rules Out

Specificity The proportion of truly non-diseased persons, as measured by the gold standard, who are so identified by the diagnostic test under study. True Negatives/(False Positive + True Negative) d/(b+d) Specificity = Spin = Rules In

Predictive Values In screening and diagnostic tests, the probability that a person with a positive test is a true positive (i.e., does have the disease), or that a person with a negative test truly does not have the disease. The predictive value of a screening test is determined by the sensitivity and specificity of the test, and by the prevalence of the condition for which the test is used.

Positive Predictive Value True Positive/(True Positive + False Positive) a/(a+b) Probability that a person with positive test is a true positive (does have the disease) Negative Predictive Value True Negative/(True Negative + False Negative) d/(d+c) Probability that a person with a negative test truly does not have the disease

Using Predictive Values Keep clinical significance in mind – Terminal or rare disease – Impact of false negative on patient outcome –Benefit of testing to patient Population tested is high or low risk? Alternative Tests for screening

Likelihood Ratios The likelihood ratio for a test result compares the likelihood of that result in patients with disease to the likelihood of that result in patients without disease: Positive LR = (a/a+c)/(b/b+d) –sensitivity / (1-specificity) Negative LR = (c/a+c)/(d/b+d) –(1-sensitivity) / specificity

Impact on Disease Likelihood LR >10 or <0.1 cause large changes in likelihood LR 5-10 or cause moderate changes LR 2-5 or cause small changes LR between <2 and 0.5 cause little or no change

Ruling In & Out Does patient have disease ? Higher Positive LR means disease is likely to be present if test is positive Does patient not have disease? Lower Negative LR means that disease is not likely present or cause of patient current condition

Prevalence Proportion of persons with a particular disease within a given population at a given time. Probability that a person selected at random will have disease. (a+c) / (a+b+c+d) Pre-test odds Odds that a person will have the disease; calculated before test is complete. prevalence / (1-prevalence) Post-test odds Measures impact of test result on odds of disease being present pre-test odds * LR Post-test probability Chances of disease after factoring in test results post-test odds / (post test odds+1)

Nomogram

Clinical Implications One test is not a diagnosis Implications of false positive Further testing may be needed Numbers may be significant but not clinically relevant

Number Meanings 100,000 men studied for coronary artery disease Uric Acid Factor in prediction Developed CA disease uric acid=7.8 mg/L Did not develop CA disease uric acid= 7.7 mg/L P Value = 0.05– significant Problems?

Number Meanings Large study found significant difference for very small difference in values Unlikely that uric acid will be useful as clinical predictor When test is performed, difference is less than any l ab error

Purposes of Statistics Estimate relationships between variables, cause & effect and differences in magnitude Measure the significance of the results; do the numbers have any clinical meaning? Adjust for the impact of confounding variables on results

Bibliography Center for Evidence Based Medicine. Ed. Douglas Badenoch, Olive Goddard, Bridget Burchell, Sept NHS Research and Development. 1 Oct Evidence Based Medicine Tool Kit. Ed. Jeanette Buckingham, Bruce Fisher, Duncan Saunders. Nov University of Alberta. 5 Sept Kawakami, Elisabete. 13C-Urea Breath Test with infrared spectroscopoy for diagnosing Helicobacter pylori infection in children and adolescents. Journal of Pediatric Gastroenterology and Nutrition 2002; 35(1): Riegelman, Richard. Studying a Study and Testing a Test: How to read the Medical evidence. 4 th Edition: Lippincott, Williams & Wilkins, 2000 Schwartz, Alan. EBM and Decision Tools: Diagnostic Test Cutoffs