ELISA BETTER THAN WE THOUGHT Dr Direk Limmathurotsakul, MD MSc PhD.

Slides:



Advertisements
Similar presentations
Katrina Abuabara, MD, MA1 Esther E Freeman MD, PhD2;
Advertisements

Use of the IHA: pros and cons Sharon Peacock University of Cambridge & Mahidol University.
Diagnostic Accuracy of Point-of-Care Fecal Calprotectin and Immunochemical Occult Blood Tests for Diagnosis of Organic Bowel Disease in Primary Care: The.
© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/ Other Classification Techniques 1.Nearest Neighbor Classifiers 2.Support Vector Machines.
Clinical Decision Support: Using Logistic Regression to Diagnose COPD and CHF ©2012 Wayne G. Fischer, PhD 1 COPD patient inclusion criteria: Discharged.
Evaluating Diagnostic Accuracy of Prostate Cancer Using Bayesian Analysis Part of an Undergraduate Research course Chantal D. Larose.
Bias in Clinical Research: Measurement Bias
Screening for Alzheimer’s disease Herman Buschke, MD Einstein Aging Study (NIA AG-03949) Department of Neurology Albert Einstein College of Medicine.
STUDY DESIGN FOR DIAGNOSTIC STUDY FOR MELIOIDOSIS Dr Direk Limmathurotsakul, MD MSc PhD.
Azita Kheiltash Social Medicine Specialist Tehran University of Medical Sciences Diagnostic Tests Evaluation.
1 Graphical Diagnostic Tools for Evaluating Latent Class Models: An Application to Depression in the ECA Study Elizabeth S. Garrett Department of Biostatistics.
1 EDRN: Some Statistical Considerations from a Regulatory Point of View Gregory Campbell, Ph.D. Director, Division of Biostatistics CDRH/FDA.
Model and Variable Selections for Personalized Medicine Lu Tian (Northwestern University) Hajime Uno (Kitasato University) Tianxi Cai, Els Goetghebeur,
Performance measures Morten Nielsen, CBS, BioCentrum, DTU.
Midterm Review Goodness of Fit and Predictive Accuracy
Jeremy Wyatt Thanks to Gavin Brown
Lucila Ohno-Machado An introduction to calibration and discrimination methods HST951 Medical Decision Support Harvard Medical School Massachusetts Institute.
Statistics in Screening/Diagnosis
Criteria for Assessment of Performance of Cancer Risk Prediction Models: Overview Ruth Pfeiffer Cancer Risk Prediction Workshop, May 21, 2004 Division.
Senior Microbiologist
Combining prevalence estimates from multiple sources Julian Flowers.
Screening and Diagnostic Testing Sue Lindsay, Ph.D., MSW, MPH Division of Epidemiology and Biostatistics Institute for Public Health San Diego State University.
EVIDENCE ABOUT DIAGNOSTIC TESTS Min H. Huang, PT, PhD, NCS.
Diagnosis: EBM Approach Michael Brown MD Grand Rapids MERC/ Michigan State University.
MEASURES OF TEST ACCURACY AND ASSOCIATIONS DR ODIFE, U.B SR, EDM DIVISION.
1 Risk Assessment Tests Marina Kondratovich, Ph.D. OIVD/CDRH/FDA March 9, 2011 Molecular and Clinical Genetics Panel for Direct-to-Consumer (DTC) Genetic.
Evaluating Results of Learning Blaž Zupan
Fundamentals of Clinical Research for Radiologists Presented by: Reema Al-Shawaf.
Prediction statistics Prediction generally True and false, positives and negatives Quality of a prediction Usefulness of a prediction Prediction goes Bayesian.
Screening of diseases Dr Zhian S Ramzi Screening 1 Dr. Zhian S Ramzi.
Evaluating Predictive Models Niels Peek Department of Medical Informatics Academic Medical Center University of Amsterdam.
Diagnostic Tests Afshin Ostovar Bushehr University of Medical Sciences Bushehr, /7/20151.
Pattern Classification an Diagnostic Decision Yongnan Ji.
Diagnostic Tests Studies 87/3/2 “How to read a paper” workshop Kamran Yazdani, MD MPH.
Selective cutoff reporting in studies of diagnostic test accuracy of depression screening tools: Selective cutoff reporting in studies of diagnostic test.
Evidence base of clinical diagnosis 邓贝贝 张棣 王迎. Category of diagnostic test laboratory examination medical history and information from physical examination.
Journal club Diagnostic accuracy of Urinalysis for UTI in Infants
10 May Understanding diagnostic tests Evan Sergeant AusVet Animal Health Services.
EVALUATING u After retrieving the literature, you have to evaluate or critically appraise the evidence for its validity and applicability to your patient.
Evaluating Classifiers Reading: T. Fawcett, An introduction to ROC analysis, Sections 1-4, 7 (linked from class website)An introduction to ROC analysis.
Joan Carles Soliva Vila Cognitive Neuroscience Research Unit (URNC) Dept. of Psychiatry. Autonomous University of Barcelona (UAB)
12/10/02Sacks - Clinical Assessment1 Clinical Assessment – Part II William Sacks, PhD, MD Clinical Assessment – Part II William Sacks, PhD, MD COMPUTERIZED.
Timothy Wiemken, PhD MPH Assistant Professor Division of Infectious Diseases Diagnostic Tests.
Measuring Outcomes Scott Harris October 2009 Comparing a measurement to a ‘true’ value or ‘Gold standard’
Evaluating the Newest Vital Sign: A More Convenient Measure of Health Literacy Lindsey McCormick, MS3 William Curry, MD, MS Penn State College of Medicine.
Ann Intern Med. 2011;155(7): doi: / Figure Legend:
Screening Test Kit Name
Why are most clinical research findings not spectacular?
Materials & Methods what to include and where
From: Case-Finding Instruments for Depression in Primary Care Settings
Evaluating Results of Learning
Volume 139, Issue 5, Pages (May 2011)
Natural rubber latex skin testing reagents: Safety and diagnostic accuracy of nonammoniated latex, ammoniated latex, and latex rubber glove extracts 
Introduction Results Material & Methods Conclusions
Machine Learning Week 10.
Volume 383, Issue 9919, Pages (March 2014)
DSM-IV delirium prevalence, including the estimated delirium prevalence in the 31 patients that did not undergo delirium assessment following initial screening.
Evaluation of the Clinical Usefulness of Critical Patient Severity Classification System and Glasgow Coma Scale for Neurological Patients in Intensive.
J.Ricks 200B Winter '10 Discussion section
Pre-entry screening programmes for tuberculosis in migrants to low-incidence countries: a systematic review and meta-analysis  Dr Robert W Aldridge, MSc,
Prevalence of and risk factors for active tuberculosis in migrants screened before entry to the UK: a population-based cross-sectional study  Dr Robert.
Antimüllerian hormone as predictor of implantation and clinical pregnancy after assisted conception: a systematic review and meta-analysis  Reshef Tal,
Systematic reviews and meta-analyses of diagnostic test accuracy
Receiver under the operator characteristic (ROC) curve for the test accuracy of the final risk score in the entire external validation sample (c statistic=0.84,
—ROC curves for each simple test compared with NCS (gold standard) plotting the sensitivity versus 1-specificity (the false-positive rate) for different.
Diagnostic performance of different VBM models.
The ROC curves analyzing the sensitivity and specificity of rCBVmax values in astrocytomas for 1-year survival (A) and recurrence (B) show the optimal.
Evidence Based Diagnosis
Regulatory-Industry Statistics Workshop , 2019
Receiver operating characteristic (ROC) curves for discriminating diabetic subjects without retinopathy from control subjects using a logistic regression.
Presentation transcript:

ELISA BETTER THAN WE THOUGHT Dr Direk Limmathurotsakul, MD MSc PhD

Introduction: problems and solutions of imperfect Gold Standard

Introduction: culture is an imperfect gold standard for melioidosis

ParametersCulture as a gold standard Final Bayesian LCM Prevalence37 %62 % Culture Sensitivity100 %60 % Specificity100 % ELISA Sensitivity82 %76 % Specificity73 %98 % Limmathurotsakul et al (2010) PLoS ONE 5(8) e12485

Next Step: What is the proper cutoff for ELISA

LCM estimate that true Se and Sp of ELISA were 76% and 98% Cut-off used was previously determined by conventional ROC Next Step: What is the proper cutoff for ELISA

METHOD Bayesian latent class models (LCM) were applied to all possible cut-off values Sensitivity and specificity estimated from each cut-off value was used to plot unbiased ROC curves

ParametersBayesian LCM using biased cut-off Bayesian LCM using optimal cut-off ELISA Se76 %81 % Sp98 %96 % RESULT

SUMMARY Cut-off determined by conventional method was biased towards misclassification of imperfect gold standard LCMs should be used to determine optimal cut-off ELISA could be furthered developed for use in the clinical setting with a reasonably high degree of accuracy Further evaluation of new diagnostic tests for melioidosis should be done with a carefully selected set of diagnostic tests and appropriate statistical models

How can general researchers apply Bayesian LCM to their own datasets More information: PPI-37 (WMC2013)

END