Accuracy, sensitivity and specificity analysis

Slides:



Advertisements
Similar presentations
Quality Management in Diagnostic Imaging
Advertisements

Validity and Reliability of Analytical Tests. Analytical Tests include both: Screening Tests Diagnostic Tests.
Power and sample size.
Chapter 4 Pattern Recognition Concepts: Introduction & ROC Analysis.
Azita Kheiltash Social Medicine Specialist Tehran University of Medical Sciences Diagnostic Tests Evaluation.
Evaluation of Diagnostic Test Studies
Anthropometry Technique of measuring people Measure Index Indicator Reference Information.
Prelim 11/14/11. 2 nd Semester, 3 rd Year Level  The Early 1900’s, With The Work Of An Industrial Engineer Named Frederick Winslow Taylor.  “Father.
Screening revision! By Ilona Blee. What are some UK Screening programmes?  Antenatal & newborn screening  Newborn Blood Spot  Newborn Hearing Screening.
Screening for Disease Guan Peng Department of Epidemiology School of Public Health, CMU.
For midterm. Topics to be covered  Repeat Analysis  Analysis Of Reject Versus Repeated Films  Determination Of Rejection Rate  Distribution Of Rejected.
Medical decision making. 2 Predictive values 57-years old, Weight loss, Numbness, Mild fewer What is the probability of low back cancer? Base on demographic.
Lecture 4: Assessing Diagnostic and Screening Tests
Division of Population Health Sciences Royal College of Surgeons in Ireland Coláiste Ríoga na Máinleá in Éirinn Indices of Performances of CPRs Nicola.
Principles and Predictive Value of Screening. Objectives Discuss principles of screening Describe elements of screening tests Calculate sensitivity, specificity.
SCREENING Asst. Prof. Sumattna Glangkarn RN, MSc. (Epidemiology), PhD (Nursing studies)
Sensitivity Sensitivity answers the following question: If a person has a disease, how often will the test be positive (true positive rate)? i.e.: if the.
Sensitivity & Specificity Sam Thomson 8/12/10. Sensitivity Proportion of people with the condition who have a positive test result Proportion of people.
MEASURES OF TEST ACCURACY AND ASSOCIATIONS DR ODIFE, U.B SR, EDM DIVISION.
Appraising A Diagnostic Test
CT image testing. What is a CT image? CT= computed tomography CT= computed tomography Examines a person in “slices” Examines a person in “slices” Creates.
Evaluating Results of Learning Blaž Zupan
Fundamentals of Clinical Research for Radiologists Presented by: Reema Al-Shawaf.
Screening of diseases Dr Zhian S Ramzi Screening 1 Dr. Zhian S Ramzi.
1 Wrap up SCREENING TESTS. 2 Screening test The basic tool of a screening program easy to use, rapid and inexpensive. 1.2.
How to review a diagnostic study CCBS Study Afternoon 12 August 2008
Diagnostic Tests Studies 87/3/2 “How to read a paper” workshop Kamran Yazdani, MD MPH.
The Diagnostic Process A BRIEF OVERVIEW diagnostic process What is it? to figure out to problem solve method scheme.
Screening.  “...the identification of unrecognized disease or defect by the application of tests, examinations or other procedures...”  “...sort out.
Integrated Management of Childhood Illnesses
Laboratory Medicine: Basic QC Concepts M. Desmond Burke, MD.
ROC curve estimation. Index Introduction to ROC ROC curve Area under ROC curve Visualization using ROC curve.
Solving Equations Using Logs. True or False? 1.Log 4 = log Log 15 = log 3 x log 5 3.Log 4 = log 8 – log 2 4.Log 64 = 2 log 8 5.Log 64 = 8 log 2.
SCREENING FOR DISEASE. Learning Objectives Definition of screening; Principles of Screening.
© 2010 Jones and Bartlett Publishers, LLC. Chapter 12 Clinical Epidemiology.
Critical Appraisal Course for Emergency Medicine Trainees Module 5 Evaluation of a Diagnostic Test.
A prospective study of PET/CT in initial staging of small-cell lung cancer : comparison with CT, bone scintigraphy and bone marrow analysis B. M. Fischer1,
دکتر حمیدرضا صابری
CHP400: Community Health Program-lI Mohamed M. B. Alnoor Muna M H Diab SCREENING.
Accuracy, sensitivity and specificity analysis
Performance of a diagnostic test Tunisia, 31 Oct 2014
Clinical Epidemiology
Conditional Probability, Bayes Theorem, Independence and Repetition of Experiments Chris Massa.
Diagnostic Test Studies
Choosing Wisely : Radiology Perspective
Diagnostic test accuracy. Study design and the 2x2 table
Class session 7 Screening, validity, reliability
Evaluating Results of Learning
Lecture 3.
Comunicación y Gerencia
بسم الله الرحمن الرحيم Clinical Epidemiology
What is Screening? Basic Public Health Concepts Sheila West, Ph.D.
How do we delay disease progress once it has started?
Practical clinical chemistry
Diagnosis II Dr. Brent E. Faught, Ph.D. Assistant Professor
Hint: Numerator Denominator. Vascular Technology Lecture 34: Test Validation (Statistical Profile and Correlation) HHHoldorf.
Conduct of Film Analysis
What is Screening? Basic Public Health Concepts Sheila West, Ph.D.
Screening, Sensitivity, Specificity, and ROC curves
I-APIC CIC Q&A February 2016.
Find 4 A + 2 B if {image} and {image} Select the correct answer.
THALASSEMIA MINOR DIAGNOSTICS BY A COMPUTATIONAL METHOD
Figure 1. Table for calculating the accuracy of a diagnostic test.
Patricia Butterfield & Naomi Chaytor October 18th, 2017
True or False: {image} is one-to-one function.
Evaluate the limit: {image} Choose the correct answer from the following:
Conditional Probability, Bayes Theorem, Independence and Repetition of Experiments Chris Massa.
True or False True or False
Given that {image} {image} Evaluate the limit: {image} Choose the correct answer from the following:
Evidence Based Diagnosis
Presentation transcript:

Accuracy, sensitivity and specificity analysis

It can be affected by factors such as: The main outcome of a diagnostic imaging examination is an accurate diagnosis of a patients condition so that proper treatment can be administered. It can be affected by factors such as: Image quality Competency of the radiologist to interpret the image

Classification of a Diagnosis Positive – patients in whom the disease has been diagnosed. True positive – if the diagnosis is revealed to be correct. False positive – if study indicates that they do not have the disease despite the positive findings from the image. Negative – healthy patients with no disease present are considered negative.

True negative – if a diagnosis of a negative is determined from an image and is supported by follow-up studies. False negative – if a negative diagnosis is given to a patient who later has the disease.

Accuracy Is the percentage of cases that is diagnosed correctly; it can be determined by the following equation: Accuracy = (NTp + NTn)/Ntotal =100 N = number of cases NTp = Number of cases of True Positive NTn = Number of cases of True Negative Ntotal = total number of cases

Example If a 210 total chest x-ray are performed in a month and the number of true negatives is 167 and the number of true positive is 36, then the accuracy rate of the image diagnosis is Answer: 0.967 or 96.7%

Sensitivity Is also referred to as the TP fraction (True Positive Fraction) and indicates the likelihood of obtaining a positive diagnosis in a patient with the disease. Sensitivity is determined by the following equation. Sensitivity = NTp/(NTp + NFn) NFn – False Negative

Example If a department has a true positive of 36 and has a false negative of 3, what is the sensitivity of the diagnosis. Answer: 0.92 or 92%

Specificity Is also known as the TN fraction (True Negative Fraction) and indicates the likelihood of a patient obtaining a negative diagnosis when no disease is present. Specificity is determined by the following equation Specificity = NTn/(NTn + NFp) NFp = False positive

Example A department receiving a 167 TNs and 4 FPs has a specificity of Answer: 0.97 or 97%

Problem solving If a department has a total number of 300 cases , with a true positive of 157 and a true negative of 115 with a false negative of 5 and a false positive of 2. What is the accuracy percentage? What is the sensitivity percentage? What is the specificity percentage?

Answer Accuracy = 157 + 115/300 x 100 = 0.906 or 90.6% Sensitivity = 157/157 + 5 = 0.969 or 96.9% Specificity = 115/115 + 2 = 0.982 or 98.2%

Practice If a department has a causal rate of 12% that was caused by the processor what is the number of films used if it has a total repeat rate of 432? x/432 = 0.12 432*0.12 = x X=51.84 or 52 films

Data analysis With these data shows that the department has an accuracy 90.6% to which cases of diagnosis is correct, sensitivity or detectability of 96.9% which is the likelihood of obtaining a positive diagnosis of patients with a disease. A specificity of 98.2% to which it indicates the likelihood of a patient obtaining a negative diagnosis when no disease is present.

Summary The ideal for all of the values is 100%. A diagnostic imaging department is responsible for establishing its own threshold of acceptability for each value. Implementing a quality management program requires more than just equipment monitoring and maintenance. The outcome assessment of diagnostic images must also be performed to evaluate the success of the procedure.

END OF MIDTERM