Uncertainty in Measurement and Total Error

Slides:



Advertisements
Similar presentations
Gage R&R Estimating measurement components
Advertisements

Estimation, Variation and Uncertainty Simon French
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
Uncertainty in Engineering The presence of uncertainty in engineering is unavoidable. Incomplete or insufficient data Design must rely on predictions or.
1 Methods of Experimental Particle Physics Alexei Safonov Lecture #21.
Sampling Distributions (§ )
15 de Abril de A Meta-Analysis is a review in which bias has been reduced by the systematic identification, appraisal, synthesis and statistical.
Lecture 9 Inexact Theories. Syllabus Lecture 01Describing Inverse Problems Lecture 02Probability and Measurement Error, Part 1 Lecture 03Probability and.
Point estimation, interval estimation
Quality Control Procedures put into place to monitor the performance of a laboratory test with regard to accuracy and precision.
Limitations of Analytical Methods l The function of the analyst is to obtain a result as near to the true value as possible by the correct application.
Evaluating Hypotheses
Value of Information Some introductory remarks by Tony O’Hagan.
Intro to Statistics for the Behavioral Sciences PSYC 1900
Chapter 11 Multiple Regression.
Quality Assurance.
1 This sequence shows why OLS is likely to yield inconsistent estimates in models composed of two or more simultaneous relationships. SIMULTANEOUS EQUATIONS.
Chapter 6 Random Error The Nature of Random Errors
Introduction to the Principles of Laboratory Medicine Photos by Theresa Kristopaitis, MD.
Copyright 2008 © Silliker, All Rights Reserved Interpretation of Lab Results What am I buying? What does it mean? What do I do with it?
1 Bayesian methods for parameter estimation and data assimilation with crop models Part 2: Likelihood function and prior distribution David Makowski and.
Chapter 7 Estimation: Single Population
Development of An ERROR ESTIMATE P M V Subbarao Professor Mechanical Engineering Department A Tolerance to Error Generates New Information….
Error Analysis Accuracy Closeness to the true value Measurement Accuracy – determines the closeness of the measured value to the true value Instrument.
Statistical Decision Theory
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
General Principle of Monte Carlo Fall 2013 By Yaohang Li, Ph.D.
Using Scientific Measurements. Uncertainty in Measurements All measurements have uncertainty. 1.Measurements involve estimation by the person making the.
LECTURER PROF.Dr. DEMIR BAYKA AUTOMOTIVE ENGINEERING LABORATORY I.
LECTURER PROF.Dr. DEMIR BAYKA AUTOMOTIVE ENGINEERING LABORATORY I.
Lab 3b: Distribution of the mean
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
1 Review from previous class  Error VS Uncertainty  Definitions of Measurement Errors  Measurement Statement as An Interval Estimate  How to find bias.
Stat 112: Notes 2 Today’s class: Section 3.3. –Full description of simple linear regression model. –Checking the assumptions of the simple linear regression.
Chapter 5 Parameter estimation. What is sample inference? Distinguish between managerial & financial accounting. Understand how managers can use accounting.
POOLED DATA DISTRIBUTIONS GRAPHICAL AND STATISTICAL TOOLS FOR EXAMINING COMPARISON REFERENCE VALUES Alan Steele, Ken Hill, and Rob Douglas National Research.
Statistical Decision Theory Bayes’ theorem: For discrete events For probability density functions.
ME Mechanical and Thermal Systems Lab Fall 2011 Chapter 3: Assessing and Presenting Experimental Data Professor: Sam Kassegne, PhD, PE.
CHEMISTRY ANALYTICAL CHEMISTRY Fall
Chapter 1: Square Roots and the Pythagorean Theorem Unit Review.
Limit of detection, limit of quantification and limit of blank Elvar Theodorsson.
G. Cowan Lectures on Statistical Data Analysis Lecture 8 page 1 Statistical Data Analysis: Lecture 8 1Probability, Bayes’ theorem 2Random variables and.
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
The Pythagorean Theorem Use the Pythagorean Theorem to find the missing measure in a right triangle including those from contextual situations.
1 INSTRUMENTAL VARIABLE ESTIMATION OF SIMULTANEOUS EQUATIONS In the previous sequence it was asserted that the reduced form equations have two important.
EBM --- Journal Reading Presenter :葉麗雯 Date : 2005/10/27.
G. Cowan Lectures on Statistical Data Analysis Lecture 9 page 1 Statistical Data Analysis: Lecture 9 1Probability, Bayes’ theorem 2Random variables and.
Validation in Clinical chemistry Elvar Theodorsson.
Levey Jennings Chart Activity Staff Meeting Topic.
Statistical Concepts Basic Principles An Overview of Today’s Class What: Inductive inference on characterizing a population Why : How will doing this allow.
Ch 1. Introduction Pattern Recognition and Machine Learning, C. M. Bishop, Updated by J.-H. Eom (2 nd round revision) Summarized by K.-I.
Survey on computer aided decision support for diagnosis of celiac disease Sebastian Hegenbart, Andreas Uhl, Andreas Vécsei Computers in Biology and Medicine.
Establishing by the laboratory of the functional requirements for uncertainty of measurements of each examination procedure Ioannis Sitaras.
Statistica /Statistics Statistics is a discipline that has as its goal the study of quantity and quality of a particular phenomenon in conditions of.
Introduction to Probability - III John Rundle Econophysics PHYS 250
Measurement, Quantification and Analysis
usually unimportant in social surveys:
Other confidence intervals
Visual Recognition Tutorial
Statistical Quality Control, 7th Edition by Douglas C. Montgomery.
acceptable quality level (AQL) Proportion of defects
Introduction to estimation: 2 cases
Introduction to Instrumentation Engineering
Counting Statistics and Error Prediction
David C. Whitcomb, MD, PhD  Clinics in Laboratory Medicine 
Clinical Toxicology Clinics in Laboratory Medicine
Lecture # 2 MATHEMATICAL STATISTICS
Sampling Distributions (§ )
The Pythagorean Theorem
Automated Hematology Analyzers: State of the Art
Presentation transcript:

Uncertainty in Measurement and Total Error Elvar Theodorsson, MD, PhD  Clinics in Laboratory Medicine  Volume 37, Issue 1, Pages 15-34 (March 2017) DOI: 10.1016/j.cll.2016.09.002 Copyright © 2016 The Author Terms and Conditions

Fig. 1 Conceptual differences between diagnostic uncertainty and measurement error approaches when estimating (A) diagnostic uncertainties, (B) bias, and (C) TE in laboratory medicine. Diagnostic uncertainty approaches (A) provide estimates of diagnostic uncertainty; the combined uncertainty of all causes of uncertainty in the total testing chain when using laboratory results for diagnosing patients, including biological variation and preanalytical, analytical, and postanalytical variations. Both the LPU favored by GUM and simple addition of variances according to the pythagorean theorem can be used to estimate diagnostic uncertainty. LPU methods have their major strength in their ability to deal with numerous and complex causes of uncertainty but their major weakness is their theoretic and practical complexity and lack of practical implementations in laboratory medicine.81 Measurement error approaches (B, C) provide estimates of the uncertainty of the measurement methods; the analytical phase of the total testing chain. If the main purpose of the external quality control program is to determine bias and imprecision separately, approach (B) is preferred. External quality control programs aiming for estimation of TE use singleton measurements (C). They are supported by comprehensive theoretic models, acceptance by regulatory authorities, and widespread practical use in laboratory medicine. Biological, preanalytical, and postanalytical variations are not relevant when monitoring variation in control samples, but these variations are relevant when dealing with patient samples.46 Clinics in Laboratory Medicine 2017 37, 15-34DOI: (10.1016/j.cll.2016.09.002) Copyright © 2016 The Author Terms and Conditions

Fig. 2 The total testing chain in laboratory medicine involves several possible sources of uncertainty from the clinical decision to order a test through biological variation, the preanalytical, analytical, and postanalytical phases, to the value of the test result in the ongoing clinical decisions. Error methods focus primarily on the analytical phase (the properties of the measurement system), whereas uncertainty methods focus on counting all sources of uncertainties, including biological variation, preanalytical variation, analytical variation, and postanalytical variation, as an aid in diagnosis and in monitoring treatment effects. Clinics in Laboratory Medicine 2017 37, 15-34DOI: (10.1016/j.cll.2016.09.002) Copyright © 2016 The Author Terms and Conditions

Fig. 3 The terminology used in VIM3 to describe components of error and measurement uncertainty.91 Measurement error, or simply error, is a property of a single measurement: measured quantity value minus a reference quantity value.9,21,92 The reference quantity value serves a surrogate true value” within the system (or model). A true value or reference value of the measurand in a particular patient sample cannot be known. Therefore, the true value of a single patient result cannot be known, and the confidence in a result must consequently be expressed in probabilistic terms based on frequentist statistics (confidence intervals) for error models and bayesian statistics (probability density) for uncertainty models. Clinics in Laboratory Medicine 2017 37, 15-34DOI: (10.1016/j.cll.2016.09.002) Copyright © 2016 The Author Terms and Conditions

Fig. 4 The pythagorean theorem states that the square of the hypotenuse (the side opposite the right angle; marked C) is equal to the sum of the squares of the other 2 sides A and B. This means that the sum of the area of quadrant C is equal to the sum of the areas of the quadrants A and B. Clinics in Laboratory Medicine 2017 37, 15-34DOI: (10.1016/j.cll.2016.09.002) Copyright © 2016 The Author Terms and Conditions

Fig. 5 Simplification of the principles of Monte Carlo techniques for estimating diagnostic uncertainty. The variance from the study used to estimate biological variation is used to model the contribution of the biological variation to the estimate of diagnostic uncertainty. Preanalytical variation is estimated from a quadratic probability function whose properties are estimated as type B uncertainty. Analytical variation is estimated as repeatability variance; all measurement results within the laboratory organization when measuring the same sample for a certain measurand using all measurement systems at different points in time. Postanalytical variation is estimated from a quadratic probability function whose properties are estimated as type B uncertainty. At least 100,000 repeated samples are simultaneously drawn from all probability functions in order to create the diagnostic uncertainty probability distribution. Clinics in Laboratory Medicine 2017 37, 15-34DOI: (10.1016/j.cll.2016.09.002) Copyright © 2016 The Author Terms and Conditions

Fig. 6 Simplification of the principles of resampling with replacement techniques for resampling estimation of diagnostic uncertainty (here illustrated as gaussian distribution as example of any possible distribution). All original data from the study used to estimate biological variation are used for resampling (here illustrated as a tombola) the contribution of the biological variation to the estimate of diagnostic uncertainty. Preanalytical variation is estimated from a quadratic probability function whose properties are estimated as type B uncertainty. Analytical variation is estimated as reproducibility variation; all measurement results within the laboratory organization when measuring the same sample for a certain measurand using all measurement systems at different points in time. All data are used for resampling (here illustrated as a tombola) the contribution of the analytical variation to the estimate of diagnostic uncertainty. Postanalytical variation is estimated from a quadratic probability function whose properties are estimated as type B uncertainty. Clinics in Laboratory Medicine 2017 37, 15-34DOI: (10.1016/j.cll.2016.09.002) Copyright © 2016 The Author Terms and Conditions

Fig. 7 Simplification of traditional external quality control (ECQ/proficiency testing) scheme (A) and control scheme (B) focused on minimizing bias within a conglomerate of laboratories (Lab) where laboratories B to H regularly send patient samples they have already analyzed to laboratory A, which participates in national or international ECQ. Clinics in Laboratory Medicine 2017 37, 15-34DOI: (10.1016/j.cll.2016.09.002) Copyright © 2016 The Author Terms and Conditions