08/2-2009 COMMUTABILiTY.

Slides:



Advertisements
Similar presentations
User verification of performance Zahra Khatami/Robert Hill BHR University Hospitals/Sheffield Teaching Hospitals Focus 2013.
Advertisements

The Expression of Uncertainty in Measurement
JCTLM REFERENCE LABORATORY SERVICES Report of WG2 November 14, 2005 _________________________________________.
Copyright Alan Rowley Associates Steps to an Accurate Result Select a method and validate it as suitable for the purpose envisaged. Establish that.
Clas-Göran Persson Sweden Q-KEN, Riga 25th of October, 2011
Nov-2009 A bias is a bias is a bias By Dietmar Stöckl STT Consulting.
All you wanted to know about laboratory tests, but were afraid to ask By Dietmar Stöckl STT Consulting The informed patient meeting the laboratory.
PSY 1950 Confidence and Power December, Requisite Quote “The picturing of data allows us to be sensitive not only to the multiple hypotheses that.
Traceability to the SI: What does it mean in practice? Ms. Sally Bruce and Ms. Dana Leaman National Voluntary Laboratory Accreditation Program NIST.
Senior Lecturer in Pathology
Chemometrics Method comparison
Melbourne, Australia, November 2011
Statistics 300: Elementary Statistics Section 9-3.
For the CAP Instrumentation and Chemistry Resource Committees
1 Institute of Engineering Mechanics Leopold-Franzens University Innsbruck, Austria, EU H.J. Pradlwarter and G.I. Schuëller Confidence.
Experimental Evaluation of Learning Algorithms Part 1.
New calibration procedure in analytical chemistry in agreement to VIM 3 Miloslav Suchanek ICT Prague and EURACHEM Czech Republic.
Wenclawiak, B.: Glossary of Analytical Chemistry Terms© Springer-Verlag Berlin Heidelberg 2003 In: Wenclawiak, Koch, Hadjicostas (eds.) Quality Assurance.
Identification of Reference Measurement Laboratories _________________________________________ JCTLM WG-2 Lothar Siekmann Institute of Clinical Biochemistry.
Stat 112: Notes 2 Today’s class: Section 3.3. –Full description of simple linear regression model. –Checking the assumptions of the simple linear regression.
Use of Reference Materials in Medical Testing SLAB 10th Anniversary Celebrations Accreditation Conference 10 th November 2015 Dr Deepani Siriwardhana Senior.
Metrology for Chemical Analysis
Traceability Ivo Leito Materials:
Sample Size Determination
All you wanted to know about laboratory tests, but were afraid to ask By Dietmar Stöckl STT Consulting The informed patient meeting the laboratory.
All you wanted to know about laboratory tests, but were afraid to ask By Dietmar Stöckl STT Consulting The informed patient meeting the laboratory.
Validation in Clinical chemistry Elvar Theodorsson.
Key Comparisons in Electrochemistry Significance to Metrology and Global Trade Kenneth W. Pratt* and David L. Duewer National Institute of Standards and.
Putting Confidence Into Your Lab’s Results Alan Steele, Barry Wood & Rob Douglas National Research Council Ottawa, CANADA National.
Traceability in Chemical Measurement Comparable results are needed in order to avoid duplicating measurements which cost time and money. Comparable results.
THEORY OF SAMPLING MMEA Certainty Seminar Markku Ohenoja 1 Markku Ohenoja / Control Engineering Laboratory
Low Cost Safety Improvements Pooled Fund Study Analytical Basics Dr. Bhagwant Persaud.
Goodness-of-Fit A test of whether the distribution of counts in one categorical variable matches the distribution predicted by a model is called a goodness-of-fit.
Method Validation-where do I start?
CHAPTER 10 Comparing Two Populations or Groups
Inference about the slope parameter and correlation
EPID 503 – Class 12 Cohort Study Design.
Pharmaceutical Statistics
Regression and Correlation
Sample Size Determination
Inference for Regression (Chapter 14) A.P. Stats Review Topic #3
CHAPTER 4 Research in Psychology: Methods & Design
Confidence Intervals and p-values
Supplemental Figures S1-S28
Least Square Regression
Multiple Regression.
This CRAZY thing called“INFERENCE”
Week 10 Chapter 16. Confidence Intervals for Proportions
1-Way Random Effects Model
Workshop Method Validation in Analytical Sciences Current practices and future challenges Gent, 9-10 May 2016 Report from WG 1 Day2.
Hypothesis Testing Summer 2017 Summer Institutes.
Comparing Two Proportions
Certification system for prepackages
به نام خدا تضمين کيفيت در آزمايشگاه
08/ Good news By Dietmar Stöckl STT Consulting.
Multiple Regression Models
Comparing Two Proportions
OUTLINE Lecture 5 A. Review of Lecture 4 B. Special SLR Models
Categorical Data Analysis Review for Final
Do Now What is the predicted English score when the math score is 10?
CHAPTER 10 Comparing Two Populations or Groups
Paired Samples and Blocks
Homework Questions.
CHAPTER 10 Comparing Two Populations or Groups
AP Statistics Chapter 12 Notes.
Chapter 12 Inference for Proportions
STANDARDISATION, HARMONISATION AND TRACEABILITY
Confidence Intervals Usually set at 95 % What does that mean ?
Classical regression review
Confidence and Prediction Intervals
Presentation transcript:

08/2-2009 COMMUTABILiTY

Commutability The hidden secrets By Dietmar Stöckl STT Consulting

Tin Can 3 - Commutability Definition Commutability of a reference material property of a reference material, demonstrated by the closeness of agreement between the relation among the measurement results for a stated quantity in this material, obtained according to two given measurement procedures, and the relation obtained among the measurement results for other specified materials NOTE 1 The reference material in question is usually a calibrator and the other specified materials are usually routine samples (can also be trueness controls, DS) NOTE 2 The measurement procedures referred to in the definition are the one preceding and the one following the reference material (calibrator) in question in a calibration hierarchy (see ISO 17511) (in general, can be any two measurement procedures, DS). JCGM 200:2008. International vocabulary of metrology – Basic and general concepts and associated terms (VIM). International Bureau of Weights and Measures (BIPM); Joint Committee for Guides in Metrology (JCGM): Paris, 2008. Freely available at: http://www.bipm.org/en/publications/guides/vim.html Tin Can 3 - Commutability

Experiment and interpretation Measure a minimum of 20 native samples and test samples (trueness controls, calibrators) in one run in replicate (EP 14, n = 3) with at least two measurement procedures General interpretation “Compare the behaviour of the test samples with the native samples” EP 14 interpretation Test samples should be within the prediction limits of the regression based on the native samples Tin Can 3 - Commutability

Cholesterol example EP 14 +4% The test sample is just at the prediction limit and is considered commutable. When this sample is used as trueness control in proficiency testing, the results are flawed by 4%! Tin Can 3 - Commutability

Different point of view +0.8% Commutability should be judged versus the confidence interval of the regression line! Tin Can 3 - Commutability

Commutability – A different view Samples with confidence intervals versus CI of regression line. Tin Can 3 - Commutability

Commutability of single, native samples +3.8% Single, native samples may have sample-related effects and may not represent the average sample! When this sample is used as trueness control in PT, the results are flawed by 3.8%! Tin Can 3 - Commutability

Tin Can 3 - Commutability Related samples CAVE! The statistical treatment of related samples (dilutions of calibrators; PT materials with the same matrix) has not been addressed, yet. Tin Can 3 - Commutability

Tin Can 3 - Commutability Calibrator set Tin Can 3 - Commutability

Commutability – Current concept The statistical concept is wrong It is about the confidence interval of the line and not about the prediction interval. We want to assess the trueness of the measurement procedure or we want to calibrate the procedure Unsolved problem Related samples Remark Not merely a statistical problem! Check the quality of the input data! Tin Can 3 - Commutability