QC THE MULTIRULE INTERPRETATION

Slides:



Advertisements
Similar presentations
Module 6: QC Basic Rules and Charts
Advertisements

Sample size estimation
BPT2423 – STATISTICAL PROCESS CONTROL
Statistical Quality Control N.Obeidi Descriptive Statistics Descriptive Statistics include: Descriptive Statistics include: – The Mean- measure of central.
Goal Sharing Team Training Statistical Resource Leaders (2) Peter Ping Liu, Ph D, PE, CQE, OCP and CSIT Professor and Coordinator of Graduate Programs.
Laboratory Quality Control
Software Quality Control Methods. Introduction Quality control methods have received a world wide surge of interest within the past couple of decades.
8-1 Quality Improvement and Statistics Definitions of Quality Quality means fitness for use - quality of design - quality of conformance Quality is.
Control Charts for Variables
The Analysis of Variance
PSY 307 – Statistics for the Behavioral Sciences
Intro to Statistics for the Behavioral Sciences PSYC 1900 Lecture 11: Power.
Internal Quality Control (QC) for Medical Laboratories: An introduction Dr. Otto Panagiotakis and Dr. Alexander Haliassos ESEAP – Greek Proficiency Testing.
15 Statistical Quality Control CHAPTER OUTLINE
Methods and Philosophy of Statistical Process Control
The Bell Shaped Curve By the definition of the bell shaped curve, we expect to find certain percentages of the population between the standard deviations.
Control charts Pharos University. An internal system for quality control is needed to ensure that valid data continue to be produced. This implies that.
Copyright © Cengage Learning. All rights reserved. 16 Quality Control Methods.
Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc Chapter 11 Introduction to Hypothesis Testing.
Chemometrics Method comparison
Unit #7 - Basic Quality Control for the Clinical Laboratory
Quality Assessment 2 Quality Control.
APCCB AVERAGE OF DELTA – A NEW CONCEPT IN QUALITY CONTROL GRD Jones Department of Chemical Pathology, St Vincents Hospital, Sydney, Australia.
Enzyme-linked immunosorbent assay Microtiter well EEEEE Specimen 2nd antibody E Substrate SP.
McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 9 Hypothesis Testing.
1 Dr. Jerrell T. Stracener EMIS 7370 STAT 5340 Probability and Statistics for Scientists and Engineers Department of Engineering Management, Information.
ABC of Quality Control A problem based approach RT ERASMUS NHLS / FACULTY OF HEALTH SCIENCES, UNIVERSITY OF STELLENBOSCH 20th July, 2007, Bela Bela.
AACB ASM 2003 THE POWER OF ERROR DETECTION OF WESTGARD MULTI-RULES: A RE-EVALUATION Graham Jones Department of Chemical Pathology St Vincent’s Hospital,
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Automated CBC Parameters
Automated CBC Parameters
Psy B07 Chapter 4Slide 1 SAMPLING DISTRIBUTIONS AND HYPOTHESIS TESTING.
Quality Control Lecture 5
Laboratory QA/QC An Overview.
No criminal on the run The concept of test of significance FETP India.
Slide Slide 1 Copyright © 2007 Pearson Education, Inc Publishing as Pearson Addison-Wesley. Lecture Slides Elementary Statistics Tenth Edition and the.
Chapter 9 Three Tests of Significance Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.
Why do we need to do it? What are the basic tools?
Graham Jones Department of Chemical Pathology,
Issues concerning the interpretation of statistical significance tests.
Slide 1 Copyright © 2004 Pearson Education, Inc..
Application of Westgard multi rules in medical laboratories
© Copyright McGraw-Hill 2004
Statistical Inference Statistical inference is concerned with the use of sample data to make inferences about unknown population parameters. For example,
1 SMU EMIS 7364 NTU TO-570-N Control Charts Basic Concepts and Mathematical Basis Updated: 3/2/04 Statistical Quality Control Dr. Jerrell T. Stracener,
1 Some Special Process Control Procedures and s charts Warning limits Control charts for moving averages chart with a linear trend.
Control Charts and Trend Analysis for ISO 17025
Chapter 13 Understanding research results: statistical inference.
Westgard Multirule System
10 March 2016Materi ke-3 Lecture 3 Statistical Process Control Using Control Charts.
4-1 MGMG 522 : Session #4 Choosing the Independent Variables and a Functional Form (Ch. 6 & 7)
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Quality Assessment.
Pakistan Society of Chemical Pathologists Zoom Series of Lectures ZT 25. Quality Management 2 Brig Aamir Ijaz MCPS, FCPS, FRCP (Edin), MCPS-HPE HOD.
Westgard rules.
INTERNAL QUALITY CONTROL
Laboratory Quality Control
Practical clinical chemistry
CONCEPTS OF HYPOTHESIS TESTING
Quality Control (2) Lecture 6
به نام خالق هستی بخش.
Quality Control Lecture 3
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Westgard rules 12s rule: the run is accepted when both control results are within 2 SD limits from the mean value 13s rule: the run is considered out.
CHAPTER 9 Testing a Claim
CHAPTER 9 Testing a Claim
Quality Assessment The goal of laboratory analysis is to provide the accurate, reliable and timeliness result Quality assurance The overall program that.
Westgard rules Dr Ahmed Aboamer MD in Clinical pathology.
Presentation transcript:

QC THE MULTIRULE INTERPRETATION Chemometrics QC THE MULTIRULE INTERPRETATION Department of Chemical Pathology, University of Pretoria, Dr R Delport 2003

Chemometrics Multirule QC uses a combination of decision criteria, or control rules, to decide whether an analytical run is in-control or out-of-control.

Chemometrics 13s refers to a control rule that is commonly used with a Levey-Jennings chart when the control limits are set as the mean plus 3s and the mean minus 3s. A run is rejected when a single control measurement exceeds the mean plus 3s or the mean minus 3s control limit.

Chemometrics 12s refers to the control rule that is commonly used with a Levey-Jennings chart when the control limits are set as the mean plus/minus 2s. In the original Westgard multirule QC procedure, this rule is used as a warning rule to trigger careful inspection of the control data by the following rejection rules.

Chemometrics 22s - reject when 2 consecutive control measurements exceed the same mean plus 2s or the same mean minus 2s control limit.

Chemometrics R4s - reject when 1 control measurement in a group exceeds the mean plus 2s and another exceeds the mean minus 2s.

Chemometrics 41s - reject when 4 consecutive control measurements exceed the same mean plus 1s or the same mean minus 1s control limit. 

Chemometrics 10x - reject when 10 consecutive control measurements fall on one side of the mean.

Chemometrics 8x - reject when 8 consecutive control measurements fall on one side of the mean.

Chemometrics 12x - reject when 12 consecutive control measurements fall on one side of the mean. The preceding control rules are usually used with N's of 2 or 4, which means they are appropriate when two different control materials are measured 1 or 2 times per material.

Chemometrics In situations where 3 different control materials are being analyzed 2of32s - reject when 2 out of 3 control measurements exceed the same mean plus 2s or mean minus 2s control limit;

Chemometrics 31s - reject when 3 consecutive control measurements exceed the same mean plus 1s or mean minus 1s control limit.

Chemometrics 6x - reject when 6 consecutive control measurements fall on one side of the mean. 

Chemometrics 9x - reject when 9 consecutive control measurements fall on one side of the mean. 

Chemometrics A related control rule that is sometimes used, particularly in Europe, looks for a "trend" where several control measurements in a row are increasing or decreasing: 7T - reject when seven control measurements trend in the same direction, i.e., get progressively higher or progressively lower.

Chemometrics False alarms are minimized by using the 12s rule as a warning rule, then confirming any problems by application of more specific rules that have a low probability of false rejection (serial testing). True alarms or error detection are maximized by selecting a combination of the rules most sensitive to detection of random and systematic errors, then rejecting a run if any one of these rules is violated (parallel testing). http://www.westgard.com/lesson3.htm QC - THE PLANNING PROCESS

Chemometrics The key in how to apply control rules with multiple materials and multiple runs is to identify which control results represent consecutive measurements; e.g., if one measurement is made on each of two different control materials in an analytical run, control rules can be applied as follows: The two control results "within a run" can be inspected by applying a 13s rule to each material, as well as the 22s and R4s rules "across materials." The 22s rule can also be applied to the last two measurements "within a material and across runs." The 41s rule can be applied to the two control measurements in the current run and the two measurements in the previous run, i.e., the rule can be applied "across materials and across runs". The 41s rule can also be applied to the last four measurements "within a material and across runs," which now requires the control results from the three previous runs. The 10x rule can be applied to both control measurement in a run for the last five runs, or to the measurements on just one material for the last ten runs.

Chemometrics Because of these many possible applications of individual rules in a multirule QC procedure, it is best to provide specific directions for when to analyze controls, how to interpret the results, and what to do based on those results. Statistical QC procedure. Use a 12s warning rule and the 13s/22s/R4s/41s/10x rejection rules with 2 control measurements per run. Analysis of control materials. Analyze one sample of the Level A control and one sample of the Level B control in each run. Interpretation of warning rule. If both control results are within 2s limits, report the patient test results. If one control result exceeds a 2s limit, inspect the control data as follows and reject the run if any control rule is violated

Chemometrics 4. Within run inspection of control results. Inspect the control results in the current run by applying the 13s rule to the results from each material and the 22s and R4s rules across materials. Note that the 41s and 10x control rules cannot be applied within a run because there are only two control measurements available. 5. Across run inspection of control results. Apply the 22s rule within each material across the last two runs; apply the 41s rule within each material across the last 4 runs; apply the 41s rule across the last two runs and the two measurements on each material; apply the 10x rule across the last five runs and the two measurements on each material. [Note that this protocol does not specify applying the 10x rule within each material across the last ten runs.]

Chemometrics 6. Interpretation of rejection rules. If none of the rules in steps 3 and 4 are violated, accept the run and report patient results. If any one of the rules in steps 3 and 4 is violated, the run is out-of-control; do not report patient test results. 7. Problem-solving. When a run is out-of-control, investigate the process and correct the problem, in the following way: Determine the type of error occurring on the basis of the rule violated. Random error is usually indicated by the 13s or R4s rules, whereas systematic error is more likely indicated by the 22s,41s, or 10x rules. Refer to trouble-shooting guides to identify possible causes for the type of error indicated by the control rule that was violated. Inspect the testing process and identify the cause of the problem. Correct the problem, then analyze control samples again to assess control status. Repeat or verify the results on the patient samples once the method has been demonstrated to be in-control. Consult a supervisor for any decision to report patient results when a run is out-of-control.

Chemometrics Example control results for this multiple rule application High: mean=250 and s=5) Low: mean=200 and s=4 Identify the rule at: 3,4,7,9,10, 11,12,14,20 http://www.westgard.com/lesson18.htm#terminology

Chemometrics Run 3 Both control results exceed their respective +2s limits, therefore there is a 22s rule violation across materials. A systematic error is most likely occurring and is affecting the results throughout the critical analytical range from at least 200 to 250 mg/dL.

Chemometrics Run 4 The high control result is below its -2s limit, which is a warning of a possible problem. Inspection with the 13s, 22s, and R4s rejection rules that can be applied within the run do not confirm a problem. Note that the across-runs rules would not be applied because the previous run was rejected.

Chemometrics Run 7 The high control result exceeds its +3s limit, therefore there is a 13s control rule violation. This most likely indicates random error.

Chemometrics Run 9 The high control result is below its -2s limit. Inspection of the control results by the rejection rules does not confirm a problem.

Chemometrics Run 10 The control chart for the high control material shows that the last two measurements have both exceeded the -2s limit, therefore a 22s rule violation has occurred within material and across runs. This situation would be consistent with a loss of linearity that is beginning to affect the high end of the analytical range.

Chemometrics Run 11 There is a 12s warning on the high level control material, but inspection doesn't show any other rule violations, therefore, the patient test results in this run can be reported.

Chemometrics Run 12 The control charts for the high and low materials show that the last four control observations have exeeded their respective +1s limits, therefore a 41s rule violation appears to have occured across materials and across runs.

Chemometrics Run 12 Note, however, that the QC protocol specified that a control result had to first exceed a 2s control limit before initiating the application of the 41s rule. Therefore, according to the protocol, this run would not be interpreted as out-of-control.

Chemometrics Run 14 The control results for the high material exceeds its +2s limit and the control result for the low material exceeds its -2s limit, therefore an R4s rule violation has occurred. This most likely indicates a random error.

Chemometrics Run 14 The control results for the high material exceeds its +2s limit and the control result for the low material exceeds its -2s limit, therefore an R4s rule violation has occurred. This most likely indicates a random error.

Chemometrics Run 20 The last five control results on the high material and the last five results on the low material all are lower than their respective means, giving a total of ten consecutive control results on one side of the mean. There is a 10x rule violation across runs and across materials, which indicates that a systematic error most likely has occurred.

Chemometrics QC - THE LEVEY-JENNINGS CONTROL CHART Exercise http://www.westgard.com/lesson12.htm Answer http://www.westgard.com/lssn12p2.htm