Utilization of Assay Performance Characteristics to Estimate Hemoglobin A 1c Result Reliability A. Woodworth, N. Korpi-Steiner, J.J. Miller, L.V. Rao,

Slides:



Advertisements
Similar presentations
Day to Day Management of Quality Control
Advertisements

Between-Method Differences in Prostate Specific Antigen Assays Affect Prostate Cancer Risk Prediction by Nomograms C. Stephan, K. Siemβen, H. Cammann,
Managerial Decision Modeling with Spreadsheets
Alternative Calibration Strategies for the Clinical Laboratory: Application to Nortriptyline Therapeutic Drug Monitoring M.T. Olson, A. Breaud, R. Harlan,
Improved Reflexive Testing Algorithm for Hepatitis C Infection Using Signal-to-Cutoff Ratios of a Hepatitis C Virus Antibody Assay K.K.Y. Lai, M. Jin,
Harmonization of Measurement Results of the Alcohol Biomarker Carbohydrate- Deficient Transferrin by Use of the Toolbox of Technical Procedures of the.
Departments of Medicine and Biostatistics
Journal Club Precision and Reliability of 5 Platelet Function Tests in Healthy Volunteers and Donors on Daily Antiplatelet Agent Therapy B.S. Karon, N.V.
Mitigating Risk of Out-of-Specification Results During Stability Testing of Biopharmaceutical Products Jeff Gardner Principal Consultant 36 th Annual Midwest.
Estimation of Sample Size
Long-Term Biological Variation of Serum Protein Electrophoresis M-Spike, Urine M-Spike, and Monoclonal Serum Free Light Chain Quantification: Implications.
Laboratory Quality Control
Software Quality Control Methods. Introduction Quality control methods have received a world wide surge of interest within the past couple of decades.
Quality Assurance.
Association of 1,5-Anhydroglucitol with Diabetes and Microvascular
Microsatellite Instability Detection by Next Generation Sequencing S.J. Salipante, S.M. Scroggins, H.L. Hampel, E.H. Turner, and C.C. Pritchard September.
Internal Quality Control (QC) for Medical Laboratories: An introduction Dr. Otto Panagiotakis and Dr. Alexander Haliassos ESEAP – Greek Proficiency Testing.
This teaching material has been made freely available by the KEMRI-Wellcome Trust (Kilifi, Kenya). You can freely download,
InterQC Delivering Simplicity in the Quality Control Management for your Laboratory Developed by Vitro.
Journal Club Electronic Medical Record–Based Performance Improvement Project to Document and Reduce Excessive Cardiac Troponin Testing S.A. Love, Z.J.
Quality Assurance in the clinical laboratory
Low 25-Hydroxyvitamin D and Risk of Type 2 Diabetes: A Prospective Cohort Study and Meta-analysis S. Afzal, S.E. Bojesen, and B.G. Nordestgaard February.
Chemometrics Method comparison
Method Comparison A method comparison is done when: A lab is considering performing an assay they have not performed previously or Performing an assay.
Journal Club MicroRNA In Vitro Diagnostics by Use of Immunoassay Analyzers A. Kappel, C. Backes, Y. Huang, S. Zafari, P. Leidinger, B. Meder, H. Schwarz,
Quality Assurance.
Quality Assessment 2 Quality Control.
APCCB AVERAGE OF DELTA – A NEW CONCEPT IN QUALITY CONTROL GRD Jones Department of Chemical Pathology, St Vincents Hospital, Sydney, Australia.
Journal Club Increased Rheumatoid Factor and Deep Venous Thrombosis: 2 Cohort Studies of 54,628 Individuals from the General Population C.L. Meyer-Olesen,
Measurements for 8 Common Analytes in Native Sera Identify Inadequate Standardization among 6 Routine Laboratory Assays H.C.M. Stepman, U. Tiikkainen,
Journal Club Influence of Glycosylation on Diagnostic and Prognostic Accuracy of N-Terminal Pro–B-type Natriuretic Peptide in Acute Dyspnea: Data from.
Analytical Goals. Valid data are essential in making medical decisions, the most important concepts used in judging analytical performance :- 1)Analytical.
Epidemiology The Basics Only… Adapted with permission from a class presentation developed by Dr. Charles Lynch – University of Iowa, Iowa City.
Sampling: Final and Initial Sample-Size Determination
© Copyright 2009 by the American Association for Clinical Chemistry Glucose Meter Performance Criteria for Tight Glycemic Control Estimated by Simulation.
Applicability of the AGREE II Instrument in Evaluating the Development Process and Quality of Current National Academy of Clinical Biochemistry Guidelines.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Prof. of Clinical Chemistry, Mansoura University.
Quantitative Insulin Analysis Using Liquid Chromatography–Tandem Mass Spectrometry in a High- Throughput Clinical Laboratory Z. Chen, M.P. Caulfield, M.J.
Quality Control Lecture 5
Quality Control and Patient Risk Curtis A. Parvin, Ph. D
Journal Club Recalibration of Blood Analytes over 25 Years in the Atherosclerosis Risk in Communities Study: Impact of Recalibration on Chronic Kidney.
How Science Works The following PowerPoint is aimed at enhancing skills learnt at GCSE when performing experiments. Pupils must commit the terminology.
Accuracy of 6 Routine 25-Hydroxyvitamin D assays; Influence of Vitamin D Binding Protein Concentration A.C. Heijboer, M.A. Blankenstein, I.P. Kema, and.
Prospective Evaluation of B-type Natriuretic Peptide Concentrations and the Risk of Type 2 Diabetes in Women B.M. Everett, N. Cook, D.I. Chasman, M.C.
Long-Term Prognostic Value for Patients with Chronic Heart Failure of Estimated Glomerular Filtration Rate Calculated with the New CKD-EPI Equations Containing.
Sandwich Assay for Tacrolimus Using 2 Anti-Tacrolimus Antibodies T.Q. Wei, Y.F. Zheng, M. Dubowy, and M. Sharma April
All you wanted to know about laboratory tests, but were afraid to ask By Dietmar Stöckl STT Consulting The informed patient meeting the laboratory.
Data Analysis: Quantitative Statements about Instrument and Method Performance.
CHEMISTRY ANALYTICAL CHEMISTRY Fall Lecture 6.
Introduction to Biostatistics and Bioinformatics Regression and Correlation.
Biochemistry Clinical practice CLS 432 Dr. Samah Kotb Lecturer of Biochemistry 2015 Introduction to Quality Control.
Journal Club Optimizing Early Rule-Out Strategies for Acute Myocardial Infarction: Utility of 1-Hour Copeptin P. Hillinger, R. Twerenbold, C. Jaeger, K.
Quality Control: Analysis Of Data Pawan Angra MS Division of Laboratory Systems Public Health Practice Program Office Centers for Disease Control and.
Wenclawiak, B.: Fit for Purpose – A Customers View© Springer-Verlag Berlin Heidelberg 2003 In: Wenclawiak, Koch, Hadjicostas (eds.) Quality Assurance in.
Quality Control Internal QC External QC. -Monitors a test's method precision and analytical bias. -Preparation of quality control samples and their interpretation.
 Routine viral diagnostics: indirect and direct detection of viruses. ◦ Indirect detection: serological tests; ◦ Direct detection:  Viral antigens;
Diagnostic clinical chemistry
Quality Assessment.
Pakistan Society Of Chemical Pathologists Zoom Series of Lectures ZT 24. Quality Managent 1 Brig Aamir Ijaz MCPS, FCPS, FRCP (Edin), MCPS-HPE HOD and.
Mathematically-OptimiZed Risk Evaluation Kim A
Quality Assurance in the clinical laboratory
Practical clinical chemistry
Choice of Methods and Instruments
How Science Works The following PowerPoint is aimed at enhancing skills learnt at GCSE when performing experiments. Pupils must commit the terminology.
Objectives Discuss advantages of a control chart over a run chart Describe how to set limits and revise limits on a control chart.
Introduction To Medical Technology
Quality Control Lecture 3
▪Internal quality control:
Quality Assessment The goal of laboratory analysis is to provide the accurate, reliable and timeliness result Quality assurance The overall program that.
Presentation transcript:

Utilization of Assay Performance Characteristics to Estimate Hemoglobin A 1c Result Reliability A. Woodworth, N. Korpi-Steiner, J.J. Miller, L.V. Rao, J. Yundt-Pacheco, L. Kuchipudi, C.A. Parvin, J.M. Rhea, and R. Molinaro August © Copyright 2014 by the American Association for Clinical Chemistry

© Copyright 2009 by the American Association for Clinical Chemistry Introduction – Quality Control and Risk  Analytical Quality Control (QC) Programs are developed in all CLIA Certified Laboratories to rapidly identify and correct errors.  CMS Recently Introduced a new type of QC Plan – Individualized QC Plan (IQCP)  Laboratories can decide to use traditional QC approaches, or  Risk management strategies  The risk of reporting an unreliable patient result can be determined using analytical performance requirements and characteristics of an individual assay.

© Copyright 2009 by the American Association for Clinical Chemistry Introduction  A risk based IQCP for Hemoglobin (Hb) A 1c  Ideal to pilot a risk analysis because: −Harmonized and Standardized −Defined performance characteristics −Both lab and POC platforms −Large body of clinical information guides testing  This Hb A 1c risk assessment utilizes: −Assay performance characteristics in clinical settings −Three different acceptance limits ( ±5%, 6%, and 7%) −Standard QC practice ( 1-2S with 2 levels of QC) −Same number of patients between QC events (100)

© Copyright 2009 by the American Association for Clinical Chemistry Quantitative Tools Utilized for Risk Assessment  Assay imprecision (%CV) and accuracy (%Bias)  Allowable Total Error (TE a ) - Quality specifications for acceptable differences between the true and measured results for a given assay  Patient Weighted Sigma Metrics – Sigma value calculated and averaged over the observed Hb A 1c patient distribution, where σ = [(TE a -%Bias)/CV]  E(N uf ) – The number of final patient results with errors > TE a each time there is a QC out of range  In-Control % Unreliable - Probability (%) of producing results with errors > TE a when the assay is in-control

© Copyright 2009 by the American Association for Clinical Chemistry Introduction  Aim of this Study  To evaluate the risk of reporting an unreliable Hb A 1c result when using currently available NGSP-Certified Hb A 1c methods.  The risk assessment employed: −6 different methods across 4 academic medical centers  See Editorial:  Little, RR. Performance of Hb A 1c Assay Methods: Good Enough? Clin Chem 2014;60:8:1031.

© Copyright 2009 by the American Association for Clinical Chemistry Question  Besides analytical error, what other sources of error should be considered when evaluating the risk of reporting an unreliable result? How are these errors detected?

© Copyright 2009 by the American Association for Clinical Chemistry Materials and Methods- Hb A 1c Assays InstrumentManufacturerMethodology Variant II Turbo (version 1.0) BioRadIon-Exchange HPLC Variant IIBioRadIon-Exchange HPLC Tosoh G8TosohIon-Exchange HPLC Capillarys 2Sebia Capillary Electrophoresis Cobas Integra 800RocheImmunoassay DCA Vantage-1 (old cal) SiemensPoint of Care DCA Vantage-2 (new cal) SiemensPoint of Care

© Copyright 2009 by the American Association for Clinical Chemistry Materials and Methods (n=40/lab)

© Copyright 2009 by the American Association for Clinical Chemistry Questions  What fixed conditions were used for the assessment of risk of reporting an unreliable result for each assay?  What different TE a settings were used and why?

© Copyright 2009 by the American Association for Clinical Chemistry Results – Figure 2 The percentage bias of all methods was calculated using the linear regression relationships over a range of NGSP target value-assigned Hb A 1c concentrations. These biases varied widely across the different platforms with the greatest variability in the Variant II and Integra 800 assays at low Hb A 1c concentrations. Precision was determined using vendor specific QC material and ranged from 1.28% % and 0.8% % at the low and high levels, respectively (For more detail see table 1).

© Copyright 2009 by the American Association for Clinical Chemistry The predicted change in the expected number of unreliable patient results prior to an accepted QC event E(N u f), represented in the y axis and computed over a range of possible out-of control conditions [systematic error (SE)] shown on the x axis for each Hb A 1c assay platform evaluated. Each assumes a 1-2s QC rule with 2 QCs and a mean of 100 Hb A 1c examinations between QC events and an Allowable Total Error (TE a ) of 6%. The lines for the Capillary 2 (3D) and DCA Vantage Lot 2 (3G) are almost flat because the E(N uf ) is minimal. Results – Figure 3

© Copyright 2009 by the American Association for Clinical Chemistry Results – Table 2 Three different measures of risk of reporting an unreliable result were calculated for each assay at 3 different Allowable Total Errors (TE a = 5%, 6% and 7%) including the patient weighted sigma, the % of unreliable results while the assay is in control (In-control % unreliable), and the maximum number of unreliable results due to an out of control condition (Max E(N uf )). Each was calculated assuming a 1-2s QC rule with 2 QC events per day and 100 patient samples between QC events. The Capillarys 2 had the lowest and the Integra 800 had the highest number of expected unreliable results while the assay was in control and out of control at 5% TE a.

© Copyright 2009 by the American Association for Clinical Chemistry Questions  Which was more influential on method performance (precision or bias) and how can this be checked regularly?  Based on the findings of this study, Is your laboratory running an appropriate amount of QC for your Hb A 1c method?

© Copyright 2009 by the American Association for Clinical Chemistry Summary and Conclusions  Three types of analytical characteristics can be used to assess risk of reporting an unreliable Hb A 1c result:  Assay performance characteristics (precision and bias)  QC Strategies (# of QC samples + rules)  Clinical performance requirements (TE a goals)  Risk estimates for reporting unreliable results based upon analytical performance alone varied almost 500 fold across the 6 Hb A 1c assay platforms.  At a ±6% TE a budget, all but one Hb A 1c assay in this study requires the “max affordable” QC be run.  Risk estimates for individual laboratories’ Hb A 1c methods can be utilized to assess QC practices and residual risk for reporting an unreliable Hb A 1c result.

© Copyright 2009 by the American Association for Clinical Chemistry Thank you for participating in this month’s Clinical Chemistry Journal Club. Additional Journal Clubs are available at Download the free Clinical Chemistry app on iTunes for additional content! Follow us