AJ Le Compte, CG Pretty, GM Shaw, JG Chase Introduction Elucidating links between glycemic control and clinical outcome requires reliable discrimination.

Slides:



Advertisements
Similar presentations
II. Potential Errors In Epidemiologic Studies Random Error Dr. Sherine Shawky.
Advertisements

© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/ Other Classification Techniques 1.Nearest Neighbor Classifiers 2.Support Vector Machines.
From the homework: Distribution of DNA fragments generated by Micrococcal nuclease digestion mean(nucs) = bp median(nucs) = 110 bp sd(nucs+ = 17.3.
MODELING METHOD Glucose-Insulin System Model CLINICAL DATA DATA: Are taken from the SPRINT [3] TGC cohort totalling 393 patients and ~40,000 patient hours.
REVIEW I Reliability Index of Reliability Theoretical correlation between observed & true scores Standard Error of Measurement Reliability measure Degree.
Evaluating Hypotheses
Examples of Ensemble Methods
7-2 Estimating a Population Proportion
Experimental Evaluation
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Lecture Slides Elementary Statistics Eleventh Edition and the Triola Statistics Series by.
Lehrstuhl für Informatik 2 Gabriella Kókai: Maschine Learning 1 Evaluating Hypotheses.
Sample Size Determination
Hypothesis Testing Is It Significant?. Questions What is a statistical hypothesis? What is the null hypothesis? Why is it important for statistical tests?
Quality Assurance in the clinical laboratory
1 Psych 5500/6500 Statistics and Parameters Fall, 2008.
INFERENTIAL STATISTICS – Samples are only estimates of the population – Sample statistics will be slightly off from the true values of its population’s.
Multiple Choice Questions for discussion
Determining Sample Size
Inference in practice BPS chapter 16 © 2006 W.H. Freeman and Company.
Chapter 7 Estimation: Single Population
Sampling. Concerns 1)Representativeness of the Sample: Does the sample accurately portray the population from which it is drawn 2)Time and Change: Was.
Real-time control Model-Based Blood Glucose Control for Neonatal Intensive Care Engineering robust solutions for our most fragile infants Background and.
Validation of a Virtual Patient and Virtual Trials Method for Accurate Prediction of TGC Protocol Performance F Suhaimi 1,5, A.J. LeCompte 1, S Penning.
Sample size determination Nick Barrowman, PhD Senior Statistician Clinical Research Unit, CHEO Research Institute March 29, 2010.
L.M. Fisk, A.J. Le Compte, G.M. Shaw, S. Penning, T. Desaive, J.G. Chase Pilot Trial of STAR in Medical ICU INTRODUCTION Background: Accurate glycemic.
© Copyright 2009 by the American Association for Clinical Chemistry Glucose Meter Performance Criteria for Tight Glycemic Control Estimated by Simulation.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Prof. of Clinical Chemistry, Mansoura University.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Chapter 7 Estimates and Sample Sizes 7-1 Review and Preview 7-2 Estimating a Population Proportion.
Estimating a Population Proportion
Research Process Parts of the research study Parts of the research study Aim: purpose of the study Aim: purpose of the study Target population: group whose.
Properties of OLS How Reliable is OLS?. Learning Objectives 1.Review of the idea that the OLS estimator is a random variable 2.How do we judge the quality.
통계적 추론 (Statistical Inference) 삼성생명과학연구소 통계지원팀 김선우 1.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7-1 Review and Preview.
Multiple Testing Matthew Kowgier. Multiple Testing In statistics, the multiple comparisons/testing problem occurs when one considers a set of statistical.
Education 793 Class Notes Decisions, Error and Power Presentation 8.
BC Jung A Brief Introduction to Epidemiology - XIII (Critiquing the Research: Statistical Considerations) Betty C. Jung, RN, MPH, CHES.
Organization of statistical research. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and.
IMPORTANCE OF STATISTICS MR.CHITHRAVEL.V ASST.PROFESSOR ACN.
© Copyright McGraw-Hill 2004
Various Topics of Interest to the Inquiring Orthopedist Richard Gerkin, MD, MS BGSMC GME Research.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 6-4 Sampling Distributions and Estimators.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Applied Quantitative Analysis and Practices LECTURE#30 By Dr. Osman Sadiq Paracha.
REVIEW I Reliability scraps Index of Reliability Theoretical correlation between observed & true scores Standard Error of Measurement Reliability measure.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Lecture Slides Elementary Statistics Eleventh Edition and the Triola Statistics Series by.
Education 793 Class Notes Inference and Hypothesis Testing Using the Normal Distribution 8 October 2003.
BIOSTATISTICS Lecture 2. The role of Biostatisticians Biostatisticians play essential roles in designing studies, analyzing data and creating methods.
European Patients’ Academy on Therapeutic Innovation The Purpose and Fundamentals of Statistics in Clinical Trials.
Update on the Online Conversion Process for AEPSi: Implications for OSEP Reporting.
Hypothesis Testing and Statistical Significance
Approaches to quantitative data analysis Lara Traeger, PhD Methods in Supportive Oncology Research.
Evaluating Hypotheses. Outline Empirically evaluating the accuracy of hypotheses is fundamental to machine learning – How well does this estimate its.
Direct method of standardization of indices. Average Values n Mean:  the average of the data  sensitive to outlying data n Median:  the middle of the.
Slides to accompany Weathington, Cunningham & Pittenger (2010), Chapter 11: Between-Subjects Designs 1.
Understanding Results
CHAPTER 9 Testing a Claim
Hypothesis Testing Is It Significant?.
12 Inferential Analysis.
Elementary Statistics
CHAPTER 9 Testing a Claim
Update on the Online Conversion Process for AEPSi:
CHAPTER 9 Testing a Claim
12 Inferential Analysis.
CHAPTER 9 Testing a Claim
Lecture Slides Elementary Statistics Twelfth Edition
CHAPTER 9 Testing a Claim
REVIEW I Reliability scraps Index of Reliability
Type I and Type II Errors
CHAPTER 9 Testing a Claim
Presentation transcript:

AJ Le Compte, CG Pretty, GM Shaw, JG Chase Introduction Elucidating links between glycemic control and clinical outcome requires reliable discrimination between groups with different target blood glucose (BG) cut-offs. Point-of-care glucometers are commonly used, but lower accuracy means BG errors will impact classification and thus outcome analyses. This study reanalyses a BG control trial with an error model of a typical glucometer to assess the impact of sensor errors on interpretation of trial results. Introduction Elucidating links between glycemic control and clinical outcome requires reliable discrimination between groups with different target blood glucose (BG) cut-offs. Point-of-care glucometers are commonly used, but lower accuracy means BG errors will impact classification and thus outcome analyses. This study reanalyses a BG control trial with an error model of a typical glucometer to assess the impact of sensor errors on interpretation of trial results. Methods A model of sensor bias and variance (CV %, Regression: y= x) was used to estimate possible ‘true’ BG profiles from measured/observed BG and repeated 100 times for each patient. BG profiles from N=301 patients (stay>24hrs) from the SPRINT trial with BG measurements measured using the Arkray SuperGlucocard II GT-1630 were reanalysed to determine how sensor errors affect classifying patients into categories of “good” and “poor” control. The defined cut-off for “Good” control for a patient was at least 70% of BG in 72–126mg/dL (cTIB>=0.7), and “Poor” as less than 70% (cTIB<0.7), based on original observed clinical BG. The number of true BG profiles that resulted in misclassification between “Good” and “Poor” control for a patient was recorded. Methods A model of sensor bias and variance (CV %, Regression: y= x) was used to estimate possible ‘true’ BG profiles from measured/observed BG and repeated 100 times for each patient. BG profiles from N=301 patients (stay>24hrs) from the SPRINT trial with BG measurements measured using the Arkray SuperGlucocard II GT-1630 were reanalysed to determine how sensor errors affect classifying patients into categories of “good” and “poor” control. The defined cut-off for “Good” control for a patient was at least 70% of BG in 72–126mg/dL (cTIB>=0.7), and “Poor” as less than 70% (cTIB<0.7), based on original observed clinical BG. The number of true BG profiles that resulted in misclassification between “Good” and “Poor” control for a patient was recorded. Results Good control was clinically measured in 76% of patients (24% with cTIB<0.7). Of these, 83% of “Good” and 64% of “Poor” control would never be misclassified over all 100 runs due to sensor error. The chance of misclassification was less than 10% for 91% (good) and 87.5% (poor) of patients. If the “Good” cut-off was cTIB>=0.5 (95% of clinical patients) then correct classification was 97% for good control patients, but fell to 40% of poor control patients as most SPRINT patients with cTIB<0.5 were close to the cut-off value and thus likely to be affected by sensor error. Results Good control was clinically measured in 76% of patients (24% with cTIB<0.7). Of these, 83% of “Good” and 64% of “Poor” control would never be misclassified over all 100 runs due to sensor error. The chance of misclassification was less than 10% for 91% (good) and 87.5% (poor) of patients. If the “Good” cut-off was cTIB>=0.5 (95% of clinical patients) then correct classification was 97% for good control patients, but fell to 40% of poor control patients as most SPRINT patients with cTIB<0.5 were close to the cut-off value and thus likely to be affected by sensor error. Glucometer accuracy and implications for clinical studies Conclusions 1)Glucometers can distinguish between patients that received good and poor BG control. 2)Cut-off values must account for sensor errors. Deadbands may be required to ensure patients are unlikely to be misclassified. 3)The proportion of patients that could be misclassified depends on the underlying distribution. Hence, feasible cut-off values are constrained to prevent sensor errors resulting in significant misclassification. 4)Sensor errors affect the ability to observe the population, and are independent of Type-I and Type-II sampling errors. Conclusions 1)Glucometers can distinguish between patients that received good and poor BG control. 2)Cut-off values must account for sensor errors. Deadbands may be required to ensure patients are unlikely to be misclassified. 3)The proportion of patients that could be misclassified depends on the underlying distribution. Hence, feasible cut-off values are constrained to prevent sensor errors resulting in significant misclassification. 4)Sensor errors affect the ability to observe the population, and are independent of Type-I and Type-II sampling errors. Research question: Classify patients into “good” and “poor” BG control categories “Good” = at least 70% of BG measurements in target BG band (4 – 7 mmol/L, 72 – 126 mg/dL) “Poor” = less than 70% of measurements in target band. Research question: Classify patients into “good” and “poor” BG control categories “Good” = at least 70% of BG measurements in target BG band (4 – 7 mmol/L, 72 – 126 mg/dL) “Poor” = less than 70% of measurements in target band. Example research study Glucometer used for clinical BG measurements. What is the chance a “good” patient was actually “poor”? Glucometer used for clinical BG measurements. What is the chance a “good” patient was actually “poor”? “Poor” control “Good” control Clinical results 76% were “Good” 24% were “Poor” Clinical results 76% were “Good” 24% were “Poor” Result: Patient very likely to be classified “good” despite glucometer errors Start: Clinically reported time in target band: 85% Model of BG sensor to estimate true glucose profile Estimated true time in target band: 83% Range of true time in target band: 83-86%  all above 70% cut-off Repeat 100x to generate range of potential “true” BG Clinical result Never misclassified Chance of mis- classification < 10% Good 76%83%91% Poor 24%64%88% Clinical result Never misclassified Chance of mis- classification < 10% Good 95%97%99% Poor 5%40%67% Patients with cTIB near 0.7 were more likely to be misclassified when accounting for glucometer error. A “deadband” around the cut-off would reduce this misclassification. Patients unlikely to be influenced by glucometer errors Glucometer errors could cause these patients to be placed in the wrong group. Thus there is greater uncertainty in which group these patients belong. Distribution of cTIB in clinical results For cTIB cut-off of 0.5 few SPRINT patients are below cut- off, and those that are were close to 0.5. Thus this cut-off value may result in less reliable interpretation of results. Patients at risk of being placed in wrong group form a large proportion of total cTIB < 0.5 patients. Deadbands around cut-off values Deadband of uncertain patient results due to glucometer errors Distribution of cTIB in clinical results Clinical accuracy Sensor model