2014 A Statistical Clinical Decision Support Tool in Telemonitoring Using Predictive Analytics © Celeste Fralick, Ph.D. Principal Engineer, Chief Data.

Slides:



Advertisements
Similar presentations
Chapter 4 Pattern Recognition Concepts: Introduction & ROC Analysis.
Advertisements

Learning Algorithm Evaluation
©2014 IDBS, Confidential Statistical Process Control Workshop An Introduction to the Principles behind SPC Ilca Croufer.
© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/ Other Classification Techniques 1.Nearest Neighbor Classifiers 2.Support Vector Machines.
Lecture Notes for Chapter 4 (2) Introduction to Data Mining
Chapter 6 - Part 1 Introduction to SPC.
Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
Assessing and Comparing Classification Algorithms Introduction Resampling and Cross Validation Measuring Error Interval Estimation and Hypothesis Testing.
x – independent variable (input)
Model Evaluation Metrics for Performance Evaluation
Supervised classification performance (prediction) assessment Dr. Huiru Zheng Dr. Franscisco Azuaje School of Computing and Mathematics Faculty of Engineering.
Statistical Process Control (SPC)
Data mining and statistical learning - lecture 13 Separating hyperplane.
Jeremy Wyatt Thanks to Gavin Brown
ROC & AUC, LIFT ד"ר אבי רוזנפלד.
T T Population Variance Confidence Intervals Purpose Allows the analyst to analyze the population confidence interval for the variance.
General Mining Issues a.j.m.m. (ton) weijters Overfitting Noise and Overfitting Quality of mined models (some figures are based on the ML-introduction.
Chapter 5 Data mining : A Closer Look.
Statistical Process Control
Evaluating Classifiers
Attention Deficit Hyperactivity Disorder (ADHD) Student Classification Using Genetic Algorithm and Artificial Neural Network S. Yenaeng 1, S. Saelee 2.
A Multivariate Biomarker for Parkinson’s Disease M. Coakley, G. Crocetti, P. Dressner, W. Kellum, T. Lamin The Michael L. Gargano 12 th Annual Research.
ROC 1.Medical decision making 2.Machine learning 3.Data mining research communities A technique for visualizing, organizing, selecting classifiers based.
Copyright © 2014, 2011 Pearson Education, Inc. 1 Chapter 14 Sampling Variation and Quality.
Error estimation Data Mining II Year Lluís Belanche Alfredo Vellido.
Performance measurement. Must be careful what performance metric we use For example, say we have a NN classifier with 1 output unit, and we code ‘1 =
Understanding Variation in Your Charts Module 5. What is the state of Statistical Control? A stable mean over time with only random variation about that.
Process Capability and Statistical Process Control.
© Copyright 2004 ECE, UM-Rolla. All rights reserved A Brief Overview of Neural Networks By Rohit Dua, Samuel A. Mulder, Steve E. Watkins, and Donald C.
WOW World of Walkover-weight “My God, it’s full of cows!” (David Bowman, 2001)
Experiments in Machine Learning COMP24111 lecture 5 Accuracy (%) A BC D Learning algorithm.
Categorical data. Decision Tree Classification Which feature to split on? Try to classify as many as possible with each split (This is a good split)
Control Charts An Introduction to Statistical Process Control.
Empirical Research Methods in Computer Science Lecture 7 November 30, 2005 Noah Smith.
BAGGING ALGORITHM, ONLINE BOOSTING AND VISION Se – Hoon Park.
Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
11/23/2015ENGM 720: Statistical Process Control1 ENGM Lecture 08 P, NP, C, & U Control Charts.
Evaluating Results of Learning Blaž Zupan
1 Appendix D: Application of Genetic Algorithm in Classification Duong Tuan Anh 5/2014.
Model Evaluation l Metrics for Performance Evaluation –How to evaluate the performance of a model? l Methods for Performance Evaluation –How to obtain.
Bab /57 Bab 4 Classification: Basic Concepts, Decision Trees & Model Evaluation Part 2 Model Overfitting & Classifier Evaluation.
Evaluating Predictive Models Niels Peek Department of Medical Informatics Academic Medical Center University of Amsterdam.
Machine Learning Tutorial-2. Recall, Precision, F-measure, Accuracy Ch. 5.
Evaluating Classification Performance
Machine Learning 5. Parametric Methods.
Chapter 5: Credibility. Introduction Performance on the training set is not a good indicator of performance on an independent set. We need to predict.
Statistics Presentation Ch En 475 Unit Operations.
Lecture 8 Estimation and Hypothesis Testing for Two Population Parameters.
Risk Adjusted X-bar Chart Farrokh Alemi, Ph.D. Based on Work of Eric Eisenstein and Charles Bethea, The use of patient mix-adjusted control charts to compare.
Control Charts. Statistical Process Control Statistical process control is a collection of tools that when used together can result in process stability.
Neural networks (2) Reminder Avoiding overfitting Deep neural network Brief summary of supervised learning methods.
CSE 4705 Artificial Intelligence
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
COMPLETE BUSINESS STATISTICS
ECE 471/571 – Lecture 18 Classifier Fusion 04/12/17.
Classification Evaluation And Model Selection
Generalization ..
Data Mining Classification: Alternative Techniques
A simple database Project Size (FP) Effort (Pm) Cost Rs. (000) Pp. doc
Experiments in Machine Learning
Learning Algorithm Evaluation
IOPS Toolkit for Risk-based Supervision
Parametric Estimation
Statistics for Business and Economics
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
JMP 11 added new features and improvements to CCB and MSA.
MIS2502: Data Analytics Classification Using Decision Trees
Basic Training for Statistical Process Control
Presentation transcript:

2014 A Statistical Clinical Decision Support Tool in Telemonitoring Using Predictive Analytics © Celeste Fralick, Ph.D. Principal Engineer, Chief Data Scientist Analytic Products & Technologies Internet of Things Group Intel Corporation #GHC

Agenda  Challenge and Approach  Segregating Clinical & Statistical Thresholds  Classification Model  Predicting Future Episodes  Summary & Future Studies

Challenge & Approach Provide clinician with robust statistical thresholds using Statistical Process Control (SPC) & Western Electric Rules Patient’s own data will drive thresholds; normal variation seen Use predictive analytics to forecast the probable classification Predict next day’s vital sign reading and whether it’s statistically normal for that patient Provide opportunity for clinicians to intervene earlier, lower costs & hospital readmissions, and improve patient outcomes. Elder with COPD or CHFClinicians monitoring vitals Broadband & Private Cloud Clinician derived thresholds colors

Clinician Derived Threshold Forced Expiratory Volume in 1 sec in L (FEV1, P#18) Date in Time Series (7/09-7/10) Peak Flow with Two Thresholds (Clinician & Statistical) InterventionTestHypState Statistically Derived State Clinician Derived Combined State Result IntervenedTPH0H0 1 Threshold violation1 1,14 Did not intervene but should have (statistically)FNH1H1 1 Threshold violation0 No threshold violation1,04 Intervened but shouldn't have (statistically)FPH1H1 0 No threshold violation1 Threshold violation0,14 No intervention necessaryTNH0H0 0 No threshold violation0 0,047 Rule Point Location Detection 1 One point beyond Zone A Detects a shift in the mean, an increase in the standard deviation, or a single aberration in the process. 2 Nine points in a row in a single (upper or lower) side of Zone C or beyond Detects a shift in the process mean. Confusion matrix & ROC available FP FN TPTP

ParameterResult Disease SeveritySevere Mean / N / 59 UCL / LCL / Std Dev Variance0.83 Skewness / Kurtosis / DistributionNormal 2 Mixture Training Gen R Square Validation Gen R Square (Polynomial Shift) Date in Time Series (7/09-7/10)

σ edge misclassifications Deeper analytics provide deeper insight: Pre- & post predictive algorithm of SPC zones generally agree Severe & Very Severe COPD patients provide better predictive models Mean FEV1 FP → FN % negligible increase for moderate COPD

DiseaseWeightBlood pressure FEV1PEFSpO2Pulse CHFIncreases Decreases Increases/ arrhythmia COPDIncreases in severe cases IncreasesDecreases Increases/ arrhythmia

2014 Summary  Provided Clinical Decision Support using elder’s own vitals rather than generalizing  By applying a unique neural net algorithm, able to classify successfully  Personalized prediction of vital sign may impact disease outcome, re-hospitalization

2014 Future Studies  Additional vital signs for specific disease  Additive algorithms to increase fit and accuracy  Reduce sources of errors via tightly controlled clinical study  Consider better neural net penalty to address overfitting 4/16/2013crf9

2014 Got Feedback? Rate and Review the session using the GHC Mobile App To download visit

2014 Backup

Investigated a random K-fold (5) for predicting values & classification – Cross-validation technique for small sample sizes in neural networks 4/16/2013crf12 Random K-Fold Data TR VAL TP FN FP TN TR X- bar xval 5x VAL X- bar Act Func Act Func Nodes Transformation Responses Act Func Input