Quality Control In Critical Care Training By Zyllan Spilsbury (F2)

Slides:



Advertisements
Similar presentations
Inferential Statistics and t - tests
Advertisements

Statistics Review – Part II Topics: – Hypothesis Testing – Paired Tests – Tests of variability 1.
U.S. Food and Drug Administration Notice: Archived Document The content in this document is provided on the FDA’s website for reference purposes only.
8. Evidence-based management Step 3: Critical appraisal of studies
Statistics for the Social Sciences
Stat 512 – Lecture 12 Two sample comparisons (Ch. 7) Experiments revisited.
Statistics for the Social Sciences Psychology 340 Fall 2006 Review For Exam 1.
3 rd Summer School in Computational Biology September 10, 2014 Frank Emmert-Streib & Salissou Moutari Computational Biology and Machine Learning Laboratory.
Chapter 11: Inference for Distributions
Statistical Treatment of Data Significant Figures : number of digits know with certainty + the first in doubt. Rounding off: use the same number of significant.
Calculating sample size for a case-control study
September 26, 2012 DATA EVALUATION AND ANALYSIS IN SYSTEMATIC REVIEW.
Hypothesis Testing and T-Tests. Hypothesis Tests Related to Differences Copyright © 2009 Pearson Education, Inc. Chapter Tests of Differences One.
Regression and Correlation Methods Judy Zhong Ph.D.
Chapter 8 Introduction to Hypothesis Testing
Claims about a Population Mean when σ is Known Objective: test a claim.
ISE 352: Design of Experiments
Research Process Research Process Step One – Conceptualize Objectives Step One – Conceptualize Objectives Step Two – Measure Objectives Step Two – Measure.
5-1 Introduction 5-2 Inference on the Means of Two Populations, Variances Known Assumptions.
Research Process Step One – Conceptualization of Objectives Step Two – Measurement of Objectives Step Three – Determine Sampling Technique Step Four –
Simple Linear Regression
Population All members of a set which have a given characteristic. Population Data Data associated with a certain population. Population Parameter A measure.
Week 8 Chapter 8 - Hypothesis Testing I: The One-Sample Case.
Copyright © 2012 by Nelson Education Limited. Chapter 7 Hypothesis Testing I: The One-Sample Case 7-1.
Experimental Methods Sept 13 & 14 Objective: Students will be able to explain and evaluate the research methods used in psychology. Agenda: 1. CBM 2. Reading.
Statistics. Key statistics and their purposes Chi squared test: determines if a data set is random or accounted for by an unwanted variable Standard deviation:
Systematic Review Module 7: Rating the Quality of Individual Studies Meera Viswanathan, PhD RTI-UNC EPC.
Literature searching & critical appraisal Chihaya Koriyama August 15, 2011 (Lecture 2)
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 4 Gathering Data Section 4.3 Good and Poor Ways to Experiment.
Review of Chapters 1- 6 We review some important themes from the first 6 chapters 1.Introduction Statistics- Set of methods for collecting/analyzing data.
Chapter 12 A Primer for Inferential Statistics What Does Statistically Significant Mean? It’s the probability that an observed difference or association.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Experimental Design Experiment: A type of research study that tests the idea that one variable causes an effect on another variable.
KidSIM Journal Club Presenter: Amani Azizalrahman June 19 th, 2014.
6.3 THE CENTRAL LIMIT THEOREM. DISTRIBUTION OF SAMPLE MEANS  A sampling distribution of sample means is a distribution using the means computed from.
Human-Computer Interaction. Overview What is a study? Empirically testing a hypothesis Evaluate interfaces Why run a study? Determine ‘truth’ Evaluate.
How to read a paper D. Singh-Ranger. Academic viva 2 papers 1 hour to read both Viva on both papers Summary-what is the paper about.
ITEC6310 Research Methods in Information Technology Instructor: Prof. Z. Yang Course Website: c6310.htm Office:
: An alternative representation of level of significance. - normal distribution applies. - α level of significance (e.g. 5% in two tails) determines the.
Framework of Preferred Evaluation Methodologies for TAACCCT Impact/Outcomes Analysis Random Assignment (Experimental Design) preferred – High proportion.
Sifting through the evidence Sarah Fradsham. Types of Evidence Primary Literature Observational studies Case Report Case Series Case Control Study Cohort.
Evaluating VR Systems. Scenario You determine that while looking around virtual worlds is natural and well supported in VR, moving about them is a difficult.
Chapter 7: The Distribution of Sample Means. Frequency of Scores Scores Frequency.
Research and Methodology. Vocab Review-- Hypothesis? Independent vs. Dependent Variable? Operational Definition? Validity vs. Reliability? Sample vs.
How to Read a Journal Article. Basics Always question: – Does this apply to my clinical practice? – Will this change how I treat patients? – How could.
Statistical Criteria for Establishing Safety and Efficacy of Allergenic Products Tammy Massie, PhD Mathematical Statistician Team Leader Bacterial, Parasitic.
Insert Program or Hospital Logo Introduction ► Due to changes in delivery room practices, improvement in clinical care, and limitations on the time spent.
Chapter 9 Hypothesis Testing.
Part Two.
Critically Appraising a Medical Journal Article
Statistics for the Social Sciences
How to read a paper D. Singh-Ranger.
Test for Goodness of Fit
12 Inferential Analysis.
AP Statistics: Chapter 7
Issues in Inferential Statistics
Two-sided p-values (1.4) and Theory-based approaches (1.5)
CHAPTER 29: Multiple Regression*
9 Tests of Hypotheses for a Single Sample CHAPTER OUTLINE
Gerald Dyer, Jr., MPH October 20, 2016
Improved Patient Outcomes Best Available Clinical Evidence Patient’s
P-VALUE.
12 Inferential Analysis.
Psych 231: Research Methods in Psychology
Goodness of Fit.
Chapter 6 Confidence Intervals.
Research Methods Chapter 2.
Hypothesis Testing for Proportions
Testing a Claim About a Standard Deviation or Variance
7.4 Hypothesis Testing for Proportions
Presentation transcript:

Quality Control In Critical Care Training By Zyllan Spilsbury (F2)

Contents Background Search criteria The paper Summary Validity Methodology Results Discussion

The Problem: Intubation and acute airway management training for trainees. Learning curve vs. Kantian Ideal How do you find balance?

What to do with airways? Preparation Pre-oxygenation Premedication Paralysis Placement Post management

The Search:

The Search

Paper: The Usefulness of Design of Experimentation in Defining the Effect Difficult Airway Factors and Training Have on Simulator Oral-Tracheal Intubation Success Rates in Novice Intubators Frank Thomas, Judi Carpenter, Carol Rhoades, Renee Holleran, Gregory Snow Academic Emergency Medicine Journal – 2010; doi: /j x

The study: Full Factorial design of experimentation – Six factors (Straight vs curved blade, trismus, tongue oedema, laryngeal spasm, pharyngeal obstruction and cervical immobilization) 64 airway scenarios were randomly assigned to 12 nurses (single blinded) First pass intubation rates and tracheal intubation time before and after didactic training Statistics: – Binary variable with intubation success measured as a linear model. – Two way interactions between the six factors

Validity Population – 12 Critical Care Transport Nurses (novice intubator) – Recruitment bias – Small study Intervention – 4 hour didactic intubation training – 5 attempts at normal (grade 1) intubation Comparison – Before and after training; – Null- Intubation success would not change between different difficult airway scenarios in the pre and post training cohorts Outcome – First pass tracheal/oesophageal intubation rates – Tracheal Intubation time (laryngoscope entry to 3 successful breaths) Study set out to detect a beneficial effect No conflict of interests noted

Methodology Use of a model “Laerdal difficult airway simulator” 64 different airway scenarios – Randomized Single blind study. Only randomized the first time. Bias. – How were they different? – Unknown how many scenarios each person underwent? Training process- – 4hour program including airway adjuncts, RSI, observation of instructional video and 5 successful attempts at intubating the model 3 month process from start to finish- – Other confounders?

Results Normal probability plots created to test the null hypothesis based on predictions Straight blade, tongue oedema and laryngeal spasm all reduced first pass intubation. (p<0.01) No difference in trismus, pharyngeal obstruction or cervical immobilization. 1st attemptintubation TrachealOesophagealMean Tracheal Intubation Time Pre training19%17%97 seconds Post training36%16%81 seconds

Results- Reliability All p values and CIs stated Standard deviations for time to intubate quoted but large. No statistical analysis of previous experience as confounder. All figures are expressed as proportions (%) – How big were the sample sizes? Wrong statistical test used for first attempt intubation – Chi squared instead of normal distribution analysis

Relevance Strange to assess “straight blade” as a “difficult airway” Intubation time is an odd thing to measure as it will not necessarily correspond to safety Assuming the results are robust: – Significant increase in first time intubation rates and times following training on a model. – Training on a model did not adversely affect intubation rate. Specific study population-> results may differ in Drs or Anaesthetic trainees. No Control. How good can models be compared to the real thing?

Conclusions Impossible to form perfect study as models are no substitute for humans Small study group Poorly randomized Poor presentation of results (proportions) Unusual outcomes Odd statistical testing Improvement in first pass intubation rate by training Good idea but poor delivery

Many Thanks! Special Mention to Victoria Treadway. References: 1) The Usefulness of Design of Experimentation in Defining the Effect Difficult Airway Factors and Training Have on Simulator Oral-Tracheal Intubation Success Rates in Novice Intubators. Frank Thomas, Judi Carpenter, Carol Rhoades, Renee Holleran, Gregory Snow. Academic Emergency Medicine Journal. 2010; doi: /j x 2) Difficult airway society guidelines 2004