Center for Biofilm Engineering Al Parker, Biostatistician Experimental design and statistical analysis of in vitro models of oral biofilms July, 2012.

Slides:



Advertisements
Similar presentations
Randomized Complete Block and Repeated Measures (Each Subject Receives Each Treatment) Designs KNNL – Chapters 21,
Advertisements

Chapter 8: Estimating with Confidence
Chapter 10: Estimating with Confidence
Confidence Intervals, Effect Size and Power
Center for Biofilm Engineering Standardized Biofilm Methods Research Team Montana State University Importance of Statistical Design and Analysis Al Parker.
Comparing Two Population Means The Two-Sample T-Test and T-Interval.
1 Statistical Inference H Plan: –Discuss statistical methods in simulations –Define concepts and terminology –Traditional approaches: u Hypothesis testing.
Chapter 8 Estimation: Additional Topics
Statistical Concepts (part III) Concepts to cover or review today: –Population parameter –Sample statistics –Mean –Standard deviation –Coefficient of variation.
Statistical thinking in antibiofilm research Cord Hamilton Al Parker Marty Hamilton MBL and SBML: 23 October
Statistical Concepts (continued) Concepts to cover or review today: –Population parameter –Sample statistics –Mean –Standard deviation –Coefficient of.
An Overview of Today’s Class
Chap 9-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 9 Estimation: Additional Topics Statistics for Business and Economics.
PSY 1950 Confidence and Power December, Requisite Quote “The picturing of data allows us to be sensitive not only to the multiple hypotheses that.
Center for Biofilm Engineering CBE workshop – July 2009 Al Parker Statistician and Research Engineer Montana State University Ruggedness Assessment and.
Center for Biofilm Engineering Marty Hamilton Professor Emeritus of Statistics Montana State University Statistical design & analysis for assessing the.
Chapter 10: Estimating with Confidence
Quiz 6 Confidence intervals z Distribution t Distribution.
A National Science Foundation Engineering Research Center in the MSU College of Engineering Center for Biofilm Engineering Effect of Power, Time, and Degassing.
Standard error of estimate & Confidence interval.
Qian H. Li, Lawrence Yu, Donald Schuirmann, Stella Machado, Yi Tsong
Objectives (BPS chapter 14)
Center for Biofilm Engineering Al Parker, PhD, Biostatistician Center for Biofilm Engineering Montana State University Statistics and Biofilms June 29,
Center for Biofilm Engineering Al Parker, Biostatistician Standardized Biofilm Methods Research Team Montana State University The Importance of Statistical.
A National Science Foundation Engineering Research Center in the MSU College of Engineering Center for Biofilm Engineering Bias is defined as the systematic.
Chapter 8: Confidence Intervals
Topic 5 Statistical inference: point and interval estimate
1 SAMPLE MEAN and its distribution. 2 CENTRAL LIMIT THEOREM: If sufficiently large sample is taken from population with any distribution with mean  and.
CS433 Modeling and Simulation Lecture 16 Output Analysis Large-Sample Estimation Theory Dr. Anis Koubâa 30 May 2009 Al-Imam Mohammad Ibn Saud University.
The Scientific Method Formulation of an H ypothesis P lanning an experiment to objectively test the hypothesis Careful observation and collection of D.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
+ Chapter 12: More About Regression Section 12.1 Inference for Linear Regression.
Center for Biofilm Engineering July 2011 Albert Parker Biostatistician and Research Engineer Center for Biofilm Engineering, MSU Using equivalence testing.
Module 14: Confidence Intervals This module explores the development and interpretation of confidence intervals, with a focus on confidence intervals.
Inference for 2 Proportions Mean and Standard Deviation.
Inferential Statistics Part 1 Chapter 8 P
Confidence intervals: The basics BPS chapter 14 © 2006 W.H. Freeman and Company.
Confidence intervals. Estimation and uncertainty Theoretical distributions require input parameters. For example, the weight of male students in NUS follows.
Center for Biofilm Engineering Al Parker, Biostatistician Standardized Biofilm Methods Research Team Montana State University Statistical methods for analyzing.
1 Module One: Measurements and Uncertainties No measurement can perfectly determine the value of the quantity being measured. The uncertainty of a measurement.
Chapter 9 Inferences Based on Two Samples: Confidence Intervals and Tests of Hypothesis.
Chapter 8 Estimation ©. Estimator and Estimate estimator estimate An estimator of a population parameter is a random variable that depends on the sample.
Statistical Concepts Basic Principles An Overview of Today’s Class What: Inductive inference on characterizing a population Why : How will doing this allow.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
Chapter 8: Estimating with Confidence
Experiments, Simulations Confidence Intervals
Chapter 8: Estimating with Confidence
Chapter 10 Two-Sample Tests and One-Way ANOVA.
Hypothesis Testing.
Lecture Slides Elementary Statistics Twelfth Edition
Al-Imam Mohammad Ibn Saud University Large-Sample Estimation Theory
Statistics 200 Objectives:
Lecture 15 Sections 7.3 – 7.5 Objectives:
Confidence Intervals: The Basics
Chapter 12 Review Inference for Regression
Estimating a Population Proportion
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Lecture Slides Elementary Statistics Twelfth Edition
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Comparing Two Proportions
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Presentation transcript:

Center for Biofilm Engineering Al Parker, Biostatistician Experimental design and statistical analysis of in vitro models of oral biofilms July, 2012

What is statistical thinking?  Data/Response  Experimental Design  Uncertainty assessment

What is statistical thinking?  Data/Response (pixel intensity in an image? log(cfu) from viable plate counts?)  Experimental Design - controls - randomization - replication (How many coupons? experiments? technicians? labs?)  Uncertainty and variability assessment

Why statistical thinking?  Anticipate criticism (design method and experiments accordingly)  Provide convincing results (establish statistical properties)  Increase efficiency (conduct the least number of experiments)  Improve communication

Why statistical thinking? in vitro testing

Attributes of an in vitro method: Seven R’s  Relevance  Reasonableness  Ruggedness  Responsiveness  Reproducibility (inter-laboratory)  Resemblance  Repeatability (intra-laboratory reproducibility)

Attributes of an in vitro method: Seven R’s  Relevance  Reasonableness  Ruggedness  Responsiveness  Reproducibility (inter-laboratory)  Resemblance  Repeatability (intra-laboratory reproducibility)

Resemblance Independent repeats of the same experiment in the same laboratory produce nearly the same control data, as indicated by a small repeatability standard deviation, CS r = STDEV( Mean Controls for each experiment )

Resemblance Example Drip Flow Reactor Low shear Plug flow ASTM E2647

Resemblance Example 4 slides or coupons control treated (sterile saline) (Chlorhexidine digluconate 0.12%) Experimental Design: saliva collected from volunteers 4 day old supragingival biofilms Both saline and treatment applied for 1 minute 5 independent experimental runs

Resemblance Example Density LD Coupon cfu/cm 2 log(cfu/cm 2 ) x x ControlLD= 8.29 Data: log 10 (cfu/cm 2 ) from viable plate counts

Resemblance Example Exp coupon LD Control LD Control SD

Resemblance from experiment to experiment 1. Mean ControlLD = 7.81 the best guess for the true mean control LD 2. CS r =STDEV(ControlLDs) =0.32 the typical distance between the ControlLD for a single experiment and the true mean control LD log 10 (cfu/cm 2 ) Summary Statistics: CS r is not STDEV(LDs)

Resemblance from experiment to experiment The variance CS r 2 can be partitioned: 84% due to among experiment sources 16% due to within experiment sources log 10 (cfu/cm 2 )

CS n c m c 2 + Estimating the true mean control LD with confidence 2. Calculate the SE of Mean ControlLD, using: CS 2 c = within-experiment variance of control coupon LD CS 2 E = among-experiments variance of control coupon LD n c = number of control coupons per experiment m = number of experiments CS m E 2 SE of Mean ControlLD = CS r / = 3. CI for the true mean control LD = Mean ControlLD ± t m-1 x SE 1. Start with your best guess: Mean ControlLD m

2 5 Estimating the true mean control LD with confidence 1. Mean ControlLD = Calculate the SE of Mean ControlLD: CS 2 c = 0.16 x (.32) 2 = CS 2 E = 0.84 x (.32) 2 = n c = 2 m = 5 5 SE of Mean ControlLD = = A 95% CI for true mean control LD = 7.81 ± 2.78 x = 7.81 ± 0.33 = (7.41, 8.20)

We are 95% confident that the true mean of the control LDs is in this interval log 10 (cfu/cm 2 ) Estimating the true mean control LD with confidence

Attributes of an in vitro method: Seven R’s  Relevance  Reasonableness  Ruggedness  Responsiveness  Reproducibility (inter-laboratory)  Resemblance  Repeatability (intra-laboratory reproducibility)

Repeatability Independent repeats of the same experiment in the same laboratory produce nearly the same response, as indicated by a small repeatability standard deviation S r = STDEV( Mean response for each experiment )

Repeatability Example 4 slides or coupons control treated (saline) (Chlorhexidine digluconate 0.12%)

Repeatability Example Data/Response: log reduction (LR) LR = mean(control LDs) – mean(treated LDs)

Repeatability Example Exp coupon LD Control LD Control SD

Repeatability Example Mean LR = 1.87 Exp control coupon LD Control LD treated coupon LD Treated LDLR Since there is no obvious pairing between the controls and treated coupons in each experiment, get 1 LR for each experiment

Repeatability Example 1. Mean LR = 1.87 the best guess for the true mean LR 2. S r = STDEV(LRs) = 0.69 the typical distance between the LR for a single experiment and the true mean LR Summary Statistics:

Estimating the true mean LR with confidence 2. Calculate the SE of Mean LR, using: S 2 c = within-experiment variance of control coupon LD S 2 d = within-experiment variance of treated coupon LD S 2 E = among-experiment variance of LR n c = number of control coupons per experiment n d = number of treated coupons per experiment m = number of experiments 1. Start with your best guess: Mean LR S n c m c 2 + S n d m d 2 + S m E 2 SE of mean LR = S r / = 3. CI for the true mean LR = Mean LR ± t m-1 x SE m

Estimating the true mean LR with confidence 1. Mean LR = S c 2 = S d 2 = S E 2 = n c = 2, n d = 2, m = 5 SE of mean LR = = % CI for true mean LR= 1.87 ± 2.78 x = 1.87 ± = (1.01, 2.73)

We are 95% confident that the true mean LR is in this interval Estimating the true mean LR with confidence

How many coupons? experiments? no. control coupons (n c ): no. treated coupons (n d ): no. experiments (m) n c m m n d m margin of error= t m-1 x

Summary  Even though biofilms are complicated, it is feasible to develop in vitro methods that meet the “Seven R” criteria.  Good experiments use controls, randomization where possible, and sufficient replication.  Assess uncertainty by reporting CIs.  To reduce uncertainty, invest effort in conducting more experiments instead of using more coupons in a single experiment.  For additional statistical resources for biofilm methods, check out:

Any questions?