CHEN 4860 Unit Operations Lab Design of Experiments (DOE) With excerpts from “Strategy of Experiments” from Experimental Strategies, Inc.

Slides:



Advertisements
Similar presentations
Multiple Regression Analysis
Advertisements

Chapter 6 The 2k Factorial Design
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs The Essentials of 2-Level Design of Experiments Part I:
Experimental Design, Response Surface Analysis, and Optimization
11.1 Introduction to Response Surface Methodology
II.2 Four Factors in Eight Runs Some Fiber Optics Examples and Exercises* Some DOE’s Some DOE’s Responses: Responses: –Shrinkage (S) –Excess.
1 Chapter 6 The 2 k Factorial Design Introduction The special cases of the general factorial design (Chapter 5) k factors and each factor has only.
BA 555 Practical Business Analysis
Econ Prof. Buckles1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 1. Estimation.
1 BA 275 Quantitative Business Methods Residual Analysis Multiple Linear Regression Adjusted R-squared Prediction Dummy Variables Agenda.
Chapter 8 Two-Level Fractional Factorial Designs
Elementary hypothesis testing Purpose of hypothesis testing Type of hypotheses Type of errors Critical regions Significant levels Hypothesis vs intervals.
CHEN 4860 Unit Operations Lab Design of Experiments (DOE) With excerpts from “Strategy of Experiments” from Experimental Strategies, Inc.
Lecture 17 Today: Start Chapter 9 Next day: More of Chapter 9.
Chapter 9 - Lecture 2 Computing the analysis of variance for simple experiments (single factor, unrelated groups experiments).
1 Terminating Statistical Analysis By Dr. Jason Merrick.
Factorial Experiments
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs The Essentials of 2-Level Design of Experiments Part I:
Chapter 8Design and Analysis of Experiments 8E 2012 Montgomery 1 Design of Engineering Experiments The 2 k-p Fractional Factorial Design Text reference,
Chapter 3: Screening Designs
Sampling Distribution of the Mean Central Limit Theorem Given population with and the sampling distribution will have: A mean A variance Standard Error.
DOX 6E Montgomery1 Design of Engineering Experiments Part 7 – The 2 k-p Fractional Factorial Design Text reference, Chapter 8 Motivation for fractional.
Dr. Gary Blau, Sean HanMonday, Aug 13, 2007 Statistical Design of Experiments SECTION V SCREENING.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 14 Sequential Experimentation, Screening Designs, Fold-Over Designs.
1 The General 2 k Factorial Design Section 6-4, pg. 224, Table 6-9, pg. 225 There will be k main effects, and.
Engineering Statistics ENGR 592 Prepared by: Mariam El-Maghraby Date: 26/05/04 Design of Experiments Plackett-Burman Box-Behnken.
1 Chapter 3: Screening Designs 3.1 Fractional Factorial Designs 3.2 Blocking with Screening Designs.
Fractional Factorial Design Full Factorial Disadvantages Full Factorial Disadvantages –Costly (Degrees of freedom wasted on estimating higher order terms)
1 Statistical Distribution Fitting Dr. Jason Merrick.
DOX 6E Montgomery1 Unreplicated 2 k Factorial Designs These are 2 k factorial designs with one observation at each corner of the “cube” An unreplicated.
Lecture 8 Simple Linear Regression (cont.). Section Objectives: Statistical model for linear regression Data for simple linear regression Estimation.
1 Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u.
III.7 Blocking Two-level Designs _ Blocking _ Example _ Four Blocks _ Exercise.
1 Resolution III Designs Designs with main effects aliased with two- factor interactions Used for screening (5 – 7 variables in 8 runs, variables.
ELEC 303 – Random Signals Lecture 18 – Classical Statistical Inference, Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 4, 2010.
MSE-415: B. Hawrylo Chapter 13 – Robust Design What is robust design/process/product?: A robust product (process) is one that performs as intended even.
Robust System Design Session #11 MIT Plan for the Session Quiz on Constructing Orthogonal Arrays (10 minutes) Complete some advanced topics on OAs Lecture.
Solutions. 1.The tensile strength of concrete produced by 4 mixer levels is being studied with 4 replications. The data are: Compute the MS due to mixers.
The American University in Cairo Interdisciplinary Engineering Program ENGR 592: Probability & Statistics 2 k Factorial & Central Composite Designs Presented.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 15 Review.
1 Prof. Dr. Rainer Stachuletz Multiple Regression Analysis y =  0 +  1 x 1 +  2 x  k x k + u 1. Estimation.
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs The Essentials of 2-Level Design of Experiments Part I:
Introducing Communication Research 2e © 2014 SAGE Publications Chapter Seven Generalizing From Research Results: Inferential Statistics.
6.1 - One Sample One Sample  Mean μ, Variance σ 2, Proportion π Two Samples Two Samples  Means, Variances, Proportions μ 1 vs. μ 2.
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs The Essentials of 2-Level Design of Experiments Part I:
Chapter 8. Process and Measurement System Capability Analysis
What we give up to do Exploratory Designs 1. Hicks Tire Wear Example data 2.
1 Chapter 8 Two-level Fractional Factorial Designs.
Stats Methods at IC Lecture 3: Regression.
Psych 231: Research Methods in Psychology
Two-Sample Hypothesis Testing
Chapter 13 Simple Linear Regression
Statistical Methods For Engineers
BA 275 Quantitative Business Methods
Comparing Populations
Special Topics In Design
Psych 231: Research Methods in Psychology
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs Developed by Don Edwards, John Grego and James Lynch.
Some 24-1 DOE’s Responses: Shrinkage (S) Excess Length (L)
Replicated Binary Designs
The Essentials of 2-Level Design of Experiments Part II: The Essentials of Fractional Factorial Designs Developed by Don Edwards, John Grego and James.
Inferential Statistics
Text reference, Chapter 8
ENM 310 Design of Experiments and Regression Analysis Chapter 3
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs Developed by Don Edwards, John Grego and James Lynch.
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs Developed by Don Edwards, John Grego and James Lynch.
Latin and Graeco-Latin Squares
14 Design of Experiments with Several Factors CHAPTER OUTLINE
Chapter 13 Simple Linear Regression
Presentation transcript:

CHEN 4860 Unit Operations Lab Design of Experiments (DOE) With excerpts from “Strategy of Experiments” from Experimental Strategies, Inc.

DOE Lab Schedule

DOE Lab Schedule Details  Lecture 2 Limitations of Factorial Design  Centerpoint Design  Screening Designs  Response Surface Designs  Formal Report

Limitations of Factorial Design Circumventing Shortcomings

Limitations of 2 k Factorials  Optimum number of trials? “Signal-to-Noise” ratio  Nonlinearity? 3 k factorial or center point factorial  Inoperable regions? Tuck method  Too many variables? Screening designs  Fractional Factorial  Plackett-Burman  Need detailed understanding? Response Surface Plots

Number of Runs vs. Signal/Noise Ratio  Confidence Interval or Signal FEavg + t*SeffFEavg - t*Seff   FEavg + t*SeffFEavg - t*Seff

Number of Runs vs. Signal/Noise Ratio  Avg + t*Seff   = 2*t*Seff  Seff = 2*Se/sqrt(N)   = 2*2*t*Se/sqrt(N)  Rearrange, N (total number of trials) is:  N=[2*2*t/(/Se)]^2  Estimate t as approximately 2  N=[(7 or 8)/(/Se)]^2

Number of Runs vs. Signal/Noise Ratio  (/Se) is the signal to noise ratio. Ratio (/Se) Number of Runs to to to to 256

Number of Runs vs. Signal/Noise Ratio

Factorial Design (2 k )  2 is number of levels (low, high)  What about non-linearity? A B C LO, HI, LO LO, LO, LO Pts (A, B, C) HI, LO, LO HI, HI, LO HI, LO, HI HI, HI, HI LO, HI, HI LO, HI, LO

Centerpoint Test for Nonlinearity  Additional pts. located at midpoints of factor levels. (No longer 8 runs, Now 20) A B C LO, HI, LO LO, LO, LO Pts (A, B, C) HI, LO, LO HI, HI, LO HI, LO, HI HI, HI, HI LO, HI, HI LO, HI, LO

Centerpoint Test for Non-linearity  Effect(nonlinearity) =Ynoncpavg-Ycavg  What about significance? Calculate variance of non-centerpoint (cp) tests as normal (S^2) Calculate variances of cp (Sc^2) Degrees of Freedom (df) for base design  (#noncp runs)*(reps/run-1) DF for cp (dfc)  (#cp runs-1) Calculate weighted avg variance  Se^2 = [(df*S^2)+(dfc*Sc^2)]/(dfc+df) Snonlin=Se*sqrt(1/Nnoncp+1/Ncp) dftot=dfc+df Lookup t from table using dftot Calculate DL = + t*Snonlin

Better Way to Test Non-Linearity  Use response surface plots with Face Centered Cubes, Box-Behnken Designs, and others. Face-Centered Cube (15 runs)Box-Behnken Design (13 runs)

Inoperable Regions  Don’t shrink design, pull corner inward X1 X2 X1 X2 BADGOOD

Diagnosing the Environment  Too many variables, use screening designs to pick best candidates for factorial design Screening Designs Full Factorial Designs Response Surface Designs Many Independent Variables Fewer independent variables (<5) “Crude” Information Quality Linear Prediction Quality non-linear Prediction

Screening Designs  Benefits: Only few more runs than factors needed Used for 6 or more factors  Limitations: Can’t measure any interactions or non- linearity. Assume effects are independent of each other

Screening Designs  # of runs needed # of FactorsFull FactorialScreening Design , , , ,388, ,217,72828

Screening Designs  Fractional Factorial Interactions are totally confounded with each other in identifiable sets called “aliases”. Available in sizes that are powers of 2.  Plackett-Burman Interactions are partially correlated with other effects in identifiable patterns Available in sizes that are multiples of 4.

Fractional Factorial (1/2-Factorial)  Suppose we want to study 4 factors, but don’t want to run the 16 experiments (or 32 with replication). ABCABACBCABC Typical Full Factorial

Fractional Factorial  What happens if we replace the unlikely ABC interaction with a new variable D? The other 2 factor interactions become confounded with one another to form “aliases”  AB=CD, AC=BD, AD=BC The other 3 factor interactions become confounded with the main factor to also form “aliases”  A=BCD, B=ACD, C=ABD

Fractional Factorial  Ignoring the unlikely 3 factor interaction, we have… ABCDAB=CDAC=BDAD=BC

Fractional Factorial  Calculations performed the same  If the effects of interactions prove to be significant, perform a full factorial with the main effects to determine which interaction is most important.

Plackett-Burman  Benefits: Can study more factors in less experiments  Costs: Main factor in confounded with all 2 factor interactions.  Suppose we want to study 7 factors, but only want to run 8 experiments (or 16 with replication).

Plackett-Burman A=BD= CG=EF B=AD= CE=FG C=AG= BE=DF D=AB= CF=EG E=AF= BC=DG F=AE= BG=CD G=AC= BF=DE

Plackett-Burman  Calculations performed the same  How do you handle confounding of main affects? Use General Rules:  Heredity: Large main effects have interactions  Sparsity: Interactions are of a lower magnitude than main effects  Process Knowledge Use Reflection

Reflection of Plackett-Burman  Reruns the same experiment with the opposite signs. A=BD= CG=EF B=AD= CE=FG C=AG= BE=DF D=AB= CF=EG E=AF=B C=DG F=AE=B G=CD G=AC= BF=DE

Reflection of Plackett-Burman  Treats 2 factor responses as noise  Average the effects from each run to determine the true main effect Normal  E(A)calc=E(A)act-Noise Reflected  E(A)calcr=E(A)actr+Noise Combined  E(A)est=(E(A)calc+E(A)calcr)/2

Response Surface Plots  Need detail for more than 1 response variable and related interactions  Types 3 level factorial Face-Centered Cube Design Box-Behnken Design  Many experiments required

Size of Response Surface Design Number of Factors 3-level Factorial Face- Centered Cube* Box- Behnken* *extra space left for multiple center points due to blocking

Summary  Diagnose your problem  Use one of the many different methods outlined to circumvent it  Many more options and designs listed on the web

Formal Memo  Follow outline presented for formal memo presented on Dr. Placek’s website. Executive Summary Discussion and Results Appendix with Data, Calcs, References, etc.  **GOAL IS PLANNING**

Formal Memo Report Questions  What are your objectives?  How did you minimize random and bias error?  What variables did you control and why?  What variables did you measure and why?  What were the results of your experiment?  Which factors were most important and why?  What is your theory (based on chem-eng knowledge) on why the experiment turned out the way it did?  Was there any codependence?  What will be your next experiment?  What would you do differently the next time?