Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 14 Sequential Experimentation, Screening Designs, Fold-Over Designs.

Slides:



Advertisements
Similar presentations
CSUN Engineering Management Six Sigma Quality Engineering Week 11 Improve Phase.
Advertisements

Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 15 Analysis of Data from Fractional Factorials and Other Unbalanced.
II.4 Sixteen Run Fractional Factorial Designs  Introduction  Resolution Reviewed  Design and Analysis  Example: Five Factors Affecting Centerpost Gasket.
Chapter 6 The 2k Factorial Design
Design and Analysis of Experiments
1 Chapter 6 The 2 k Factorial Design Introduction The special cases of the general factorial design (Chapter 5) k factors and each factor has only.
Constrained Optimization 3-8 Continuous &/or Discrete Linear + Cross-products (interactions) Good predictions of effects and interactions 2-Level Factorial.
Chapter 8 Two-Level Fractional Factorial Designs
1 Design & Analysis of Multistratum Randomized Experiments Ching-Shui Cheng Dec. 8, 2006 National Tsing Hua University.
Chapter 28 Design of Experiments (DOE). Objectives Define basic design of experiments (DOE) terminology. Apply DOE principles. Plan, organize, and evaluate.
Fractional factorial Chapter 8 Hand outs. Initial Problem analysis Eyeball, statistics, few graphs Note what problems are and what direction would be.
Stat Today: Start Chapter 4 Assignment 4:.
1 Design & Analysis of Multi-Stratum Randomized Experiments Ching-Shui Cheng June 6, 2008 National Sun Yat-sen University.
Fractional Factorial Designs 2 7 – Factorial Design in 8 Experimental Runs to Measure Shrinkage in Wool Fabrics J.M. Cardamone, J. Yao, and A. Nunez (2004).
L. M. LyeDOE Course1 Design and Analysis of Multi-Factored Experiments Fractional Factorial Designs.
1 Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 5 Complete Factorial Experiments, Completely Randomized Designs,
1 14 Design of Experiments with Several Factors 14-1 Introduction 14-2 Factorial Experiments 14-3 Two-Factor Factorial Experiments Statistical analysis.
 The factorial function (n!)  Permutations  Combinations.
Factorial Experiments
For Discussion Today (when the alarm goes off) Survey your proceedings for just one paper in which factorial design has been used or, if none, one in which.
Chapter 8Design and Analysis of Experiments 8E 2012 Montgomery 1 Design of Engineering Experiments The 2 k-p Fractional Factorial Design Text reference,
CPE 619 2k-p Factorial Design
Chapter 3: Screening Designs
DOX 6E Montgomery1 Design of Engineering Experiments Part 7 – The 2 k-p Fractional Factorial Design Text reference, Chapter 8 Motivation for fractional.
Dr. Gary Blau, Sean HanMonday, Aug 13, 2007 Statistical Design of Experiments SECTION V SCREENING.
Chapter 4 Fractional factorial Experiments at two levels
1 Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 6 Solving Normal Equations and Estimating Estimable Model Parameters.
The Essentials of 2-Level Design of Experiments Part II: The Essentials of Fractional Factorial Designs The Essentials of 2-Level Design of Experiments.
Chapter 4 sections 1 and 2.  Fig. 1  Not connected  All vertices are even.  Fig. 2  Connected  All vertices are even.
Engineering Statistics ENGR 592 Prepared by: Mariam El-Maghraby Date: 26/05/04 Design of Experiments Plackett-Burman Box-Behnken.
1 Chapter 3: Screening Designs 3.1 Fractional Factorial Designs 3.2 Blocking with Screening Designs.
Fractional Factorial Design Full Factorial Disadvantages Full Factorial Disadvantages –Costly (Degrees of freedom wasted on estimating higher order terms)
Statistical Analysis Professor Lynne Stokes
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 17 Block Designs.
1 The General 2 k-p Fractional Factorial Design 2 k-1 = one-half fraction, 2 k-2 = one-quarter fraction, 2 k-3 = one-eighth fraction, …, 2 k-p = 1/ 2 p.
Lecture 9 Page 1 CS 239, Spring 2007 More Experiment Design CS 239 Experimental Methodologies for System Software Peter Reiher May 8, 2007.
IE341 Midterm. 1. The effects of a 2 x 2 fixed effects factorial design are: A effect = 20 B effect = 10 AB effect = 16 = 35 (a) Write the fitted regression.
III.7 Blocking Two-level Designs _ Blocking _ Example _ Four Blocks _ Exercise.
1 Resolution III Designs Designs with main effects aliased with two- factor interactions Used for screening (5 – 7 variables in 8 runs, variables.
Design Of Experiments With Several Factors
1 The 2 k-p Fractional Factorial Design Text reference, Chapter 8 Motivation for fractional factorials is obvious; as the number of factors becomes large.
Solutions. 1.The tensile strength of concrete produced by 4 mixer levels is being studied with 4 replications. The data are: Compute the MS due to mixers.
Specific Comparisons This is the same basic formula The only difference is that you are now performing comps on different IVs so it is important to keep.
The American University in Cairo Interdisciplinary Engineering Program ENGR 592: Probability & Statistics 2 k Factorial & Central Composite Designs Presented.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 15 Review.
II.3 Screening Designs in Eight Runs: Other Screening Designs in 8 runs  In addition to 5 factors in 8 runs, Resolution III designs can be used to study.
Fractional Factorial Designs Andy Wang CIS 5930 Computer Systems Performance Analysis.
1 Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 9 Review.
L. M. LyeDOE Course1 Design and Analysis of Multi-Factored Experiments Fractional Factorials Not Based on the Powers of 2 – Irregular Designs.
Designs for Experiments with More Than One Factor When the experimenter is interested in the effect of multiple factors on a response a factorial design.
1 Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture #10 Testing the Statistical Significance of Factor Effects.
No-Confounding Designs1 Alternatives to Resolution IV Screening Designs in 16 Runs Douglas C. Montgomery Regents’ Professor of Industrial Engineering &
L. M. LyeDOE Course1 Design and Analysis of Multi-Factored Experiments Part I Experiments in smaller blocks.
1 Chapter 8 Two-level Fractional Factorial Designs.
1 Chapter 8 Two-level Fractional Factorial Designs.
1 Fractional Factorial Designs Consider a 2 k, but with the idea of running fewer than 2 k treatment combinations. Example: (1) 2 3 design- run 4 t.c.’s.
Design and Analysis of Multi-Factored Experiments
Fractional Factorial Design
AB AC AD AE AF 5 ways If you used AB, then, there would be 4 remaining ODD vertices (C, D, E and F) CD CE CF 3 ways If you used CD, then, there.
I=ABD=ACE=BCF=BCDE=ACDF=ABEF=DEF
Exploring Partially ordered sets
The Essentials of 2-Level Design of Experiments Part II: The Essentials of Fractional Factorial Designs Developed by Don Edwards, John Grego and James.
Latin Square Designs.
II.4 Sixteen Run Fractional Factorial Designs
III.7 Blocking Two-level Designs
Text reference, Chapter 8
II.2 Four Factors in Eight Runs
For Discussion Today Survey your proceedings for just one paper in which factorial design has been used or, if none, one in which it could have been used.
Design matrix Run A B C D E
Presentation transcript:

Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 14 Sequential Experimentation, Screening Designs, Fold-Over Designs

Don’t Risk all Experimental Resources on a Single Comprehensive Experiment Usually many inert factors, few dominant ones Unexpected effects may be found early Experiment could be terminated early with substantial cost savings Comprehensive evaluation of a few dominant factors is usually more informative than little information on many factors

Conduct a Screening Experiment to Identify Dominant Factors Augment the Screening Experiment to Identify Strong Two-Factor Interactions Conduct a R V Experiment with the Dominant Factors Comprehensive Experiment with a Few Factors and Multiple Levels or Design to Quantitatively Characterize the Response Surface Figure 7.7 A simple strategy for a sequence of experiments.

Sequential Experimentation Large experiments Design so that key fractions can be run in sequence Key fractions : Resolution III, IV, or V Analyze each sequence of data as it is completed Based on the results of the analysis Continue experiment Terminate Redesign with dominant/new factors

Acid Plant Corrosion Study Factor Raw Material Feed Rate3,000pph6,000pph Gas Temperature100 o C220 o C Scrubber Water5%20% Reactor Bed Acid20%30% Exit Temperture300 o C360 o C Reactant Distribution PointEastWest Coded Level Plant must cease commercial production during experimentation -- test runs must be minimized MGH Table 7.1

Screening Experiments Very few test runs Ability to assess main effects only Generally leads to a comprehensive evaluation of a few dominant factors Potential for bias Highly effective for isolating vital few strong effects should be used ONLY under the proper circumstances Highly effective for isolating vital few strong effects should be used ONLY under the proper circumstances

Plackett-Burman Screening Designs Any number of factors, each having 2 levels Interactions nonexistent or negligible Relative to main effects Number of test runs is a multiple of 4 At least 6 more test runs than factors should be used

Construction Determine the number of factors (k) to be included in the design Determine the experiments size : at least k + 6 6df for error Select the design generator from Table 7A2 Generate the rows of the design Design generator is the first row Move all levels in the previous row one position to the left; move the first level of the previous row to the last position Continue the previous step until n - 1 rows are filled The last row has all levels equal to -1

Construction (con’t) Randomize Randomly Assign Factors to Columns; Delete Unassigned Columns Randomly Permute the Rows

Acid Plant Corrosion Study Factor Raw Material Feed Rate3,000pph6,000pph Gas Temperature100 o C220 o C Scrubber Water5%20% Reactor Bed Acid20%30% Exit Temperture300 o C360 o C Reactant Distribution PointEastWest Coded Level Seeking identification of dominant main effects

Plackett-Burman Design : Corrosion Study k = 6 Factors n = 12 (Minimum Recommended) Design Generator

Plackett-Burman Design : Corrosion Study k = 6 Factors n = 12 (Minimum Recommended)

Plackett-Burman Design : Corrosion Study k = 6 Factors n = 12 (Minimum Recommended)

Plackett-Burman Design : Corrosion Study k = 6 Factors n = 12 (Minimum Recommended)

Plackett-Burman Design : Corrosion Study Randomly assign factors to columns

Plackett-Burman Design : Corrosion Study Eliminate unassigned columns randomly permute rows

Plackett-Burman Design : Corrosion Study Resolution III

Human Performance Testing Response Eye Focus Time (ms) Predictors (A) Acuity or Sharpness of Vision (B) Distance from Eye to Target (C) Target Shape (D) Illumination Level (E) Target Size (F) Target Density (G) Subject 2 Levels Each Only a few effects anticipated, no interactions Only a few effects anticipated, no interactions

Design Considerations Complete factorial : repeats = repeats Very few effects expected, no interactions Solution Fractional Factorial R III Solution Fractional Factorial R III

Human Performance Testing Design: Defining Equation I = ABD = ACE = BCF = ABCG Added Factors D = AB, E = AC, F = BC, G = ABC Implicit Equations = 11 n = 8

Human Performance Testing Complete Defining Relation I = ABD = ACE = BCF = ABCG = BCDE = ACDF = CDG = ABEF = BEG = AFG = DEF = ADEG = CEFG = BDFG = ABCDEFG Implicit Contrasts

Human Performance Testing Complete Defining Relation I = ABD = ACE = BCF = ABCG = BCDE = ACDF = CDG = ABEF = BEG = AFG = DEF = ADEG = CEFG = BDFG = ABCDEFG Implicit Contrasts Main-Effect Aliases A = BD = CE = FG B = AD = CF = EG C = AE = BF = DG D = AB = CG = EF E = AC = BG = DF F = BC = AG = DE G = CD = BE = AF Assuming No 3fi

Human Performance Testing Complete Defining Relation I = ABD = ACE = BCF = ABCG = BCDE = ACDF = CDG = ABEF = BEG = AFG = DEF = ADEG = CEFG = BDFG = ABCDEFG Implicit Contrasts Main-Effect Aliases A + BD + CE + FG B + AD + CF + EG C + AE + BF + DG D + AB + CG + EF E + AC + BG + DF F + BC + AG + DE G + CD + BE + AF Alternative Interpretation of Aliasing: Each Measured Effect is the Sum of Four Effects Alternative Interpretation of Aliasing: Each Measured Effect is the Sum of Four Effects

Human Performance Testing

Conclusions A, B, and D are the primary factors that affect eye focus times

Human Performance Testing Conclusions A, B, and D are the primary factors that affect eye focus times Key Main-Effect Aliases A = BD B = AD D = AB Could the primary effects be only two factors and their interaction ?

Human Performance Testing Fold-Over Design: Defining Equation I = -ABD = -ACE = -BCF = -ABCG Added Factors -D = AB, -E = AC, -F = BC, -G = ABC Reverse the signs on all levels of all factors in the design Reverse the signs on all levels of all factors in the design

Human Performance Testing: Fold-Over Design

Combined Effects: Original DesignA + BD + CE + FG Fold-Over DesignA - BD - CE - FG AverageA Difference/2 BD + CE + FG Conclusion: Reversing ALL signs in a second fraction unaliases ALL main effects from two-factor interactions (still assumes higher-order interactions are negligible)

Human Performance Testing: Fold-Over Design Conclusions ? n = 16 Original Design: D = AB

Fold-Over Designs Reverse the signs on one or more factors Run a second fraction with the sign reversals Use the confounding pattern of the original and the fold-over design to determine the alias structure Averages Half-Differences

Human Performance Testing Complete Defining Relation Reversing the Signs on B I = -ABD = ACE = -BCF = -ABCG = -BCDE = ACDF = CDG = -ABEF = -BEG = AFG = DEF = ADEG = CEFG = -BDFG = -ABCDEFG Main-Effect Aliases A - BD + CE + FG -B + AD + CF + EG C + AE - BF + DG D - AB + CG + EF E + AC - BG + DF F - BC + AG + DE G + CD - BE + AF

Human Performance Testing: Fold-Over Design Combined Effects: Original DesignA + BD + CE + FG Fold-Over DesignA - BD + CE + FG AverageA + CE + FG Difference/2 BD Conclusion: Reversing the signs on ONE factor in a second fraction unaliases its main effect and ALL its two-factor interactions Original DesignB + AD + CF + EG Fold-Over Design -B + AD + CF + EG Average AD + CE + FG Difference/2B Similar With All Main Effects Except B