CPE 619 2k-p Factorial Design

Slides:



Advertisements
Similar presentations
2k-p Fractional Factorial Designs
Advertisements

CSUN Engineering Management Six Sigma Quality Engineering Week 11 Improve Phase.
Incomplete Block Designs. Randomized Block Design We want to compare t treatments Group the N = bt experimental units into b homogeneous blocks of size.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 15 Analysis of Data from Fractional Factorials and Other Unbalanced.
II.2 Four Factors in Eight Runs Introduction Introduction Confounding Confounding –Confounding/Aliasing –Alias Structure Examples and Exercises Examples.
Fractional Factorial Designs of Experiments
Experimental Design, Response Surface Analysis, and Optimization
Friday, May 14, 2004 ISYS3015 Analytical Methods for IS Professionals School of IT, The University of Sydney 1 Factorial Designs Week 9 Lecture 2.
Statistics CSE 807.
L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 1 MER301: Engineering Reliability LECTURE 14: Chapter 7: Design of Engineering.
Chapter 8 Two-Level Fractional Factorial Designs
Shivkumar Kalyanaraman Rensselaer Polytechnic Institute 1 Introduction to Experiment Design Shiv Kalyanaraman Rensselaer Polytechnic Institute
Review of Matrix Algebra
k r Factorial Designs with Replications r replications of 2 k Experiments –2 k r observations. –Allows estimation of experimental errors Model:
Shivkumar Kalyanaraman Rensselaer Polytechnic Institute 1 Introduction to Experiment Design Shiv Kalyanaraman Rensselaer Polytechnic Institute
P M V Subbarao Professor Mechanical Engineering Department
1 14 Design of Experiments with Several Factors 14-1 Introduction 14-2 Factorial Experiments 14-3 Two-Factor Factorial Experiments Statistical analysis.
Factorial Experiments
For Discussion Today (when the alarm goes off) Survey your proceedings for just one paper in which factorial design has been used or, if none, one in which.
One-Factor Experiments Andy Wang CIS 5930 Computer Systems Performance Analysis.
Fractional Factorial Experiments (Continued) The concept of design resolution is a useful way to categorize fractional factorial designs. The higher the.
Chapter 8Design and Analysis of Experiments 8E 2012 Montgomery 1 Design of Engineering Experiments The 2 k-p Fractional Factorial Design Text reference,
CPE 619 Simple Linear Regression Models Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama.
DOX 6E Montgomery1 Design of Engineering Experiments Part 7 – The 2 k-p Fractional Factorial Design Text reference, Chapter 8 Motivation for fractional.
Ratio Games and Designing Experiments Andy Wang CIS Computer Systems Performance Analysis.
Dr. Gary Blau, Sean HanMonday, Aug 13, 2007 Statistical Design of Experiments SECTION V SCREENING.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 14 Sequential Experimentation, Screening Designs, Fold-Over Designs.
Dr. Gary Blau, Sean HanMonday, Aug 13, 2007 Statistical Design of Experiments SECTION IV FACTORIAL EXPERIMENTATION.
The Essentials of 2-Level Design of Experiments Part II: The Essentials of Fractional Factorial Designs The Essentials of 2-Level Design of Experiments.
Introduction to Experimental Design
Design of Engineering Experiments Part 5 – The 2k Factorial Design
14-1 Introduction An experiment is a test or series of tests. The design of an experiment plays a major role in the eventual solution of the problem.
Engineering Statistics ENGR 592 Prepared by: Mariam El-Maghraby Date: 26/05/04 Design of Experiments Plackett-Burman Box-Behnken.
1 FACTORIAL EXPERIMENTS THIS APPROACH HAS SIGNIFICANT ADVANTAGES AND DISADVANTAGES.
Fractional Factorial Design Full Factorial Disadvantages Full Factorial Disadvantages –Costly (Degrees of freedom wasted on estimating higher order terms)
Statistical Analysis Professor Lynne Stokes
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 17 Block Designs.
ENGR 610 Applied Statistics Fall Week 9
Lecture 9 Page 1 CS 239, Spring 2007 More Experiment Design CS 239 Experimental Methodologies for System Software Peter Reiher May 8, 2007.
IE341 Midterm. 1. The effects of a 2 x 2 fixed effects factorial design are: A effect = 20 B effect = 10 AB effect = 16 = 35 (a) Write the fitted regression.
III.7 Blocking Two-level Designs _ Blocking _ Example _ Four Blocks _ Exercise.
1 Resolution III Designs Designs with main effects aliased with two- factor interactions Used for screening (5 – 7 variables in 8 runs, variables.
Design Of Experiments With Several Factors
CPE 619 Experimental Design Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama in Huntsville.
1 The 2 k-p Fractional Factorial Design Text reference, Chapter 8 Motivation for fractional factorials is obvious; as the number of factors becomes large.
CPE 619 Two-Factor Full Factorial Design With Replications Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The.
Solutions. 1.The tensile strength of concrete produced by 4 mixer levels is being studied with 4 replications. The data are: Compute the MS due to mixers.
The American University in Cairo Interdisciplinary Engineering Program ENGR 592: Probability & Statistics 2 k Factorial & Central Composite Designs Presented.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 15 Review.
CPE 619 One Factor Experiments Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama in.
CPE 619 Comparing Systems Using Sample Data Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of.
Experiment Design Overview Number of factors 1 2 k levels 2:min/max n - cat num regression models2k2k repl interactions & errors 2 k-p weak interactions.
Fractional Factorial Designs Andy Wang CIS 5930 Computer Systems Performance Analysis.
L. M. LyeDOE Course1 Design and Analysis of Multi-Factored Experiments Fractional Factorials Not Based on the Powers of 2 – Irregular Designs.
Designs for Experiments with More Than One Factor When the experimenter is interested in the effect of multiple factors on a response a factorial design.
1 Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture #10 Testing the Statistical Significance of Factor Effects.
Engineering Statistics Design of Engineering Experiments.
1 Chapter 8 Two-level Fractional Factorial Designs.
1 Chapter 8 Two-level Fractional Factorial Designs.
2 k-p Designs k factors two levels for each factor will only run 2 -p of the possible factor combinations will only run 2 k-p observations total.
Introduction to Experiment Design
DESIGN OF EXPERIMENTS.
Design and Analysis of Multi-Factored Experiments
The Essentials of 2-Level Design of Experiments Part II: The Essentials of Fractional Factorial Designs Developed by Don Edwards, John Grego and James.
ENM 310 Design of Experiments and Regression Analysis Chapter 3
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs Developed by Don Edwards, John Grego and James Lynch.
II.2 Four Factors in Eight Runs
For Discussion Today Survey your proceedings for just one paper in which factorial design has been used or, if none, one in which it could have been used.
14 Design of Experiments with Several Factors CHAPTER OUTLINE
Presentation transcript:

CPE 619 2k-p Factorial Design Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama in Huntsville http://www.ece.uah.edu/~milenka http://www.ece.uah.edu/~lacasa

PART IV: Experimental Design and Analysis How to: Design a proper set of experiments for measurement or simulation Develop a model that best describes the data obtained Estimate the contribution of each alternative to the performance Isolate the measurement errors Estimate confidence intervals for model parameters Check if the alternatives are significantly different Check if the model is adequate

Introduction 2k-p Fractional Factorial Designs Sign Table for a 2k-p Design Confounding Other Fractional Factorial Designs Algebra of Confounding Design Resolution

2k-p Fractional Factorial Designs Large number of factors ) large number of experiments ) full factorial design too expensive ) Use a fractional factorial design 2k-p design allows analyzing k factors with only 2k-p experiments 2k-1 design requires only half as many experiments 2k-2 design requires only one quarter of the experiments

Example: 27-4 Design Study 7 factors with only 8 experiments!

Fractional Design Features Full factorial design is easy to analyze due to orthogonality of sign vectors Fractional factorial designs also use orthogonal vectors That is The sum of each column is zero åi xij =0 8 j jth variable, ith experiment The sum of the products of any two columns is zero åi xijxil=0 8 j¹ l The sum of the squares of each column is 27-4, that is, 8 åi xij2 = 8 8 j

Analysis of Fractional Factorial Designs Model: Effects can be computed using inner products

Example 19.1 Factors A through G explain 37.26%, 4.74%, 43.40%, 6.75%, 0%, 8.06%, and 0.03% of variation, respectively  Use only factors C and A for further experimentation

Sign Table for a 2k-p Design Steps: Prepare a sign table for a full factorial design with k-p factors Mark the first column I Mark the next k-p columns with the k-p factors Of the (2k-p-k-p-1) columns on the right, choose p columns and mark them with the p factors which were not chosen in step 1

Example: 27-4 Design

Example: 24-1 Design

Confounding Confounding: Only the combined influence of two or more effects can be computed.

Confounding (cont’d) ) Effects of D and ABC are confounded. Not a problem if qABC is negligible.

Confounding (cont’d) Confounding representation: D=ABC Other Confoundings: I=ABCD ) confounding of ABCD with the mean

Other Fractional Factorial Designs A fractional factorial design is not unique. 2p different designs Confoundings: Not as good as the previous design

Algebra of Confounding Given just one confounding, it is possible to list all other confoundings Rules: I is treated as unity. Any term with a power of 2 is erased. Multiplying both sides by A:

Algebra of Confounding (cont’d) Multiplying both sides by B, C, D, and AB: and so on. Generator polynomial: I=ABCD For the second design: I=ABC. In a 2k-p design, 2p effects are confounded together

Example 19.7 In the 27-4 design: Using products of all subsets:

Example 19.7 (cont’d) Other confoundings:

Design Resolution Order of an effect = Number of terms Order of ABCD = 4, order of I = 0. Order of a confounding = Sum of order of two terms E.g., AB=CDE is of order 5. Resolution of a Design = Minimum of orders of confoundings Notation: RIII = Resolution-III = 2k-pIII Example 1: I=ABCD  RIV = Resolution-IV = 24-1IV

Design Resolution (cont’d) Example 2: I = ABD  RIII design. Example 3: This is a resolution-III design A design of higher resolution is considered a better design

Case Study 19.1: Latex vs. troff

Case Study 19.1 (cont’d) Design: 26-1 with I=BCDEF

Case Study 19.1: Conclusions Over 90% of the variation is due to: Bytes, Program, and Equations and a second order interaction Text file size were significantly different making it's effect more than that of the programs High percentage of variation explained by the ``program £ Equation'' interaction  Choice of the text formatting program depends upon the number of equations in the text. troff not as good for equations

Case Study 19.1: Conclusions (cont’d) Low ``Program £ Bytes'' interaction ) Changing the file size affects both programs in a similar manner. In next phase, reduce range of file sizes. Alternately, increase the number of levels of file sizes.

Case Study 19.2: Scheduler Design Three classes of jobs: word processing, data processing, and background data processing. Design: 25-1 with I=ABCDE

Measured Throughputs

Effects and Variation Explained

Case Study 19.2: Conclusions For word processing throughput (TW): A (Preemption), B (Time slice), and AB are important. For interactive jobs: E (Fairness), A (preemption), BE, and B (time slice). For background jobs: A (Preemption), AB, B (Time slice), E (Fairness). May use different policies for different classes of workloads. Factor C (queue assignment) or any of its interaction do not have any significant impact on the throughput. Factor D (Requiring) is not effective. Preemption (A) impacts all workloads significantly. Time slice (B) impacts less than preemption. Fairness (E) is important for interactive jobs and slightly important for background jobs.

Summary Fractional factorial designs allow a large number of variables to be analyzed with a small number of experiments Many effects and interactions are confounded The resolution of a design is the sum of the order of confounded effects A design with higher resolution is considered better

Exercise 19.1 Analyze the 24-1 design: Quantify all main effects Quantify percentages of variation explained Sort the variables in the order of decreasing importance List all confoundings Can you propose a better design with the same number of experiments What is the resolution of the design?

Exercise 19.2 Is it possible to have a 24-1III design? a 24-1II design? 24-1IV design? If yes, give an example.

Homework Updated Exercise 19.1 Analyze the 24-1 design: Quantify all main effects. Quantify percentages of variation explained. Sort the variables in the order of decreasing importance. List all confoundings. Can you propose a better design with the same number of experiments. What is the resolution of the design?

Solution to Exercise 19.1 3. A, C, D, AB, B, BC, BD

Solution to Exercise 19.1 (cont’d)

Solution to Homework