Partition Experimental Designs for Sequential Process Steps: Application to Product Development Leonard Perry, Ph.D., MBB, CSSBB, CQE Associate Professor.

Slides:



Advertisements
Similar presentations
Connie M. Borror, Arizona State University West Christine M. Anderson-Cook, Los Alamos National Laboratory Bradley Jones, JMP SAS Institute Construction.
Advertisements

Design of Experiments Lecture I
CSUN Engineering Management Six Sigma Quality Engineering Week 11 Improve Phase.
Chapter 6 The 2k Factorial Design
Sampling plans Given a domain, we can reduce the prediction error by good choice of the sampling points The choice of sampling locations is called “design.
11.1 Introduction to Response Surface Methodology
2 n Factorial Experiment 4 Factor used to Remove Chemical Oxygen demand from Distillery Spent Wash R.K. Prasad and S.N. Srivastava (2009). “Electrochemical.
1 Chapter 6 The 2 k Factorial Design Introduction The special cases of the general factorial design (Chapter 5) k factors and each factor has only.
14-1 Introduction An experiment is a test or series of tests. The design of an experiment plays a major role in the eventual solution of the problem.
IE 673Session 7 - Process Improvement (Continued) 1 Process Improvement (Continued)
L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 14 1 MER301: Engineering Reliability LECTURE 14: Chapter 7: Design of Engineering.
Chapter 8 Two-Level Fractional Factorial Designs
1 Design & Analysis of Multistratum Randomized Experiments Ching-Shui Cheng Dec. 8, 2006 National Tsing Hua University.
Industrial Applications of Response Surface Methodolgy John Borkowski Montana State University Pattaya Conference on Statistics Pattaya, Thailand.
1 Design & Analysis of Multi-Stratum Randomized Experiments Ching-Shui Cheng June 6, 2008 National Sun Yat-sen University.
Design-Expert version 71 What’s New in Design-Expert version 7 Factorial and RSM Design Pat Whitcomb November, 2006.
Design and Analysis of Engineering Experiments
10.1 Chapter 10 Optimization Designs Optimization Designs CS RO R Focus: A Few Continuous Factors Output: Best Settings Reference: Box, Hunter &
Chapter 1Based on Design & Analysis of Experiments 7E 2009 Montgomery 1 Design and Analysis of Engineering Experiments Ali Ahmad, PhD.
Process exploration by Fractional Factorial Design (FFD)
1 14 Design of Experiments with Several Factors 14-1 Introduction 14-2 Factorial Experiments 14-3 Two-Factor Factorial Experiments Statistical analysis.
VIII. Introduction to Response Surface Methodology
Annex I: Methods & Tools prepared by some members of the ICH Q9 EWG for example only; not an official policy/guidance July 2006, slide 1 ICH Q9 QUALITY.
Fractional Factorial Experiments (Continued) The concept of design resolution is a useful way to categorize fractional factorial designs. The higher the.
Chapter 8Design and Analysis of Experiments 8E 2012 Montgomery 1 Design of Engineering Experiments The 2 k-p Fractional Factorial Design Text reference,
DOX 6E Montgomery1 Design of Engineering Experiments Part 7 – The 2 k-p Fractional Factorial Design Text reference, Chapter 8 Motivation for fractional.
Robust Design Integrated Product and Process Development MeEn 475/476 “Great Product, Solid, and just always works.” - CNET user review of MacBook Pro.
Robust Design ME 470 Systems Design Fall Why Bother? Customers will pay for increased quality! Customers will be loyal for increased quality!
Dr. Gary Blau, Sean HanMonday, Aug 13, 2007 Statistical Design of Experiments SECTION V SCREENING.
Chapter 4 Fractional factorial Experiments at two levels
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 14 Sequential Experimentation, Screening Designs, Fold-Over Designs.
Industrial Applications of Experimental Design John Borkowski Montana State University University of Economics and Finance HCMC, Vietnam.
1 Design and Analysis of Engineering Experiments Chapter 1: Introduction.
1 The General 2 k Factorial Design Section 6-4, pg. 224, Table 6-9, pg. 225 There will be k main effects, and.
Copyright © 2010 Pearson Addison-Wesley. All rights reserved. Chapter 15 2 k Factorial Experiments and Fractions.
Engineering Statistics ENGR 592 Prepared by: Mariam El-Maghraby Date: 26/05/04 Design of Experiments Plackett-Burman Box-Behnken.
EQT373 STATISTIC FOR ENGINEERS Design of Experiment (DOE) Noorulnajwa Diyana Yaacob School of Bioprocess Engineering Universiti Malaysia Perlis 30 April.
1 The Drilling Experiment Example 6-3, pg. 237 A = drill load, B = flow, C = speed, D = type of mud, y = advance rate of the drill.
DOX 6E Montgomery1 Unreplicated 2 k Factorial Designs These are 2 k factorial designs with one observation at each corner of the “cube” An unreplicated.
Chapter 6Design & Analysis of Experiments 8E 2012 Montgomery 1 Design of Engineering Experiments Part 5 – The 2 k Factorial Design Text reference, Chapter.
III.7 Blocking Two-level Designs _ Blocking _ Example _ Four Blocks _ Exercise.
1 Statistical Design of Experiments BITS Pilani, November ~ Shilpa Gupta (97A4)
International Conference on Design of Experiments and Its Applications July 9-13, 2006, Tianjin, P.R. China Sung Hyun Park, Hyuk Joo Kim and Jae-Il.
The American University in Cairo Interdisciplinary Engineering Program ENGR 592: Probability & Statistics 2 k Factorial & Central Composite Designs Presented.
Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 15 Review.
Design and Analysis of Experiments Dr. Tai-Yue Wang Department of Industrial and Information Management National Cheng Kung University Tainan, TAIWAN,
1 Prof. Indrajit Mukherjee, School of Management, IIT Bombay High (2 pounds ) Low (1pound) B=60 ( ) Ab=90 ( ) (1)=80 ( ) A=100.
1 Statistical Analysis Professor Lynne Stokes Department of Statistical Science Lecture 9 Review.
L. M. LyeDOE Course1 Design and Analysis of Multi-Factored Experiments Fractional Factorials Not Based on the Powers of 2 – Irregular Designs.
Designs for Experiments with More Than One Factor When the experimenter is interested in the effect of multiple factors on a response a factorial design.
No-Confounding Designs1 Alternatives to Resolution IV Screening Designs in 16 Runs Douglas C. Montgomery Regents’ Professor of Industrial Engineering &
1 Chapter 8 Two-level Fractional Factorial Designs.
11 Designs for the First Order Model “Orthogonal first order designs” minimize the variance of If the off diagonal elements of X´X are all zero then the.
Design of Experiments (DOE)
Chapter 14 Introduction to Statistical Quality Control, 7th Edition by Douglas C. Montgomery. Copyright (c) 2012  John Wiley & Sons, Inc.
Using an Add-In Based on a JMP Script to Analyze
Design & Analysis of Experiments 8E 2012 Montgomery
Design and Analysis of Multi-Factored Experiments
Olga Yee NCS 2018 Paris, France
Special Topics In Design
Fractional Factorial Design
III.7 Blocking Two-level Designs
Text reference, Chapter 8
ENM 310 Design of Experiments and Regression Analysis Chapter 3
Design matrix Run A B C D E
Design and Analysis of Experiments
Graziano and Raulin Research Methods: Chapter 12
14 Design of Experiments with Several Factors CHAPTER OUTLINE
Presentation transcript:

Partition Experimental Designs for Sequential Process Steps: Application to Product Development Leonard Perry, Ph.D., MBB, CSSBB, CQE Associate Professor & ISyE Program Chair Industrial & Systems Engineering (ISyE) University of San Diego 1

Example: Lens Finishing Processes A company desires to improve their lens finishing process. Experimental runs must be limited due to cost concerns. What type of design do you recommend? 2 Process One: Four Factors Process Two: Six Factors

Objective of Partition Designs To create a experimental design capable of handling a serial process consisting of multiple sequential processes that possess several factors and multiple responses. Advantages:  Output from first process may be difficult to measure.  Potential interaction between sequential processes  Reduction of experimental runs 3

Partition Design 4 Design Matrix #1Design Matrix #2Responses +=

Partition Design: Assumptions Process/Product Knowledge required Screening Experiment required Resources limited, minimize runs Sparsity-of-Effect Principle 5

Partition Design: Methodology 6 1. Perform Screening Experiment for Each Individual Process 2. Construct Partition Design 3. Perform Partition Design Experiment 4. Perform Partition Design Analysis a) Select Significant Effects for Each Response b) Build Empirical Model for Each Response c) Calculate Partition Intercept d) Select Significant Effects for Intercept 5. Build Final Empirical Model

Review: Experimental Objectives Product/Process Characterization  Determine which factors are most influential on the observed response.  “Screening” Experiments  Designs: 2 k-p Fractional Factorial, Plackett-Burman Designs Product/Process Improvement  Find the setting for factors that create a desired output or response  Determine model equation to relate factors and observed response  Designs: 2 k Factorial, 2 k Factorial with Center Points Product/Process Optimization  Determine an operating or design region in which the important factors lead to the best possible response. (Response Surface)  Designs: Central Composite Designs, Box-Behnken Designs, D-optimal Product/Process Robustness  Explore settings that minimize the effects of uncontrollable factors  Designs: Taguchi Experiments 7

Example: First-order Partition Design Two factors significant in each process  Total of k = 4 factors  Potential Interaction between processes Partition Design  N = 5 runs (N = k - 1) (Saturated Design) 8

Step 1: Perform Screening Experiment Process 1: Significant Factors:  Factor A  Factor B Process 2: Significant Factors:  Factor C  Factor D 9

Step 2: Construct Partition Design Partition Design: Design Criteria  First-order models Orthogonal D-optimal Minimize Alias Confounding  Second-order models D-efficiency G-efficiency Minimize Alias Confounding 10

Step 2: Construct Partition Design First-order Design (Res III or Saturated)  Orthogonal  D-optimality  Minimize Alias Confounding 11

Step 2: Construct Partition Design 12 TermAliases ModelA-ABD CD ABC ModelB-BAB BC BD ABC ABD BCD ErrorC-CAB AD BC BD ABC ABD BCD ErrorD-DAB AC BCD

Step 3: Perform Partition Design Experiment Planning is key Requires increased coordination between process steps Identification of Outputs and Inputs 13

Step 4: Perform Partition Design Analysis For Each Response: A. Select Significant Effects B. Build Empirical Model C. Calculate Partition Intercept Response D. Select Significant Effects for Intercept Response 14

Step 4a: Select Significant Effects 15

Step 4a: Select Significant Effects 16

Step 4b: Build Empirical Model 17

Step 4c: Calculate Partition Intercept Response 18 Calculations Int1 i = A B + y1 i for i= 1 to N Run 1 Int1 i = A B + y1 i Int1 1 = (1) (1) Int1 1 = 9.101

Step 4: Partition Analysis Repeat for Second Partition A. Select Significant Effects B. Build Empirical Model C. Calculate Partition Intercept Response 19

Step 4d: Select Significant Effects for Intercept 20

Step 5: Build Final Empirical Model 21

Manufacturing Process #1 Controllable factors Uncontrollable factors Inputs Outputs, y x 1 x 2 x k z 1 z 2 z r... Q8 Design Space – Link input parameters with quality attributes over broad range Traditional Design of Experiments (DOE) –Systematic approach to study effects of multiple factors on process performance –Limitation: not applied to multiple sequential process steps; does not account for the effects of upstream process factors on downstream process outputs Case Study: Biogen IDEC Manufacturing Process #2 Controllable factors Uncontrollable factors Inputs Outputs, y x 1 x 2 x k z 1 z 2 z r... 22

Protein-A Controllable factors Uncontrollable factors x 1 x 2 x k z 1 z 2 z r... CIEX Controllable factors Uncontrollable factors x 1 x 2 x k z 1 z 2 z r... pH 4.5 pool pH 5.75 pool pH 7 pool 20 Protein-A eluate pools 20 CEX eluate pools Harvest Controllable factors Uncontrollable factors x 1 x 2 x k z 1 z 2 z r... Case Study: Biogen IDEC Partition Design: Experimental Resolution IV: 1/16 fractional factorial for whole design Each partition: full factorial Harvest pH included in Protein A partition Each column: 16 expts + 4 center points = 20 expts 23

Partition Design: Designs 24

25 Input Parameter % of Total Sum of Squares Load HCP [f(Harvest pH, ProA Wash I)] 83.3 CIEX Elution pH 6.6 Load HCP Load HCP * Elution pH1.6 CIEX Elution [NaCl] 1.1 CIEX Elution pH CIEX Elution [NaCl] * CIEX Elution pH0.5 Load HCP * CIEX Elution [NaCl]0.2 CIEX Load Capacity 0.1 R2R Adjusted R Predicted R Input Parameter % of Total Sum of Squares Harvest pH 32.6 Pro A Wash I Conc Harvest pH * Pro A Wash I 15.6 CIEX Elution pH 10.1 Harvest pH * CIEX Elution pH8.8 Pro A Wash I. * CIEX Elution pH4.6 CIEX Load Capacity 3.9 Pro A Wash I. Conc. * CIEX Elution NaCl1.8 CIEX Elution [NaCl] 1.5 Harvest pH * CIEX Elution [NaCl]1.2 CIEX Elution [NaCl] * CIEX Elution pH 0.2 R2R Adjusted R Predicted R Traditional Model Results Partition Model Results CIEX Step HCP ANOVA Comparison: Main Effects Partition model identified same significant main factors and their relative rank in significance

26 Input Parameter % Sum of Squares Load HCP [f(A,C)] 83.3 CIEX Elution pH 6.6 Load HCP Load HCP * CIEX Elution pH1.6 Elution [NaCl] 1.1 Elution pH Elution [NaCl] * CIEX Elution pH0.5 Load HCP * CIEX Elution [NaCl]0.2 SPXL Load Capacity (mg/ml) 0.1 Input Parameter % of Total Sum of Squares Harvest pH 32.6 Pro A Wash I Conc Harvest pH * Pro A Wash I conc15.6 CIEX Elution pH 10.1 Harvest pH * CIEX Elution pH8.8 Pro A Wash I. Conc.* CIEX Elution pH4.6 CIEX Load Capacity 3.9 ProA Wash 1. * CIEX Elution NaCl1.8 Elution [NaCl] 1.5 Harvest pH * CIEX Elution [NaCl]1.2 CIEX Elution [NaCl] * CIEX Elution pH0.2 Traditional Model Results Partition Model Results Partition model able to identify interactions between process steps CIEX Step HCP ANOVA Comparison: Interactions

27 Summary of Partition Designs Experimental design capable of handling a serial process  Sequential process steps that possess several factors and multiple responses Potential Advantages  Links process steps together: identify upstream operation effects and interactions to downstream processes.  Better understanding of the overall process  Potentially less experiments  No manipulation of uncontrollable parameters necessary Manufacturing Process #1 Controllable factors Uncontrollable factors Inputs Outputs, y x 1 x 2 x k z 1 z 2 z r... Manufacturing Process #2 Controllable factors Uncontrollable factors Inputs Outputs, y x 1 x 2 x k z 1 z 2 z r... Manufacturing Process #3 Controllable factors Uncontrollable factors Inputs Outputs, y x 1 x 2 x k z 1 z 2 z r...

References D. E. Coleman and D. C. Montgomery (1993), ‘Systematic Approach to Planning for a Designed Industrial Experiment’, Technometrics, 35, Lin, D.J.K. (1993). "Another Look at First-Order Saturated Designs: The p- efficient Designs," Technometrics, 35: (3), p Montgomery, D.C., Borror, C.M. and Stanley, J.D., (1997). “Some Cautions in the Use of Plackett-Burman Designs,” Quality Engineering, 10, Box, G. E. P. and Draper, N. R. (1987) Empirical Model Building and Response Surfaces, John Wiley, New York, NY Box, G. E. P. and Wilson, K. B. (1951), “On the Experimental Attainment of Optimal Conditions,” Journal of the Royal Statistical Society, 13, Hartley, H. O. (1959), “Smallest composite design for quadratic response surfaces,” Biometrics 15, Khuri, A. I. (1988), “A Measure of Rotatability for Response Surface Designs,” Technometrics, 30, Perry, L. A., Montgomery, and D. C, Fowler, J. W., " Partition Experimental Designs for Sequential Processes: Part I - First Order Models ", Quality and Reliability Engineering International, 18,1. 28