Case Studies of Batch Processing Experiments Diane K. Michelson International Sematech Statistical Methods May 21, 2003 Quality and Productivity Research.

Slides:



Advertisements
Similar presentations
Split-Plot Designs Usually used with factorial sets when the assignment of treatments at random can cause difficulties –large scale machinery required.
Advertisements

Split-Plot Designs Usually used with factorial sets when the assignment of treatments at random can cause difficulties large scale machinery required for.
Multiple Comparisons in Factorial Experiments
Chapter 4Design & Analysis of Experiments 7E 2009 Montgomery 1 Experiments with Blocking Factors Text Reference, Chapter 4 Blocking and nuisance factors.
1 Chapter 4 Experiments with Blocking Factors The Randomized Complete Block Design Nuisance factor: a design factor that probably has an effect.
DOX 6E Montgomery1 Design of Engineering Experiments Part 3 – The Blocking Principle Text Reference, Chapter 4 Blocking and nuisance factors The randomized.
1 Design of Engineering Experiments Part 3 – The Blocking Principle Text Reference, Chapter 4 Blocking and nuisance factors The randomized complete block.
Experimental Design Fr. Clinic II. Planning Begins with carefully considering what the objectives (or goals)are –How do our filters work? –Which filter.
Analysis of Variance Outlines: Designing Engineering Experiments
i) Two way ANOVA without replication
Experiments with both nested and “crossed” or factorial factors
STT 511-STT411: DESIGN OF EXPERIMENTS AND ANALYSIS OF VARIANCE Dr. Cuixian Chen Chapter 14: Nested and Split-Plot Designs Design & Analysis of Experiments.
Chapter 14Design and Analysis of Experiments 8E 2012 Montgomery 1.
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs The Essentials of 2-Level Design of Experiments Part I:
Experimental Design, Response Surface Analysis, and Optimization
Joseph G Pigeon Villanova University
N-way ANOVA. Two-factor ANOVA with equal replications Experimental design: 2  2 (or 2 2 ) factorial with n = 5 replicate Total number of observations:
Chapter 5 Introduction to Factorial Designs
14-1 Introduction An experiment is a test or series of tests. The design of an experiment plays a major role in the eventual solution of the problem.
Experimental Design Fr. Clinic II Dr. J. W. Everett.
Industrial Applications of Response Surface Methodolgy John Borkowski Montana State University Pattaya Conference on Statistics Pattaya, Thailand.
1 Chapter 5 Introduction to Factorial Designs Basic Definitions and Principles Study the effects of two or more factors. Factorial designs Crossed:
Analysis of Variance Chapter 3Design & Analysis of Experiments 7E 2009 Montgomery 1.
Chapter 5Design & Analysis of Experiments 7E 2009 Montgomery 1 Factorial Experiments Text reference, Chapter 5 General principles of factorial experiments.
Nested and Split Plot Designs. Nested and Split-Plot Designs These are multifactor experiments that address common economic and practical constraints.
T WO W AY ANOVA W ITH R EPLICATION  Also called a Factorial Experiment.  Factorial Experiment is used to evaluate 2 or more factors simultaneously. 
T WO WAY ANOVA WITH REPLICATION  Also called a Factorial Experiment.  Replication means an independent repeat of each factor combination.  The purpose.
1 14 Design of Experiments with Several Factors 14-1 Introduction 14-2 Factorial Experiments 14-3 Two-Factor Factorial Experiments Statistical analysis.
October 15, 2008 Designing Experiments: What's Important and When to Get Help Matthew Williams, Dept. of Statistics.
Text reference, Chapter 14, Pg. 525
Design of Experiments Chapter 21.
Chapter 8Design and Analysis of Experiments 8E 2012 Montgomery 1 Design of Engineering Experiments The 2 k-p Fractional Factorial Design Text reference,
INT 506/706: Total Quality Management Introduction to Design of Experiments.
© 2014 Carl Lund, all rights reserved A First Course on Kinetics and Reaction Engineering Class 11.
1 Design of Engineering Experiments Part 10 – Nested and Split-Plot Designs Text reference, Chapter 14, Pg. 525 These are multifactor experiments that.
I.Introduction to Engineering Statistics A. The Engineering Method The heart of sound engineering practice is the engineering method systematic approach.
DESIGN OF EXPERIMENTS NESTED DESIGNS SPLIT PLOT DESIGNS
Identifying the Split-plot and Constructing an Analysis George A. Milliken Department of Statistics Kansas State University
Design of Engineering Experiments Part 5 – The 2k Factorial Design
14-1 Introduction An experiment is a test or series of tests. The design of an experiment plays a major role in the eventual solution of the problem.
DOX 6E Montgomery1 Design of Engineering Experiments Part 4 – Introduction to Factorials Text reference, Chapter 5 General principles of factorial experiments.
Experimental Design If a process is in statistical control but has poor capability it will often be necessary to reduce variability. Experimental design.
IE341 Midterm. 1. The effects of a 2 x 2 fixed effects factorial design are: A effect = 20 B effect = 10 AB effect = 16 = 35 (a) Write the fitted regression.
Chapter coverage Part A Part A –1: Practical tools –2: Consulting –3: Design Principles Part B (4-6) One-way ANOVA Part B (4-6) One-way ANOVA Part C (7-9)
1 Statistical Design of Experiments BITS Pilani, November ~ Shilpa Gupta (97A4)
Solutions. 1.The tensile strength of concrete produced by 4 mixer levels is being studied with 4 replications. The data are: Compute the MS due to mixers.
ETM U 1 Analysis of Variance (ANOVA) Suppose we want to compare more than two means? For example, suppose a manufacturer of paper used for grocery.
Chapter 13 Design of Experiments. Introduction “Listening” or passive statistical tools: control charts. “Conversational” or active tools: Experimental.
L. M. LyeDOE Course1 Design and Analysis of Multi-Factored Experiments Advanced Designs -Hard to Change Factors- Split-Plot Design and Analysis.
1 Design of Engineering Experiments – The 2 k Factorial Design Text reference, Chapter 6 Special case of the general factorial design; k factors, all at.
ETM U k factorials Recall our example from last time … Estimate the effects Determine significant effects Develop regression model Examine.
Designs for Experiments with More Than One Factor When the experimenter is interested in the effect of multiple factors on a response a factorial design.
Engineering Statistics Design of Engineering Experiments.
1 Chapter 5.8 What if We Have More Than Two Samples?
Overview Modern chip designs have multiple IP components with different process, voltage, temperature sensitivities Optimizing mix to different customer.
Repeated Measures Designs
Two way ANOVA with replication
i) Two way ANOVA without replication
Two way ANOVA with replication
Topics Randomized complete block design (RCBD) Latin square designs
Chapter 5 Introduction to Factorial Designs
IE-432 Design Of Industrial Experiments
An overview of the design and analysis of experiments
Introduction to Experimental and Observational Study Design
ENM 310 Design of Experiments and Regression Analysis Chapter 3
The Essentials of 2-Level Design of Experiments Part I: The Essentials of Full Factorial Designs Developed by Don Edwards, John Grego and James Lynch.
DESIGN OF EXPERIMENTS by R. C. Baker
14 Design of Experiments with Several Factors CHAPTER OUTLINE
Presentation transcript:

Case Studies of Batch Processing Experiments Diane K. Michelson International Sematech Statistical Methods May 21, 2003 Quality and Productivity Research Conference

2 Abstract Experimentation in the semiconductor industry requires clever design and clever analysis. In this paper, we look at two recent experiments performed at ISMT. The first is a split plot design at a clean operation. The second is a strip plot design of 3 factors over 3 process steps. The importance of using the correct error terms in testing the model will be discussed.

3 Split Plot Experiment An experiment was designed to optimize the performance of a wafer cleaning step. Factors were chemical supplier and three process factors (time, temp, concentration). A 2 4 full factorial (plus centerpoints) was first considered. Run 1Run 2Run 3Run 4Run 5Run 6Run 7Run 8Run 9Run 10Run 11Run 12Run 13Run 14Run 15Run ABCDABCD

4 Completely Randomized Design In the CRD, treatments are randomly assigned to experimental units. The CRD would require 16 bath changes, one for each run. This was not practical, since bath changes are expensive and time-consuming. Engineering wanted to run all treatment combinations using one supplier first in one bath, and all treatment combinations using the second supplier in another bath.

5 What Engineering Wanted B C D                     A A +1 RUN 9RUN 10RUN 11RUN 12RUN 13RUN 14RUN 15RUN 16 RUN 1RUN 2RUN 3RUN 4RUN 5RUN 6RUN 7RUN 8

6 Multiple experimental units The split plot design has two (or more) experimental units. The experimental unit for the supplier variable is a bath (whole plot). The experimental unit for the process factors is a wafer (sub plot). Note that supplier is not a blocking factor.

7 A=+1 A=-1 Visual Look B=+1,C=+1 B=+1,C=-1 B=-1,C=+1 B=-1,C=-1

8 Analysis The model is Parameter estimates are not affected by the split plot design The error term for testing effects is not necessarily the residual, since there are restrictions on randomization.

9 ANOVA The ANOVA table for an unreplicated split plot design shows that with just one “run” of each supplier, the supplier effect can not be tested.

10 Replicated Whole Plots

11 ANOVA for replicated whole plots Replicating the supplier once gives this ANOVA table.

12 A cheaper option Another choice is to run a fractional factorial within each supplier run. Statistical software will not create this design, in general. It is typically easier to create these designs “by hand” in a spreadsheet package. B C D             A A

13 ANOVA for fractioned design ANOVA table for the fractioned design. Note the decrease in residual df. Adding 2 centerpoints per supplier run will add 4 df to the residual and allows for a test of curvature of the process factors.

14 Considerations CRD –very expensive, since one factor is hard to vary Split plot –cheaper, but not as much information on the supplier effect as on the process effects –must have replicates of whole plot factor

15 Strip plot experiment Problem: yield issues on Interconnect baseline product Product is a short loop process of Metal 1, Via, Metal 2 The failing electrical parameter was Via chain yield Yield was fine after M2 but bad after Final Test

16 Yield drop between M2 and Final

17 Via chains Each measurement represents the resistance of a via chain as measured by forcing a current through the 360,000 via chain, and sensing a voltage. This generates a resistance value for the chain, which is divided by 360,000 to get the per-via resistance. The responses were yield and median resistance of a via in a chain of 360,000 vias. Yield was defined using a 1 ohm criterion for the.25  m via diameter.

18 Failure after passivation

19 Process Flow / Factors

20 Design Three factors, each at 2 levels, plus centerpoints  2 3 full factorial. If run as a Completely Randomized Design, this experiment would use 10 wafers, and 10 runs. Wafers are not batched.

21 Design Engineering wanted to batch wafers together at each step. Using just 10 wafers would mean 3 runs of each tool, one for each level of the factor. This leads to 0 error df, and untestable effects. Need to have multiple runs at each level.

22 Design This design is a strip plot. Wafers are batched. Requires 20 wafers in 2 lots of 10, but only 6 runs of each tool.

23 Visual Look A=-1 A=+1 A=-1 B=+1 B=-1 B=+1

24 Analysis The model is The strip plot design does not change effect calculations.

25 Testing effects In the CRD, the denominator of the F- statistic for testing the main effects and two factor interactions is the residual. In the Strip Plot, there are restrictions on randomization, therefore, the error term for testing effects is not necessarily the residual.

26 Testing effects The error term for testing all the effects at one process step is the LOT*EFFECT interaction. The error term for testing effects which cross process steps is the residual.

27 Considerations CRD –more runs –less wafers –wafers should not be batched together –textbook analysis Strip plot –less runs –more wafers –wafers can be batched –more complex analysis Analyzing a strip plot as a CRD may lead to missing significant effects.

28 General considerations What about single wafer tools? –Each wafer is a separate run. –If the only thing defining a batch is the wafer handling, treat it as a single wafer tool. –If the chamber needs to heat up or otherwise change before a batch is run, treat it as a batch tool. What about estimating variability from the past? R&D Engineers are looking for very large effects. –they want to see these effects each and every time a process is run. What do you do when Things Go Horribly Wrong? –graphs…

29 Conclusions Experimentation in the wafer fab requires consideration of –design structure –execution structure Experiments with hard-to-vary factors are good candidates for split plot designs Experiments which cover multiple process steps are good candidates for strip plot designs