Improving Stable Processes Professor Tom Kuczek Purdue University

Slides:



Advertisements
Similar presentations
Questions From Yesterday
Advertisements

Pattern Recognition and Machine Learning
Analysis by design Statistics is involved in the analysis of data generated from an experiment. It is essential to spend time and effort in advance to.
Pattern Recognition and Machine Learning
CHAPTER 2 Building Empirical Model. Basic Statistical Concepts Consider this situation: The tension bond strength of portland cement mortar is an important.
FTP Biostatistics II Model parameter estimations: Confronting models with measurements.
Regression Analysis Using Excel. Econometrics Econometrics is simply the statistical analysis of economic phenomena Here, we just summarize some of the.
1 Home Gas Consumption Interaction? Should there be a different slope for the relationship between Gas and Temp after insulation than before insulation?
Some Terms Y =  o +  1 X Regression of Y on X Regress Y on X X called independent variable or predictor variable or covariate or factor Which factors.
Using process knowledge to identify uncontrolled variables and control variables as inputs for Process Improvement 1.
Section 4.2 Fitting Curves and Surfaces by Least Squares.
Chapter 13 Additional Topics in Regression Analysis
x – independent variable (input)
Maximum likelihood Conditional distribution and likelihood Maximum likelihood estimations Information in the data and likelihood Observed and Fisher’s.
SYSTEMS Identification Ali Karimpour Assistant Professor Ferdowsi University of Mashhad Reference: “System Identification Theory For The User” Lennart.
1 Chapter 3 Multiple Linear Regression Ray-Bing Chen Institute of Statistics National University of Kaohsiung.
Chapter 4 Multiple Regression.
IE 673Session 7 - Process Improvement (Continued) 1 Process Improvement (Continued)
Analysis of Covariance Goals: 1)Reduce error variance. 2)Remove sources of bias from experiment. 3)Obtain adjusted estimates of population means.
Maximum likelihood (ML) and likelihood ratio (LR) test
Lecture 11 Multivariate Regression A Case Study. Other topics: Multicollinearity  Assuming that all the regression assumptions hold how good are our.
Ch. 14: The Multiple Regression Model building
Linear and generalised linear models
Analysis of Covariance Goals: 1)Reduce error variance. 2)Remove sources of bias from experiment. 3)Obtain adjusted estimates of population means.
Christopher Dougherty EC220 - Introduction to econometrics (chapter 3) Slideshow: prediction Original citation: Dougherty, C. (2012) EC220 - Introduction.
1 PREDICTION In the previous sequence, we saw how to predict the price of a good or asset given the composition of its characteristics. In this sequence,
Experimental Design If a process is in statistical control but has poor capability it will often be necessary to reduce variability. Experimental design.
Chap 14-1 Statistics for Business and Economics, 6e © 2007 Pearson Education, Inc. Chapter 14 Additional Topics in Regression Analysis Statistics for Business.
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 3: LINEAR MODELS FOR REGRESSION.
CSC321: 2011 Introduction to Neural Networks and Machine Learning Lecture 11: Bayesian learning continued Geoffrey Hinton.
Chapter 11 Linear Regression Straight Lines, Least-Squares and More Chapter 11A Can you pick out the straight lines and find the least-square?
Introduction to Machine Learning Supervised Learning 姓名 : 李政軒.
Managerial Economics Demand Estimation & Forecasting.
Time series Decomposition Farideh Dehkordi-Vakil.
Simple Linear Regression. The term linear regression implies that  Y|x is linearly related to x by the population regression equation  Y|x =  +  x.
CROSS-VALIDATION AND MODEL SELECTION Many Slides are from: Dr. Thomas Jensen -Expedia.com and Prof. Olga Veksler - CS Learning and Computer Vision.
VI. Regression Analysis A. Simple Linear Regression 1. Scatter Plots Regression analysis is best taught via an example. Pencil lead is a ceramic material.
Multiple Regression. Simple Regression in detail Y i = β o + β 1 x i + ε i Where Y => Dependent variable X => Independent variable β o => Model parameter.
Stats 845 Applied Statistics. This Course will cover: 1.Regression –Non Linear Regression –Multiple Regression 2.Analysis of Variance and Experimental.
Multiple Regression I 1 Copyright © 2005 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Multiple Regression Analysis (Part 1) Terry Dielman.
SEM Basics 2 Byrne Chapter 2 Kline pg 7-15, 50-51, ,
Review of fundamental 1 Data mining in 1D: curve fitting by LLS Approximation-generalization tradeoff First homework assignment.
1 Module One: Measurements and Uncertainties No measurement can perfectly determine the value of the quantity being measured. The uncertainty of a measurement.
EXCEL DECISION MAKING TOOLS BASIC FORMULAE - REGRESSION - GOAL SEEK - SOLVER.
Essentials of Business Statistics: Communicating with Numbers By Sanjiv Jaggia and Alison Kelly Copyright © 2014 by McGraw-Hill Higher Education. All rights.
Machine Learning 5. Parametric Methods.
Chapter 2-OPTIMIZATION G.Anuradha. Contents Derivative-based Optimization –Descent Methods –The Method of Steepest Descent –Classical Newton’s Method.
The Mixed Effects Model - Introduction In many situations, one of the factors of interest will have its levels chosen because they are of specific interest.
1 G Lect 3M Regression line review Estimating regression coefficients from moments Marginal variance Two predictors: Example 1 Multiple regression.
MACHINE LEARNING 3. Supervised Learning. Learning a Class from Examples Based on E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1)
1 Response Surface A Response surface model is a special type of multiple regression model with: Explanatory variables Interaction variables Squared variables.
EXCEL DECISION MAKING TOOLS AND CHARTS BASIC FORMULAE - REGRESSION - GOAL SEEK - SOLVER.
Computacion Inteligente Least-Square Methods for System Identification.
F5 Performance Management. 2 Section C: Budgeting Designed to give you knowledge and application of: C1. Objectives C2. Budgetary systems C3. Types of.
Linear Models Tony Dodd. 21 January 2008Mathematics for Data Modelling: Linear Models Overview Linear models. Parameter estimation. Linear in the parameters.
Model Selection and the Bias–Variance Tradeoff All models described have a smoothing or complexity parameter that has to be considered: multiplier of the.
Stats Methods at IC Lecture 3: Regression.
Predicting Energy Consumption in Buildings using Multiple Linear Regression Introduction Linear regression is used to model energy consumption in buildings.
Multiple Regression.
The simple linear regression model and parameter estimation
How regression works The Right Questions about Statistics:
Multiple Regression Analysis: Estimation
Determining How Costs Behave
CHAPTER 29: Multiple Regression*
Introduction to Instrumentation Engineering
Multiple Regression.
Regression Models - Introduction
Simple Linear Regression
Statistical Thinking and Applications
Regression and Correlation of Data
Presentation transcript:

Improving Stable Processes Professor Tom Kuczek Purdue University Using process knowledge to identify uncontrolled variables and control variables as inputs for Process Improvement

Process may be off Target or Have Excess Variation X-double bar is the estimate of the process mean which may be off target. Sigma(X) is the estimate of Common Cause Variation. Both of these contribute to the Capability of the process, .

Improving Common Cause Common Cause variation usually cannot be reduced by trying to explain differences between values when the process is stable. How Uncontrolled variables and Control variables affect our response X, must be understood in order to partition Common Cause Variation into basic sources. Stable processes will require some degree of change to reduce Common Cause.

Variables in the Production Process Variables in the production process may be Uncontrolled variables or Control variables. Uncontrolled variables are variables which may affect the output of the process, but which are not currently controlled (such as input Rate to a Process). Control variables are variables such as process settings which affect the outcome of the process (such as Temperature and Pressure of a reactor vessel).

Output Variables Output Variables are measurements of the resulting product characteristic, X. The chosen measures for the product are measures of the product characteristics important to the customer. Customers may be internal or external to the organization.

Part I: Reducing Output Variation Around the Target Output variation of the product may be broken down into two sources: Actual variation of the “true” product characteristic, often around a target value, usually designated by the symbol tau “ τ “. Variability in the measurement process, which may introduce bias or added variation to the measurement of the characteristic, which occurs in the measurement process itself.

Product Characteristic Variation: Parameter Design (finding Control settings) Let us first concentrate on the product characteristic value of interest to our customer. There are two main issues here: 1. To center our product as close to the target value , τ , as possible. 2. To minimize the variation around the target value.

Building an empirical Model Variables which can affect the output variable, X of the Production Process are either Uncontrolled variables or Control variables. Uncontrolled variables would include variation in raw materials or environmental conditions during process operation. They are also called Noise variables. Control variables would include any fixed settings for machines involved in the production process.

Model Form The model would express product output Y, as a function of uncontrolled and control variables in a form such as: X= f (uncontrolled variables, control variables) where f( , ) generally denotes a simple mathematical function, such a regression model.

For example Suppose we want to measure a response, X=viscosity. Suppose X is affected by input variables Temp, Pressure and Rate (of process operation). Then X=f(Temp, Pressure, Rate)+ε Can be approximated by a simple Regression model.

Model Building In order to build even the simplest model for the output characteristic, X, we need a set of data with the values of the uncontrolled and control variables and the resulting output measure X. We may use either: Exploratory data analysis using existing data to begin with, or Experimental design, where we use pre-determined values of the uncontrolled variables (temporarily fixed for the experiment) and control variables to give us an optimal model.

Choosing Parameter Levels Control variables- levels (settings) of control variables are chosen which span available operating settings. Uncontrolled variables- levels are chosen and temporarily fixed for each of the uncontrolled variables. These levels are chosen to represent values of the uncontrolled variables actually observed during the production process.

Why Control and Uncontrolled Variables? Uncontrolled variables contribute to the response and therefore contribute to our estimate of Common Cause variation. Certain settings of the control variables may minimize the effect of the uncontrolled variables, thereby reducing Common Cause, if there is an Interaction between control and uncontrolled variables. Another control variable can be used to control the mean of the process and so can be used to put the mean near Target.

Why interaction? If variables interact, we can use control variables to compensate for the variation in uncontrolled variables, such as Rate of input to the process. Now we can compensate for things we can’t control, like Rate variability, using things we can control, like the process settings for Temp and Pressure.

Forms of Interaction Interaction can take many forms, but two of the most common and important are antagonism and synergy. Antagonism occurs when two variables tend to cancel each other out. Synergy occurs when two variables tend to have a multiplicative effect.

Interaction as Antagonism

Interaction as Synergy

Response Surface Approach Goals: Model the response, X, as a regression-type function of the control and uncontrolled variables. Use recorded data on the distribution of the uncontrolled variables to model the mean and variance of the response, X. Pick optimal control variable settings to put the process mean on target and minimize the variation due to uncontrolled variables.

Example continued.. Let us suppose that we have two control variables: Temp, Pressure - Control and one noise variable: Rate - Uncontrolled. We then fit a slightly more complex equation than simple linear regression to our data. In this model we include an interaction term.

Example, continued… Assume our fitted model is now Now that we have two control variables and one of them interacts with the uncontrolled variable Rate, we can use them separately. We can use one of them, Pressure, to minimize variation of the process, while we then use the other, Temp, to then adjust the mean to where the target is.

Example, continued. We do this by estimating and We can set Pressure to minimize the variance and set Temp to put the mean on target.

Steps summarized For a given output variable X, choose input variables which affect it (Flowmap and C&E Matrix). Collect data on all variables. Fit a simple empirical model, such as a Regression model to the data. Estimate the variability of uncontrolled variables. Pick Process setting values of control variables to put process mean on target and minimize effect of uncontrolled variable.

BTW, sometimes this works well to reduce Common Cause and sometimes not. Sometimes this approach does not work well, i.e. you may not be able to use Control variables to reduce the variability that Uncontrolled variables add to Common Cause. If the fitted model does not include an Interaction term you can only adjust the mean of the Process. When it does work, it is because an Interaction term in the fitted model allows you to reduce Common Cause variation and it is very much like the example shown.