Robust System Design Session #11 MIT Plan for the Session Quiz on Constructing Orthogonal Arrays (10 minutes) Complete some advanced topics on OAs Lecture.

Slides:



Advertisements
Similar presentations
Robust System Design MIT MatrixExperiments Using Orthogonal Arrays.
Advertisements

MIT Plan for the Session Questions? Complete some random topics Lecture on Design of Dynamic Systems (Signal / Response Systems) Recitation on HW#5?
Design of Experiments Lecture I
Robot Vision SS 2005 Matthias Rüther 1 ROBOT VISION Lesson 3: Projective Geometry Matthias Rüther Slides courtesy of Marc Pollefeys Department of Computer.
Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
AP Statistics Chapter 16. Discrete Random Variables A discrete random variable X has a countable number of possible values. The probability distribution.
1 The Bootstrap’s Finite Sample Distribution An Analytical Approach Lawrence C. Marsh Department of Economics and Econometrics University of Notre Dame.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #19 3/8/02 Taguchi’s Orthogonal Arrays.
1-1 Regression Models  Population Deterministic Regression Model Y i =  0 +  1 X i u Y i only depends on the value of X i and no other factor can affect.
Image processing. Image operations Operations on an image –Linear filtering –Non-linear filtering –Transformations –Noise removal –Segmentation.
Stochastic Differentiation Lecture 3 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO Working Group on Continuous.
Analysis of Variance: ANOVA. Group 1: control group/ no ind. Var. Group 2: low level of the ind. Var. Group 3: high level of the ind var.
#9 SIMULATION OUTPUT ANALYSIS Systems Fall 2000 Instructor: Peter M. Hahn
Lecture 19: Tues., Nov. 11th R-squared (8.6.1) Review
Evaluating Hypotheses
Final Review Session.
Machine Learning CUNY Graduate Center Lecture 3: Linear Regression.
Position Error in Assemblies and Mechanisms Statistical and Deterministic Methods By: Jon Wittwer.
MAE 552 Heuristic Optimization Instructor: John Eddy Lecture #20 3/10/02 Taguchi’s Orthogonal Arrays.
Analysis of Variance & Multivariate Analysis of Variance
Independent Sample T-test Classical design used in psychology/medicine N subjects are randomly assigned to two groups (Control * Treatment). After treatment,
Lecture II-2: Probability Review
Today Wrap up of probability Vectors, Matrices. Calculus
Computer Simulation A Laboratory to Evaluate “What-if” Questions.
Chapter 7: Random Variables
1 CE 530 Molecular Simulation Lecture 7 David A. Kofke Department of Chemical Engineering SUNY Buffalo
One-Factor Experiments Andy Wang CIS 5930 Computer Systems Performance Analysis.
Advanced Risk Management I Lecture 6 Non-linear portfolios.
CPE 619 Simple Linear Regression Models Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama.
Simple Linear Regression Models
Chapter 15 Modeling of Data. Statistics of Data Mean (or average): Variance: Median: a value x j such that half of the data are bigger than it, and half.
Chapter 14 Monte Carlo Simulation Introduction Find several parameters Parameter follow the specific probability distribution Generate parameter.
MIT Objectives Review the format and expectations for the final exam Review material needed to succeed on the final exam Set the material from the course.
MEGN 537 – Probabilistic Biomechanics Ch.7 – First Order Reliability Methods Anthony J Petrella, PhD.
Chapter 13 Analysis of Variance (ANOVA) PSY Spring 2003.
Stochastic Linear Programming by Series of Monte-Carlo Estimators Leonidas SAKALAUSKAS Institute of Mathematics&Informatics Vilnius, Lithuania
1 Statistical Distribution Fitting Dr. Jason Merrick.
Module 1: Statistical Issues in Micro simulation Paul Sousa.
VI. Evaluate Model Fit Basic questions that modelers must address are: How well does the model fit the data? Do changes to a model, such as reparameterization,
1 Chapter 19 Monte Carlo Valuation. 2 Simulation of future stock prices and using these simulated prices to compute the discounted expected payoff of.
Analysis of Variance ANOVA
Go to Table of Content Single Variable Regression Farrokh Alemi, Ph.D. Kashif Haqqi M.D.
1 Review of ANOVA & Inferences About The Pearson Correlation Coefficient Heibatollah Baghi, and Mastee Badii.
Computational Intelligence: Methods and Applications Lecture 23 Logistic discrimination and support vectors Włodzisław Duch Dept. of Informatics, UMK Google:
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Propagation of Error Ch En 475 Unit Operations. Quantifying variables (i.e. answering a question with a number) 1. Directly measure the variable. - referred.
1 G Lect 11a G Lecture 11a Example: Comparing variances ANOVA table ANOVA linear model ANOVA assumptions Data transformations Effect sizes.
Monte-Carlo method for Two-Stage SLP Lecture 5 Leonidas Sakalauskas Institute of Mathematics and Informatics Vilnius, Lithuania EURO Working Group on Continuous.
ETM U 1 Analysis of Variance (ANOVA) Suppose we want to compare more than two means? For example, suppose a manufacturer of paper used for grocery.
Reduces time complexity: Less computation Reduces space complexity: Less parameters Simpler models are more robust on small datasets More interpretable;
Computer simulation Sep. 9, QUIZ 2 Determine whether the following experiments have discrete or continuous out comes A fair die is tossed and the.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
AP Statistics Chapter 16. Discrete Random Variables A discrete random variable X has a countable number of possible values. The probability distribution.
Over-fitting and Regularization Chapter 4 textbook Lectures 11 and 12 on amlbook.com.
Lecture 1: Basic Statistical Tools. A random variable (RV) = outcome (realization) not a set value, but rather drawn from some probability distribution.
Optimization formulation Optimization methods help us find solutions to problems where we seek to find the best of something. This lecture is about how.
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Surveying II. Lecture 1.. Types of errors There are several types of error that can occur, with different characteristics. Mistakes Such as miscounting.
MIT Robust System Design Constructing Orthogonal Arrays.
Lecture 3 Types of Probability Distributions Dr Peter Wheale.
Matrix Models for Population Management & Conservation March 2014 Lecture 10 Uncertainty, Process Variance, and Retrospective Perturbation Analysis.
Fundamentals of Data Analysis Lecture 11 Methods of parametric estimation.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Estimating standard error using bootstrap
Regression Analysis AGEC 784.
Regression.
MEGN 537 – Probabilistic Biomechanics Ch
CHAPTER 29: Multiple Regression*
Filtering and State Estimation: Basic Concepts
Lecture 2 – Monte Carlo method in finance
Presentation transcript:

Robust System Design Session #11 MIT Plan for the Session Quiz on Constructing Orthogonal Arrays (10 minutes) Complete some advanced topics on OAs Lecture on Computer Aided Robust Design Recitation on HW#5

Robust System Design Session #11 MIT How to Estimate Error variance in an L 18 Consider Phadke pg. 89 How would the two unassigned columns contribute to error variance? Remember L18(21x37) –Has 1+1*(2-1)+7*(3-1) = 16 DOF –But 18 rows –Therefore 2 DOF can be used to estimate the sum square due to error

Robust System Design Session #11 MIT Breakdown of Sum Squares GTSS SS due to mean Total SS SS due to error SS due to factor B SS due to factor A etc.

Robust System Design Session #11 MIT Column Merging Can turn 2 two level factors into a 4 level factor Can turn 2 three level factors into a six level factor Need to strike out interaction column (account for the right number of DOF!) Example on an L8

Robust System Design Session #11 MIT Column Merging in an L 8 Eliminate the column which is confounded with interactions Create a new four-level column

Robust System Design Session #11 MIT Computer Aided Robust Design

Robust System Design Session #11 MIT Engineering Simulations Many engineering systems can be modeled accurately by computer simulations –Finite Element Analysis –Digital and analog circuit simulations –Computational Fluid Dynamics Do you use simulations in design & analysis? How accurate & reliable are your simulations?

Robust System Design Session #11 MIT Simulation & Design Optimization Formal mathematical form minimize y = f (x) minimize weight subject to h(x) = 0 subject to height=23” g(x) ≤ 0 max stress<0.8Y

Robust System Design Session #11 MIT Robust Design Optimization Vector of design variables x –Control factors (discrete vs continuous) Objective function f(x) –S/N ratio (noise must be induced) Constraints h(x), g(x) –Not commonly employed –Sliding levels may be used to handle equality constraints in some cases

Robust System Design Session #11 MIT Noise Distributions Normal –Arises when many independent random variables are summed Uniform –Arises when other distributions are truncated Lognormal Distribution –Arises when normally distributed variables are multiplied or transformed

Robust System Design Session #11 MIT Correlation of Noise Factors Covariance Correlation coefficient –What does k=1 imply? –What does negative k imply? –What does k=0 imply?

Robust System Design Session #11 MIT Question About Noise Does the distribution of noise affect the S/N ratio of the simulation? –If so, under what conditions? Does correlation of noise factors affect S/N ratios? –If so, in what way? (raise / lower)

Robust System Design Session #11 MIT Simulating Variation in Noise Factors Taylor series expansion –Linearize the system response –Apply closed form solutions Monte Carlo –Generate random numbers –Use as input to the simulation Orthogonal array based simulation –Create an ordered set of test conditions –Use as input to the simulation

Robust System Design Session #11 MIT Taylor Series Expansion Approximate system response Apply rules of probability VAR(aX ) = aVAR( X ) VAR( X + Y ) = VAR( X ) + VAR(Y ) iff x, y independent To get

Robust System Design Session #11 MIT Local Linearity of the System Response Surface wrt Noise Holds for – Machining (most) – CMMs Fails for –Dimensions of form –Dual head valve grinding

Robust System Design Session #11 MIT Key Limitations of Taylor Series Expansion System response must be approximately linear w.r.t. noise factors –Linear over what range? –What if it isn’t quite linear? Noise factors must be statistically independent –How common is correlation of noise? –What happens when you neglect correlation?

Robust System Design Session #11 MIT Monte Carlo Simulation

Robust System Design Session #11 MIT Monte Carlo Simulation Pros and Cons No assumptions about system response f(x) You may simulate correlation among noises –How can this be accomplished? Accuracy not a function of the number of noises 95% confidence interval= It takes a large number of trials to get very accurate answers It’s easy too!

Robust System Design Session #11 MIT Othogonal Array Based Simulation Define noise factors and levels Two level factors Three level factors Choose an appropriate othogonal array Use as the outer array to induce noise

Robust System Design Session #11 MIT Setting Levels for Lognormal Distributions

Robust System Design Session #11 MIT Using Sliding Levels to Simulate Correlation Try it for RFP Mean is defined as RFM Tolerance is 2% Fill out rows 1 and 19 of the noise array

Robust System Design Session #11 MIT Run the Noise Array At the baseline control factor settings Run the simulation at all of the noise factor settings Find the system response for each row of the array Perform ANOVA on the data –Percent of total SS is percent contribution to variance in system response

Robust System Design Session #11 MIT Othogonal Array Pros and Cons Can handle some degree of non-linearity Can accommodate correlation Provides a direct evaluation of noise factor contributions Usually requires orders of magnitude fewer function evaluations than OA simulation

Robust System Design Session #11 MIT Optimization Choose control factors and levels Set up an inner array of control factors For each row, induce noise from the outer array Compute mean, variance, and S/N Select control factors based on the additive model Run a confirmation experiment

Robust System Design Session #11 MIT Next Steps Homework #8 due on Lecture 13 Next session –Read Phadke Ch. 9 --“Design of Dynamic Systems” –No quiz tomorrow Lecture 13-Quiz on Dynamic Systems