Modelling unknown errors as random variables Thomas Svensson, SP Technical Research Institute of Sweden, a statistician working with Chalmers and FCC in.

Slides:



Advertisements
Similar presentations
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
Advertisements

Multiple Regression and Model Building
Design of Experiments Lecture I
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Managerial Economics in a Global Economy
Hypothesis Testing Steps in Hypothesis Testing:
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 12 l Multiple Regression: Predicting One Factor from Several Others.
CmpE 104 SOFTWARE STATISTICAL TOOLS & METHODS MEASURING & ESTIMATING SOFTWARE SIZE AND RESOURCE & SCHEDULE ESTIMATING.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Simple Linear Regression. Start by exploring the data Construct a scatterplot  Does a linear relationship between variables exist?  Is the relationship.
The Simple Linear Regression Model: Specification and Estimation
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 7-1 Introduction to Statistics: Chapter 8 Estimation.
SIMPLE LINEAR REGRESSION
Lecture 4 Measurement Accuracy and Statistical Variation.
7-2 Estimating a Population Proportion
SIMPLE LINEAR REGRESSION
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
1 BA 555 Practical Business Analysis Review of Statistics Confidence Interval Estimation Hypothesis Testing Linear Regression Analysis Introduction Case.
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Chapter 12 Section 1 Inference for Linear Regression.
Standard error of estimate & Confidence interval.
Statistical Methods For Engineers ChE 477 (UO Lab) Larry Baxter & Stan Harding Brigham Young University.
Introduction to Linear Regression and Correlation Analysis
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 7-1 Business Statistics: A Decision-Making Approach 6 th Edition Chapter.
Chapter 7 Estimation: Single Population
Confidence Interval Estimation
Confidence Interval Estimation
Population All members of a set which have a given characteristic. Population Data Data associated with a certain population. Population Parameter A measure.
Lecture 12 Statistical Inference (Estimation) Point and Interval estimation By Aziza Munir.
PARAMETRIC STATISTICAL INFERENCE
● Final exam Wednesday, 6/10, 11:30-2:30. ● Bring your own blue books ● Closed book. Calculators and 2-page cheat sheet allowed. No cell phone/computer.
LECTURER PROF.Dr. DEMIR BAYKA AUTOMOTIVE ENGINEERING LABORATORY I.
TWO-VARIABLEREGRESSION ANALYSIS: SOME BASIC IDEAS In this chapter:
Chap 12-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 12 Introduction to Linear.
Business Statistics for Managerial Decision Farideh Dehkordi-Vakil.
Multiple Regression and Model Building Chapter 15 Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
Part 2: Model and Inference 2-1/49 Regression Models Professor William Greene Stern School of Business IOMS Department Department of Economics.
2.4 Units of Measurement and Functional Form -Two important econometric issues are: 1) Changing measurement -When does scaling variables have an effect.
Sampling Error.  When we take a sample, our results will not exactly equal the correct results for the whole population. That is, our results will be.
1 11 Simple Linear Regression and Correlation 11-1 Empirical Models 11-2 Simple Linear Regression 11-3 Properties of the Least Squares Estimators 11-4.
Chap 7-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 7 Estimating Population Values.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. All Rights Reserved. Section 7-1 Review and Preview.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc. Chap 8-1 Confidence Interval Estimation.
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Chap 7-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 7 Estimating Population Values.
Module 1: Measurements & Error Analysis Measurement usually takes one of the following forms especially in industries: Physical dimension of an object.
Correlation & Regression Analysis
Chapter 8: Simple Linear Regression Yang Zhenlin.
1 Module One: Measurements and Uncertainties No measurement can perfectly determine the value of the quantity being measured. The uncertainty of a measurement.
Residual Analysis Purposes –Examine Functional Form (Linear vs. Non- Linear Model) –Evaluate Violations of Assumptions Graphical Analysis of Residuals.
Sampling Design and Analysis MTH 494 Lecture-21 Ossam Chohan Assistant Professor CIIT Abbottabad.
10.1 – Estimating with Confidence. Recall: The Law of Large Numbers says the sample mean from a large SRS will be close to the unknown population mean.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Multiple Regression Chapter 14.
CHAPTER- 3.1 ERROR ANALYSIS.  Now we shall further consider  how to estimate uncertainties in our measurements,  the sources of the uncertainties,
Learning Theory Reza Shadmehr Distribution of the ML estimates of model parameters Signal dependent noise models.
Basic Business Statistics, 11e © 2009 Prentice-Hall, Inc. Chap 8-1 Chapter 8 Confidence Interval Estimation Business Statistics: A First Course 5 th Edition.
11-1 Copyright © 2014, 2011, and 2008 Pearson Education, Inc.
Estimating standard error using bootstrap
MECH 373 Instrumentation and Measurements
The simple linear regression model and parameter estimation
MECH 373 Instrumentation and Measurement
Chapter 7. Classification and Prediction
Two-Sample Hypothesis Testing
Correlation and Regression
Introduction to Instrumentation Engineering
CONCEPTS OF ESTIMATION
Simple Linear Regression
Measurements & Error Analysis
Presentation transcript:

Modelling unknown errors as random variables Thomas Svensson, SP Technical Research Institute of Sweden, a statistician working with Chalmers and FCC in industrial applications with companies like Volvo Aero, SKF, Volvo CE, Atlas Copco, Scania, Daimler, DAF, MAN, Iveco. SP:s customers with fatigue testing and modelling, and the evaluation of measurement uncertainty.

Problems Introduce statistics as an engineering tool for measurement uncertainty reliability with respect to fatigue failures Identify all sources of variation and uncertainty and put them in a statistical framework For both applications we use the Gauss approximation formula for the final uncertainty, where the covariances usually are neglected.

Sources of variation and uncertainty We have random variables such as: Electrical noise in instruments A population of operators Material strength scatter Variability within geometrical tolerances A population of users, drivers, missions, roads…

We have also non-random variables which are sources of uncertainty: Calibration error for instruments Non-linearity in gage transfer functions Sampling bias with respect to suppliers users Statistical uncertainty in estimated parameters Model errors: …. Sources of variation and uncertainty

sources of model errors External force vector process Multiaxial stress process Equivalent stress process, one or two dimensions. Cycle count Damage number transfer functions, static, dynamic reduction by principal stress, von Mises, Dang Van… rain flow count, level crossings, narrow band approximation, … Empirical relationships, Wöhler curve, Crack growth laws Fatigue life assessment by calculations: Model errors are introduced in all steps, reduction is necessary in order to compare with material strength, only simple empirical models are available because of the lack of detailed information, defects as microcracks, inclusions and pores are not at the drawing. material properties residual stresses corrections

Modelling unknown errors as random variables A total measurement uncertainty depends on several sources, both random and non-random. Fatigue life prediction depends on several random variables, uncertain judgements and possible model errors. Can these different type of sources be put in a common statistical framework? How can we estimate the statistical properties of the sources?

Example 1, Calibration An instrument is constructed in such a way that the output is proportional to the value of the measurand. Calibration and linear regression gives the proportionality constant, the sensitivity b. The mathematical model: The statistical model: Statistical theory gives prediction intervals for future usage of the instrument based on n observations from the calibration

Example 1, Calibration A more true model: There is a systematic model error which violates the assumptions behind the prediction interval. Solution: hypothetical randomization. The measurement uncertainty by means of the prediction interval should be regarded as a measure of future usage where the level x is random. Restriction : Reduction of uncertainty by taking means of replicates will not be in control unless the variance for the random part is known. Regression procedure: If replicates are made on different levels, the regression should be made on mean values to get a proper estimate of the standard deviation. But, for the prediction interval this estimate must be adjusted since we actually estimate

Example 2, model error, plasticity In a specific numerical fatigue assessment at Volvo Aero they can, by experience, tell that the true plasticity correction is expected to be between the values given by “the linear rule” and “the Neuber rule”. We calculate the fatigue life assuming the “linear rule”, keeping all other variables and procedures at their nominal values. The fatigue life prediction is: We calculate the fatigue life assuming the “Neuber rule”, keeping all other variables and procedures at their nominal values. The fatigue life prediction is: We now regard the unknown systematic error as a uniform random variable with variance:

Example 2, model error, plasticity How can this procedure be justified? What are the implications? Hypothetical randomisation by regarding the air engine chief engineers as a population? Hardly! In fact, the choice will introduce a systematic error for all VAC engines and the statistical measure will not comply with observed failure rates.

Example 3, Instrument bias A testing laboratory buys an instrument that is specified to have the accuracy, say 0.2%. What does this mean? Usually it means that the systematic error is less than 0.2% of the maximum output. How can this systematic error be handled in a statistical sense? For global comparisons one can regard it as a random bias, which hopefully has mean zero. It can then be included as a random contribution for global uncertainty statements. In a single laboratory there may be several similar instruments and by assuming that the operator always makes a random choice, also the local bias may be regarded as random and be included in the laboratory uncertainty. For comparisons the systematic error can be eliminated by using the same instrument and be excluded from uncertainty statements for comparative measurements.

Discussion In some engineering problems often uncertainties are far more important than random variation. This has resulted in the rejection of statistical tools and “worst case” estimates, “conservative” modelling and vague safety factors are kept in use. By putting also uncertainties in the statistical framework it is possible to take advantage of the statistical tools, compare all sources of scatter and uncertainty, and be more rational in updating and refinement of models. Reduction of variance by mean values of replicates is out of control. The resulting uncertainty measure in reliability cannot be interpreted as a failure rate. Large systematic errors should be eliminated by classification, better modelling, or more experiments. Are there more problems?