Discussion ofAspects of Bias, Prediction Variance and Mean Square Error Geoff Vining Virginia Tech.

Slides:



Advertisements
Similar presentations
Outline Background Model Development Variance Dispersion Graphs
Advertisements

Connie M. Borror, Arizona State University West Christine M. Anderson-Cook, Los Alamos National Laboratory Bradley Jones, JMP SAS Institute Construction.
Rachel T. Johnson Douglas C. Montgomery Bradley Jones
Dummy Dependent variable Models
Modeling of Data. Basic Bayes theorem Bayes theorem relates the conditional probabilities of two events A, and B: A might be a hypothesis and B might.
1 Regression as Moment Structure. 2 Regression Equation Y =  X + v Observable Variables Y z = X Moment matrix  YY  YX  =  YX  XX Moment structure.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Stat 112: Lecture 7 Notes Homework 2: Due next Thursday The Multiple Linear Regression model (Chapter 4.1) Inferences from multiple regression analysis.
Lecture 3 HSPM J716. Efficiency in an estimator Efficiency = low bias and low variance Unbiased with high variance – not very useful Biased with low variance.
/k 2DS00 Statistics 1 for Chemical Engineering lecture 4.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
11 Simple Linear Regression and Correlation CHAPTER OUTLINE
Mitigating Risk of Out-of-Specification Results During Stability Testing of Biopharmaceutical Products Jeff Gardner Principal Consultant 36 th Annual Midwest.
Simple Linear Regression
CJT 765: Structural Equation Modeling Class 3: Data Screening: Fixing Distributional Problems, Missing Data, Measurement.
11.1 Introduction to Response Surface Methodology
Confidence Intervals Underlying model: Unknown parameter We know how to calculate point estimates E.g. regression analysis But different data would change.
LINEAR REGRESSION: Evaluating Regression Models. Overview Standard Error of the Estimate Goodness of Fit Coefficient of Determination Regression Coefficients.
Statistics 350 Lecture 23. Today Today: Exam next day Good Chapter 7 questions: 7.1, 7.2, 7.3, 7.28, 7.29.
8 Statistical Intervals for a Single Sample CHAPTER OUTLINE
Lecture 6 Notes Note: I will homework 2 tonight. It will be due next Thursday. The Multiple Linear Regression model (Chapter 4.1) Inferences from.
Measurement: Reliability and Validity For a measure to be useful, it must be both reliable and valid Reliable = consistent in producing the same results.
8-1 Introduction In the previous chapter we illustrated how a parameter can be estimated from sample data. However, it is important to understand how.
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Spreadsheet Modeling & Decision Analysis A Practical Introduction to Management Science 5 th edition Cliff T. Ragsdale.
1 841f06parnas13 Evaluation of Safety Critical Software David L. Parnas, C ACM, June 1990.
1 G Lect 11W Logistic Regression Review Maximum Likelihood Estimates Probit Regression and Example Model Fit G Multiple Regression Week 11.
Extension to Multiple Regression. Simple regression With simple regression, we have a single predictor and outcome, and in general things are straightforward.
© 2001 Prentice-Hall, Inc.Chap 9-1 BA 201 Lecture 22 Estimation of Predicted Values.
Jeroen Pannekoek - Statistics Netherlands Work Session on Statistical Data Editing Oslo, Norway, 24 September 2012 Topic (I) Selective and macro editing.
9-1 MGMG 522 : Session #9 Binary Regression (Ch. 13)
1 Modeling Coherent Mortality Forecasts using the Framework of Lee-Carter Model Presenter: Jack C. Yue /National Chengchi University, Taiwan Co-author:
Chapter 5: Regression Analysis Part 1: Simple Linear Regression.
Managerial Economics Demand Estimation & Forecasting.
Regression Regression relationship = trend + scatter
Regression Analysis Week 8 DIAGNOSTIC AND REMEDIAL MEASURES Residuals The main purpose examining residuals Diagnostic for Residuals Test involving residuals.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Center for Radiative Shock Hydrodynamics Fall 2011 Review Assessment of predictive capability Derek Bingham 1.
1 Analysis Considerations in Industrial Split-Plot Experiments When the Responses are Non-Normal Timothy J. Robinson University of Wyoming Raymond H. Myers.
VI. Regression Analysis A. Simple Linear Regression 1. Scatter Plots Regression analysis is best taught via an example. Pencil lead is a ceramic material.
Applied Quantitative Analysis and Practices LECTURE#25 By Dr. Osman Sadiq Paracha.
Multiple Logistic Regression STAT E-150 Statistical Methods.
Linear Regression Basics III Violating Assumptions Fin250f: Lecture 7.2 Spring 2010 Brooks, chapter 4(skim) 4.1-2, 4.4, 4.5, 4.7,
Linear Prediction Correlation can be used to make predictions – Values on X can be used to predict values on Y – Stronger relationships between X and Y.
Machine Learning 5. Parametric Methods.
Logistic Regression Saed Sayad 1www.ismartsoft.com.
L Berkley Davis Copyright 2009 MER301: Engineering Reliability Lecture 12 1 MER301: Engineering Reliability LECTURE 12: Chapter 6: Linear Regression Analysis.
Maximum likelihood estimators Example: Random data X i drawn from a Poisson distribution with unknown  We want to determine  For any assumed value of.
Management and Cost Accounting, 6 th edition, ISBN © 2004 Colin Drury MANAGEMENT AND COST ACCOUNTING SIXTH EDITION COLIN DRURY.
6. Ordered Choice Models. Ordered Choices Ordered Discrete Outcomes E.g.: Taste test, credit rating, course grade, preference scale Underlying random.
[Part 5] 1/43 Discrete Choice Modeling Ordered Choice Models Discrete Choice Modeling William Greene Stern School of Business New York University 0Introduction.
Assumptions & Requirements.  Three Important Assumptions 1.The errors are normally distributed. 2.The errors have constant variance (i.e., they are homoscedastic)
Exposure Prediction and Measurement Error in Air Pollution and Health Studies Lianne Sheppard Adam A. Szpiro, Sun-Young Kim University of Washington CMAS.
Bias-Variance Analysis in Regression  True function is y = f(x) +  where  is normally distributed with zero mean and standard deviation .  Given a.
Fundamentals of Data Analysis Lecture 11 Methods of parametric estimation.
STA302/1001 week 11 Regression Models - Introduction In regression models, two types of variables that are studied:  A dependent variable, Y, also called.
William Greene Stern School of Business New York University
Ch12.1 Simple Linear Regression
Statistics in MSmcDESPOT
Slope of the regression line:
Statistical Methods For Engineers
BA 275 Quantitative Business Methods
Regression Models - Introduction
The Least-Squares Line Introduction
Simple Linear Regression
Simple Linear Regression
Chapter 11 Variable Selection Procedures
Model Adequacy Checking
Linear Regression Analysis 5th edition Montgomery, Peck & Vining
Regression Models - Introduction
Presentation transcript:

Discussion ofAspects of Bias, Prediction Variance and Mean Square Error Geoff Vining Virginia Tech

Construction and Evaluation of Response Surface Designs Incorporating Bias from Model Misspecification Appreciate that the Authors Are Exxtending FDS Plots to Include Bias Very Natural and Welcomed Extension Reflections from a Very Quick Reading!

Construction and Evaluation of Response Surface Designs Incorporating Bias from Model Misspecification Looks Like the Authors Are Treating the Lack- of-Fit Coefficients as Random – Very Problematic – Actually, They Are Fixed but Unknown Suggest a More Thorough Literature Review

Construction and Evaluation of Response Surface Designs Incorporating Bias from Model Misspecification Box and Draper (1959, 1963) Lambda – Optimality (1980s) Trace L – Optimality (1980s) Vining and Myers (Technometrics, 1991) – Extends VDGs to Include Bias – Defines the Lack-of-Fit in Terms of Power – Avoids the Need for Looking at Individual Coefficients

Prediction Based Model Selection for Reliability Takes a Generalized Linear Models Approach to Reliability Not Focused on Time to Failure Focus on Probability of Failure – Binary Response – Probit Models – Region of Interest – True Value Comes from the Full Model

Prediction Based Model Selection for Reliability Issues: – General There Are Multiple Regions of Interest – In any generalized linear model, …, the estimate from the full model converges in probability to the true model. If, and only if, the full model is,in fact, the full model!! All models are wrong; some models are useful. More closely related to Mallows Cp. – Number of Models to Evaluate

Prediction Based Model Selection for Reliability Comments – Interesting Approach – Serious Approach to Model Selection for Reliability – Some Concern about Reliance on the Full Model – Focus on Probability of Failure Seems Limiting Perhaps Appropriate Seems to ignore the physics of failure.