Global predictors of regression fidelity A single number to characterize the overall quality of the surrogate. Equivalence measures –Coefficient of multiple.

Slides:



Advertisements
Similar presentations
Young Modulus Example The pairs (1,1), (2,2), (4,3) represent strain (millistrains) and stress (ksi) measurements. Estimate Young modulus using the three.
Advertisements

11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Kin 304 Regression Linear Regression Least Sum of Squares
Uncertainty in fall time surrogate Prediction variance vs. data sensitivity – Non-uniform noise – Example Uncertainty in fall time data Bootstrapping.
6-1 Introduction To Empirical Models 6-1 Introduction To Empirical Models.
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Regression Analysis Once a linear relationship is defined, the independent variable can be used to forecast the dependent variable. Y ^ = bo + bX bo is.
Curve fit metrics When we fit a curve to data we ask: –What is the error metric for the best fit? –What is more accurate, the data or the fit? This lecture.
Cal State Northridge  320 Andrew Ainsworth PhD Regression.
LINEAR REGRESSION: Evaluating Regression Models Overview Assumptions for Linear Regression Evaluating a Regression Model.
LINEAR REGRESSION: Evaluating Regression Models. Overview Assumptions for Linear Regression Evaluating a Regression Model.
The Simple Linear Regression Model: Specification and Estimation
Intro to Statistics for the Behavioral Sciences PSYC 1900
Simple Linear Regression Analysis
Regression The basic problem Regression and Correlation Accuracy of prediction in regression Hypothesis testing Regression with multiple predictors.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Curve fit noise=randn(1,30); x=1:1:30; y=x+noise ………………………………… [p,s]=polyfit(x,y,1);
Simple Linear Regression Analysis
Simple Linear Regression NFL Point Spreads – 2007.
Relationships Among Variables
Marketing Research Aaker, Kumar, Day and Leone Tenth Edition
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter Inference on the Least-Squares Regression Model and Multiple Regression 14.
CORRELATION & REGRESSION
1 FORECASTING Regression Analysis Aslı Sencer Graduate Program in Business Information Systems.
1 1 Slide © 2007 Thomson South-Western. All Rights Reserved Chapter 13 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
1 1 Slide © 2008 Thomson South-Western. All Rights Reserved Chapter 15 Multiple Regression n Multiple Regression Model n Least Squares Method n Multiple.
Linear Regression Least Squares Method: the Meaning of r 2.
Correlation and Prediction Error The amount of prediction error is associated with the strength of the correlation between X and Y.
Part IV Significantly Different: Using Inferential Statistics
© Copyright McGraw-Hill Correlation and Regression CHAPTER 10.
Chapter 13 Multiple Regression
Section 12.3 Regression Analysis HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2008 by Hawkes Learning Systems/Quant Systems, Inc. All.
11/23/2015Slide 1 Using a combination of tables and plots from SPSS plus spreadsheets from Excel, we will show the linkage between correlation and linear.
INDE 6335 ENGINEERING ADMINISTRATION SURVEY DESIGN Dr. Christopher A. Chung Dept. of Industrial Engineering.
REGRESSION DIAGNOSTICS Fall 2013 Dec 12/13. WHY REGRESSION DIAGNOSTICS? The validity of a regression model is based on a set of assumptions. Violation.
Linear Prediction Correlation can be used to make predictions – Values on X can be used to predict values on Y – Stronger relationships between X and Y.
Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Simple Linear Regression Analysis Chapter 13.
© 2011 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part, except for use as permitted in a license.
Multiple Regression Analysis Regression analysis with two or more independent variables. Leads to an improvement.
Global predictors of regression fidelity A single number to characterize the overall quality of the surrogate. Equivalence measures –Coefficient of multiple.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
Quantitative methods and R – (2) LING115 December 2, 2009.
Hypothesis Testing Example 3: Test the hypothesis that the average content of containers of a particular lubricant is 10 litters if the contents of random.
Curve fit metrics When we fit a curve to data we ask: –What is the error metric for the best fit? –What is more accurate, the data or the fit? This lecture.
1 AAEC 4302 ADVANCED STATISTICAL METHODS IN AGRICULTURAL RESEARCH Part II: Theory and Estimation of Regression Models Chapter 5: Simple Regression Theory.
Global predictors of regression fidelity A single number to characterize the overall quality of the surrogate. Equivalence measures –Coefficient of multiple.
The simple linear regression model and parameter estimation
Questions from lectures
Regression Analysis AGEC 784.
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
10.2 Regression If the value of the correlation coefficient is significant, the next step is to determine the equation of the regression line which is.
Regression The basic problem Regression and Correlation
Kin 304 Regression Linear Regression Least Sum of Squares
Chapter 12: Regression Diagnostics
BPK 304W Regression Linear Regression Least Sum of Squares
Statistical Methods For Engineers
BA 275 Quantitative Business Methods
Linear Regression.
Fundamental Statistics for the Behavioral Sciences, 4th edition
Model Comparison: some basic concepts
Least Squares Method: the Meaning of r2
Curve fit metrics When we fit a curve to data we ask:
5.2 Least-Squares Fit to a Straight Line
Curve fit metrics When we fit a curve to data we ask:
Product moment correlation
Regression & Prediction
Correlation and Covariance
Regression and Correlation of Data
3 basic analytical tasks in bivariate (or multivariate) analyses:
Presentation transcript:

Global predictors of regression fidelity A single number to characterize the overall quality of the surrogate. Equivalence measures –Coefficient of multiple determination –Adjusted coefficient of multiple determination Prediction accuracy measures –Model independent: Cross validation error –Model dependent: Standard error

Linear Regression

Coefficient of multiple determination Equivalence of surrogate with data is often measured by how much of the variance in the data is captured by the surrogate. Coefficient of multiple determination and adjusted version

R 2 does not reflect accuracy Compare y1=x to y2=0.1x plus same noise (normally distributed with zero mean and standard deviation of 1. Estimate the average errors between the function (red) and surrogate (blue). R 2 = R 2 =0.3016

Cross validation Validation consists of checking the surrogate at a set of validation points. This may be considered wasteful because we do not use all the points for fitting the best possible surrogate. Cross validation divides data into n g groups. Fit the approximation to n g -1 groups, and use last group to estimate error. Repeat for each group. When each group consists of one point, error often called PRESS (prediction error sum of squares) Calculate error at each point and then present r.m.s error For linear regression can be shown that

Model based error for linear regression

Comparison of errors

Problems The pairs (0,0), (1,1), (2,1) represent strain (millistrains) and stress (ksi) measurements. –Estimate Young’s modulus using regression. –Calculate the error in Young modulus using cross validation both from the definition and from the formula on Slide 5. Repeat the example of y=x, using only data at x=3,6,9,…,30. Use the same noise values as given for these points in the notes for Slide 4.