2014. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR We need to be.

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

Kin 304 Regression Linear Regression Least Sum of Squares
Linear Equations Review. Find the slope and y intercept: y + x = -1.
Chapter 12 Simple Linear Regression
BA 275 Quantitative Business Methods
Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Probabilistic & Statistical Techniques Eng. Tamer Eshtawi First Semester Eng. Tamer Eshtawi First Semester
Simple Linear Regression. G. Baker, Department of Statistics University of South Carolina; Slide 2 Relationship Between Two Quantitative Variables If.
Linear regression models
Definition  Regression Model  Regression Equation Y i =  0 +  1 X i ^ Given a collection of paired data, the regression equation algebraically describes.
Chapter 12 Simple Linear Regression
LINEAR REGRESSION: Evaluating Regression Models. Overview Standard Error of the Estimate Goodness of Fit Coefficient of Determination Regression Coefficients.
Lesson #32 Simple Linear Regression. Regression is used to model and/or predict a variable; called the dependent variable, Y; based on one or more independent.
Probability & Statistics for Engineers & Scientists, by Walpole, Myers, Myers & Ye ~ Chapter 11 Notes Class notes for ISE 201 San Jose State University.
RLR. Purpose of Regression Fit data to model Known model based on physics P* = exp[A - B/(T+C)] Antoine eq. Assumed correlation y = a + b*x1+c*x2 Use.
1 1 Slide Simple Linear Regression Chapter 14 BA 303 – Spring 2011.
Linear Regression.
Least-Squares Regression
Introduction to Linear Regression and Correlation Analysis
Regression Analysis Regression analysis is a statistical technique that is very useful for exploring the relationships between two or more variables (one.
Relationship of two variables
Multiple Linear Regression - Matrix Formulation Let x = (x 1, x 2, …, x n )′ be a n  1 column vector and let g(x) be a scalar function of x. Then, by.
CPE 619 Simple Linear Regression Models Aleksandar Milenković The LaCASA Laboratory Electrical and Computer Engineering Department The University of Alabama.
Simple Linear Regression Models
Stats for Engineers Lecture 9. Summary From Last Time Confidence Intervals for the mean t-tables Q Student t-distribution.
1 1 Slide © 2005 Thomson/South-Western Slides Prepared by JOHN S. LOUCKS St. Edward’s University Slides Prepared by JOHN S. LOUCKS St. Edward’s University.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
1 Dr. Jerrell T. Stracener EMIS 7370 STAT 5340 Probability and Statistics for Scientists and Engineers Department of Engineering Management, Information.
1 1 Slide © 2014 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole.
Regression. Population Covariance and Correlation.
Thomas Knotts. Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR.
Inference for Regression Simple Linear Regression IPS Chapter 10.1 © 2009 W.H. Freeman and Company.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Regression Analysis Relationship with one independent variable.
Regression Analysis Part C Confidence Intervals and Hypothesis Testing
Simple Linear Regression. Data available : (X,Y) Goal : To predict the response Y. (i.e. to obtain the fitted response function f(X)) Least Squares Fitting.
AP STATISTICS LESSON 14 – 1 ( DAY 1 ) INFERENCE ABOUT THE MODEL.
Ch14: Linear Least Squares 14.1: INTRO: Fitting a pth-order polynomial will require finding (p+1) coefficients from the data. Thus, a straight line (p=1)
Basic Statistics Linear Regression. X Y Simple Linear Regression.
Trees Example More than one variable. The residual plot suggests that the linear model is satisfactory. The R squared value seems quite low though,
Chapter 10: Determining How Costs Behave 1 Horngren 13e.
Curve Fitting Pertemuan 10 Matakuliah: S0262-Analisis Numerik Tahun: 2010.
Engineers often: Regress data to a model  Used for assessing theory  Used for predicting  Empirical or theoretical model Use the regression of others.
Statistics Review ChE 475 Fall 2015 Dr. Harding. 1. Repeated Data Points Use t-test based on measured st dev (s) true mean measured mean In Excel, =T.INV(
Regression Analysis Deterministic model No chance of an error in calculating y for a given x Probabilistic model chance of an error First order linear.
Regression Analysis1. 2 INTRODUCTION TO EMPIRICAL MODELS LEAST SQUARES ESTIMATION OF THE PARAMETERS PROPERTIES OF THE LEAST SQUARES ESTIMATORS AND ESTIMATION.
Chapter 12 Simple Linear Regression n Simple Linear Regression Model n Least Squares Method n Coefficient of Determination n Model Assumptions n Testing.
1 1 Slide The Simple Linear Regression Model n Simple Linear Regression Model y =  0 +  1 x +  n Simple Linear Regression Equation E( y ) =  0 + 
Correlation and Regression Chapter 9. § 9.2 Linear Regression.
Linear Regression Models Andy Wang CIS Computer Systems Performance Analysis.
Introduction Many problems in Engineering, Management, Health Sciences and other Sciences involve exploring the relationships between two or more variables.
Regression Analysis AGEC 784.
AP Statistics Chapter 14 Section 1.
Relationship with one independent variable
CHAPTER 10 Correlation and Regression (Objectives)
Linear Regression Models
Statistical Methods For Engineers
CHAPTER 29: Multiple Regression*
Prediction of new observations
BA 275 Quantitative Business Methods
Review (1) ChE 475 Fall 2016 Dr. Harding.
Correlation and Regression
Simple Linear Regression
Relationship with one independent variable
Section 2: Linear Regression.
Correlation and Regression
Nonlinear Fitting.
Regression Statistics
Lesson 2.2 Linear Regression.
Business Statistics - QBM117
Presentation transcript:

2014

Engineers often: Regress data  Analysis  Fit to theory  Data reduction Use the regression of others  Antoine Equation  DIPPR We need to be able to report uncertainties associated with regression. Do the data fit the model? What are the errors in the prediction? What are the errors in the parameters? We need to be able to report uncertainties associated with regression. Do the data fit the model? What are the errors in the prediction? What are the errors in the parameters?

There are two classes of regressions  Linear  Non-linear “Linear” refers to the parameters, not the functional dependence of the independent variable  You can use the Mathcad function “linfit” on linear equations

There are two classes of regressions  Linear  Non-linear “Linear” refers to the parameters, not the functional dependence of the independent variable  You can use the Mathcad function “linfit” on linear equations

residual (error) “X” data “Y” Measured slope Intercept “Y” Predicted

residual (error) “X” data “Y” data intercept slope SS E “Y” predicted sum squared error mean squared error Number of fitted parameters: 2 for a two-parameter model Number of fitted parameters: 2 for a two-parameter model

A useful statistic but not definitive Tells you how well the data fit the model. It does not tell you if the model is correct.

How well does the line fit the data at each point (not just the mean)? In what range should the data lie (are there outliers)? What are the confidence intervals on the slope and intercept?

Confidence Intervals from Example Green is confidence interval How well does the model fit the data? Red is the prediction band Where should the data fall? Can I throw out any points?

When you fit data to a straight line, the slope and intercept are only estimates of the true slope and intercept. (slope) (intercept)

Confidence Interval on the Prediction Prediction Band: Expected Range of Data

CONFIDENCE INTERVAL “Mean Prediction Band” Shows possible errors in where the line will go Interval narrows with increasing number of data points  See equation on previous slide PREDICTION BAND “Single (another) Point Prediction Band” Shows where the data should lie Interval does not narrow much with increasing number of data points  See equation on previous slide

Igor has the equations already programmed and will Plot the confidence intervals Plot the prediction bands Print the  confidence intervals on the slope and intercept Assignment

Linear regression can be written in matrix form. XY

Standard Error of b i is the square root of the i-th diagonal term of the matrix