Y=a+bx Sum of squares of errors Linear Regression: Method of Least Squares The Method of Least Squares is a procedure to determine the best fit line to.

Slides:



Advertisements
Similar presentations
11-1 Empirical Models Many problems in engineering and science involve exploring the relationships between two or more variables. Regression analysis.
Advertisements

Statistical Techniques I EXST7005 Simple Linear Regression.
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Data Analysis: Bivariate Correlation and Regression CHAPTER sixteen.
Learning Objectives Copyright © 2004 John Wiley & Sons, Inc. Bivariate Correlation and Regression CHAPTER Thirteen.
Probabilistic & Statistical Techniques Eng. Tamer Eshtawi First Semester Eng. Tamer Eshtawi First Semester
Definition  Regression Model  Regression Equation Y i =  0 +  1 X i ^ Given a collection of paired data, the regression equation algebraically describes.
Chapter 10 Regression. Defining Regression Simple linear regression features one independent variable and one dependent variable, as in correlation the.
Developing and Using a Simple Regression Equation. The simple regression model is based on the equation for a straight line: Yc = A+BX.
EGR 105 Foundations of Engineering I Fall 2007 – week 7 Excel part 3 - regression.
EGR 105 Foundations of Engineering I Fall 2007 – week 7 Excel part 3 - regression.
SIMPLE LINEAR REGRESSION
Chapter 3 Summarizing Descriptive Relationships ©.
Lecture 5 Curve fitting by iterative approaches MARINE QB III MARINE QB III Modelling Aquatic Rates In Natural Ecosystems BIOL471 © 2001 School of Biological.
C82MCP Diploma Statistics School of Psychology University of Nottingham 1 Linear Regression and Linear Prediction Predicting the score on one variable.
Chapter 2 – Simple Linear Regression - How. Here is a perfect scenario of what we want reality to look like for simple linear regression. Our two variables.
SIMPLE LINEAR REGRESSION
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Regression Analysis What is regression ?What is regression ? Best-fit lineBest-fit line Least squareLeast square What is regression ?What is regression.
Relationship of two variables
Correlation and simple linear regression Marek Majdan Training in essential biostatistics for Public Health Professionals in BiH, Marek Majdan, PhD;
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
Managerial Economics Demand Estimation. Scatter Diagram Regression Analysis.
Section 5.2: Linear Regression: Fitting a Line to Bivariate Data.
Statistical Methods Statistical Methods Descriptive Inferential
Curve Fitting and Regression EEE 244. Descriptive Statistics in MATLAB MATLAB has several built-in commands to compute and display descriptive statistics.
Basic Concepts of Correlation. Definition A correlation exists between two variables when the values of one are somehow associated with the values of.
Regression Regression relationship = trend + scatter
PROGRAM 6: Curve Fitting to fit a straight line to a given set of data points using Least Square Method If data is in terms of two variables x and y then.
Simple Linear Regression. The term linear regression implies that  Y|x is linearly related to x by the population regression equation  Y|x =  +  x.
9.2A- Linear Regression Regression Line = Line of best fit The line for which the sum of the squares of the residuals is a minimum Residuals (d) = distance.
Chapter 6 (cont.) Difference Estimation. Recall the Regression Estimation Procedure 2.
Curve Fitting Pertemuan 10 Matakuliah: S0262-Analisis Numerik Tahun: 2010.
© 2001 Prentice-Hall, Inc.Chap 13-1 BA 201 Lecture 18 Introduction to Simple Linear Regression (Data)Data.
Regression Analysis. 1. To comprehend the nature of correlation analysis. 2. To understand bivariate regression analysis. 3. To become aware of the coefficient.
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression.
Engineering Analysis ENG 3420 Fall 2009 Dan C. Marinescu Office: HEC 439 B Office hours: Tu-Th 11:00-12:00.
y=a+bx Linear Regression: Method of Least Squares slope y intercept y
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
STATISTICS 12.0 Correlation and Linear Regression “Correlation and Linear Regression -”Causal Forecasting Method.
V. Rouillard  Introduction to measurement and statistical analysis CURVE FITTING In graphical form, drawing a line (curve) of best fit through.
OLS Regression What is it? Closely allied with correlation – interested in the strength of the linear relationship between two variables One variable is.
Transforming Numerical Methods Education for the STEM Undergraduate Regression
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
6/13/ Linear Regression Civil Engineering Majors Authors: Autar Kaw, Luke Snyder
Irwin/McGraw-Hill © Andrew F. Siegel, 1997 and l Chapter 9 l Simple Linear Regression 9.1 Simple Linear Regression 9.2 Scatter Diagram 9.3 Graphical.
1 Objective Given two linearly correlated variables (x and y), find the linear function (equation) that best describes the trend. Section 10.3 Regression.
Part 5 - Chapter
Part 5 - Chapter 17.
Statistics 101 Chapter 3 Section 3.
Linear Regression Special Topics.
Practice. Practice Practice Practice Practice r = X = 20 X2 = 120 Y = 19 Y2 = 123 XY = 72 N = 4 (4) 72.
Regression and Correlation
Simple Linear Regression
CHAPTER 10 Correlation and Regression (Objectives)
Part 5 - Chapter 17.
y=a+bx Linear Regression: Method of Least Squares slope y intercept y
REGRESSION.
^ y = a + bx Stats Chapter 5 - Least Squares Regression
Linear regression Fitting a straight line to observations.
Least Squares Fitting A mathematical procedure for finding the best-fitting curve to a given set of points by minimizing the sum of the squares of the.
Least-Squares Regression
Correlation and Regression
Discrete Least Squares Approximation
Correlation and Regression
y=a+bx Linear Regression: Method of Least Squares slope y intercept
Regression & Prediction
Ch 4.1 & 4.2 Two dimensions concept
Mechanical Engineering Majors Authors: Autar Kaw, Luke Snyder
Created by Erin Hodgess, Houston, Texas
Presentation transcript:

y=a+bx Sum of squares of errors Linear Regression: Method of Least Squares The Method of Least Squares is a procedure to determine the best fit line to data; the proof uses simple calculus and linear algebra. The basic problem is to find the best fit straight line y = a + bx given that, for n {1,…,N}, the pairs (x n ; y n ) are observed. The form of the fitted curve is y intercept slope

xy a=1.188 b=0.484 y= x Example 1: Find a 1 st order polynomial y=a+bx for the values given in the Table. Data point Fitted curve clc;clear x=[-5,2,4]; y=[-2,4,3.5]; p=polyfit(x,y,1) x1=-5:0.01:7; yx=polyval(p,x1); plot(x,y,'or',x1,yx,'b') xlabel('x value') ylabel ('y value')

xy y=a+bx y= x Example 2: clc;clear x=[0,3,5,8,10]; y=[200,230,240,270,290]; p=polyfit(x,y,1) x1=-1:0.01:12; yx=polyval(p,x1); plot(x,y,'or',x1,yx,'b') xlabel('x value') ylabel ('y value') Data point Fitted curve

Method of Least Squares: Tensile tests were performed for a composite material having a crack in order to calculate the fracture toughness. Obtain a linear relationship between the breaking load F and crack length a. Method of Least Squares Slope Intercept Slope Intercept

Method of Least Squares: with Visual Basic: mls.txt 5 10, , , , ,0.28 with Matlab: clc;clear x=[10,9.25,9.1,9.4,8.5]; y=[0.5,0.4,0.35,0.45,0.28]; p=polyfit(x,y,1) F=8:0.01:12; a=polyval(p,x1); plot(x,y,'or‘,F,a,'b') xlabel('x value') ylabel ('y value')

Method of Least Squares: The change in the interior temperature of an oven with respet to time is given in the Figure. It is desired to model the relationship between the temperature (T) and time (t) by a first order polynomial as T=c 1 t+c 2. Determine the coefficients c 1 and c 2. T (°C) t (min.) Slope Intercept Slope Intercept

Method of Least Squares: With Visual Basic: mls.txt 4 0,175 5,204 10,200 15,212 with Matlab: clc;clear x=[0,5,10,15]; y=[175,204,200,212]; p=polyfit(x,y,1) t=0:0.01:15; T=polyval(p,x1); plot(x,y,'or',t,T,'b') xlabel('x value') ylabel ('y value')