6/13/2016 1 Linear Regression Civil Engineering Majors Authors: Autar Kaw, Luke Snyder

Slides:



Advertisements
Similar presentations
1 Direct Method of Interpolation Electrical Engineering Majors Authors: Autar Kaw, Jai Paul
Advertisements

Differentiation-Discrete Functions
5/19/ Runge 4 th Order Method Mechanical Engineering Majors Authors: Autar Kaw, Charlie Barker
7/2/ Differentiation-Discrete Functions Industrial Engineering Majors Authors: Autar Kaw, Sri Harsha Garapati.
7/2/ Backward Divided Difference Major: All Engineering Majors Authors: Autar Kaw, Sri Harsha Garapati
8/8/ Euler Method Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
8/8/ Linear Regression Major: All Engineering Majors Authors: Autar Kaw, Luke Snyder
8/15/ Differentiation-Discrete Functions Major: All Engineering Majors Authors: Autar Kaw, Sri Harsha Garapati.
8/18/ Nonlinear Regression Major: All Engineering Majors Authors: Autar Kaw, Luke Snyder
9/14/ Trapezoidal Rule of Integration Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
1 Spline Interpolation Method Computer Engineering Majors Authors: Autar Kaw, Jai Paul
9/19/2015http://numericalmethods.eng.usf.edu1 Introduction to Scientific Computing Major: All Engineering Majors Authors: Autar Kaw, Luke Snyder
10/8/ Propagation of Errors Major: All Engineering Majors Authors: Autar Kaw, Matthew Emmons
10/11/ Nonlinear Regression Chemical Engineering Majors Authors: Autar Kaw, Luke Snyder
10/16/20151 Sources of Error Major: All Engineering Majors Authors: Autar Kaw, Luke Snyder Transforming Numerical Methods.
1 Lagrangian Interpolation Major: All Engineering Majors Authors: Autar Kaw, Jai Paul
1 Newton’s Divided Difference Polynomial Method of Interpolation Chemical Engineering Majors Authors: Autar Kaw, Jai.
1 Newton’s Divided Difference Polynomial Method of Interpolation Major: All Engineering Majors Authors: Autar Kaw,
11/17/ Shooting Method Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
12/1/ Trapezoidal Rule of Integration Civil Engineering Majors Authors: Autar Kaw, Charlie Barker
1 Direct Method of Interpolation Major: All Engineering Majors Authors: Autar Kaw, Jai Paul
12/17/ Linear Regression Dr. A. Emamzadeh. 2 What is Regression? What is regression? Given n data points best fitto the data. The best fit is generally.
1/16/ Runge 4 th Order Method Civil Engineering Majors Authors: Autar Kaw, Charlie Barker
Gaussian Elimination Mechanical Engineering Majors Author(s): Autar Kaw Transforming Numerical Methods Education for.
1/19/ Runge 4 th Order Method Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
1 Direct Method of Interpolation Computer Engineering Majors Authors: Autar Kaw, Jai Paul
2/12/ Linear Regression Electrical Engineering Majors Authors: Autar Kaw, Luke Snyder
Mechanical Engineering Majors Authors: Autar Kaw
1 Direct Method of Interpolation Mechanical Engineering Majors Authors: Autar Kaw, Jai Paul
1 Spline Interpolation Method Major: All Engineering Majors Authors: Autar Kaw, Jai Paul
1 Newton’s Divided Difference Polynomial Method of Interpolation Mechanical Engineering Majors Authors: Autar Kaw,
1 Spline Interpolation Method Mechanical Engineering Majors Authors: Autar Kaw, Jai Paul
6/13/ Linear Regression Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker Presented by: دکتر ابوالفضل.
Trapezoidal Rule of Integration
Civil Engineering Majors Authors: Autar Kaw, Charlie Barker
Gauss Quadrature Rule of Integration
Differentiation-Discrete Functions
Spline Interpolation Method
Spline Interpolation Method
Mechanical Engineering Majors Authors: Autar Kaw, Charlie Barker
Chemical Engineering Majors Authors: Autar Kaw, Charlie Barker
Spline Interpolation Method
Direct Method of Interpolation
Spline Interpolation Method
Lagrangian Interpolation
Civil Engineering Majors Authors: Autar Kaw, Charlie Barker
Newton’s Divided Difference Polynomial Method of Interpolation
Trapezoidal Rule of Integration
Sources of Error Major: All Engineering Majors
Spline Interpolation Method
Computer Engineering Majors Authors: Autar Kaw, Luke Snyder
Lagrangian Interpolation
Lagrangian Interpolation
Major: All Engineering Majors Authors: Autar Kaw, Luke Snyder
Direct Method of Interpolation
Major: All Engineering Majors Authors: Autar Kaw, Luke Snyder
Sources of Error Major: All Engineering Majors
Industrial Engineering Majors Authors: Autar Kaw, Luke Snyder
Lagrangian Interpolation
Lagrangian Interpolation
Simpson’s 1/3rd Rule of Integration
Mechanical Engineering Majors Authors: Autar Kaw, Luke Snyder
Electrical Engineering Majors Authors: Autar Kaw, Charlie Barker
Spline Interpolation Method
Chemical Engineering Majors Authors: Autar Kaw, Charlie Barker
Sources of Error Major: All Engineering Majors
Differentiation-Discrete Functions
Chemical Engineering Majors Authors: Autar Kaw, Luke Snyder
Newton’s Divided Difference Polynomial Method of Interpolation
Lagrangian Interpolation
Presentation transcript:

6/13/ Linear Regression Civil Engineering Majors Authors: Autar Kaw, Luke Snyder Transforming Numerical Methods Education for STEM Undergraduates

Linear Regression

3 What is Regression? What is regression? Given n data points best fitto the data. The best fit is generally based on minimizing the sum of the square of the residuals, Residual at a point is Figure. Basic model for regression Sum of the square of the residuals.

Linear Regression-Criterion#1 Given n data pointsbest fit to the data. Does minimizingwork as a criterion, where x y Figure. Linear regression of y vs. x data showing residuals at a typical point, x i.

Example for Criterion#1 xy Example: Given the data points (2,4), (3,6), (2,6) and (3,8), best fit the data to a straight line using Criterion#1 Figure. Data points for y vs. x data. Table. Data Points

Linear Regression-Criteria#1 xyy predicted ε = y - y predicted Table. Residuals at each point for regression model y = 4x – 4. Figure. Regression curve for y=4x-4, y vs. x data Using y=4x-4 as the regression curve

Linear Regression-Criteria#1 xyy predicted ε = y - y predicted Table. Residuals at each point for y=6 Figure. Regression curve for y=6, y vs. x data Using y=6 as a regression curve

Linear Regression – Criterion #1 for both regression models of y=4x-4 and y=6. The sum of the residuals is as small as possible, that is zero, but the regression model is not unique. Hence the above criterion of minimizing the sum of the residuals is a bad criterion.

Linear Regression-Criterion#2 x y Figure. Linear regression of y vs. x data showing residuals at a typical point, x i. Will minimizingwork any better?

Linear Regression-Criteria 2 xyy predicted |ε| = |y - y predicted | Table. The absolute residuals employing the y=4x-4 regression model Figure. Regression curve for y=4x-4, y vs. x data Using y=4x-4 as the regression curve

Linear Regression-Criteria#2 xyy predicted |ε| = |y – y predicted | Table. Absolute residuals employing the y=6 model Figure. Regression curve for y=6, y vs. x data Using y=6 as a regression curve

Linear Regression-Criterion#2 Can you find a regression line for whichand has unique regression coefficients? for both regression models of y=4x-4 and y=6. The sum of the errors has been made as small as possible, that is 4, but the regression model is not unique. Hence the above criterion of minimizing the sum of the absolute value of the residuals is also a bad criterion.

Least Squares Criterion The least squares criterion minimizes the sum of the square of the residuals in the model, and also produces a unique line. x y Figure. Linear regression of y vs. x data showing residuals at a typical point, x i.

Finding Constants of Linear Model Minimize the sum of the square of the residuals: To find giving andwe minimizewith respect toand.

Finding Constants of Linear Model Solving for and directly yields,

Example 1 Temperature, T Coefficient of Thermal Expansion, −20 −40 −60 −80 −100 −120 − 140 − 160 −180 −200 −220 −240 −260 −280 −300 −320 −340 The coefficient of thermal expansion of steel is given at discrete values of temperature, as shown in the table. Table. Data points for thermal expansion vs. temperature If the data is regressed to a first order polynomial, Find the constants of the model.

Example 1 cont. The necessary summations are calculated as

Example 1 cont. We can now calculate the value of using

Example 1 cont. The value forcan be calculated usingwhere The regression model is now given by

Question: Can you find the decrease in the diameter of a solid cylinder of radius 12” if the cylinder is cooled from a room temperature of 80°F to a dry-ice/alcohol bath with temperatures of −108°F? What would be the error if you used the thermal expansion coefficient at room temperature to find the answer? Example 1 cont. Figure. Linear regression of Coefficient of Thermal expansion vs. Temperature data

Example 2 StrainStress (%)(MPa) To find the longitudinal modulus of composite, the following data is collected. Find the longitudinal modulus, Table. Stress vs. Strain data using the regression model and the sum of the square of the residuals. Figure. Data points for Stress vs. Strain data

Example 2 cont. Residual at each point is given by The sum of the square of the residuals then is Differentiate with respect to Therefore

Example 2 cont. iεσε 2 εσ ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − × ×10 − ×10 8 Table. Summation data for regression model With and Using

Example 2 Results The equation Figure. Linear regression for Stress vs. Strain data describes the data.

Additional Resources For all resources on this topic such as digital audiovisual lectures, primers, textbook chapters, multiple-choice tests, worksheets in MATLAB, MATHEMATICA, MathCad and MAPLE, blogs, related physical problems, please visit ession.html

THE END