The Method of Least-Squares

Slides:



Advertisements
Similar presentations
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Advertisements

Regression Analysis Module 3. Regression Regression is the attempt to explain the variation in a dependent variable using the variation in independent.
Regression Regression: Mathematical method for determining the best equation that reproduces a data set Linear Regression: Regression method applied with.
Engineering experiments involve the measuring of the dependent variable as the independent one has been altered, so as to determine the relationship between.
Least Square Regression
The Islamic University of Gaza Faculty of Engineering Civil Engineering Department Numerical Analysis ECIV 3306 Chapter 17 Least Square Regression.
Introduction to Linear and Logistic Regression. Basic Ideas Linear Transformation Finding the Regression Line Minimize sum of the quadratic residuals.
1 1 Slide Simple Linear Regression Chapter 14 BA 303 – Spring 2011.
Adapted from Walch Education A linear equation describes a situation where there is a near- constant rate of change. An exponential equation describes.
Solving Systems of Equations Graphically. Quadratic Equations/ Linear Equations  A quadratic equation is defined as an equation in which one or more.
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression Chapter.
Algebra 1 Notes Lesson 7-2 Substitution. Mathematics Standards -Patterns, Functions and Algebra: Solve real- world problems that can be modeled using.
16-1 Linear Trend The long term trend of many business series often approximates a straight line.
3-2 Solving Equations by Using Addition and Subtraction Objective: Students will be able to solve equations by using addition and subtraction.
Curve-Fitting Regression
CHAPTER 3 Model Fitting. Introduction Possible tasks when analyzing a collection of data points: Fitting a selected model type or types to the data Choosing.
1 Multiple Regression A single numerical response variable, Y. Multiple numerical explanatory variables, X 1, X 2,…, X k.
Look at the tables and graphs below. The data show three ways you have learned that variable quantities can be related. The relationships shown are linear,
9.3 Graphing Quadratic Functions
CORRELATION. Correlation key concepts: Types of correlation Methods of studying correlation a) Scatter diagram b) Karl pearson’s coefficient of correlation.
Copyright © Cengage Learning. All rights reserved. 1 STRAIGHT LINES AND LINEAR FUNCTIONS.
John C. Mayer Introduction to Mathematical Modeling 1 Curve Fitting.
Section 1-3: Graphing Data
Chapter 3- Model Fitting. Three Tasks When Analyzing Data: 1.Fit a model type to the data. 2.Choose the most appropriate model from the ones that have.
+ Unit 1 – First degree equations and inequalities Chapter 3 – Systems of Equation and Inequalities 3.1 – Solving Systems by Graphing.
Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 ~ Curve Fitting ~ Least Squares Regression.
Chapter Nonlinear Systems.
 G K Powers 2013 Cambridge University Press 5. Interpreting linear relationships Study guide 1.
To accompany Quantitative Analysis for Management, 8e by Render/Stair/Hanna Port of Baltimore Exponential Smoothing Example QtrActual Tonnage Unloaded.
Chapter 14 Introduction to Regression Analysis. Objectives Regression Analysis Uses of Regression Analysis Method of Least Squares Difference between.
BUSINESS MATHEMATICS & STATISTICS. Module 6 Correlation ( Lecture 28-29) Line Fitting ( Lectures 30-31) Time Series and Exponential Smoothing ( Lectures.
Warm Up 1. Find the slope and y-intercept of the line that passes through (4, 20) and (20, 24). The population of a town is decreasing at a rate of 1.8%
Chapter 5: Systems of Linear Equations Section 5.1: Solving Systems of Linear Equations by Elimination.
3-1Forecasting Weighted Moving Average Formula w t = weight given to time period “t” occurrence (weights must add to one) The formula for the moving average.
ELEC 413 Linear Least Squares. Regression Analysis The study and measure of the statistical relationship that exists between two or more variables Two.
The Parabola 10.1.
Chapter 10 Conic Sections.
TIME SERIES ANALYSIS.
Equations Quadratic in form factorable equations
CHAPTER 3 Describing Relationships
Ch12.1 Simple Linear Regression
12. Modelling non-linear relationships
Straight Line Graphs (Linear Graphs)
Basic Graphing Techniques
3-2: Solving Systems of Equations using Substitution
Warm-Up 2-1.
Parabolas 4.2. Parabolas 4.2 Standard Form of Parabolic Equations Standard Form of Equation   Axis of Symmetry Vertex Direction Parabola Opens up or.
Solve a system of linear equation in two variables
3-2: Solving Systems of Equations using Substitution
Solving Systems of Equations using Substitution
GRAPHS AND RELATIONSHIPS
3-2: Solving Systems of Equations using Substitution
M248: Analyzing data Block D UNIT D2 Regression.
Least-Squares Regression
Discrete Least Squares Approximation
Least Square Regression
Time Series Analysis (Demand Forecasting)
Systems of Equations Solve by Graphing.
3.2 – Least Squares Regression
3-2: Solving Systems of Equations using Substitution
Equations Quadratic in form factorable equations
3-2: Solving Systems of Equations using Substitution
3-2: Solving Systems of Equations using Substitution
9/27/ A Least-Squares Regression.
3-2: Solving Systems of Equations using Substitution
3-2: Solving Systems of Equations using Substitution
In practice,the method of least squares is widely used
Graphing Linear Equations
exponential equations
MATH 2311 Section 5.5.
Presentation transcript:

The Method of Least-Squares Lecture#32 MGT 601

4. The Method of Least-Squares A trend line, described by a mathematical equation of the form of a straight line, a parabola, or an exponential can be measured using the method of least-Squares, by letting time to be independent variable. Let us suppose that the long-term trend appears to be linear. Then the equation of the least-Squares linear trend would be

Method of Least-Squares The values of a and b the two constants are determined by solving the following two normal equations simultaneously;

Method of Least-Squares The trend values are computed from this equation by substituting the values of t and are plotted on the graph of the original values. To simplify computations, the time variable (t) is coded by taking the time deviations from the middle point of the periods and the coded time period is denoted by X. For example, when the number of years is odd, the middle year is taken at 0 or the origin, and when the number of years is even, X=0 is taken at the middle of the two middle two years. The coded form of the linear trend would be

Method of Least-Squares When the long term trend of a time series graph appears to be a curve, we fit a parabolic curve of second degree or a curve of some other type such as exponential, logistic etc. It should be kept in mind that trend which has the smaller is the better fit. This method is useful for prediction purposes.

A problem using a Least-Square method in a Time Series Consider a following data illustrating the number of ships loaded at Karachi Port between 1988 and 1995. In this problem we will find linear equation that will describe the secular trend of loading. Time Series for the number of ships loaded at Karachi Port. Year : 1988 1989 1990 1991 1992 1993 1994 1995 Number: 98 105 116 119 135 156 177 208

Method of Least-Squares