Simple Linear Regression – Matrix Approach

Slides:



Advertisements
Similar presentations
Finding the Inverse of a Matrix
Advertisements

Arithmetic Operations on Matrices. 1. Definition of Matrix 2. Column, Row and Square Matrix 3. Addition and Subtraction of Matrices 4. Multiplying Row.
12.4 Inverses of Matrices. Remember if A and B are inverses, AB = I and BA = I *only square matrices can have multiplicative inverses* Ex 1) Show that.
Copyright © Cengage Learning. All rights reserved. 7.6 The Inverse of a Square Matrix.
1 1 Slide Simple Linear Regression Chapter 14 BA 303 – Spring 2011.
Section 8.3 – Systems of Linear Equations - Determinants Using Determinants to Solve Systems of Equations A determinant is a value that is obtained from.
Chapter 7 – Solving Systems of Linear Equations 7.3 – Solving Linear Systems by Linear Combinations.
Systems of Linear Equations Let’s say you need to solve the following for x, y, & z: 2x + y – 2z = 10 3x + 2y + 2z = 1 5x + 4y + 3z = 4 Two methods –Gaussian.
4.4 & 4.5 Notes Remember: Identity Matrices: If the product of two matrices equal the identity matrix then they are inverses.
Lesson 11-1 Matrix Basics and Augmented Matrices Objective: To learn to solve systems of linear equation using matrices.
Solving Systems of 3 or More Variables Why a Matrix? In previous math classes you solved systems of two linear equations using the following method:
Section 3.6 – Solving Systems Using Matrices
4.6 Cramer’s Rule Using Determinants to solve systems of equations.
1.10 and 1.11 Quiz : Friday Matrices Test: Oct. 20.
1. Inverse of A 2. Inverse of a 2x2 Matrix 3. Matrix With No Inverse 4. Solving a Matrix Equation 1.
4.7 Identity and Inverse Matrices and Solving Systems of Equations Objectives: 1.Determine whether two matrices are inverses. 2.Find the inverse of a 2x2.
Matrix Algebra and Regression a matrix is a rectangular array of elements m=#rows, n=#columns  m x n a single value is called a ‘scalar’ a single row.
Chapter 9 Matrices and Determinants Copyright © 2014, 2010, 2007 Pearson Education, Inc Determinants and Cramer’s Rule.
Lesson 11-1 Matrix Basics and Augmented Matrices Objective: To learn to solve systems of linear equation using matrices.
Class Opener:. Identifying Matrices Student Check:
Justin Gilmore Problem Set 1- #15 15.If r is the rank and d is the determinant of the matrix what is r-d? In order to solve the problem, we must first.
4.5 Matrices, Determinants, Inverseres -Identity matrices -Inverse matrix (intro) -An application -Finding inverse matrices (by hand) -Finding inverse.
SAT Problem Of the Day. Do Now Do Now 4.4 Solving Systems with Matrix Equations 4.4 Solving Systems with Matrix Equations Objectives: Use matrices to.
3.6 Solving Systems Using Matrices You can use a matrix to represent and solve a system of equations without writing the variables. A matrix is a rectangular.
 6. Use matrices to represent and manipulate data, e.g., to represent payoffs or incidence relationships related in a network.  7. Multiply matrices.
1 Simple Linear Regression and Correlation Least Squares Method The Model Estimating the Coefficients EXAMPLE 1: USED CAR SALES.
Chapter 4 Section 5 and 6 Finding and Using Inverses Algebra 2 Notes February 26, 2009.
 Recall that when you wanted to solve a system of equations, you used to use two different methods.  Substitution Method  Addition Method.
The General Linear Model. Estimation -- The General Linear Model Formula for a straight line y = b 0 + b 1 x x y.
3.8B Solving Systems using Matrix Equations and Inverses.
3.5 Perform Basic Matrix Operations Add Matrices Subtract Matrices Solve Matric equations for x and y.
Statistics 350 Lecture 13. Today Last Day: Some Chapter 4 and start Chapter 5 Today: Some matrix results Mid-Term Friday…..Sections ; ;
Do Now: Perform the indicated operation. 1.). Algebra II Elements 11.1: Matrix Operations HW: HW: p.590 (16-36 even, 37, 44, 46)
Chapter 5: Matrices and Determinants Section 5.5: Augmented Matrix Solutions.
Section 6-2: Matrix Multiplication, Inverses and Determinants There are three basic matrix operations. 1.Matrix Addition 2.Scalar Multiplication 3.Matrix.
Algebra 3 5.1/2 Systems of Linear Equations/Matrices.
College Algebra Chapter 6 Matrices and Determinants and Applications
Use Inverse Matrices to Solve Linear Systems
Daily Vocabulary Coefficient matrix Matrix of constants.
12-1 Organizing Data Using Matrices
Review Problems Matrices
Multiplication of Matrices
Using Determinants to solve systems of equations
Warm Up #6 1. Let a = 4, b = – 5, c = – 2, and d = 7. Find ad – bc.
7.3 Matrices.
DETERMINANT definition and origin.
Using Matrices to Solve Systems of Equations
Elementary Statistics: Picturing The World
Introduction to Matrices
Matrices Elements, Adding and Subtracting
Use Inverse Matrices to Solve 2 Variable Linear Systems
Single Regression Equation
Multiple Linear Regression
Simple Linear Regression
CALCULATING EQUATION OF LEAST SQUARES REGRESSION LINE
Regression lecture 2 1. Review: deterministic and random components
4.4 Objectives Day 1: Find the determinants of 2  2 and 3  3 matrices. Day 2: Use Cramer’s rule to solve systems of linear equations. Vocabulary Determinant:
Multiplication of Matrices
Sec 3.5 Inverses of Matrices
Simple Linear Regression
1.8 Matrices.
Matrices.
Cases. Simple Regression Linear Multiple Regression.
1.8 Matrices.
Linear Algebra and Matrices
Topic 11: Matrix Approach to Linear Regression
Chapter 14 Multiple Regression
Simple Linear Regression
Regression lecture 2 1. Review: deterministic and random components
Regression and Correlation of Data
Presentation transcript:

Simple Linear Regression – Matrix Approach Recall our example: Hypothesize the relationship, Y = α + βx + ε and calculate the estimate, Attendance, x Amount Bet ($000), Y 117 2.07 128 2.80 122 3.14 119 2.26 131 3.40 135 3.89 125 2.93 120 2.66 130 3.33 127 3.54

Matrix Form of the Equation Define the matrices: Note: the column of 1s in the X matrix is referred to as a “dummy variable” used to allow us to calculate a in the regression equation.

General Matrix Form We obtain the least squares estimates (a, b) of (α, β) by solving the matrix equation: for b, or

Recall Basic Matrix Operations

For Our Example, Step 1: XTX 10 1254 (note: n=10, Σx = 1254, Σx2 = 157,558) XTX= 1254 157,558

For Our Example, Step 2: XTY 30.02 XTY= 3791 (note: n=10, Σy = 30.02, Σxy = 3791)

Inverting Matrices Calculate the determinant. 2 x 2 matrix (M) , D = ad – bc 3 x 3 matrix (Q), Z = a(ek – fh) – b(dk – fg) + c(dh – eg) Calculate the elements of the matrix 2 x 2 matrix (M) ,

Inverting Matrices (cont.) (cont.) Calculate the elements 3 x 3 matrix (Q),

For Our Example Step 3: (XTX)-1 D = _______________

Our Example Step 4: Determine b = ________________________

Your Turn (In-Class / Homework)