1/18/2016 1 LU Decomposition Industrial Engineering Majors Authors: Autar Kaw Transforming.

Slides:



Advertisements
Similar presentations
4/22/ LU Decomposition Electrical Engineering Majors Authors: Autar Kaw Transforming.
Advertisements

4/26/ LU Decomposition Civil Engineering Majors Authors: Autar Kaw Transforming.
5/1/ Finite Difference Method Civil Engineering Majors Authors: Autar Kaw, Charlie Barker
Major: All Engineering Majors Authors: Autar Kaw
5/19/ Runge 4 th Order Method Mechanical Engineering Majors Authors: Autar Kaw, Charlie Barker
Major: All Engineering Majors Author(s): Autar Kaw
7/2/ Differentiation-Discrete Functions Industrial Engineering Majors Authors: Autar Kaw, Sri Harsha Garapati.
7/2/ Backward Divided Difference Major: All Engineering Majors Authors: Autar Kaw, Sri Harsha Garapati
8/8/ Euler Method Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
8/8/ Gauss Quadrature Rule of Integration Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
8/15/ Binary Representation Major: All Engineering Majors Authors: Autar Kaw, Matthew Emmons
Major: All Engineering Majors Author(s): Autar Kaw
LU Decomposition 1. Introduction Another way of solving a system of equations is by using a factorization technique for matrices called LU decomposition.
Computer Engineering Majors Authors: Autar Kaw
9/7/ Gauss-Siedel Method Chemical Engineering Majors Authors: Autar Kaw Transforming.
9/14/ Trapezoidal Rule of Integration Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
1 Spline Interpolation Method Computer Engineering Majors Authors: Autar Kaw, Jai Paul
9/22/ Runge 2 nd Order Method Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
10/8/ Propagation of Errors Major: All Engineering Majors Authors: Autar Kaw, Matthew Emmons
10/17/ Gauss-Siedel Method Industrial Engineering Majors Authors: Autar Kaw
Chemical Engineering Majors Author(s): Autar Kaw
10/26/ Gauss-Siedel Method Civil Engineering Majors Authors: Autar Kaw Transforming.
5/30/ Runge 4 th Order Method Chemical Engineering Majors Authors: Autar Kaw, Charlie Barker
5/31/ Multi Dimensional Direct Search Methods Major: All Engineering Majors Authors: Autar Kaw, Ali Yalcin
11/17/ Shooting Method Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
Gaussian Elimination Electrical Engineering Majors Author(s): Autar Kaw Transforming Numerical Methods Education for.
1 Direct Method of Interpolation Major: All Engineering Majors Authors: Autar Kaw, Jai Paul
Gaussian Elimination Industrial Engineering Majors Author(s): Autar Kaw Transforming Numerical Methods Education for.
1/16/ Runge 4 th Order Method Civil Engineering Majors Authors: Autar Kaw, Charlie Barker
Gaussian Elimination Mechanical Engineering Majors Author(s): Autar Kaw Transforming Numerical Methods Education for.
1/19/ Runge 4 th Order Method Major: All Engineering Majors Authors: Autar Kaw, Charlie Barker
1/29/ Bisection Method Computer Engineering Majors Authors: Autar Kaw, Jai Paul
1 Direct Method of Interpolation Computer Engineering Majors Authors: Autar Kaw, Jai Paul
Mechanical Engineering Majors Authors: Autar Kaw
1 Direct Method of Interpolation Mechanical Engineering Majors Authors: Autar Kaw, Jai Paul
2/26/ Gauss-Siedel Method Electrical Engineering Majors Authors: Autar Kaw
2/28/ Runge 4 th Order Method Computer Engineering Majors Authors: Autar Kaw, Charlie Barker
3/1/ LU Decomposition Computer Engineering Majors Authors: Autar Kaw Transforming.
3/6/ Gauss-Siedel Method Major: All Engineering Majors Author: دکتر ابوالفضل رنجبر نوعی
Gaussian Elimination Civil Engineering Majors Author(s): Autar Kaw Transforming Numerical Methods Education for STEM.
3/12/ Trapezoidal Rule of Integration Computer Engineering Majors Authors: Autar Kaw, Charlie Barker
Autar Kaw Benjamin Rigsby Transforming Numerical Methods Education for STEM Undergraduates.
Autar Kaw Benjamin Rigsby Transforming Numerical Methods Education for STEM Undergraduates.
6/13/ Secant Method Computer Engineering Majors Authors: Autar Kaw, Jai Paul
Numerical Methods.  LU Decomposition is another method to solve a set of simultaneous linear equations  For most non-singular matrix [A] that one could.
Numerical Computation Lecture 6: Linear Systems – part II United International College.
Trapezoidal Rule of Integration
Gauss Quadrature Rule of Integration
Civil Engineering Majors Authors: Autar Kaw, Charlie Barker
Spline Interpolation Method
Autar Kaw Benjamin Rigsby
Major: All Engineering Majors Authors: Autar Kaw
Direct Method of Interpolation
Lagrangian Interpolation
Chemical Engineering Majors Authors: Autar Kaw
Civil Engineering Majors Authors: Autar Kaw, Charlie Barker
Newton’s Divided Difference Polynomial Method of Interpolation
Major: All Engineering Majors Author(s): Autar Kaw
Gauss Quadrature Rule of Integration
Numerical Computation and Optimization
Industrial Engineering Majors Authors: Autar Kaw, Charlie Barker
Lagrangian Interpolation
Simultaneous Linear Equations
Simpson’s 1/3rd Rule of Integration
Major: All Engineering Majors Authors: Autar Kaw
Electrical Engineering Majors Authors: Autar Kaw, Charlie Barker
Spline Interpolation Method
Lecture 8 Matrix Inverse and LU Decomposition
Chemical Engineering Majors Authors: Autar Kaw, Charlie Barker
Major: All Engineering Majors Authors: Autar Kaw
Presentation transcript:

1/18/ LU Decomposition Industrial Engineering Majors Authors: Autar Kaw Transforming Numerical Methods Education for STEM Undergraduates

LU Decomposition

LU Decomposition LU Decomposition is another method to solve a set of simultaneous linear equations Which is better, Gauss Elimination or LU Decomposition? To answer this, a closer look at LU decomposition is needed.

Method For most non-singular matrix [A] that one could conduct Naïve Gauss Elimination forward elimination steps, one can always write it as [A] = [L][U] where [L] = lower triangular matrix [U] = upper triangular matrix LU Decomposition

How does LU Decomposition work? If solving a set of linear equations If [A] = [L][U] then Multiply by Which gives Remember [L] -1 [L] = [I] which leads to Now, if [I][U] = [U] then Now, let Which ends with and [A][X] = [C] [L][U][X] = [C] [L] -1 [L] -1 [L][U][X] = [L] -1 [C] [I][U][X] = [L] -1 [C] [U][X] = [L] -1 [C] [L] -1 [C]=[Z] [L][Z] = [C] (1) [U][X] = [Z] (2)

LU Decomposition How can this be used? Given [A][X] = [C] 1.Decompose [A] into [L] and [U] 2.Solve [L][Z] = [C] for [Z] 3.Solve [U][X] = [Z] for [X]

When is LU Decomposition better than Gaussian Elimination? To solve [A][X] = [B] Table. Time taken by methods where T = clock cycle time and n = size of the matrix So both methods are equally efficient. Gaussian EliminationLU Decomposition

To find inverse of [A] Time taken by Gaussian Elimination Time taken by LU Decomposition n CT| inverse GE / CT| inverse LU Table 1 Comparing computational times of finding inverse of a matrix using LU decomposition and Gaussian elimination.

Method: [A] Decompose to [L] and [U] [U] is the same as the coefficient matrix at the end of the forward elimination step. [L] is obtained using the multipliers that were used in the forward elimination process

Finding the [U] matrix Using the Forward Elimination Procedure of Gauss Elimination Step 1:

Finding the [U] Matrix Step 2: Matrix after Step 1:

Finding the [L] matrix Using the multipliers used during the Forward Elimination Procedure From the first step of forward elimination

Finding the [L] Matrix From the second step of forward elimination

Does [L][U] = [A]? ?

Example: Production Optimization To find the number of toys a company should manufacture per day to optimally use their injection-molding machine and the assembly line, one needs to solve the following set of equations. The unknowns are the number of toys for boys, x 1, number of toys for girls, x 2, and the number of unisexual toys, x 3. Find the values of x 1, x 2,and x 3 using LU Decomposition.

Example: Production Optimization Use Forward Elimination to find the [U] matrix Step 1

Example: Production Optimization This is the matrix after the 1 st step: Step 2

Example: Production Optimization Use the multipliers from Forward Elimination From the 1 st step of forward elimination

Example: Production Optimization From the 2 nd step of forward elimination

Example: Production Optimization Does [L][U] = [A] ?

Example: Production Optimization Set [L][Z] = [C] Solve for [Z]

Example: Production Optimization Solve for [Z]

Example: Production Optimization Set [U][X] = [Z] Solve for [X] The 3 equations become

Example: Production Optimization Solve for [X]

Example: Production Optimization Solve for [X] cont.

Example: Production Optimization The solution vector is 1440 toys for boys should be produced 1512 toys for girls should be produced 36 unisexual toys should be produced

Finding the inverse of a square matrix The inverse [B] of a square matrix [A] is defined as [A][B] = [I] = [B][A]

Finding the inverse of a square matrix How can LU Decomposition be used to find the inverse? Assume the first column of [B] to be [b 11 b 12 … b n1 ] T Using this and the definition of matrix multiplication First column of [B] Second column of [B] The remaining columns in [B] can be found in the same manner

Example: Inverse of a Matrix Find the inverse of a square matrix [A] Using the decomposition procedure, the [L] and [U] matrices are found to be

Example: Inverse of a Matrix Solving for the each column of [B] requires two steps 1)Solve [L] [Z] = [C] for [Z] 2)Solve [U] [X] = [Z] for [X] Step 1: This generates the equations:

Example: Inverse of a Matrix Solving for [Z]

Example: Inverse of a Matrix Solving [U][X] = [Z] for [X]

Example: Inverse of a Matrix Using Backward Substitution So the first column of the inverse of [A] is:

Example: Inverse of a Matrix Repeating for the second and third columns of the inverse Second ColumnThird Column

Example: Inverse of a Matrix The inverse of [A] is To check your work do the following operation [ A ][ A ] -1 = [ I ] = [ A ] -1 [ A ]

Additional Resources For all resources on this topic such as digital audiovisual lectures, primers, textbook chapters, multiple-choice tests, worksheets in MATLAB, MATHEMATICA, MathCad and MAPLE, blogs, related physical problems, please visit osition.html

THE END