Computing Eigen Information for Small Matrices The eigen equation can be rearranged as follows: Ax = x  Ax = I n x  Ax - I n x = 0  (A - I n )x = 0.

Slides:



Advertisements
Similar presentations
Ch 7.7: Fundamental Matrices
Advertisements

Chapter 28 – Part II Matrix Operations. Gaussian elimination Gaussian elimination LU factorization LU factorization Gaussian elimination with partial.
Chapter 6 Eigenvalues and Eigenvectors
Section 5.1 Eigenvectors and Eigenvalues. Eigenvectors and Eigenvalues Useful throughout pure and applied mathematics. Used to study difference equations.
OCE301 Part II: Linear Algebra lecture 4. Eigenvalue Problem Ax = y Ax = x occur frequently in engineering analysis (eigenvalue problem) Ax =  x [ A.
Eigenvalues and Eigenvectors
Eigenvalues and Eigenvectors (11/17/04) We know that every linear transformation T fixes the 0 vector (in R n, fixes the origin). But are there other subspaces.
The Characteristic Equation of a Square Matrix (11/18/05) To this point we know how to check whether a given number is an eigenvalue of a given square.
Eigenvalues and Eigenvectors
Symmetric Matrices and Quadratic Forms
Chapter 6 Eigenvalues.
5.II. Similarity 5.II.1. Definition and Examples
Ch 7.3: Systems of Linear Equations, Linear Independence, Eigenvalues
5 5.1 © 2012 Pearson Education, Inc. Eigenvalues and Eigenvectors EIGENVECTORS AND EIGENVALUES.
化工應用數學 授課教師: 郭修伯 Lecture 9 Matrices
Linear Algebra With Applications by Otto Bretscher. Page The Determinant of any diagonal nxn matrix is the product of its diagonal entries. True.
Boyce/DiPrima 9th ed, Ch 7.3: Systems of Linear Equations, Linear Independence, Eigenvalues Elementary Differential Equations and Boundary Value Problems,
CHAPTER SIX Eigenvalues
1 資訊科學數學 14 : Determinants & Inverses 陳光琦助理教授 (Kuang-Chi Chen)
Eigenvalue Problems Solving linear systems Ax = b is one part of numerical linear algebra, and involves manipulating the rows of a matrix. The second main.
1 MAC 2103 Module 12 Eigenvalues and Eigenvectors.
CHAPTER 2 MATRIX. CHAPTER OUTLINE 2.1 Introduction 2.2 Types of Matrices 2.3 Determinants 2.4 The Inverse of a Square Matrix 2.5 Types of Solutions to.
Day 1 Eigenvalues and Eigenvectors
Day 1 Eigenvalues and Eigenvectors
Eigenvalues and Eigenvectors
Chapter Content Real Vector Spaces Subspaces Linear Independence
Matrices CHAPTER 8.1 ~ 8.8. Ch _2 Contents  8.1 Matrix Algebra 8.1 Matrix Algebra  8.2 Systems of Linear Algebra Equations 8.2 Systems of Linear.
Linear algebra: matrix Eigen-value Problems
5 5.2 © 2012 Pearson Education, Inc. Eigenvalues and Eigenvectors THE CHARACTERISTIC EQUATION.
Chapter 5 Eigenvalues and Eigenvectors 大葉大學 資訊工程系 黃鈴玲 Linear Algebra.
4.6: Rank. Definition: Let A be an mxn matrix. Then each row of A has n entries and can therefore be associated with a vector in The set of all linear.
Section 2.3 Properties of Solution Sets
Diagonalization and Similar Matrices In Section 4.2 we showed how to compute eigenpairs (,p) of a matrix A by determining the roots of the characteristic.
Elementary Linear Algebra Anton & Rorres, 9 th Edition Lecture Set – 07 Chapter 7: Eigenvalues, Eigenvectors.
Eigenvalues The eigenvalue problem is to determine the nontrivial solutions of the equation Ax= x where A is an n-by-n matrix, x is a length n column.
Chapter 6 Eigenvalues. Example In a certain town, 30 percent of the married women get divorced each year and 20 percent of the single women get married.
5.1 Eigenvectors and Eigenvalues 5. Eigenvalues and Eigenvectors.
Section 1.7 Linear Independence and Nonsingular Matrices
Instructor: Mircea Nicolescu Lecture 8 CS 485 / 685 Computer Vision.
5 5.1 © 2016 Pearson Education, Ltd. Eigenvalues and Eigenvectors EIGENVECTORS AND EIGENVALUES.
Chapter 61 Chapter 7 Review of Matrix Methods Including: Eigen Vectors, Eigen Values, Principle Components, Singular Value Decomposition.
Boot Camp in Linear Algebra TIM 209 Prof. Ram Akella.
Matrices, Vectors, Determinants.
Reduced echelon form Matrix equations Null space Range Determinant Invertibility Similar matrices Eigenvalues Eigenvectors Diagonabilty Power.
Review of Eigenvectors and Eigenvalues from CliffsNotes Online mining-the-Eigenvectors-of-a- Matrix.topicArticleId-20807,articleId-
Characteristic Polynomial Hung-yi Lee. Outline Last lecture: Given eigenvalues, we know how to find eigenvectors or eigenspaces Check eigenvalues This.
Chapter 6 Eigenvalues and Eigenvectors
Eigenvalues and Eigenvectors
ISHIK UNIVERSITY FACULTY OF EDUCATION Mathematics Education Department
Elementary Linear Algebra Anton & Rorres, 9th Edition
Eigenvalues and Eigenvectors
Section 4.1 Eigenvalues and Eigenvectors
Systems of First Order Linear Equations
Euclidean Inner Product on Rn
Eigenvalues and Eigenvectors
4.6: Rank.
Boyce/DiPrima 10th ed, Ch 7.3: Systems of Linear Equations, Linear Independence, Eigenvalues Elementary Differential Equations and Boundary Value Problems,
Chapter 6 Eigenvalues Basil Hamed
Eigenvalues and Eigenvectors
Symmetric Matrices and Quadratic Forms
Properties of Solution Sets
EIGENVECTORS AND EIGENVALUES
Elementary Linear Algebra Anton & Rorres, 9th Edition
Eigenvalues and Eigenvectors
Linear Algebra Lecture 35.
Eigenvalues and Eigenvectors
Linear Algebra Lecture 28.
Eigenvalues and Eigenvectors
Eigenvalues and Eigenvectors
Symmetric Matrices and Quadratic Forms
Presentation transcript:

Computing Eigen Information for Small Matrices The eigen equation can be rearranged as follows: Ax = x  Ax = I n x  Ax - I n x = 0  (A - I n )x = 0 (1) The matrix equation (A - I n )x = 0 is a homogeneous linear system with coefficient matrix A - I n. Since an eigenvector x cannot be the zero vector, this means we seek a nontrivial solution to the linear system (A - I n )x = 0. Thus ns(A - I n )  0 or equivalently rref(A - I n ) must contain a zero row. It follows that matrix A - I n must be singular, so from Chapter 3, det(A - I n ) = 0. (or det( I n - A) = 0 ) (2) Equation (2) is called the characteristic equation of matrix A and solving it for gives us the eigenvalues of A. Because the determinant is a linear combination of particular products of entries of the matrix, the characteristic equation is really a polynomial in equation of degree n. We call c( ) = det(A - I n ) (3) the characteristic polynomial of matrix A. The eigenvalues are the solutions of (2) or equivalently the roots of the characteristic polynomial (3). Once we have the n eigenvalues of A, 1, 2,..., n, the corresponding eigenvectors are nontrivial solutions of the homogeneous linear systems (A - i I n )x = 0 for i = 1,2,..., n. (4)

We summarize the computational approach for determining eigenpairs (, x) as a two-step procedure: Example: Find eigenpairs of Step I. Find the eigenvalues.

The eigenvalues are Step II. To find corresponding eigenvectors we solve (A - i I n )x = 0 for i = 1,2

Given that is an eigenvalue of A, then we know that matrix A - I n is singular and hence rref(A - I n ) will have at least one zero row. A homogeneous linear system whose coefficient matrix has rref with at least one zero row will have a solution set with at least one free variable. The free variables can be chosen to have any value as long as the resulting solution is not the zero vector. In the example for eigenvalue 1 = 3, the general solution was The free variable in this case could be any nonzero value. We chose x 2 = 2 to avoid fractions, but this is not required. If we chose x 2 = 1/7, then is a valid eigenvector. Since there will be at least one free variable when determining an eigenvector to correspond to an eigenvalue, there are infinitely many ways to express the entries of an eigenvector.

Example:Find the eigenvalues and corresponding eigenvectors of The characteristic polynomial is Its factors areSo the eigenvalues are 1, 2, and 3. Corresponding eigenvectors are

The eigenvalues are the roots of the characteristic polynomial, thus it is possible that a numerical value can be a root more than once. For example: has roots 0, 3, 3. We say 3 is a multiple or repeated root. The number of times the root is repeated is called its multiplicity. Thus it follows that a matrix can have repeated eigenvalues. Example:Find eigenpairs of The characteristic polynomial is Thus the eigenvalues are 1 = 2 = 1 and 3 = 2. We have a repeated eigenvalue of multiplicity 2.

To find corresponding eigenvectors we do the following: We find that one eigenvector is Explain why {p 1, p 2, p 3 } is a basis for R 3.

More properties of eigenvalues and eigenvectors. A and A T have the same eigenvalues. Proof: We see this by showing that A and A T have the same characteristic polynomial: Since the characteristic polynomials are the same and eigenvalues are roots of the characteristic polynomial, the eigenvalues must be the same. Exercise: Let A be the transition matrix of a Markov process where is a probability matrix which has all entries in [0, and the sum of the entries in each column equal to 1. Show that λ =1 is an eigenvalue of A. If A is diagonal, upper triangular, or lower triangular, then the eigenvalues of A are its diagonal entries. Proof: Construct a proof.

Symmetric matrices arise frequently in applications. The next two properties provide information about their eigenvalues and eigenvectors. More properties of eigenvalues and eigenvectors. The eigenvalues of a symmetric matrix are real numbers. Proof: (The steps of a guided proof are in the exercises.) The eigenvectors corresponding to distinct eigenvalues of a symmetric matrix are orthogonal. Proof: (The steps of a guided proof are in the exercises.)

For a square matrix A we have the following important ideas: Is A nonsingular or singular? {See Chapter 2.} Is det(A) nonzero or zero? {See Chapter 3.} Next we connect these to properties of the eigenvalues. More properties of eigenvalues and eigenvectors. det(A) is the product of the absolute values of the eigenvalues of A. Proof: If 1, 2,..., n are the eigenvalues of A, then they are the roots of its characteristic polynomial. Hence Evaluating this polynomial at = 0 gives det(A) = (-1) 2n n = n A is nonsingular if and only if 0 is not an eigenvalue of A, or equivalently, A is singular if and only if 0 is an eigenvalue of A. Proof: Use the previous property to construct a proof.

A particular type of matrix based on eigenvector properties. A matrix A is called defective if A has an eigenvalue of multiplicity m > 1 for which the corresponding eigenspace has a basis of fewer than m vectors; that is, the dimension of the eigenspace corresponding to is less than m. Example:Given matrixwhich has eigenvalues λ = 0, 0, 4. Determine if A is defective. Solution: Determine the number of linearly independent eigenvectors corresponding to the repeated eigenvalue λ = 0. Find the number of vectors in a basis for the null space of A – 0I. A - 0I = A, so we find the rref([A | 0]). We get We see there are two free variables in the general solution so there will be two linearly independent eigenvectors corresponding to the eigenvalue of multiplicity two. Hence A is not defective.

Example: Determine if is defective. Its eigenvalues are λ = 1, 6, 6. Solution: Determine the number of linearly independent eigenvectors corresponding to the repeated eigenvalue λ = 6. Find the number of vectors in a basis for the null space of A – 6I. A - 6I =, so we find the rref([A | 0]). We get We see there is one free variables in the general solution so there will be only one linearly independent eigenvectors corresponding to the eigenvalue of multiplicity two. Hence A is defective.