Mar 08 2002Numerical approach for large-scale Eigenvalue problems 1 Definition Why do we study it ? Is the Behavior system based or nodal based? What are.

Slides:



Advertisements
Similar presentations
10.4 Complex Vector Spaces.
Advertisements

3D Geometry for Computer Graphics
Chapter 28 – Part II Matrix Operations. Gaussian elimination Gaussian elimination LU factorization LU factorization Gaussian elimination with partial.
Solving Linear Systems (Numerical Recipes, Chap 2)
Lecture 13 - Eigen-analysis CVEN 302 July 1, 2002.
Section 5.1 Eigenvectors and Eigenvalues. Eigenvectors and Eigenvalues Useful throughout pure and applied mathematics. Used to study difference equations.
Lecture 17 Introduction to Eigenvalue Problems
DEF: Characteristic Polynomial (of degree n) QR - Algorithm Note: 1) QR – Algorithm is different from QR-Decomposition 2) a procedure to calculate the.
Modern iterative methods For basic iterative methods, converge linearly Modern iterative methods, converge faster –Krylov subspace method Steepest descent.
1cs542g-term Notes  In assignment 1, problem 2: smoothness = number of times differentiable.
1cs542g-term High Dimensional Data  So far we’ve considered scalar data values f i (or interpolated/approximated each component of vector values.
Determinants Bases, linear Indep., etc Gram-Schmidt Eigenvalue and Eigenvectors Misc
Symmetric Matrices and Quadratic Forms
Computer Graphics Recitation 5.
Chapter 6 Eigenvalues.
An introduction to iterative projection methods Eigenvalue problems Luiza Bondar the 23 rd of November th Seminar.
Lecture 18 Eigenvalue Problems II Shang-Hua Teng.
Orthogonality and Least Squares
Finding Eigenvalues and Eigenvectors What is really important?
Matrices CS485/685 Computer Vision Dr. George Bebis.
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 6. Eigenvalue problems.
Stats & Linear Models.
5.1 Orthogonality.
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
CHAPTER SIX Eigenvalues
Today’s class Boundary Value Problems Eigenvalue Problems
Linear Algebra Review 1 CS479/679 Pattern Recognition Dr. George Bebis.
Eigenvalue Problems Solving linear systems Ax = b is one part of numerical linear algebra, and involves manipulating the rows of a matrix. The second main.
8.1 Vector spaces A set of vector is said to form a linear vector space V Chapter 8 Matrices and vector spaces.
1 MAC 2103 Module 12 Eigenvalues and Eigenvectors.
Linear Algebra (Aljabar Linier) Week 10 Universitas Multimedia Nusantara Serpong, Tangerang Dr. Ananda Kusuma
AN ORTHOGONAL PROJECTION
Linear algebra: matrix Eigen-value Problems
Orthogonality and Least Squares
Computing Eigen Information for Small Matrices The eigen equation can be rearranged as follows: Ax = x  Ax = I n x  Ax - I n x = 0  (A - I n )x = 0.
Chapter 5 Eigenvalues and Eigenvectors 大葉大學 資訊工程系 黃鈴玲 Linear Algebra.
Orthogonalization via Deflation By Achiya Dax Hydrological Service Jerusalem, Israel
What is the determinant of What is the determinant of
Elementary Linear Algebra Anton & Rorres, 9 th Edition Lecture Set – 07 Chapter 7: Eigenvalues, Eigenvectors.
Numerical Analysis – Eigenvalue and Eigenvector Hanyang University Jong-Il Park.
Eigenvalues The eigenvalue problem is to determine the nontrivial solutions of the equation Ax= x where A is an n-by-n matrix, x is a length n column.
Review of Linear Algebra Optimization 1/16/08 Recitation Joseph Bradley.
5.1 Eigenvectors and Eigenvalues 5. Eigenvalues and Eigenvectors.
1. Systems of Linear Equations and Matrices (8 Lectures) 1.1 Introduction to Systems of Linear Equations 1.2 Gaussian Elimination 1.3 Matrices and Matrix.
5.1 Eigenvalues and Eigenvectors
Advanced Computer Graphics Spring 2014 K. H. Ko School of Mechatronics Gwangju Institute of Science and Technology.
STATIC ANALYSIS OF UNCERTAIN STRUCTURES USING INTERVAL EIGENVALUE DECOMPOSITION Mehdi Modares Tufts University Robert L. Mullen Case Western Reserve University.
Instructor: Mircea Nicolescu Lecture 8 CS 485 / 685 Computer Vision.
1 Instituto Tecnológico de Aeronáutica Prof. Maurício Vicente Donadon AE-256 NUMERICAL METHODS IN APPLIED STRUCTURAL MECHANICS Lecture notes: Prof. Maurício.
Chapter 61 Chapter 7 Review of Matrix Methods Including: Eigen Vectors, Eigen Values, Principle Components, Singular Value Decomposition.
Matrices CHAPTER 8.9 ~ Ch _2 Contents  8.9 Power of Matrices 8.9 Power of Matrices  8.10 Orthogonal Matrices 8.10 Orthogonal Matrices 
ALGEBRAIC EIGEN VALUE PROBLEMS
Lecture XXVII. Orthonormal Bases and Projections Suppose that a set of vectors {x 1,…,x r } for a basis for some space S in R m space such that r  m.
Tutorial 6. Eigenvalues & Eigenvectors Reminder: Eigenvectors A vector x invariant up to a scaling by λ to a multiplication by matrix A is called.
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
Introduction The central problems of Linear Algebra are to study the properties of matrices and to investigate the solutions of systems of linear equations.
CS479/679 Pattern Recognition Dr. George Bebis
Elementary Linear Algebra Anton & Rorres, 9th Edition
Matrices and vector spaces
Section 4.1 Eigenvalues and Eigenvectors
CHAPTER 8.9 ~ 8.16 Matrices.
1C9 Design for seismic and climate changes
CS485/685 Computer Vision Dr. George Bebis
Numerical Analysis Lecture 16.
Eigenvalues and Eigenvectors
Symmetric Matrices and Quadratic Forms
SKTN 2393 Numerical Methods for Nuclear Engineers
Linear Algebra Lecture 35.
Subject :- Applied Mathematics
Symmetric Matrices and Quadratic Forms
Presentation transcript:

Mar Numerical approach for large-scale Eigenvalue problems 1 Definition Why do we study it ? Is the Behavior system based or nodal based? What are the real time applications How do we calculate these values What are the applications and applicable areas A lot many definitions and new way of looking at the things Matrix theories and spaces : an overview Introduction

Mar Numerical approach for large-scale Eigenvalue problems 2 Understanding with Mechanical Engineering l 2l l mmm l x2x2 x1x1 T T T T sin a)Three beads on a string b)The forces on bead 1 Vibration of beads perpendicular to string x i+1 a T sin xixi x i+1 - x i A CB c)The approximation for sin Governing equations are

Mar Numerical approach for large-scale Eigenvalue problems (Modes of vibration) Physical interpretation: Physical Interpretation

Mar Numerical approach for large-scale Eigenvalue problems 4 In many physical applications we often encounter to study system behavior : The problem is called the Eigenvalue problem for the matrix A. is called the Eigenvalue (proper value or characteristic value) value u is called the Eigenvector of A. System can be written as To have a non-trivial solution for ‘u’ Degree of polynomial in order of A General Formulation - discussions

Mar Numerical approach for large-scale Eigenvalue problems 5 Distinguishion A A has distinct eigenvaluesA has multiple eigenvalues Eigenvectors are linearly independent Eigenvectors are linearly independent Eigenvectors are linearly dependent semi simple matrix (diagonalizable) Non - semi simple (non - diagonalizable)

Mar Numerical approach for large-scale Eigenvalue problems 6 Spectral Approximation Set of all Eigenvalues : Spectrum of ‘A’ Single Vector Iteration Power method Shifted power method Inverse power method Rayliegh Quotient iteration Deflation Techniques Wielandt deflation with one vector Deflation with several vectors Schur - Weilandt deflation Practical deflation procedures Projection methods Orthogonal projection methods Rayleigh - Ritz procedure Oblique projection methods Jacobi method Subspace iteration technique

Mar Numerical approach for large-scale Eigenvalue problems 7 Power method It’s a single vector iteration technique This method only generates only dominant eigenpairs It generates a sequence of vectors This sequence of vectors when normalized properly, under reasonably mild conditions converge to a dominant eigenvector associated with eigenvalue of largest modulus. Methodology: Start : Choose a nonzero initial vector Iterate : for k = 1,2,…… until convergence, compute

Mar Numerical approach for large-scale Eigenvalue problems 8 Why and What's happening in power method To apply power method, our assumptions should be

Mar Numerical approach for large-scale Eigenvalue problems 9 Shifted Power method …. Eigenvalues of A Eigenvalues of (A-I)

Mar Numerical approach for large-scale Eigenvalue problems 10 Inverse power method-Shifted Inverse power method Basic idea is that Advantages 1.Least dominant eigenpair of A 2.Faster convergence rate Shifted Inverse power method: The same mechanism follows like in the shifted power method and only thing is that we will achieve faster convergence rates in comparison.

Mar Numerical approach for large-scale Eigenvalue problems 11 Rayliegh Quotient

Mar Numerical approach for large-scale Eigenvalue problems 12 Deflation Techniques Definition : Manipulate the system After finding out the largest eigenvalue in the system,displace it in such away that next larger value is the largest value in the system and apply power method. Weilandt deflation technique It’s a single vector deflation technique.

Mar Numerical approach for large-scale Eigenvalue problems 13 Deflation with several vectors: It uses the Schur decomposition

Mar Numerical approach for large-scale Eigenvalue problems 14 Schur - Weilandt Deflation

Mar Numerical approach for large-scale Eigenvalue problems 15 Projection methods Suppose if matrix ‘A’ is real and the eigenvalues are complex.consider power method where dominant eigenvalues are complex and but the matrix is real. Although the usual sequence

Mar Numerical approach for large-scale Eigenvalue problems 16 Orthogonal projection methods

Mar Numerical approach for large-scale Eigenvalue problems 17 What exactly is happening in orthogonal projection Suppose v is the guess vector, take successive two iterations in the power method. Form an orthonormal basis X = [v|Av]. Do the Gram - Schmidt process to QR factorize X. Say v is nX1 and Av is ofcourse of nX1. So ‘X’ is now nX2 matrix. Q = [q1|q2] where q1 = q1/norm(q1); q2 = projection onto q1; now Q is perfectly orthonormalized. q1,q2 form an orthonormal basis which spans x,x, which are corresponding eigenvectors as it converges.

Mar Numerical approach for large-scale Eigenvalue problems 18 Rayleigh - Ritz procedure

Mar Numerical approach for large-scale Eigenvalue problems 19 Oblique projection method

Mar Numerical approach for large-scale Eigenvalue problems 20 Jacobi method Jacobi method finds all the eigenvalues and vectors at a time. The inverse of orthogonal matrix is its own transpose.

Mar Numerical approach for large-scale Eigenvalue problems 21 Jacobi method….

Mar Numerical approach for large-scale Eigenvalue problems 22 Subspace Iteration Techniques It is one of the most important methods in the structural engineering Bauer’s method

Mar Numerical approach for large-scale Eigenvalue problems 23 Applications and Applicable areas Problems related to the analysis of vibrations usually symmetric generalized eigenvalue problems Problems related to stability analysis usually generates non - symmetric matrices Structural Dynamics Electrical Networks Combustion processes Macroeconomics Normal mode techniques Quantum chemistry chemical reactions Magneto Hydrodynamics