A Comparison of Some Iterative Methods in Scientific Computing Shawn Sickel Man-Cheng Yeung Jon Held Department of Mathematics Introduction: Large sparse.

Slides:



Advertisements
Similar presentations
Numerical Solution of Linear Equations
Advertisements

Optimization.
ACCELERATING GOOGLE’S PAGERANK Liz & Steve. Background  When a search query is entered in Google, the relevant results are returned to the user in an.
1 Numerical Solvers for BVPs By Dong Xu State Key Lab of CAD&CG, ZJU.
Applied Linear Algebra - in honor of Hans SchneiderMay 25, 2010 A Look-Back Technique of Restart for the GMRES(m) Method Akira IMAKURA † Tomohiro SOGABE.
MATH 685/ CSI 700/ OR 682 Lecture Notes
Solving Linear Systems (Numerical Recipes, Chap 2)
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Parallel Programming in C with MPI and OpenMP Michael J. Quinn.
Iterative Methods and QR Factorization Lecture 5 Alessandra Nardi Thanks to Prof. Jacob White, Suvranu De, Deepak Ramaswamy, Michal Rewienski, and Karen.
Steepest Decent and Conjugate Gradients (CG). Solving of the linear equation system.
Modern iterative methods For basic iterative methods, converge linearly Modern iterative methods, converge faster –Krylov subspace method Steepest descent.
Fast Computational Methods for Visually Guided Robots Maryam Mahdaviani, Nando de Freitas, Bob Fraser and Firas Hamze Department of Computer Science, University.
Computational Solutions of Helmholtz Equation Yau Shu Wong Department of Mathematical & Statistical Sciences University of Alberta Edmonton, Alberta, Canada.
Shawn Sickel A Comparison of some Iterative Methods in Scientific Computing.
Avoiding Communication in Sparse Iterative Solvers Erin Carson Nick Knight CS294, Fall 2011.
Linear Systems What is the Matrix?. Outline Announcements: –Homework III: due Wed. by 5, by Office Hours: Today & tomorrow, 11-1 –Ideas for Friday?
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 20 Solution of Linear System of Equations - Iterative Methods.
Special Matrices and Gauss-Siedel
An introduction to iterative projection methods Eigenvalue problems Luiza Bondar the 23 rd of November th Seminar.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Parallel Programming in C with MPI and OpenMP Michael J. Quinn.
CS240A: Conjugate Gradients and the Model Problem.
Monica Garika Chandana Guduru. METHODS TO SOLVE LINEAR SYSTEMS Direct methods Gaussian elimination method LU method for factorization Simplex method of.
CSE 245: Computer Aided Circuit Simulation and Verification
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Example: Introduction to Krylov Subspace Methods DEF: Krylov sequence
Numerical Analysis 1 EE, NCKU Tien-Hao Chang (Darby Chang)
LU Decomposition 1. Introduction Another way of solving a system of equations is by using a factorization technique for matrices called LU decomposition.
ITERATIVE TECHNIQUES FOR SOLVING NON-LINEAR SYSTEMS (AND LINEAR SYSTEMS)
Advanced Computer Graphics Spring 2014 K. H. Ko School of Mechatronics Gwangju Institute of Science and Technology.
Solving Scalar Linear Systems Iterative approach Lecture 15 MA/CS 471 Fall 2003.
AN INTRODUCTION TO ELEMENTARY ROW OPERATIONS Tools to Solve Matrices.
1 Iterative Solution Methods Starts with an initial approximation for the solution vector (x 0 ) At each iteration updates the x vector by using the sytem.
Matrix Solutions to Linear Systems. 1. Write the augmented matrix for each system of linear equations.
Solving Systems of 3 or More Variables Why a Matrix? In previous math classes you solved systems of two linear equations using the following method:
Lecture 7 - Systems of Equations CVEN 302 June 17, 2002.
1 Marijn Bartel Schreuders Supervisor: Dr. Ir. M.B. Van Gijzen Date:Monday, 24 February 2014.
CSE 245: Computer Aided Circuit Simulation and Verification Matrix Computations: Iterative Methods I Chung-Kuan Cheng.
Linear System function [A,b,c] = assem_boundary(A,b,p,t,e); np = size(p,2); % total number of nodes bound = unique([e(1,:) e(2,:)]); % boundary nodes inter.
Parallel Solution of the Poisson Problem Using MPI
CS240A: Conjugate Gradients and the Model Problem.
Linear Systems – Iterative methods
Case Study in Computational Science & Engineering - Lecture 5 1 Iterative Solution of Linear Systems Jacobi Method while not converged do { }
1 Section 5.3 Linear Systems of Equations. 2 THREE EQUATIONS WITH THREE VARIABLES Consider the linear system of three equations below with three unknowns.
1 Chapter 7 Numerical Methods for the Solution of Systems of Equations.
Krylov-Subspace Methods - I Lecture 6 Alessandra Nardi Thanks to Prof. Jacob White, Deepak Ramaswamy, Michal Rewienski, and Karen Veroy.
9 Nov B - Introduction to Scientific Computing1 Sparse Systems and Iterative Methods Paul Heckbert Computer Science Department Carnegie Mellon.
Gaoal of Chapter 2 To develop direct or iterative methods to solve linear systems Useful Words upper/lower triangular; back/forward substitution; coefficient;
Linear System expensive p=[0,0.2,0.4,0.45,0.5,0.55,0.6,0.8,1]; t=[1:8; 2:9]; e=[1,9]; n = length(p); % number of nodes m = size(t,2); % number of elements.
MA5233 Lecture 6 Krylov Subspaces and Conjugate Gradients Wayne M. Lawton Department of Mathematics National University of Singapore 2 Science Drive 2.
Finding Rightmost Eigenvalues of Large, Sparse, Nonsymmetric Parameterized Eigenvalue Problems Minghao Wu AMSC Program Advisor: Dr. Howard.
Krylov-Subspace Methods - II Lecture 7 Alessandra Nardi Thanks to Prof. Jacob White, Deepak Ramaswamy, Michal Rewienski, and Karen Veroy.
MA237: Linear Algebra I Chapters 1 and 2: What have we learned?
Lecture 9 Numerical Analysis. Solution of Linear System of Equations Chapter 3.
Solving Systems of Linear Equations: Iterative Methods
Solving Linear Systems Ax=b
Iterative Methods Good for sparse matrices Jacobi Iteration
A Comparison of some Iterative Methods in Scientific Computing
CSE 245: Computer Aided Circuit Simulation and Verification
CSE 245: Computer Aided Circuit Simulation and Verification
Conjugate Gradient Method
Introduction to Scientific Computing II
Warm-up: Find the equation of the parabola y = ax2 + bx + c that passes through the given points: (-1, 4), (1, -6), (2, -5) CW: 7.1 – 7.3 Systems Quiz.
Introduction to Scientific Computing II
Matrix Solutions to Linear Systems
Introduction to Scientific Computing II
Numerical Analysis Lecture13.
Numerical Linear Algebra
Systems of Equations Solve by Graphing.
Administrivia: November 9, 2009
Warm-up: Solve the system by any method:
Presentation transcript:

A Comparison of Some Iterative Methods in Scientific Computing Shawn Sickel Man-Cheng Yeung Jon Held Department of Mathematics Introduction: Large sparse linera systems affect our lives from every direction. In High School, everybody is taught the Gaussian Elimination method. If a 1000x1000 matriz was solved using Gaussian Elimination, it would take 334,333,000 steps, which would take well more than 300 years to complete. In this presentation, I will compare and contrast the methods used today for solving large sparse linera equations. Purpose: How is the GE method outdated? Gaussian Elimination What is an Iterative Method? An Iterative Method uses educated guesses to find closer and more accurate guesses each step. Which algorithms are compared in this work? In this work, GS, Jacobi, Conjugate Gradient, BiConjugate Gradient, and BiConjugate Gradient Stabilized Methods are evaulated. Which Iterative Method is the fastest? Each Krylov Subspace method and each Basic Iterative Method has unique conditions that specifically limit the kinds of systems that may be solved. Discussion: The top graph, which compares the iteration speed between the Jacobian Method and the Gauss-Seidel Method, clearly shows that the Gauss-Seidel Method is better. Both of those methods require the magnitude of the largest number to be <1. Gauss-Seidel converges faster because the EigenValue is smaller than Jacobi’s. The lower the eigenvalue is, the iterations will converge faster. The second graph, which compares the Conjugate Gradient Method and the BiConjugate Gradient Method in solving a non-SPD matrix, shows that CG does not converge, but BiCG can. BiCG was made to be able to converge with any linear system, whereas CG was designed to solve SPD matrices only. The third graph compares the BiCgonjugate Gradient Method and the BiConjugate Gradient Stabilized Method. In this case, both equations converge. BiCG was made to converge with any linear system, but if the A-Transpose is not present, it cannot proceed. The BiCGSTAB was created for situations which lack such information. Methods: My professor and graduate student guided me through learning the different methods, as well as scientific computing. First, I learned how to solve linear systems by hand using GE. Then I was introduced into using the GS and Jacobi method. Once I have experienced the time it takes to solve a simple 10x10 matriz with those, I learned that in real life, people deal with matrices everyday, some having dimensions of over millions by millions. Matlab 7.0 was a tool I was taught how to use. This programming tool was used to map these itration graphs, and solves for eigenvalues instantly. Acknowledgements: For the success in my paper, I would like to thank my fellow SRAPers and the SRAP staff for encouragement and support. I would not have been able to complete this research paper without the help and guidance of Man- Chung Yeung and Jon Held. They taught me how to use Matlab computer programming, they helped edit my paper, and they showed me how the different iterative methods work.