Solving Minimal Problems Numerics KALLE ÅSTRÖM, CENTRE FOR MATHEMATICAL SCIENCES, LUND UNIVERSITY, SWEDEN.

Slides:



Advertisements
Similar presentations
Chapter 28 – Part II Matrix Operations. Gaussian elimination Gaussian elimination LU factorization LU factorization Gaussian elimination with partial.
Advertisements

Chapter 2 Solutions of Systems of Linear Equations / Matrix Inversion
Lecture 17 Introduction to Eigenvalue Problems
Part 3 Chapter 9 Gauss Elimination
A quick example calculating the column space and the nullspace of a matrix. Isabel K. Darcy Mathematics Department Applied Math and Computational Sciences.
Systems of Linear Equations Examples Prepared by Vince Zaccone For Campus Learning Assistance Services at UCSB.
ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 15 Solution of Systems of Equations.
Solving a System with Three Variables and Three Unknowns.
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 6. Eigenvalue problems.
Algebra II March 2 nd Students should complete warm-up problems. Given a graph of a system of equations students will be able to determine how many solutions.
Center for Machine Perception Department of Cybernetics, Faculty of Electrical Engineering Czech Technical University in Prague Methods for Solving Systems.
Thinking Mathematically Algebra: Graphs, Functions and Linear Systems 7.3 Systems of Linear Equations In Two Variables.
7.1 SOLVING SYSTEMS BY GRAPHING The students will be able to: Identify solutions of linear equations in two variables. Solve systems of linear equations.
Solving Systems of Equations
Advanced Computer Graphics Spring 2014 K. H. Ko School of Mechatronics Gwangju Institute of Science and Technology.
Table of Contents The goal in solving a linear system of equations is to find the values of the variables that satisfy all of the equations in the system.
1.1.2 INTRODUCTION TO SYSTEMS OF LINEAR EQUATIONS Chapter 1: Systems of Linear Equations and Matrices SWBAT: Redefine algebraic operations as Elementary.
Systems of Linear Equations Let’s say you need to solve the following for x, y, & z: 2x + y – 2z = 10 3x + 2y + 2z = 1 5x + 4y + 3z = 4 Two methods –Gaussian.
CHAPTER 2 MATRIX. CHAPTER OUTLINE 2.1 Introduction 2.2 Types of Matrices 2.3 Determinants 2.4 The Inverse of a Square Matrix 2.5 Types of Solutions to.
Diagonalization Revisted Isabel K. Darcy Mathematics Department Applied Math and Computational Sciences University of Iowa Fig from knotplot.com.
Matrix Solutions to Linear Systems. 1. Write the augmented matrix for each system of linear equations.
MATH 175: Numerical Analysis II Lecturer: Jomar Fajardo Rabajante 2 nd Sem AY IMSP, UPLB.
Solving Linear Systems by Elimination Math Tech II Everette Keller.
MODULE 8 APPROXIMATION METHODS I Once we move past the two particle systems, the Schrödinger equation cannot be solved exactly. The electronic inter-repulsion.
We will use Gauss-Jordan elimination to determine the solution set of this linear system.
You already know how to solve equations like these:
Do Now: Evaluate: 3AB. Algebra II 3.7: Evaluate Determinants HW: p.207 (4-14 even) Test : Friday, 12/6.
Chapter 9 Matrices and Determinants Copyright © 2014, 2010, 2007 Pearson Education, Inc Determinants and Cramer’s Rule.
Introduction To this point MATLAB has been used to answer questions with a numeric value ▫Variables are assigned specific values ▫Answers are numbers MATLAB.
Chapter 1 - Fundamentals Equations. Definitions Equation An equation is a statement that two mathematical statements are equal. Solutions The values.
Solving Systems Using Elimination
Algebra 1 Notes Lesson 7-4 Elimination Using Multiplication.
SOLVING SYSTEMS ALGEBRAICALLY SECTION 3-2. SOLVING BY SUBSTITUTION 1) 3x + 4y = 12 STEP 1 : SOLVE ONE EQUATION FOR ONE OF THE VARIABLES 2) 2x + y = 10.
Scientific Computing General Least Squares. Polynomial Least Squares Polynomial Least Squares: We assume that the class of functions is the class of all.
7.4. 5x + 2y = 16 5x + 2y = 16 3x – 4y = 20 3x – 4y = 20 In this linear system neither variable can be eliminated by adding the equations. In this linear.
3.6 Solving Systems Using Matrices You can use a matrix to represent and solve a system of equations without writing the variables. A matrix is a rectangular.
Systems of Equations and Inequalities Ryan Morris Josh Broughton.
Solving Minimal Problems Symmetry KALLE ÅSTRÖM, CENTRE FOR MATHEMATICAL SCIENCES, LUND UNIVERSITY, SWEDEN.
Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Chapter 27.
Zuzana Kukelova, Martin Bujnak, Jan Heller, Tomas Pajdla The Art of Solving Minimal Problems Tricks: One more point? Microsoft Research Cambridge Czech.
Zuzana Kukelova, Martin Bujnak, Tomas Pajdla The Art of Solving Minimal Problems Tricks: Problem Formulation Microsoft Research Cambridge Czech Technical.
GUIDED PRACTICE for Example – – 2 12 – 4 – 6 A = Use a graphing calculator to find the inverse of the matrix A. Check the result by showing.
Start Presentation October 4, 2012 Efficient Solution of Equation Systems This lecture deals with the efficient mixed symbolic/numeric solution of algebraically.
1 ECE 102 Engineering Computation Chapter 3 Math Review 3: Cramer’s Rule Dr. Herbert G. Mayer, PSU Status 10/11/2015 For use at CCUT Fall 2015.
1 ECE 221 Electric Circuit Analysis I Chapter 6 Cramer’s Rule Herbert G. Mayer, PSU Status 11/14/2014 For use at Changchun University of Technology CCUT.
Solve Linear Systems by Elimination February 3, 2014 Pages
SYSTEMS OF LINEAR EQUATIONS College Algebra. Graphing and Substitution Solving a system by graphing Types of systems Solving by substitution Applications.
Solving a System of 3 Equations with 3 Unknowns. Breakdown Step 1 Labeling Step 2 Reduce to a 2 by 2 Step 3 Substitute Back In Step 4 Check Solution.
= the matrix for T relative to the standard basis is a basis for R 2. B is the matrix for T relative to To find B, complete:
Do Now: Perform the indicated operation. 1.). Algebra II Elements 11.1: Matrix Operations HW: HW: p.590 (16-36 even, 37, 44, 46)
1 SYSTEM OF LINEAR EQUATIONS BASE OF VECTOR SPACE.
Today in Algebra 2 Get a calculator. Go over homework Notes: –Solving Systems of Equations using Elimination Homework.
Part 3 Chapter 9 Gauss Elimination
MATRICES AND DETERMINANTS
Solving Linear Systems Algebraically
6-3 Solving Systems Using Elimination
REVIEW: Solving Linear Systems by Elimination
Chapter 27.
Programming #4 Computer Problems
Simultaneous Equations
Numerical Computation and Optimization
Matrix Solutions to Linear Systems
Linear Algebra Lecture 3.
Chapter 7: Matrices and Systems of Equations and Inequalities
Systems of Equations Solve by Graphing.
Evaluating Expressions and Solving Equations
Name ________________________________________________
Example 2B: Solving Linear Systems by Elimination
Systems of three equations with three variables are often called 3-by-3 systems. In general, to find a single solution to any system of equations,
Multiply by 5/40 and sum with 2nd row
Presentation transcript:

Solving Minimal Problems Numerics KALLE ÅSTRÖM, CENTRE FOR MATHEMATICAL SCIENCES, LUND UNIVERSITY, SWEDEN

Solving System of Polynomial Equations Step by Step once more 1.System of equations 2.Expand by multiplying each equation with a number of monomials 3.Choose a set of Basis monomials 4.Choose an action variable, e g 5.Calculate monomials to reduce R and the rest E 6.Re-order monomials 7.Gaussian elimination

Solving System of Polynomial Equations Step by Step once more 8.Gaussian elimination 9.Form Action matrix 10.Solve eigenvalue problem 11.Extract solutions from eigenvalues/eigenvectors 12.What is the main cause of bad numerics?

Solving System of Polynomial Equations Step by Step once more 8.From Gaussian elimination 9.Form Action matrix 10.Solve eigenvalue problem 11.Extract solutions from eigenvalues/eigenvectors 12.What is the main cause of bad numerics?

Ways to improve numerics 1.Redo the problem formulation –Simpler equations, fewer unknowns 2.Choice of polynomials to multiply with (expansion) 3.Choice of basis monomials 4.Numerical linear algebra (SVD, QR) 5.Exploit symmetry

QR with column pivoting - as a method for choosing basis monomials 1.Choose a set P of monomials (slightly larger than B, before) 2.Reduce E and R part as before 3.Use QR with column pivoting to choose basis monomials B among P that minimize the condition number

QR with column pivoting (Byröd, Josephson, Åström, IJCV 2009)

SVD method - as a method for choosing basis polynomials 1.Choose a set P of monomials (slightly larger than B, before) 2.Reduce E and R part as before 3.Use QR with column pivoting to choose basis monomials B among P that minimize the condition number 4.Theoretically better, but more complicated to code and longer time to compute. 

Optimizing (i) expansion and (ii) set of permissible monomials 1.Generate a small benchmark set of examples 2.Change the set of permissible monomials. 3.Evaluate on the benchmark set. 4.Perform local optimization. 5.Difficult optimization problem, many local minima. 6.Potential for improvement

Optimizing (i) expansion and (ii) set of permissible monomials 1.Generate a small benchmark set of examples 2.Change the set of permissible monomials. 3.Evaluate on the benchmark set. 4.Perform local optimization. 5.Difficult optimization problem, many local minima. 6.Potential for improvement