1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 23.

Slides:



Advertisements
Similar presentations
Numerical Integration
Advertisements

Numerical Methods for Partial Differential Equations CAAM 452 Spring 2005 Lecture 9 Instructor: Tim Warburton.
Theory of Computing Lecture 3 MAS 714 Hartmut Klauck.
1 12. Principles of Parameter Estimation The purpose of this lecture is to illustrate the usefulness of the various concepts introduced and studied in.
Computational Methods in Physics PHYS 3437
Visual Recognition Tutorial
Gradient Methods April Preview Background Steepest Descent Conjugate Gradient.
1 L-BFGS and Delayed Dynamical Systems Approach for Unconstrained Optimization Xiaohui XIE Supervisor: Dr. Hon Wah TAM.
Finite Element Method Introduction General Principle
INTEGRALS 5. INTEGRALS We saw in Section 5.1 that a limit of the form arises when we compute an area.  We also saw that it arises when we try to find.
Evaluating Hypotheses
Gradient Methods May Preview Background Steepest Descent Conjugate Gradient.
Caracas, Marzo 2006 Algorithm for 3D-Modeling H.-J. Götze IfG, Christian-Albrechts-Universität Kiel Interpretation Interpretation.
Gradient Methods Yaron Lipman May Preview Background Steepest Descent Conjugate Gradient.
1 MA375 Introduction To Numerical Computing Fall 2003 Prof. Tim Warburton
MA/CS 375 Fall MA/CS 375 Fall 2002 Lecture 32.
Lehrstuhl für Informatik 2 Gabriella Kókai: Maschine Learning 1 Evaluating Hypotheses.
Subdivision Analysis via JSR We already know the z-transform formulation of schemes: To check if the scheme generates a continuous limit curve ( the scheme.
Maximum likelihood (ML)
Numerical Methods for Partial Differential Equations CAAM 452 Spring 2005 Lecture 9 Instructor: Tim Warburton.
Numerical Methods for Partial Differential Equations CAAM 452 Spring 2005 Lecture 6 Various Finite Difference Discretizations for the Advection Equations.
SOLUTION FOR THE BOUNDARY LAYER ON A FLAT PLATE
Ch 8.1 Numerical Methods: The Euler or Tangent Line Method
19.5 Numeric Integration and Differentiation
Primal-Dual Meets Local Search: Approximating MST’s with Non-uniform Degree Bounds Author: Jochen Könemann R. Ravi From CMU CS 3150 Presentation by Dan.
MA/CS471 Lecture 8 Fall 2003 Prof. Tim Warburton
1 MA557/MA578/CS557 Numerical Partial Differential Equations Spring 2002 Prof. Tim Warburton
1 Tips for solving Project 1 Reactor SO 3 SO 2 +O 2.
Lecture 22 MA471 Fall Advection Equation Recall the 2D advection equation: We will use a Runge-Kutta time integrator and spectral representation.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 5a.
Numerical Methods for Partial Differential Equations CAAM 452 Spring 2005 Lecture 3 AB2,AB3, Stability, Accuracy Instructor: Tim Warburton.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 21.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: Deterministic vs. Random Maximum A Posteriori Maximum Likelihood Minimum.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 31.
1 Lesson 8: Basic Monte Carlo integration We begin the 2 nd phase of our course: Study of general mathematics of MC We begin the 2 nd phase of our course:
MA/CS 375 Fall MA/CS 375 Fall 2002 Lecture 31.
Numerical Methods for Partial Differential Equations CAAM 452 Spring 2005 Lecture 5 Summary of convergence checks for LMM and one-step time stepping Instructor:
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 8.
6. Introduction to Spectral method. Finite difference method – approximate a function locally using lower order interpolating polynomials. Spectral method.
ECE 8443 – Pattern Recognition LECTURE 10: HETEROSCEDASTIC LINEAR DISCRIMINANT ANALYSIS AND INDEPENDENT COMPONENT ANALYSIS Objectives: Generalization of.
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology Principles of Parameter Estimation.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 24.
Chapter 10 Minimization or Maximization of Functions.
ECE 8443 – Pattern Recognition ECE 8423 – Adaptive Signal Processing Objectives: MLLR For Two Gaussians Mean and Variance Adaptation MATLB Example Resources:
INTEGRALS We saw in Section 5.1 that a limit of the form arises when we compute an area. We also saw that it arises when we try to find the distance traveled.
5 INTEGRALS.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 17.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 13.
Fourier Approximation Related Matters Concerning Fourier Series.
Approximating Derivatives Using Taylor Series and Vandermonde Matrices.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 19.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 25.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 32.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 28.
Runge Kutta schemes Taylor series method Numeric solutions of ordinary differential equations.
Evaluating Hypotheses. Outline Empirically evaluating the accuracy of hypotheses is fundamental to machine learning – How well does this estimate its.
Evaluating Hypotheses. Outline Empirically evaluating the accuracy of hypotheses is fundamental to machine learning – How well does this estimate accuracy.
Announcements Topics: -sections 7.3 (definite integrals), 7.4 (FTC), and 7.5 (additional techniques of integration) * Read these sections and study solved.
Keywords (ordinary/partial) differencial equation ( 常 / 偏 ) 微分方程 difference equation 差分方程 initial-value problem 初值问题 convex 凸的 concave 凹的 perturbed problem.
The simple linear regression model and parameter estimation
Chapter 7. Classification and Prediction
12. Principles of Parameter Estimation
Latent Variables, Mixture Models and EM
LECTURE 05: THRESHOLD DECODING
Feature space tansformation methods
5.3 Higher-Order Taylor Methods
SKTN 2393 Numerical Methods for Nuclear Engineers
12. Principles of Parameter Estimation
Chapter 2 A Survey of Simple Methods and Tools
1st semester a.y. 2018/2019 – November 22, 2018
Presentation transcript:

1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 23

2 Basis Ordering There has been some confusion about the numbering of the PKDO basis functions. There are now a number of basis functions. We will choose an ordering: where M=(p+1)(p+2)/2 and we have normalized each of the

3 Accuracy of Polynomial Interpolation We introduce the operator supremum-norm and the Linfinity norm: for the p’th order interpolation operator. The interpolation error is bounded below by:

4 cont This tells us that the interpolating polynomial which approximates a function can only be less or equal in accuracy to the best polynomial approximation. Finding the optimal polynomial which approximates a function is an unsolved problem. However, there is a theorem by Lebesgue which allows us to bound the interpolation error in terms of the error one would attain by choosing the best possible polynomial approximation.

5 Theorem (Lebesgue) Assume that and we consider a set of M interpolation points then: i.e. the Lebesgue constant gives us an idea of the optimality of the M points. The smaller is the better.

6 Comments Note – the Lebesgue number only depends on the distribution of nodes. The only condition on the function being approximated is that it is continuous. Here’s the tricky part. It is difficult to compute exactly as it requires us to search the continuum of points in the triangle. However, we can approximate this number by randomly sampling a large number of points in the triangle. i.e. for some, large, N compute the following:

7 Open Problem It is still an open problem to find the set of nodes for the triangle which minimize the Lebesgue constant. Various attempts have been made: Hesthaven: (You will need access permission – so download on on campus) Wingate and Taylor: And others.. See comparison tables in Hesthaven paper.

8 Fekete Nodes For the Triangle 1)Read the Wingate and Taylor paper over the break. 2)The Fekete nodes are chosen according to: the condition that they are the nodes which maximize the determinant of the VDM matrix. 3)Wingate and Taylor suggest a method for calculating the Fekete nodes based on the method of steepest ascent. 4)Nodes are moved in the direction which most increase the log of the determinant of the generalized Vandermonde matrix.

9 Steepest Descent Approach Suppose we start with a list of M initial node locations we will solve the following ODE to steady state. We denote the determinant of the Vandermonde matrix by: We will now show that this is equivalent to solving:

10 We need to compute the gradient of log(V) Step 1: expand the determinant of the Vandermonde matrix with respect to the co-determinants:

11 Step 2: as an example of how to compute the gradient of |V| with respect to the node coordinates we first differentiate with respect to r 1

12 Step 3: Expand derivative terms with respect to the Lagrange interpolating basis for the M nodes

13 Step 4: replace derivative terms in differentiation of V:

14 Step 5: factorize matrix

15 Conclusion: This is not exactly as reported in the Wingate & Taylor paper. However, since |V| simply scales the node velocities uniformly it will not make very much difference as we are integrating in a “pseudo-time” manner.

16 Interpretation of Algorithm At each node, the algorithm pushes the node in the direction of the slope of the interpolating polynomial at that node: At steady state, the interpolating polynomial associated with a node will have (approximately) zero slope at that node.. This is a property shared by the Gauss-Lobatto- Legendre nodes in 1D !.

17 Download The Code Download the Fekete node routine computing routine from the class web page. Over the break use this code to compute the Fekete nodes for p=1 to p=10. Save the node coordinates in a file for each polynomial order.. These will be the nodes we use for future computations.

18 To Run: Unzip the files and set the current directory to the umFEKETE directory. In Matlab: p = 7; [R,S] = am282fekete2d(p); scatter(R,S); This might take quite a while. The code will output the approximate Lebesgue constant as the nodes move. Run now with p=4

19 P=7 nodes Note there are 8 nodes on each edge and a total of 36 nodes. The approximate Lebesgue number is:

20 am282fekete2d am282ab am282jacobideriv2dab am282derivmatrix2d am282vdm2dabam282jacobi2dabam282jacobi1d am282jacobderiv1d

21 Surface Mass Matrices Recall the DG scheme: We now have defined the set of nodes which we can build the h n Lagrange interpolating polynomials. The only remaining task is to discretize the boundary terms.

22 Surface Term We now break the boundary integral into the three edge components: Last step due to the face normals being constant The last step is to compute:

23 Starting with edge 1 (a=-1,-1<=b<=1), we will work with the PKDO basis:

24

25 Edge 2 If we try the same thing with the second edge it gets more complicated:

26 Edges 2 & 3 We can use the surface mass matrix from edge 1 by noting that the Fekete nodes have the same distribution on edge 1 as they do on edge 2. Identify which nodes correspond and permute the edge 1 matrix.

27 Computing Jump Terms Note we need [C m ] which only makes sense for the nodes which lie on the f’th edge.

28 Next Lecture Next class we will start examining the consistency of the DG scheme Also – finally the consistency analysis. Review the Hesthaven-Warburton paper for details.