Stochastic Differential Equations and Random Matrices

Slides:



Advertisements
Similar presentations
Statistical perturbation theory for spectral clustering Harrachov, 2007 A. Spence and Z. Stoyanov.
Advertisements

Partial Differential Equations
Use of Kalman filters in time and frequency analysis John Davis 1st May 2011.
The QR iteration for eigenvalues. ... The intention of the algorithm is to perform a sequence of similarity transformations on a real matrix so that the.
Modern iterative methods For basic iterative methods, converge linearly Modern iterative methods, converge faster –Krylov subspace method Steepest descent.
CSCI 317 Mike Heroux1 Sparse Matrix Computations CSCI 317 Mike Heroux.
MA5233: Computational Mathematics
Symmetric Eigensolvers in Sca/LAPACK Osni Marques
XYZ 6/18/2015 MIT Brain and Cognitive Sciences Convergence Analysis of Reinforcement Learning Agents Srinivas Turaga th March, 2004.
Symmetric Definite Generalized Eigenproblem
LAPACK HTML version LAPACK = Linear Algebra PACKage ~ LINPACK + EISPACK
Ordinary Differential Equations (ODEs) 1Daniel Baur / Numerical Methods for Chemical Engineers / Implicit ODE Solvers Daniel Baur ETH Zurich, Institut.
MATH 685/ CSI 700/ OR 682 Lecture Notes Lecture 6. Eigenvalue problems.
Dominant Eigenvalues & The Power Method
Alan Edelman, Jeff Bezanson Viral Shah, Stefan Karpinski Jeremy Kepner and the vibrant open-source community Computer Science & AI Laboratories Novel Algebras.
VIRTUAL PROTOTYPING of ROBOTS DYNAMICS E. Tarabanov.
Random Matrix Theory Numerical Computation and Remarkable Applications Alan Edelman Mathematics Computer Science & AI Labs Computer Science & AI Laboratories.
Tempus Workshop, Niš, October 2002 Computer Science Education in Dortmund, Germany Claudio Moraga Dept. Computer Science, University of Dortmund, Germany.
Random Matrix Theory and Numerical Linear Algebra: A story of communication Alan Edelman Mathematics Computer Science & AI Labs ILAS Meeting June 3, 2013.
Eigenvalue Problems Solving linear systems Ax = b is one part of numerical linear algebra, and involves manipulating the rows of a matrix. The second main.
Algorithms for a large sparse nonlinear eigenvalue problem Yusaku Yamamoto Dept. of Computational Science & Engineering Nagoya University.
Computing a posteriori covariance in variational DA I.Gejadze, F.-X. Le Dimet, V.Shutyaev.
1 Eigenvalue Problems in Nanoscale Materials Modeling Hong Zhang Computer Science, Illinois Institute of Technology Mathematics and Computer Science, Argonne.
On the Use of Sparse Direct Solver in a Projection Method for Generalized Eigenvalue Problems Using Numerical Integration Takamitsu Watanabe and Yusaku.
Computational Aspects of Multi-scale Modeling Ahmed Sameh, Ananth Grama Computing Research Institute Purdue University.
Solving Linear Systems Solving linear systems Ax = b is one part of numerical linear algebra, and involves manipulating the rows of a matrix. Solving linear.
1 ECE 1304 Introduction to Electrical and Computer Engineering Section 1.7 Linear Algebra with MATLAB.
The Random Matrix Technique of Ghosts and Shadows Alan Edelman Dept of Mathematics Computer Science and AI Laboratories Massachusetts Institute of Technology.
Progress in the method of Ghosts and Shadows for Beta Ensembles Alan Edelman (MIT) Alex Dubbs (MIT) and Plamen Koev (SJS) Aug 10, 2012 IMS Singapore Workshop.
Project NExT CAS Panel Session University of Wisconsin, Madison July 30, 2008 Mathematica in the Military: Using CAS tools at the United States Military.
University of Colorado Boulder ASEN 5070: Statistical Orbit Determination I Fall 2014 Professor Brandon A. Jones Lecture 29: Observability and Introduction.
Performance of BLAS-3 Based Tridiagonalization Algorithms on Modern SMP Machines Yusaku Yamamoto Dept. of Computational Science & Engineering Nagoya University.
GAME PROGRAMMER By: Aaron Ramos and Oscar Quiles.
Complex Eigenvalues and Phase Portraits. Fundamental Set of Solutions For Linear System of ODEs With Eigenvalues and Eigenvectors and The General Solution.
Finding Rightmost Eigenvalues of Large, Sparse, Nonsymmetric Parameterized Eigenvalue Problems Minghao Wu AMSC Program Advisor: Dr. Howard.
ALGEBRAIC EIGEN VALUE PROBLEMS
S5.40. Module Structure 30% practical tests / 70% written exam 3h lectures / week (except reading week) 3 x 2h of computer labs (solving problems practicing.
Parallel Direct Methods for Sparse Linear Systems
A Fast Introduction What is a matrix (One Matrix many matrices)
Introduction What is a matrix (One Matrix many matrices)
Chapter 19 Area of a Region Between Two Curves.
Progress Report— 11/06 宗慶.
Chapter 4: Feedback Control System Characteristics Objectives
SIMULATION SIMULAND PURPOSE TECHNIQUE CREDIBILITY PROGRAMMATICS
Solving Systems of Linear Equations: Iterative Methods
Forming Perfect Squares
Widrow-Hoff Learning (LMS Algorithm).
Numerical Computations and Random Matrix Theory
Data Analysis Statistical Measures Industrial Engineering
Logarithms to an Arbitrary Base
Fast Multipole: It's All About Adding Functions in Finite Precision
An Introduction to Maple
Fast Multipole: It's All About Adding Functions in Finite Precision
The Fast Multipole Method: It’s All about Adding Functions
Degree and Eigenvector Centrality
Advances in Random Matrix Theory (stochastic eigenanalysis)
Advances in Random Matrix Theory (stochastic eigenanalysis)
Probability & Statistics Probability Theory Mathematical Probability Models Event Relationships Distributions of Random Variables Continuous Random.
1.
Why are random matrix eigenvalues cool?
Numerical Computations and Random Matrix Theory
Communication and Coding Theory Lab(CS491)
Advances in Random Matrix Theory: Let there be tools
 = N  N matrix multiplication N = 3 matrix N = 3 matrix N = 3 matrix
Remainder Theorem.
Modified Modal Methods in Asymmetric Systems
University of Queensland
Introduction To MATLAB
Chapter 4: Feedback Control System Characteristics Objectives
Generating Random Variates
Presentation transcript:

Stochastic Differential Equations and Random Matrices Alan Edelman MIT: Dept of Mathematics, Computer Science Artificial Intelligence Laboratory SIAM Applied Linear Algebra July 18, 2003 11/8/2018

Subject + Random = Wow! Quantum Mechanics Statistical Mechanics Randomized Algorithms Random Variation & Natural Selection Option Pricing Model Why not applied linear algebra???? 11/8/2018

Everyone’s Favorite Tridiagonal -2 1 1 n2 … … … … … d2 dx2 11/8/2018

Everyone’s Favorite Tridiagonal -2 1 G 1 (βn)1/2 1 n2 … … … + … … dW β1/2 d2 dx2 + 11/8/2018

G 11/8/2018

G 11/8/2018

7 G O 11/8/2018

7 G O 11/8/2018

7 G O 11/8/2018

7 G O 11/8/2018

7 G O 11/8/2018

7 G O 11/8/2018

7 G O 11/8/2018

7 G O 11/8/2018

7 G O 11/8/2018

7 G O 11/8/2018

7 G O 6 11/8/2018

7 G O 6 11/8/2018

7 G O 6 11/8/2018

7 G O 6 11/8/2018

7 G O 6 11/8/2018

7 G O 6 11/8/2018

7 G O 6 11/8/2018

7 G O 6 11/8/2018

7 G O 6 11/8/2018

7 G O 6 5 11/8/2018

7 G O 6 5 11/8/2018

7 G O 6 5 11/8/2018

7 G O 6 5 11/8/2018

7 G O 6 5 11/8/2018

7 G O 6 5 11/8/2018

7 G O 6 5 11/8/2018

7 G O 6 5 11/8/2018

7 G O 6 5 4 11/8/2018

7 G O 6 5 4 11/8/2018

7 G O 6 5 4 11/8/2018

7 G O 6 5 4 11/8/2018

7 G O 6 5 4 11/8/2018

7 G O 6 5 4 11/8/2018

7 G O 6 5 4 11/8/2018

7 G O 6 5 4 3 11/8/2018

7 G O 6 5 4 3 11/8/2018

7 G O 6 5 4 3 11/8/2018

7 G O 6 5 4 3 11/8/2018

7 G O 6 5 4 3 11/8/2018

7 G O 6 5 4 3 11/8/2018

7 G O 6 5 4 3 2 11/8/2018

7 G O 6 5 4 3 2 11/8/2018

7 G O 6 5 4 3 2 11/8/2018

7 G O 6 5 4 3 2 11/8/2018

7 G O 6 5 4 3 2 11/8/2018

7 G O 6 5 4 3 2 1 11/8/2018

7 G O 6 5 4 3 2 1 11/8/2018

G 6 5 4 3 2 1 Same idea: sym matrix to tridiagonal form 11/8/2018

G 6 5 4 3 2  Same idea: General beta beta: 1: reals 2: complexes 4: quaternions 11/8/2018

Stochastic Operator Limit , dW β 2 x dx d + - , N(0,2) χ n β 2 1 ~ H 2) (n 1) ÷ ø ö ç è æ - … … … , G β 2 H n + » ¥ 11/8/2018

Largest Eigenvalue Plots 11/8/2018

MATLAB beta=1; n=1e9; opts.disp=0;opts.issym=1; alpha=10; k=round(alpha*n^(1/3)); % cutoff parameters d=sqrt(chi2rnd( beta*(n:-1:(n-k-1))))'; H=spdiags( d,1,k,k)+spdiags(randn(k,1),0,k,k); H=(H+H')/sqrt(4*n*beta); eigs(H,1,1,opts) 11/8/2018

Tricks to get O(n9) speedup Sparse matrix storage (Only O(n) storage is used) Tridiagonal Ensemble Formulas (Any beta is available due to the tridiagonal ensemble) The Lanczos Algorithm for Eigenvalue Computation ( This allows the computation of the extreme eigenvalue faster than typical general purpose eigensolvers.) The shift-and-invert accelerator to Lanczos and Arnoldi (Since we know the eigenvalues are near 1, we can accelerate the convergence of the largest eigenvalue) The ARPACK software package as made available seamlessly in MATLAB (The Arnoldi package contains state of the art data structures and numerical choices.) The observation that if k = 10n1/3 , then the largest eigenvalue is determined numerically by the top k × k segment of n. (This is an interesting mathematical statement related to the decay of the Airy function.) 11/8/2018

Open Problems The distribution for general beta Seems to be governed by a convection-diffusion equation 11/8/2018