SVD Data Compression: Application to 3D MHD Magnetic Field Data Diego del-Castillo-Negrete Steve Hirshman Ed d’Azevedo ORNL ORNL-PPPL LDRD Meeting ORNL.

Slides:



Advertisements
Similar presentations
Eigen Decomposition and Singular Value Decomposition
Advertisements

EigenFaces and EigenPatches Useful model of variation in a region –Region must be fixed shape (eg rectangle) Developed for face recognition Generalised.
Eigen Decomposition and Singular Value Decomposition
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
Tensors and Component Analysis Musawir Ali. Tensor: Generalization of an n-dimensional array Vector: order-1 tensor Matrix: order-2 tensor Order-3 tensor.
Numeriska beräkningar i Naturvetenskap och Teknik Today’s topic: Approximations Least square method Interpolations Fit of polynomials Splines.
Input Space versus Feature Space in Kernel- Based Methods Scholkopf, Mika, Burges, Knirsch, Muller, Ratsch, Smola presented by: Joe Drish Department of.
PCA + SVD.
Data mining and statistical learning - lecture 6
MATH 685/ CSI 700/ OR 682 Lecture Notes
Basis Expansion and Regularization Presenter: Hongliang Fei Brian Quanz Brian Quanz Date: July 03, 2008.
1 Chapter 4 Interpolation and Approximation Lagrange Interpolation The basic interpolation problem can be posed in one of two ways: The basic interpolation.
Computational Methods in Physics PHYS 3437
EARS1160 – Numerical Methods notes by G. Houseman
Computer Vision Spring ,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #20.
1cs542g-term High Dimensional Data  So far we’ve considered scalar data values f i (or interpolated/approximated each component of vector values.
Principal Component Analysis CMPUT 466/551 Nilanjan Ray.
Principal Component Analysis
CS 584. Review n Systems of equations and finite element methods are related.
Spectral bases for 3D shapes representation. Spectral bases – reminder Last week we spoke of Fourier analysis  1D sine/cosine bases for signals:
Lecture 2: Numerical Differentiation. Derivative as a gradient
Chapter 19 Numerical Differentiation §Estimate the derivatives (slope, curvature, etc.) of a function by using the function values at only a set of discrete.
1 Numerical geometry of non-rigid shapes Spectral Methods Tutorial. Spectral Methods Tutorial 6 © Maks Ovsjanikov tosca.cs.technion.ac.il/book Numerical.
Light Field Mapping: Hardware-Accelerated Visualization of Surface Light Fields.
Computing Sketches of Matrices Efficiently & (Privacy Preserving) Data Mining Petros Drineas Rensselaer Polytechnic Institute (joint.
Computer Graphics Recitation The plan today Least squares approach  General / Polynomial fitting  Linear systems of equations  Local polynomial.
1cs542g-term Notes  Extra class next week (Oct 12, not this Friday)  To submit your assignment: me the URL of a page containing (links to)
1 Introduction to Model Order Reduction Luca Daniel Massachusetts Institute of Technology
SVD(Singular Value Decomposition) and Its Applications
Function approximation: Fourier, Chebyshev, Lagrange
Empirical Modeling Dongsup Kim Department of Biosystems, KAIST Fall, 2004.
Chapter 2 Dimensionality Reduction. Linear Methods
CSE554AlignmentSlide 1 CSE 554 Lecture 8: Alignment Fall 2014.
Orthogonal Functions Numerical Methods in Geophysics Function Approximation The Problem we are trying to approximate a function f(x) by another function.
CSE554AlignmentSlide 1 CSE 554 Lecture 5: Alignment Fall 2011.
Lecture 22 - Exam 2 Review CVEN 302 July 29, 2002.
1 Recognition by Appearance Appearance-based recognition is a competing paradigm to features and alignment. No features are extracted! Images are represented.
WB1440 Engineering Optimization – Concepts and Applications Engineering Optimization Concepts and Applications Fred van Keulen Matthijs Langelaar CLA H21.1.
Model Construction: interpolation techniques 1392.
Fourier TheoryModern Seismology – Data processing and inversion 1 Fourier Series and Transforms Orthogonal functions Fourier Series Discrete Fourier Series.
Course 13 Curves and Surfaces. Course 13 Curves and Surface Surface Representation Representation Interpolation Approximation Surface Segmentation.
1 Spring 2003 Prof. Tim Warburton MA557/MA578/CS557 Lecture 8.
6. Introduction to Spectral method. Finite difference method – approximate a function locally using lower order interpolating polynomials. Spectral method.
Estimation of Number of PARAFAC Components
1 Complex Images k’k’ k”k” k0k0 -k0-k0 branch cut   k 0 pole C1C1 C0C0 from the Sommerfeld identity, the complex exponentials must be a function.
CSE 185 Introduction to Computer Vision Face Recognition.
Geometric Modeling using Polygonal Meshes Lecture 3: Discrete Differential Geometry and its Application to Mesh Processing Office: South B-C Global.
1 EEE 431 Computational Methods in Electrodynamics Lecture 8 By Dr. Rasime Uyguroglu
Domain decomposition in parallel computing Ashok Srinivasan Florida State University.
1. Systems of Linear Equations and Matrices (8 Lectures) 1.1 Introduction to Systems of Linear Equations 1.2 Gaussian Elimination 1.3 Matrices and Matrix.
Matrix Factorization & Singular Value Decomposition Bamshad Mobasher DePaul University Bamshad Mobasher DePaul University.
CS654: Digital Image Analysis Lecture 11: Image Transforms.
1 Chapter 4 Interpolation and Approximation Lagrange Interpolation The basic interpolation problem can be posed in one of two ways: The basic interpolation.
ECE 530 – Analysis Techniques for Large-Scale Electrical Systems Prof. Hao Zhu Dept. of Electrical and Computer Engineering University of Illinois at Urbana-Champaign.
Principal Warps: Thin-Plate Splines and the Decomposition of Deformations 김진욱 ( 이동통신망연구실 ; 박천현 (3D 모델링 및 처리연구실 ;
Runge Kutta schemes Taylor series method Numeric solutions of ordinary differential equations.
CSE 554 Lecture 8: Alignment
Singular Value Decomposition and its applications
Localization for Anisotropic Sensor Networks
Boundary Element Analysis of Systems Using Interval Methods
Recognition: Face Recognition
Spectral Methods Tutorial 6 1 © Maks Ovsjanikov
PCA vs ICA vs LDA.
Singular Value Decomposition
Chapter 12 Curve Fitting : Fitting a Straight Line Gab-Byung Chae
Principal Component Analysis
Outline H. Murase, and S. K. Nayar, “Visual learning and recognition of 3-D objects from appearance,” International Journal of Computer Vision, vol. 14,
Recitation: SVD and dimensionality reduction
Principal Component Analysis
Using Manifold Structure for Partially Labeled Classification
Presentation transcript:

SVD Data Compression: Application to 3D MHD Magnetic Field Data Diego del-Castillo-Negrete Steve Hirshman Ed d’Azevedo ORNL ORNL-PPPL LDRD Meeting ORNL August 8-10, 2005

Motivation Particle based simulations with M3D require moving around large amounts of magnetic data (broadcasting to other processors) Compressing these data would save computer storage and allow individual processors to store B-fields needed to push particles through all space. For 2-d data (3rd dimension FFT) requires data points. The goal is to explore the possibility of representing the same field in a basis that only requires data points with

Proper orthogonal decomposition We seek a tensor product representation of the field and define the -truncation and error The proper orthogonal decomposition consist of choosing an optimal set of orthogonal eigenfunctions such that for a fixed  e(  is the smallest. That is, we are looking for the best low order tensor product approximation of the data in a least square sense. This techniqu,e also known as singular value decomposition and principal component analysis, is widely used in many areas including fluid turbulence and image processing.

N x N matrix -rank approximation An Example from QPS

Eigenfunctions for QPS |B| decomposition

SDV works well for complicated fields and sharp variations However …..

SDV method has problems with non-Cartesian boundaries Proposed alternative: Create an extension of the field in the vacuum and apply SDV compression to the total resulting field.

Extending the field is not trivial SVD does not like no-differentiable functions Slow decay

Grid extension algorithm Plasma boundary represented as a parametric curve in the plane Nested family of “rectified” boundaries created by expanding Discretizing t construct a grid in the vacuum region Using the grid extrapolate the boundary values along the t=constant coordinate lines using a Taylor expansion: Where, to smooth the ghost field we impose the “Laplacian” condition In the last step, the data in the is used to interpolate the data

Test of grid extension algorithm Rank 5 approximation error Original data Extended data Eigenvalues

Eigenfunctions

“Crystal-Growth” Algorithm Initializ e Mask Find next bdy layer mask=0 pts with at least one nearest neighbor (mask=1) Use Taylor series (> order 2) and symmetric layers of neighbors with mask=1 to compute smooth extrapolation for bdy points Update mask=1 for all bdy points at end of this cycle ANY(mask == 0) ? Mask=0 in vacuum Mask=1 in plasma Mask=1 Mask=0 Nearest neighbors

Test of crystal growth algorithm Rank 5 approximation error Original data Extended data Eigenvalues

Eigenfunctions

Application to M3D magnetic field data Br data from M3D Eigenvalues ErrorRank 5 error

Despite the relatively good decay of the eigenvalues and the error as function of the rank of the approximation, the high order eigenfunctions exhibit sharp variations. This might be due to lack of smoothness of the original data.

Least squares polynomial fit Assume matrix obtained from a smooth function [ f(x(i),y(j) ], where f(x,y) can be well approximated by polynomials. f(x,y) = sum( c(k,l) T(k,x) T(l,y), k=0..m,l=0..m ), T(k,x) may be k-th degree Chebyshev polynomials Compute coefficients c(k,l) using least squares fit with known data within the defined region

Least squares fit Resulting fitted data is globally smooth, and usually leads to fast decay of singular values Singular vectors appear to be smooth functions Derivatives can be estimated from basis functions Good compression since only the coefficients need to be sent, values of T(k,x(i)) or T(l,y(j)) can be regenerated

Conclusions SVD decomposition is an efficient data compression technique that can be used to represent magnetic field data in particle based plasma simulations. For two dimensional data of size the compression rate is where  is the number of eigenfunctions, typically Achieving efficient data compression requires smooth data in a rectangular domain. For plasmas with irregular (non-rectangular) boundaries one has first to extend the data in a differentiable way into a rectangular box.

Conclusions We have discussed three data extension algorithms: Crystal growth Grid extension Truncated Chebychev x-y expansions We applied the methods to several examples and were able to achieve compression rates of at least R~1/10 with errors of order