FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012 A Solution Accurate, Efficient and Stable Unsplit Staggered Mesh MHD.

Slides:



Advertisements
Similar presentations
PARMA UNIVERSITY SIMULATIONS OF THE ISOLATED BUILDING TEST CASE F. AURELI, A. MARANZONI & P. MIGNOSA DICATeA, Parma University Parco Area delle Scienze.
Advertisements

4 th order Embedded Boundary FDTD algorithm for Maxwell Equations Lingling Wu, Stony Brook University Roman Samulyak, BNL Tianshi Lu, BNL Application collaborators:
Joint Mathematics Meetings Hynes Convention Center, Boston, MA
2ª aula Evolution Equation. The Finite Volume Method.
Finite Volume II Philip Mocz. Goals Construct a robust, 2nd order FV method for the Euler equation (Navier-Stokes without the viscous term, compressible)
(c) MSc Module MTMW14 : Numerical modelling of atmospheres and oceans Staggered schemes 3.1 Staggered time schemes.
Algorithm Development for the Full Two-Fluid Plasma System
July 11, 2006 Comparison of Exact and Approximate Adjoint for Aerodynamic Shape Optimization ICCFD 4 July 10-14, 2006, Ghent Giampietro Carpentieri and.
Jim Uschock Naval Surface Warfare Center Dahlgren Division (540) Quantitative Methods in Defense & National Security “Understanding.
Numerical Integration of Partial Differential Equations (PDEs)
ASCI/Alliances Center for Astrophysical Thermonuclear Flashes Simulating Self-Gravitating Flows with FLASH P. M. Ricker, K. Olson, and F. X. Timmes Motivation:
Level Set Formulation for Curve Evolution Ron Kimmel Computer Science Department Technion-Israel Institute of Technology Geometric.
“Assimilating” Solar Data into MHD Models of the Solar Atmosphere W.P. Abbett SSL UC Berkeley HMI Team Meeting, Jan 2005.
An Advanced Simulation and Computing (ASC) Academic Strategic Alliances Program (ASAP) Center at The University of Chicago The Center for Astrophysical.
Accurate Numerical Treatment of the Source Terms in the Non-linear Shallow Water Equations J.G. Zhou, C.G. Mingham, D.M. Causon and D.M. Ingram Centre.
Parallel Mesh Refinement with Optimal Load Balancing Jean-Francois Remacle, Joseph E. Flaherty and Mark. S. Shephard Scientific Computation Research Center.
Efficient Parallelization for AMR MHD Multiphysics Calculations Implementation in AstroBEAR.
Introduction to Numerical Methods I
Computations of Fluid Dynamics using the Interface Tracking Method Zhiliang Xu Department of Mathematics University of Notre.
Numerical Schemes for Advection Reaction Equation Ramaz Botchorishvili Faculty of Exact and Natural Sciences Tbilisi State University GGSWBS,Tbilisi, July.
© British Crown Copyright 2007/MOD Numerical Simulation Using High-Resolution Methods A. D. Weatherhead, AWE D. Drikakis, Cranfield University.
Zhaorui Li and Farhad Jaberi Department of Mechanical Engineering Michigan State University East Lansing, Michigan Large-Scale Simulations of High Speed.
© Arturo S. Leon, BSU, Spring 2010
Hybrid WENO-FD and RKDG Method for Hyperbolic Conservation Laws
A Look at High-Order Finite- Volume Schemes for Simulating Atmospheric Flows Paul Ullrich University of Michigan.
An Unsplit Ideal MHD code with Adaptive Mesh Refinement Ravi Samtaney Computational Plasma Physics Group Princeton Plasma Physics Laboratory Princeton.
ASCI/Alliances Center for Astrophysical Thermonuclear Flashes FLASH MHD Timur Linde FLASH MHD Timur Linde This work was supported by the ASCI Flash Center.
Implementation of an Advection Scheme based on Piecewise Parabolic Method (PPM) in the MesoNH The main goal of this study was to estimate if the RGSW model.
CENTRAL AEROHYDRODYNAMIC INSTITUTE named after Prof. N.E. Zhukovsky (TsAGI) Multigrid accelerated numerical methods based on implicit scheme for moving.
Recent advances in Astrophysical MHD Jim Stone Department of Astrophysical Sciences & PACM Princeton University, USA Recent collaborators: Tom Gardiner.
A Novel Wave-Propagation Approach For Fully Conservative Eulerian Multi-Material Simulation K. Nordin-Bates Lab. for Scientific Computing, Cavendish Lab.,
Brookhaven Science Associates U.S. Department of Energy MUTAC Review January 14-15, 2003, FNAL Target Simulations Roman Samulyak Center for Data Intensive.
CFD Lab - Department of Engineering - University of Liverpool Ken Badcock & Mark Woodgate Department of Engineering University of Liverpool Liverpool L69.
Lecture 3.
Studies of the MRI with a New Godunov Scheme for MHD: Jim Stone & Tom Gardiner Princeton University Recent collaborators: John Hawley (UVa) Peter Teuben.
Approximate Riemann Solvers for Multi-component flows Ben Thornber Academic Supervisor: D.Drikakis Industrial Mentor: D. Youngs (AWE) Aerospace Sciences.
Discontinuous Galerkin Methods for Solving Euler Equations Andrey Andreyev Advisor: James Baeder Mid.
7. Introduction to the numerical integration of PDE. As an example, we consider the following PDE with one variable; Finite difference method is one of.
Ale with Mixed Elements 10 – 14 September 2007 Ale with Mixed Elements Ale with Mixed Elements C. Aymard, J. Flament, J.P. Perlat.
Introducing Flow-er: a Hydrodynamics Code for Relativistic and Newtonian Flows Patrick M. Motl Joel E. Tohline, & Luis Lehner (Louisiana.
Gas-kineitc MHD Numerical Scheme and Its Applications to Solar Magneto-convection Tian Chunlin Beijing 2010.Dec.3.
Modeling Electromagnetic Fields in Strongly Inhomogeneous Media
AMS 691 Special Topics in Applied Mathematics Lecture 8
1 Séminaire AIM (20/06/06)Romain Teyssier Modélisation numérique multi-échelle des écoulements MHD en astrophysique Romain Teyssier (CEA Saclay) Sébastien.
A Non-iterative Hyperbolic, First-order Conservation Law Approach to Divergence-free Solutions to Maxwell’s Equations Richard J. Thompson 1 and Trevor.
Minimum Numerical Viscosity to Care the Carbuncle Instability Tomoyuki Hanawa (Chiba U.) Collaborators: Hayato Mikami, Tomoaki Matsumoto before after.
1 Application of Weighted Essentially Non-Oscillatory Limiting to Compact Interpolation Schemes Debojyoti Ghosh Graduate Research Assistant Alfred Gessow.
Deutscher Wetterdienst Flux form semi-Lagrangian transport in ICON: construction and results of idealised test cases Daniel Reinert Deutscher Wetterdienst.
PLUTO: a modular code for computational astrophysics Developers: A. Mignone 1,2, G. Bodo 2 1 The University of Chicago, ASC FLASH Center 2 INAF Osseratorio.
Lecture 2. Finite Difference (FD) Methods Conservation Law: 1D Linear Differential Equation:
RMHD simulations of the non-resonant streaming instability near relativistic magnetized shocks Fabien Casse AstroParticule & Cosmologie (APC) - Université.
FINITE DIFFERENCE In numerical analysis, two different approaches are commonly used: The finite difference and the finite element methods. In heat transfer.
Computational Fluid Dynamics Lecture II Numerical Methods and Criteria for CFD Dr. Ugur GUVEN Professor of Aerospace Engineering.
Numflux etc... & geometric source terms. Updating a grid.
Introduction to Numerical Methods I
Convection-Dominated Problems
ივანე ჯავახიშვილის სახელობის
Nodal Methods for Core Neutron Diffusion Calculations
ივანე ჯავახიშვილის სახელობის
Convergence in Computational Science
21th Lecture - Advection - Diffusion
Objective Numerical methods.
AIAA OBSERVATIONS ON CFD SIMULATION UNCERTAINITIES
AIAA OBSERVATIONS ON CFD SIMULATION UNCERTAINTIES
Convergence in Numerical Science
Objective Numerical methods Finite volume.
Finite Volume Method Philip Mocz.
AIAA OBSERVATIONS ON CFD SIMULATION UNCERTAINTIES
High Accuracy Schemes for Inviscid Traffic Models
Low Order Methods for Simulation of Turbulence in Complex Geometries
Presentation transcript:

FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012 A Solution Accurate, Efficient and Stable Unsplit Staggered Mesh MHD Solver in FLASH Dongwook Lee University of Chicago The Flash Center for Computational Science

Outline  Split vs. unsplit formulations  Unsplit solvers in FLASH (UHD & USM)  CFL stability (reduced or full?)  Reduced/Full corner-transport-upwind (CTU) for 3D  Divergence-free magnetic fields for USM-MHD  constrained-transport (CT)  Verifications, convergence, performance  Runtime parameters  Summary FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Part 1 Dimensionally Split vs. Unsplit??? FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Part 1 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  Single-mode Rayleigh-Taylor Instability  Top figures:  Dimensionally split using PLM, PPM+old limiter, PPM+new limiter  high-wavenumber instabilities grow  Bottom figures:  Dimensionally unsplit using PLM, PPM+old limiter, PPM+new limiter  high-wavenumber instabilities suppressed  the split solvers experience high compressions and expansions in subsequent directional sweeps where there is a local high strain rate  Almgren et al, ApJ, 715, 2010  Single-mode Rayleigh-Taylor Instability  Top figures:  Dimensionally split using PLM, PPM+old limiter, PPM+new limiter  high-wavenumber instabilities grow  Bottom figures:  Dimensionally unsplit using PLM, PPM+old limiter, PPM+new limiter  high-wavenumber instabilities suppressed  the split solvers experience high compressions and expansions in subsequent directional sweeps where there is a local high strain rate  Almgren et al, ApJ, 715, 2010

Part 1 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  Weakly magnetized 2D field loop  Gardiner and Stone 2005 (JCP); Lee and Deane 2009 (JCP)  Weakly magnetized 2D field loop  Gardiner and Stone 2005 (JCP); Lee and Deane 2009 (JCP)

Part 1 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  8-wave split MHD scheme (Powell et al. 1999) at t=2.0  Unsplit staggered mesh MHD scheme (Lee and Deane, 2009) at t=2.0

Part 1 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  What is wrong with the split formulation for MHD?  In the split formulation, you cannot correctly include terms proportional to  Gardiner and Stone (2005)  Dynamics of in-plane magnetic fields in x and y directions are ruined from erroneous growth of magnetic field in z direction:  What is wrong with the split formulation for MHD?  In the split formulation, you cannot correctly include terms proportional to  Gardiner and Stone (2005)  Dynamics of in-plane magnetic fields in x and y directions are ruined from erroneous growth of magnetic field in z direction:

Part 2 Unsplit Hydro/MHD Solvers & Algorithms FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Hydro Unit in FLASH Hydro_Unsplit FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Unsplit Staggered Mesh (USM) MHD Solver  Shock-capturing high-order Godunov Riemann solver (Lee & Deane, JCP, 2009; Lee 2012, to be submitted)  Finite volume method  New data reconstruction-evolution algorithm for high-order accuracy  Adaptive mesh refinement, uniform grid  1 st order Godunov, 2 nd order MUSCL-Hancock, 3 rd order PPM, 5 th Order WENO  Approximate Riemann solvers: Roe, HLL, HLLC, HLLD, Marquina, modified Marquina, Local Lax-Friedrichs  Monotonicity preserving upwind PPM slope limiter for MHD (Lee, 2010, Astronum)  Divergence of magnetic fields is numerically controlled on a staggered grid, using a constrained transport (CT) method (Evans & Hawley, 1998)  Wide ranges of plasma flows  Full Courant stability limit (CFL ~ 1 for 3D) FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Unsplit Formulations FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

MHD Governing Equations  MHD system of equations:  This can be written in a simple matrix form: FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

MHD Governing Equations  Conservative variables and fluxes: FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

 A primitive form: where the coefficient matrix is Linearized System FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Corner Transport Upwind (CTU) FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Corner Transport Upwind (CTU) Normal predictor Transverse corrector FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Corner Transport Upwind (CTU) Normal predictor Transverse corrector FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  Traditional approach (Colella 1990; Saltzman 1994)  Characteristic tracing for the normal predictor  Subsequent calls to Riemann solvers for transverse corrector  Traditional approach (Colella 1990; Saltzman 1994)  Characteristic tracing for the normal predictor  Subsequent calls to Riemann solvers for transverse corrector

Corner Transport Upwind (CTU) Normal predictor Transverse corrector FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  Traditional approach (Colella 1990; Saltzman 1994)  Characteristic tracing for the normal predictor  Subsequent calls to Riemann solvers for transverse corrector  Traditional approach (Colella 1990; Saltzman 1994)  Characteristic tracing for the normal predictor  Subsequent calls to Riemann solvers for transverse corrector  New approach (Lee and Deane 2009):  Characteristic tracing for BOTH normal predictor and transverse corrector!  New approach (Lee and Deane 2009):  Characteristic tracing for BOTH normal predictor and transverse corrector!

 A primitive form: where the coefficient matrix is  First consider the evolution in the x-normal direction and treat the normal magnetic field separately from the other variables: Linearized System, cont’d  Normal predictor  MHD source term FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Single-step data Reconstruction-evolution in USM FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Characteristic tracing for Transverse corrector  A jump relationship: FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Reduced 3D CTU in USM FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Full 3D CTU in USM FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Summary of Part 1 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  New approach of using characteristic tracing for BOTH normal predictor and transverse corrector  Reduced 3D CTU  A direct extension of 2D CTU to 3D  Requires 3 Riemann solves for 3D (6-ctu needs 6 Riemann solves)  Only including second cross derivatives  CFL limit ~ 0.5  Full 3D CTU  Full considerations of accounting for third cross derivatives  Requires 3 Riemann solves for 3D (12-ctu needs 12 Riemann solves)  CFL limit ~ 1.0  20% relative performance gain compared to reduced 3D CTU

Part 2 Divergence-Free fields: Constrained Transport (CT) MHD FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Part 2 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  CT scheme by Balsara and Spicer, 1998:

Part 2: recall…  Conservative variables and fluxes: FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Part 2 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  New upwind biased modified electric field construction(upwind-MEC), Lee 2012:

Part 2 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  Small angle advection of the 2D field loop:

Part 2 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  Small angle advection of the 3D field loop:

Summary of Part 2 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  Three CT schemes were discussed:  Standard CT scheme by Balsara and Spicer, 1998:  Takes a simple arithmetic averaging  Lacks numerical diffusion for magnetic fields advection  Modified electric field construction (MEC) scheme by Lee and Deane, 2009:  3 rd order accurate in space  Not enough numerical diffusion for field advection  Upwind biased MEC (upwind-MEC) scheme by Lee, 2012 (to be submitted)  Upwind scheme of MEC  Added numerical diffusion to stabilize field advection

Part 3 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012 Verification, convergence, and performance

Part 3 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Part 3 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Part 3 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Part 3 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Part 3 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Part 3 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Summary of Part 3 FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  Verification tests for the reduced/full 3D CTU schemes:  CFL=0.95 for all 3D simulations using the full CTU scheme  CFL=0.475 for the reduced CTU scheme  They both converge in 2 nd order  20% performance gain in using the full CTU scheme:  Various choices in runtime parameters

Conclusion FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012  Directionally split vs. unsplit formulations for hydro and MHD  Unsplit hydro/MHD solvers in FLASH4 (also FLASH3 in part)  The reduced and full 3D CTU algorithms  Upwind-MEC scheme for MHD  Stable solutions with 2 nd order convergence with CFL=0.95  20% performance gain in the full CTU scheme over the reduced CTU scheme  Work in progress:  Fully implicit Jacobian-Free Newton-Krylov implicit solver for the unsplit solvers  More HEDP capabilities for the USM solver

Thank You FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012 Questions?

New Upwind PPM for Slowly Moving Shock Upwind PPM5 th order WENO Standard PPM Standard PPM with increasing By larger By FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

New Upwind PPM for Slowly Moving Shock Upwind PPM5 th order WENO Standard PPM Standard PPM with increasing By Lee, 2010, 5 th Astronum Proceeding; Lee, 2011, in preparation larger By FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012

Block and Mesh Packages Uniform Grid AMR with variable patch size - CHOMBO qMesh package can be selected at configuration time qThe basic abstraction is a block of interior cells surrounded by guard cells qGrid unit makes sure that blocks are self contained before being given to the solvers Oct tree based AMR - PARAMESH FLASH Workshop Hamburger Sternwarte, University of Hamburg, Feb 15 – Feb 16, 2012