Brookhaven Science Associates U.S. Department of Energy 1 Simulation of Multiphase Magnetohydrodynamic Flows for Nuclear Fusion Applications Roman Samulyak AMS Department, Stony Brook University and Computational Science Center Brookhaven National Laboratory Collaborators: Tianshi Lu (BNL), Paul Parks (General Atomics) Wurigen Bo, Lingling Wu (Stony Brook) James Glimm, Xiaolin Li (Stony Brook) Kirk McDonald (Princeton), Harold Kirk (BNL) The Role of High Performance Computation in Economic Development Workshop at Rensselaer Polytechnic Institute, October , 2008

Brookhaven Science Associates U.S. Department of Energy 2 Talk Outline Brief description of wide range of applications Numerical algorithms for multiphase hydro and MHD flows Large scale computing (BlueGene) Application specific mathematical models and numerical algorithms (for one selected applications - tokamak fueling) Numerical simulations: main results and feedback to applications Summary and conclusions

Brookhaven Science Associates U.S. Department of Energy 3 ITER is a joint international research and development project that aims to demonstrate the scientific and technical feasibility of fusion power ITER will be constructed in Europe, at Cadarache in the South of France in ~10 years Fusion Energy. ITER project: fuel pellet ablation Models and simulations of tokamak fueling through the ablation of frozen D 2 pellets Collaboration with General Atomics Our contribution to ITER science: Laser driven pellet acceleration

Brookhaven Science Associates U.S. Department of Energy 4 New Ideas in Nuclear Fusion: Magnetized Target Fusion (MTF)

Brookhaven Science Associates U.S. Department of Energy 5 Fission Energy. DOE Nuclear Energy Research Initiative (NERI) Stony Brook University, together with Rensselaer Polytechnical Institute, Columbia University, and Brookhaven National Laboratory, joined a DOE funded consortium within NERI initiative Project title: Deployment of a Suite of High Performance Computational Tools for Multiscale Multiphysics Simulation of Generation-IV Reactors

Brookhaven Science Associates U.S. Department of Energy 6  Simulation of material relocation in a Core Disruptive Accident (CDA) in Gen. IV reactors  Numerical investigation of the surface instability and liquid entrainment in the expansion of an CDA bubble.  Studies of some fundamental problems of multiphase flows  Subgrid models for multiphase flows Numerical Studies within NERI Consortium

Brookhaven Science Associates U.S. Department of Energy 7 Spallation Neutron Source: Cavitation induced erosion in mercury target Injection of nondissolvable gas bubbles has been proposed as a pressure mitigation technique. Numerical simulations aim to estimate the efficiency of this approach, explore different flow regimes, and optimize parameters of the system. Left: pressure distribution in the SNS target prototype. Right: Cavitation induced pitting of the target flange (Los Alamos experiments)

Brookhaven Science Associates U.S. Department of Energy 8 Mercury Jet Target for Neutrino Factory / Muon Collider n Simulation of the mercury jet target interacting with a proton pulse in a magnetic field Studies of surface instabilities, jet breakup, and cavitation MHD forces reduce both jet expansion, instabilities, and cavitation Jet disruptions Target schematic

Brookhaven Science Associates U.S. Department of Energy 9 Numerical Algorithms Common features of all applications: Multiphase / free surface hydro and MHD flows interacting with external energy sources Phase transitions They require: Explicitly resolved multiphase (free surface) flows Our choice is Front Tracking Numerical algorithms for coupled hyperbolic - elliptic systems in geometrically complex domains Large scale computing

Brookhaven Science Associates U.S. Department of Energy 10 MHD equations and approximations Full system of MHD equationsLow magnetic Re approximation

Brookhaven Science Associates U.S. Department of Energy 11 Multiphase MHD Solving MHD equations (a coupled hyperbolic – elliptic system) in geometrically complex, evolving domains subject to interface boundary conditions (which may include phase transition equations) Material interfaces: Discontinuity of density and physics properties (electrical conductivity) Governed by the Riemann problem for MHD equations or phase transition equations

Brookhaven Science Associates U.S. Department of Energy 12 Front Tracking: A hybrid of Eulerian and Lagrangian methods Advantages of explicit interface tracking: No numerical interfacial diffusion Real physics models for interface propagation Different physics / numerical approximations in domains separated by interfaces Two separate grids to describe the solution: 1.A volume filling rectangular mesh 2.An unstructured codimension-1 Lagrangian mesh to represent interface Main Ideas of Front Tracking Major components: 1.Front propagation and redistribution 2.Wave (smooth region) solution

Brookhaven Science Associates U.S. Department of Energy 13 FronTier is a parallel 3D multiphysics code based on front tracking n Physics models include n Compressible fluid dynamics n MHD n Flow in porous media n Elasto-plastic deformations n Realistic EOS models, phase transition models n Exact and approximate Riemann solvers n Adaptive mesh refinement The FronTier Code (SciDAC ITAPS Software) Turbulent fluid mixing. Left: 2D Right: 3D (fragment of the interface)

Brookhaven Science Associates U.S. Department of Energy Hyperbolic step FronTier-MHD numerical scheme Elliptic step Propagate interface (solve Riemann problem for contact or phase transition equations) Untangle interface Update interface states Apply hyperbolic solvers Update interior hydro states Generate finite element grid Perform mixed finite element discretization or Perform finite volume discretization Solve linear system using fast Poisson solvers Calculate electromagnetic fields Update front and interior states Point Shift (top) or Embedded Boundary (bottom)

Brookhaven Science Associates U.S. Department of Energy 15 Normal propagation of interface points Contact discontinuity

Brookhaven Science Associates U.S. Department of Energy 16 Phase boundary problem Interface jump conditionsBalance equations Temperature and pressure at the interface Subgrid model for temperature

Brookhaven Science Associates U.S. Department of Energy 17 Embedded Boundary Elliptic Solver Main Ideas Based on the finite volume discretization Domain boundary is embedded in the rectangular Cartesian grid, and the solution is treated as a cell-centered quantity Using finite difference for full cell and linear interpolation for cut cell flux calculation Advantage: robust, readily parallelizable, compatible with FronTier grid-based interface tracking algorithm.

Brookhaven Science Associates U.S. Department of Energy 18 High Performance Computing We are interested in the development of software for parallel distributed memory supercomputers Efficient parallelization Scalability to thousands of processors State-of-art parallel visualization Code portability (for use of local and external (NERSC) computational resources)

Brookhaven Science Associates U.S. Department of Energy 19 Application Specific Models and Simulations

Brookhaven Science Associates U.S. Department of Energy 20 Pellet Ablation for Tokamak Fueling: Main Models Equation of state with atomic processes Kinetic model for the interaction of hot electrons with the ablated gas Surface ablation model Cloud charging and rotation models New conductivity model (ionization by electron impact) Schematic of processes in the ablation cloud

Brookhaven Science Associates U.S. Department of Energy 21 Macroscale Model: AMR simulation of ablation flow in plasma (Ravi Samtaney) Focus on plasma flow Ablation physics not resolved (simplified analytical models) Relation to Other Projects Local (“Microscale”) Model: Front Tracking simulation of pellet ablation Focus on detailed ablation physics, ablation rates etc. Far field plasma evolution not resolved

Brookhaven Science Associates U.S. Department of Energy 22 Saha equation for the dissociation (ionization) fraction Equation of State with Atomic Processes.

Brookhaven Science Associates U.S. Department of Energy 23 EOS with Atomic Processes Incomplete EOS (known from literature): High resolution solvers (based on the Riemann problem) require the sound speed and integrals of Riemann invariant type expressions along isentropes. Therefore the complete EOS is needed. Using the second law of thermodynamics we found the complete EOS and showed that the compatibility with the second law of thermodynamics requires:

Brookhaven Science Associates U.S. Department of Energy 24 Complete EOS with Atomic Processes Notations: We will define the sound speed in a form typical for the polytropic gas: where the effective gamma is the Gruneisen coefficient is and the entropy is

Brookhaven Science Associates U.S. Department of Energy 25 For better numerical efficiency, FronTier operates with three pairs of independent thermodynamic variables: Numerical Algorithms for EOS For the first two pairs of variables, solve numerically nonlinear algebraic equation, and find T. Using, find the remaining state. Such an approach is prohibitively slow for the calculation of Riemann integrals (involves nested nonlinear equations). To speedup calculations, we precompute and store values on Riemann integrals as functions of the density and entropy. Two dimensional table lookup and bi-linear interpolation are used.

Brookhaven Science Associates U.S. Department of Energy 26 Influence of Atomic Processes on Temperature and Conductivity

Brookhaven Science Associates U.S. Department of Energy 27 Electron Energy Deposition In the cloud:On the pellet surface:

Brookhaven Science Associates U.S. Department of Energy 28 Pellet charging model

Brookhaven Science Associates U.S. Department of Energy 29 Physics Models for Pellet Studies : Surface Ablation Features of the pellet ablation: The pellet is effectively shielded from incoming electrons by its ablation cloud Processes in the ablation cloud define the ablation rate, not details of the phase transition on the pellet surface No need to couple to acoustic waves in the solid/liquid pellet The pellet surface is in the super-critical state As a result, there is not even well defined phase boundary, vapor pressure etc. This justifies the use of a simplified model: Mass flux is given by the energy balance (incoming electron flux) at constant temperature Pressure on the surface is defined through the connection to interior states by the Riemann wave curve Density is found from the EOS

Brookhaven Science Associates U.S. Department of Energy 30 Spherically symmetric simulation Normalized ablation gas profiles at 10 microseconds Polytropic EOSPlasma EOS Poly EOSPlasma EOS Sonic radius0.66 cm0.45 cm Temperature5.51 eV1.07 eV Pressure20.0 bar26.9 bar Ablation rate112 g/s106 g/s Excellent agreement with TF model and Ishizaki. Verified scaling laws of the TF model

Brookhaven Science Associates U.S. Department of Energy 31 Axially Symmetric Hydrodynamic Simulation Temperature, eVPressure, barMach number Distributions of temperature, pressure, and Mach number of the ablation flow near the pellet at 20 microseconds. Clarified the role of directional electron beam heating on the ablation rate.

Brookhaven Science Associates U.S. Department of Energy 32 Performed first systematic studies of pellet ablation rates in magnetic fields 3 microseconds 5 microseconds 9 microseconds 1 microsecond 3 microseconds

Brookhaven Science Associates U.S. Department of Energy 33 Revealed new propertied of the ablation flow: Supersonic rotation of the ablation channel Supersonic rotation widens the ablation channel, re-distributes density, and changes the ablation rate Resolution of this phenomenon greatly improves the agreement with experiments Cloud Rotation Isosurfaces of the rotational Mach number in the pellet ablation flow

Brookhaven Science Associates U.S. Department of Energy 34 Critical observation: Formation of the ablation channel and ablation rate strongly depends on plasma pedestal properties and pellet velocity Simulations suggest that novel pellet acceleration technique (laser or gyrotron driven) are necessary for ITER Dependence on Pedestal Properties Schematic of the plasma pedestal. Plasma pedestal provides critical influence to the pellet ablation rate

Brookhaven Science Associates U.S. Department of Energy 35 Striation instabilities: Experimental observation (Courtesy MIT Fusion Group) Current work focuses on the study of striation instabilities Striation instabilities, observed in all experiments, are not well understood We believe that the key process causing striation instabilities is the supersonic channel rotation, observed in our simulations Work in Progress

Brookhaven Science Associates U.S. Department of Energy 36 Neutrino Factory / Muon Collider target Simulation tasks: Studies of the jet formation in the nozzle Entrance of the jet into the magnetic field Mercury jet - proton pulse interaction. Jet cavitation and disruption, stabilizing effect of the magnetic field Predictions for the CERN targetry experiment called MERIT (Fall of 2007)

Brookhaven Science Associates U.S. Department of Energy 37 Jet entering 15 T solenoid

Brookhaven Science Associates U.S. Department of Energy 38 Aspect ratio of the jet cross-section B = 15 T V0 = 25 m/s These studies has resulted in the change of MERIT design. The chamber was re-designed to allow much smaller angle with of the jet with the magnetic field.

Brookhaven Science Associates U.S. Department of Energy 39 Simulations predicted slightly smaller value of the jet width in different view ports. Experimental data V = 15 m/s, B = 10TV = 20 m/s, B = 10T B = 15T

Brookhaven Science Associates U.S. Department of Energy 40 Liquid jet cavitation

Brookhaven Science Associates U.S. Department of Energy 41 Interaction of the mercury jet target with proton pulses 3D FronTier simulations of the disruption of Hg jet interacting with a proton pulse.

Brookhaven Science Associates U.S. Department of Energy 42 Summary of Target Studies Accomplishments Modeling and simulation of the mercury jet target Change design parameters of the MERIT experiments Successful predictions for MERIT: jet flattening in high gradient field, jet disruption by proton pulses, stabilizing effect of the magnetic field Significance Neutrino Factory Collaboration reached the conclusion that liquid mercury jet targets can successfully work with proton beams up to 8 MW