1. LBNLGXTBR FY2001 Oil and Gas Recovery Technology Review Meeting Diagnostic and Imaging High Speed 3D Hybrid Elastic Seismic Modeling Lawrence Berkeley National Laboratory, GX Technology, Burlington Resources Contacts: Valeri Korneev 510-486-7214, VAKorneev@lbl.gov; Mike Hoversten 510-486-5085, GMHoversten@lbl.gov

2. LBNLGXTBR Why do we need 3D elastic modeling Heterogeneous 3D media, complex topography, 3- component data, strong converted S- waves Survey design Hypothesis testing AVO evaluation Wave field interpretation Synthetic data sets for depth migration and full waveform inversion testing “Engine” for inversion It is cheaper and faster than real data acquisition

3. LBNLGXTBR Society of Exploration Geophysicists and European Association of Exploration Geophysicists 3D modeling project for seismic imaging testing. 8000 Gflop hours. Acoustic. Started in 1994. Still not completed. This project needs larger model and elastic code.

4. LBNLGXTBR

5. LBNLGXTBR Deep water Gulf of Mexico Regional Seismic Line Sub-salt structures can not be seen using acoustic inversion. Elastic propagator is needed to image details.

6. LBNLGXTBR Where 3D modeling stands today Industry primarily uses acoustic uniform grid Need of “smart” users who are experts in the method Massive parallel computing is expensive and “slow ” Model building is a problem Modeling results are difficult to interpret

7. LBNLGXTBR Requirements Full elastic modeling Attenuation Anisotropy Topography Effectively exploit computational resources High fidelity numerical modeling Hybrid methodology: Ray-tracing coupled with finite difference Local resolution algorithms Massively parallel super computers and clusters

8. LBNLGXTBR What is our goal? To build a 3D elastic modeling software tool capable to compute realistic (10 km * 10 km *4 km) models at seismic exploration frequencies (up to 100 Hz) on local networks at reasonable time (overnight) by any geophysical software user (with no special method-oriented training).

9. LBNLGXTBR

10. LBNLGXTBR

11. LBNLGXTBR

12. LBNLGXTBR Issues of 3D modeling performance Accuracy. Improves by using higher order differencing and finer gridding. Model size. No less then 5 grid points per shortest wavelength. Acoustic code requires 3.5 *N cells, where N = Nx*Ny*Nz number of cells for model parameters sampling. Elastic code needs 6 times more cells. CPU time. Acoustic code requires 5*K operations per grid cell. Elastic code requires 5 times more operations per grid cell, where K= 6*m, m - an order of differential operator. Stability. Requires integration time step Optimization. Avoid over sampling and too small time integration steps. Use parallel computing. Avoid computing in undisturbed cells. Numerical artifacts. Contrast contacts. Step sampling noise of dipping interfaces. Boundary reflections. Liquid-elastic interfaces. 0.5

13. LBNLGXTBR 3D hybrid elastic seismic modeling Parallel based upon overlapping subdomain decomposition variable order 3D finite difference code. Grid spacing depends on model parameters to provide local optimal computational regime. Wave propagation in the water will be computed by acoustic code. Contrast dipping interfaces will be handled with Local Boundary Conditions approach. Computation is performed for subdomains with non-zero wave field only. Option of conditional computation restarting at any given lapse time.

14. LBNLGXTBR

15. LBNLGXTBR FY2000 Results Stair step gridding problem resolved Nonuniform grid algorithm tested New stable topography algorithm tested Parallel interface library applied to 2D 4-th order in time scheme tested GXT ray tracer installed

16. LBNLGXTBR BoxLib Foundation Library –Domain specific library: support PDE solvers on structured, hierarchical adaptive meshes (AMR) –Support for heterogeneous workloads –BoxLib based programs run on serial, distributed memory and shared memory supercomputers and on SMP clusters –Parallel implementation MPI standard based, ensuring portability Dynamic load balance achieved using dynamic-programming approach to distribute sub grids –Hybrid C++ / Fortran programming model C++ flow control, memory management and I/O Fortran numerical kernels Parallel Software Infrastructure

17. LBNLGXTBR Discretization Methodology Improved finite difference schemes –Fourth order in space and time –Reduce computational times and memory requirements by more than an order of magnitude for realistic geologic models –Improved parallel performance by reducing communication to computation ratio Absorbing boundary conditions –Use non-local pseudo-differential operators to represent one-way wave propagation –Expand with PADE approximations to obtain local representation –Add graded local damping to minimize evanescent reflections

18. LBNLGXTBR Grating effect reduction by spatial filtering No correctionLinear gradient correction

19. LBNLGXTBR Nonuniform grid FD computations Savings factors Resource 2D tested 3D projected Memory 1.6 1.8 CPU time 3.2 3.6 Two half-spaces with 100% velocity contrast No velocity contrast test

20. LBNLGXTBR Numerically stable steep topography modeling

21. LBNLGXTBR LBNL has a fast and accurate wave propagation algorithm for moderately heterogeneous elastic media: We are going to apply it

22. LBNLGXTBR Hybrid Ray Tracing and FD approach speeds up computations up to 10 times Fast code through slow simple media FD code through complex media

23. LBNLGXTBR LBNL PC cluster Vendor - SGI 8 dual Pentium III CPU 800 MHz 512 SDRAM per node Myrinet LAN - fast net card Lynux based Price $60K Completion by the end of 2000

24. LBNLGXTBR Year 2001 efforts Requested budget - 250K Parallel 3D elastic code Nonuniform grid for 3D 4-th order in time scheme for 3D Hybrid (ray tracing + FD) algorithm Topography for 3D

25. LBNLGXTBR BoxLib Parallelism Hybrid C++/Fortran Programming environment. Library supports parallel PDE solvers on rectangular meshes. MPI portability: distributed and shared memory supercomputers, clusters of engineering workstations.

26. LBNLGXTBR Discretization Fourth order accuracy in space and time based on a modified equation approach. 2D: fourth order scheme gives 2 times the performance of conventional second order schemes. 3D: fourth order 4 times as efficient.

27. LBNLGXTBR Parallel Performance Wall clock run time Number of CPUs 4-th order scheme performs better as number of CPUs increases.