Biryaltsev E.V., Galimov M.R., Demidov D.E., Elizarov A.M. HPC CLUSTER DEVELOPMENT AND OPERATION EXPERIENCE FOR SOLVING THE INVERSE PROBLEMS OF SEISMIC.

Slides:

Advertisements

Similar presentations

Issues of HPC software From the experience of TH-1A Lu Yutong NUDT.

Advertisements

EUFORIA FP7-INFRASTRUCTURES , Grant JRA4 Overview and plans M. Haefele, E. Sonnendrücker Euforia kick-off meeting 22 January 2008 Gothenburg.

1 Agenda … HPC Technology & Trends HPC Platforms & Roadmaps HP Supercomputing Vision HP Today.

CURRENT AND FUTURE HPC SOLUTIONS. T-PLATFORMS  Russia’s leading developer of turn-key solutions for supercomputing  Privately owned  140+ employees.

GPU System Architecture Alan Gray EPCC The University of Edinburgh.

PHOTOMOD. Future outlook Aleksey Elizarov Head of Software Development Department, Racurs October 2014, Hainan, China From Imagery to Map: Digital Photogrammetric.

HPCC Mid-Morning Break High Performance Computing on a GPU cluster Dirk Colbry, Ph.D. Research Specialist Institute for Cyber Enabled Discovery.

IDC HPC User Forum Conference Appro Product Update Anthony Kenisky, VP of Sales.

PARALLEL PROCESSING COMPARATIVE STUDY 1. CONTEXT How to finish a work in short time???? Solution To use quicker worker. Inconvenient: The speed of worker.

Linux Clustering A way to supercomputing. What is Cluster? A group of individual computers bundled together using hardware and software in order to make.

HIGH PERFORMANCE COMPUTING ENVIRONMENT The High Performance Computing environment consists of high-end systems used for executing complex number crunching.

DCABES 2009 China University Of Geosciences 1 The Parallel Models of Coronal Polarization Brightness Calculation Jiang Wenqian.

Earth Simulator Jari Halla-aho Pekka Keränen. Architecture MIMD type distributed memory 640 Nodes, 8 vector processors each. 16GB shared memory per node.

1 petaFLOPS+ in 10 racks TB2–TL system announcement Rev 1A.

Disk Array Performance Estimation AGH University of Science and Technology Department of Computer Science Jacek Marmuszewski Darin Nikołow, Marek Pogoda,

© 2013 Mellanox Technologies 1 NoSQL DB Benchmarking with high performance Networking solutions WBDB, Xian, July 2013.

1 Down Place Hammersmith London UK 530 Lytton Ave. Palo Alto CA USA.

1 1 Hybrid Cloud Solutions (Private with Public Burst) Accelerate and Orchestrate Enterprise Applications.

KYLIN-I 麒麟一号 High-Performance Computing Cluster Institute for Fusion Theory and Simulation, Zhejiang University

Abstract Load balancing in the cloud computing environment has an important impact on the performance. Good load balancing makes cloud computing more.

© Copyright 2010 Hewlett-Packard Development Company, L.P. 1 HP + DDN = A WINNING PARTNERSHIP Systems architected by HP and DDN Full storage hardware and.

Development of High Performance Computing on the Basis of SSCC and СС Intel-SB RAS Development of High Performance Computing on the Basis of SSCC and СС.

1 1 Hybrid Cloud Solutions (Private with Public Burst) Accelerate and Orchestrate Enterprise Applications.

A Makeshift HPC (Test) Cluster Hardware Selection Our goal was low-cost cycles in a configuration that can be easily expanded using heterogeneous processors.

Slide 1 Auburn University Computer Science and Software Engineering Scientific Computing in Computer Science and Software Engineering Kai H. Chang Professor.

Cactus Computational Frameowork Freely available, modular, environment for collaboratively developing parallel, high- performance multi-dimensional simulations.

Maximizing The Compute Power With Mellanox InfiniBand Connectivity Gilad Shainer Wolfram Technology Conference 2006.

TRACEREP: GATEWAY FOR SHARING AND COLLECTING TRACES IN HPC SYSTEMS Iván Pérez Enrique Vallejo José Luis Bosque University of Cantabria TraceRep IWSG'15.

1 Down Place Hammersmith London UK 530 Lytton Ave. Palo Alto CA USA.

Taking the Complexity out of Cluster Computing Vendor Update HPC User Forum Arend Dittmer Director Product Management HPC April,

Amy Apon, Pawel Wolinski, Dennis Reed Greg Amerson, Prathima Gorjala University of Arkansas Commercial Applications of High Performance Computing Massive.

 Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over a network (typically the Internet). 

2009/4/21 Third French-Japanese PAAP Workshop 1 A Volumetric 3-D FFT on Clusters of Multi-Core Processors Daisuke Takahashi University of Tsukuba, Japan.

CEA DSM Irfu IRFU site report. CEA DSM Irfu HEPiX Fall 0927/10/ Computing centers used by IRFU people IRFU local computing IRFU GRIF sub site Windows.

Carlo del Mundo Department of Electrical and Computer Engineering Ubiquitous Parallelism Are You Equipped To Code For Multi- and Many- Core Platforms?

IDC HPC User Forum April 14 th, 2008 A P P R O I N T E R N A T I O N A L I N C Steve Lyness Vice President, HPC Solutions Engineering

Dawning Information Industry Co., Ltd. Moscow, 12/2015 Sugon HPC: Workstation.

Dynamic Scheduling Monte-Carlo Framework for Multi-Accelerator Heterogeneous Clusters Authors: Anson H.T. Tse, David B. Thomas, K.H. Tsoi, Wayne Luk Source:

Scalable systems for reservoir modeling on modern hardware platforms Dmitry Eydinov SPE London. November, 24 th 2015.

Co-Processor Architectures Fermi vs. Knights Ferry Roger Goff Dell Senior Global CERN/LHC Technologist |

Tackling I/O Issues 1 David Race 16 March 2010.

Pathway to Petaflops A vendor contribution Philippe Trautmann Business Development Manager HPC & Grid Global Education, Government & Healthcare.

The Evolution of the Italian HPC Infrastructure Carlo Cavazzoni CINECA – Supercomputing Application & Innovation 31 Marzo 2015.

Introduction to Data Analysis with R on HPC Texas Advanced Computing Center Feb

Sobolev(+Node 6, 7) Showcase +K20m GPU Accelerator.

The Science Data Processor and Regional Centre Overview Paul Alexander UK Science Director the SKA Organisation Leader the Science Data Processor Consortium.

HPC Design of Ion Based Molecular Clusters A. Bende, C. Varodi, T. M. Di Palma INCDTIM – Istituto Motori-CNR, Napoli, Italy Romania-JINR cooperation framework.

PL-Grid: Polish Infrastructure for Supporting Computational Science in the European Research Space 1 ESIF - The PLGrid Experience ACK Cyfronet AGH PL-Grid.

Big Data Analytics and HPC Platforms

NIIF HPC services for research and education

HPC Roadshow Overview of HPC systems and software available within the LinkSCEEM project.

Organizations Are Embracing New Opportunities

Low-Cost High-Performance Computing Via Consumer GPUs

Working With Azure Batch AI

Heterogeneous Computation Team HybriLIT

DIRECT IMMERSION COOLED IMMERS HPC CLUSTERS BUILDING EXPERIENCE

Yaodong CHENG Computing Center, IHEP, CAS 2016 Fall HEPiX Workshop

Appro Xtreme-X Supercomputers

Clouds of JINR, University of Sofia and INRNE Join Together

OCP: High Performance Computing Project

DIRECT IMMERSION COOLED IMMERS HPC CLUSTERS BUILDING EXPERIENCE

Spatial Analysis With Big Data

Traditional Enterprise Business Challenges

Low-Cost High-Performance Computing Via Consumer GPUs

System G And CHECS Cal Ribbens

Overview of HPC systems and software available within

TeraScale Supernova Initiative

IBM Power Systems.

CUBAN ICT NETWORK UNIVERSITY COOPERATION (VLIRED

Can (HPC)Clouds supersede traditional High Performance Computing?

Presentation transcript:

Biryaltsev E.V., Galimov M.R., Demidov D.E., Elizarov A.M. HPC CLUSTER DEVELOPMENT AND OPERATION EXPERIENCE FOR SOLVING THE INVERSE PROBLEMS OF SEISMIC PROSPECTING

HPC - INDUSTRIAL DEPLOYMENT 2 MASS MARKET READY

OIL & GAS INDUSTRY AND TECHNOLOGY REPLACEMENT 3 NEW SOLUTIONS REQUIRED PRICE DROP PRODUCTION & EXPLORATION COMPLEXITY

NUMERICAL SIMULATION 4 GRID SIMULATION METHODS

FULL WAVE INVERSION 5

LOW-FREQUENCY SEISMIC SOUNDING (LFS) 6

APPLICATIONS 7 1.Oil & gas prospecting 2.Fracturing control 3.Borehole environment monitoring

REQUIREMENTS 8 ACCESSIBILITY BIG DATA ARRAYS PERFORMANCE VISUALIZATION models per cycle 10 9 – cells ~1 Tb per model

RESEARCH & DEVELOPMENT 9 1. The best performance for the massive parallelism tasks. 2. High computation density per equipment units. 3. Perspective technology. GPU — EFFICIENT CHOICE

GPU CLUSTER 10 UPS Eaton 9155 Power Rating 8000 / 7200 (VA/Watts) 0.7 Power factor Server >80 Tb Data storage space + SSD cache Virtualization server Citirix XenServer platform 2 x NVIDIA GK104GL with NVIDIA GRID K2 technology Mellanox InfiniBand network switch 56 Gbit/s 6 GPU cluster nodes 4 x AMD FirePro W9100 (16Gb GDDR5, 5.24 Tflops peak) 2 x Intel Xeon E v2 (25M cache, 3.50 GHz, 12 threads) Performance 35,6/64,9 Tflops 38 th position in Russian top 50 supercomputers rating RAM – 320 Gb Overall disk space volumes 86 Тb

HARDWARE & SOFTWARE ENVIRONMENT 11 VDI GPU 3D 1. GPU clusters ОC Gentoo & Open Grid Engine 2. VexCL (vector expression template library) OpenCL/CUDA 3. Simulation & analyze software system С++, MPI, Java 4. VDI server Citix XenDesktop & NVidia GRID 5. Data warehouse PostgreSQL & NFS (RAID)

WORKFLOW 12 Sensors data Simulation data Processing 3D full wave simulation GPU cluster Interpretation

SUCCESSFUL SOLUTIONS 13 Cloud solution Amazon SOFTWARE – HPC ENVIRONMENT OpenCL, CUDA, OpenMP, MPI HARDWARE – GPU CLUSTER Local solution T-platforms, Meijin, ARBYTE SC, STSS

PROBLEMS 14 DISTRIBUTED RENDERING REMOTE & SHARED ACCESS BIG DATA MANAGMENT INTEGRATION HPC2D&3DRDStore

INTEGRATED FRAMEWORKS 15 SCHLUMBERGER OCEAN HUE SPACE NVIDIA INDEX COMMERCIAL AND PROPRIETARY NVIDIA TECHNOLOGY C++,.NET, Java

SPECIALIZED FRAMEWORKS 16 Open Inventor, Nvidia Engines (SceniX, OptiX…), Equalizer, Chromium... HPC Hadoop, HPCC, Array-based DBMS (Rasdaman, SciDB)... NVidia CUDA Toolkit, AMD OpenCL SDK... Big Data Визуали зация

CONCLUSION 17 HPC HARWARE & SOFTWARE EXISTS INDUSTRIAL SPECIALIZATION COMPLETE DATA & PROCESSES INTEGRATION METHODOLOGY COMMON HPC SOFTWARE ECOSYSTEM SOFTWARE FRAMEWORKS HARD CHOICE

18 THANK YOU FOR YOUR ATTENTION!