Presentation is loading. Please wait.

Presentation is loading. Please wait.

Real-World GPGPU Mark Harris NVIDIA Developer Technology.

Published by Modified over 9 years ago

Similar presentations

Presentation on theme: "Real-World GPGPU Mark Harris NVIDIA Developer Technology."— Presentation transcript:

1 Real-World GPGPU Mark Harris NVIDIA Developer Technology

2 Copyright © NVIDIA Corporation 2004 GPGPU Research Promises Big Speedups physically-based simulation image processing scientific computing computer vision computational finance medical imaging bioinformatics databases and data mining sorting ray tracing Researchers have tried many applications on GPUs Research results promise big speedups LU-GPU dense linear system solver: 10x CPU (UNC) GPUTeraSort: 2006 Indy PennySort Champion (UNC) ClawHMMr streaming sequence search: 5-20x CPU (Stanford)

3 Copyright © NVIDIA Corporation 2004 Raw Data Promises High Perf, Too GPU Observed GFLOPS CPU Theoretical peak GFLOPS 2005 2006 NVIDIA GPU Pixel Shader GFLOPS

4 Copyright © NVIDIA Corporation 2004 Real-World Performance Gains Do research results and high peak performance translate to real application speedups? Real-World Applications Medical Imaging (Mercury Computer Systems) Electromagnetic Simulations (NVIDIA Partner) Game Physics (Havok)

5 © 2006 Mercury Computer Systems, Inc. Digital Breast Tomosynthesis (DBT) 100X reconstruction speed-up with NVIDIA Quadro FX 4500 GPU  From hours to minutes  Facilitates clinical use Improved diagnostic value  Clearer images  Fewer obstructions  Earlier detection Axis of rotation Compressed breast Digital detector X-Ray tube Compression paddle 11 Low-dose X-ray Projections Extremely Computationally Intense Reconstruction Advanced Imaging Solution of the Year “Mercury reduced reconstruction time from 5 hours to 5 minutes, making DBT clinically viable. …among 70 women diagnosed with breast cancer, DBT pinpointed 7 cases not seen with mammography” Pioneering DBT work at Massachusetts General Hospital

6 Copyright © NVIDIA Corporation 2004 Electromagnetic Simulation 3D Finite-Difference and Finite-Element Modeling of: Cell phone irradiation MRI Design / Modeling Printed Circuit Boards Radar Cross Section (Military) Computationally Intensive! Large speedups with Quadro GPUs Pacemaker with Transmit Antenna Commercial, Optimized, Mature Software Single CPU, 3.x GHz 5X 10X 1X 18X 42 1 0 # Quadro FX 4500 GPUs

7 Copyright © NVIDIA Corporation 2004 Havok FX Physics on NVIDIA GPUs Physics-based effects on a massive scale 10,000s of objects at high frame rates Rigid bodies Particles Fluids Cloth and more

8 Copyright © NVIDIA Corporation 2004 Dedicated Performance For Physics Performance Measurement 15,000 Boulder Scene Frame Rate CPU Physics Dual Core P4EE 955 - 3.46GHz GeForce 7900GTX SLI CPU Multi-threading enabled GPU Physics Dual Core P4EE 955 - 3.46GHz GeForce 7900GTX SLI CPU Multi-threading enabled 6.2 fps 64.5 fps

9 Copyright © NVIDIA Corporation 2004 GPGPU Performance Strategies Choose applications with high Arithmetic Intensity Arithmetic Intensity = Arithmetic / Bandwidth Game physics top kernels = very high A.I. > 1500 cycles per collision, ~100 texture fetches Leverage strengths of all processors in the system GPUs: data-parallel computation CPUs: sequential computation Multi-core CPUs: task-parallel computation Find the parallelism in the application Data dependencies can make problem appear sequential Divide into batches of independent parallelism

10 Copyright © NVIDIA Corporation 2004 Rigid Body Dynamics Overview 3 phases to every simulation time step Integrate positions and velocities Detect collisions Resolve collisions Integration is very parallel No dependencies between objects: use the GPU Detecting collisions is basically scene traversal CPU is good at this – use it Resolving collisions is a tricky one Is it parallel enough for the GPU?

11 Copyright © NVIDIA Corporation 2004 Is Game Physics A Data Parallel Task? Solve Collisions New Velocities Contacts & Velocities Body Slide courtesy of Andrew Bond, Havok

12 Copyright © NVIDIA Corporation 2004 Is Game Physics A Data Parallel Task? Solve Collisions New Velocities Contacts & Velocities Body Slide courtesy of Andrew Bond, Havok

13 Copyright © NVIDIA Corporation 2004 Is Game Physics A Data Parallel Task? Solve Collisions New Velocities Contacts Solve link 1 Solve link 2 Solve link N Solve link 1 Solve link 2 Solve link N Solve link 1 Solve link 2 Solve link N Batch 1Batch 2Batch M Slide courtesy of Andrew Bond, Havok

14 Copyright © NVIDIA Corporation 2004 Conclusion Real-World GPGPU is just beginning! Questions? mharris@nvidia.com http://developer.nvidia.com

Download ppt "Real-World GPGPU Mark Harris NVIDIA Developer Technology."

Similar presentations

Physical Simulation on GPUs Jim Van Verth OpenGL Software Engineer NVIDIA

Physical Simulation on GPUs Jim Van Verth OpenGL Software Engineer NVIDIA
Intro to GPU’s for Parallel Computing. Goals for Rest of Course Learn how to program massively parallel processors and achieve – high performance – functionality.

Intro to GPU’s for Parallel Computing. Goals for Rest of Course Learn how to program massively parallel processors and achieve – high performance – functionality.
HPCC Mid-Morning Break High Performance Computing on a GPU cluster Dirk Colbry, Ph.D. Research Specialist Institute for Cyber Enabled Discovery.

HPCC Mid-Morning Break High Performance Computing on a GPU cluster Dirk Colbry, Ph.D. Research Specialist Institute for Cyber Enabled Discovery.
2012-10-26 FSOSS Dr. Chris Szalwinski Professor School of Information and Communication Technology Seneca College, Toronto, Canada GPU Research Capabilities.

FSOSS Dr. Chris Szalwinski Professor School of Information and Communication Technology Seneca College, Toronto, Canada GPU Research Capabilities.
IMGD 4000: Computer Graphics in Games Emmanuel Agu.

IMGD 4000: Computer Graphics in Games Emmanuel Agu.
GPGPU Lessons Learned Mark Harris. General-Purpose Computation on GPUs Highly parallel applications Physically-based simulation image processing scientific.

GPGPU Lessons Learned Mark Harris. General-Purpose Computation on GPUs Highly parallel applications Physically-based simulation image processing scientific.
2-6-2015 Challenge the future Delft University of Technology Evaluating Multi-Core Processors for Data-Intensive Kernels Alexander van Amesfoort Delft.

Challenge the future Delft University of Technology Evaluating Multi-Core Processors for Data-Intensive Kernels Alexander van Amesfoort Delft.
A many-core GPU architecture.. Price, performance, and evolution.

A many-core GPU architecture.. Price, performance, and evolution.
GPU Computing with CUDA as a focus Christie Donovan.

GPU Computing with CUDA as a focus Christie Donovan.
2009/04/07 Yun-Yang Ma.  Overview  What is CUDA ◦ Architecture ◦ Programming Model ◦ Memory Model  H.264 Motion Estimation on CUDA ◦ Method ◦ Experimental.

2009/04/07 Yun-Yang Ma.  Overview  What is CUDA ◦ Architecture ◦ Programming Model ◦ Memory Model  H.264 Motion Estimation on CUDA ◦ Method ◦ Experimental.
Rasterization and Ray Tracing in Real-Time Applications (Games) Andrew Graff.

Rasterization and Ray Tracing in Real-Time Applications (Games) Andrew Graff.
Multi Agent Simulation and its optimization over parallel architecture using CUDA™ Abdur Rahman and Bilal Khan NEDUET(Department Of Computer and Information.

Multi Agent Simulation and its optimization over parallel architecture using CUDA™ Abdur Rahman and Bilal Khan NEDUET(Department Of Computer and Information.
Brook for GPUs Ian Buck, Tim Foley, Daniel Horn, Jeremy Sugerman, Kayvon Fatahalian, Mike Houston, Pat Hanrahan Stanford University DARPA Site Visit, UNC.

Brook for GPUs Ian Buck, Tim Foley, Daniel Horn, Jeremy Sugerman, Kayvon Fatahalian, Mike Houston, Pat Hanrahan Stanford University DARPA Site Visit, UNC.
Back-Projection on GPU: Improving the Performance Wenlay “Esther” Wei Advisor: Jeff Fessler Mentor: Yong Long April 29, 2010.

Back-Projection on GPU: Improving the Performance Wenlay “Esther” Wei Advisor: Jeff Fessler Mentor: Yong Long April 29, 2010.
1 ITCS 6/8010 CUDA Programming, UNC-Charlotte, B. Wilkinson, Jan 19, 2011 Emergence of GPU systems and clusters for general purpose High Performance Computing.

1 ITCS 6/8010 CUDA Programming, UNC-Charlotte, B. Wilkinson, Jan 19, 2011 Emergence of GPU systems and clusters for general purpose High Performance Computing.
ATI GPUs and Graphics APIs Mark Segal. ATI Hardware X1K series 8 SIMD vertex engines, 16 SIMD fragment (pixel) engines 3-component vector + scalar ALUs.

ATI GPUs and Graphics APIs Mark Segal. ATI Hardware X1K series 8 SIMD vertex engines, 16 SIMD fragment (pixel) engines 3-component vector + scalar ALUs.
Evolutions of GPU Architectures Andrew Coile CMPE220 3/2007.

Evolutions of GPU Architectures Andrew Coile CMPE220 3/2007.
Evolution of the Programmable Graphics Pipeline Patrick Cozzi University of Pennsylvania CIS 565 - Spring 2011.

Evolution of the Programmable Graphics Pipeline Patrick Cozzi University of Pennsylvania CIS Spring 2011.
Accelerating Machine Learning Applications on Graphics Processors Narayanan Sundaram and Bryan Catanzaro Presented by Narayanan Sundaram.

Accelerating Machine Learning Applications on Graphics Processors Narayanan Sundaram and Bryan Catanzaro Presented by Narayanan Sundaram.
GPGPU overview. Graphics Processing Unit (GPU) GPU is the chip in computer video cards, PS3, Xbox, etc – Designed to realize the 3D graphics pipeline.

GPGPU overview. Graphics Processing Unit (GPU) GPU is the chip in computer video cards, PS3, Xbox, etc – Designed to realize the 3D graphics pipeline.

Similar presentations

Ads by Google