“SMT Capable CPU-GPU Systems for Big Data” WSU Analytics and Big Data Meet Up ~ April 3, 2017 “SMT Capable CPU-GPU Systems for Big Data” http://webs.wichita.edu/?u=eecs&p=/faculty/abu/ Less than seven minutes, a lot to say/prove… huge pressure! I’ll start with explaining my title… “SMT Capable CPU-GPU Systems for Big Data” Next presenter, please come start when it is your time… Dr. Zaman; WSU-5261

“SMT Capable CPU-GPU Systems for Big Data” WSU Analytics and Big Data Meet Up “SMT Capable CPU-GPU Systems for Big Data” WSU – Wichita State University SMT – Simultaneous Multi-Threading CPU – Central Processing Unit GPU – Graphics Processing Unit CPU CPU Pure Harvard Architecture Von Neumann Arch A Computer System Name of the Game: performance, energy consumption, cost, …

“SMT Capable CPU-GPU Systems for Big Data” WSU Analytics and Big Data Meet Up “SMT Capable CPU-GPU Systems for Big Data” WSU – Wichita State University SMT – Simultaneous Multi-Threading CPU – Central Processing Unit GPU – Graphics Processing Unit Compute Unified Device Architecture (CUDA) – a parallel computing platform and application programming interface (API) model created by Nvidia Time-Efficient Computing

“SMT Capable CPU-GPU Systems for Big Data” WSU Analytics and Big Data Meet Up “SMT Capable CPU-GPU Systems for Big Data” WSU – Wichita State University SMT – Simultaneous Multi-Threading CPU – Central Processing Unit GPU – Graphics Processing Unit SMT Capable CPU-GPU System Many-Core GPU Card A process is a running program. A process can generate many processes (called threads). … Multicore CPU Instruction Execution Intel Xeon Phi has up to 72 cores [http://www.intel.com/content/www/us/en/products/processors/xeon-phi/xeon-phi-processors.html] Nvidia Tesla K80 has up to 4992 cores [http://www.nvidia.com/object/tesla-k80.html]

“SMT Capable CPU-GPU Systems for Big Data” WSU Analytics and Big Data Meet Up “SMT Capable CPU-GPU Systems for Big Data” WSU – Wichita State University SMT – Simultaneous Multi-Threading CPU – Central Processing Unit GPU – Graphics Processing Unit Energy-Efficient Computing CL1 – Level-1 Cache CL2 – Level-2 Cache Cache and memory are very power-hungry. More energy consumption, more heat dissipation! CL1 CL2 Name of the Game: performance, energy consumption, cost, …

CPU-GPU Systems for Big Data WSU Analytics and Big Data Meet Up “SMT Capable CPU-GPU Systems for Big Data” A1,1 A1,2 CPU-GPU Systems for Big Data Matrix Multiplication (MM) 4 x 4 Matrix: (4^3) 64 multiplications 2 x 2 Matrix: (2^3) 8 multiplications Are we reducing #*s? (no) What is the message? For many 2 x 2 matrix solvers (with 8 MULT), it takes “only” 2 * 8 MULT time unit (6416?) Do we have many solvers/cores? (Yes, GPU) A B C

CUDA/MM for Graph Problems WSU Analytics and Big Data Meet Up “SMT Capable CPU-GPU Systems for Big Data” CUDA/MM for Graph Problems Number of paths of length 4 between C and J? 7 Row (# of paths of length 1) x Column (# of paths of length 3)  Column (# of paths of length 4) CUDA (parallel programming) improves performance. Length 3  Length 4  Length 1 

CAPPLab Research Activities WSU Analytics and Big Data Meet Up “SMT Capable CPU-GPU Systems for Big Data” CAPPLab Research Activities Research supported by Kansas NSF EPSCoR, Nvidia, CybertronPC, … Asaduzzaman, A., Chidella, K.K., Mitra, P., Islam, M.F., Cluff, K., Islam, A., and Saeed, K.A., “A Novel Image Conversion and Processing Technique for Analyzing Breast Cancer,” under review, IEEE Transactions on Medical Imaging, Vol. X, No. Y, 2017. CAPPLab earned top research designation (GPU Research Center) by Nvidia in 2015. Asaduzzaman, A., Gummadi, D., and Yip, C.M., “A Talented CPU-to-GPU Memory Mapping Technique,” in IEEE SoutheastCon 2014, Lexington, KY, March 13-16, 2014. Asaduzzaman, A., Yip, C.M., Kumar, S., and Asmatulu, R., “Fast, Effective, and Adaptable Computer Modeling and Simulation of Lightning Strike Protection on Composite Materials,” in IEEE SoutheastCon Conference 2013, Jacksonville, FL, April 4-7, 2013.

“SMT Capable CPU-GPU Systems for Big Data” WSU Analytics and Big Data Meet Up “SMT Capable CPU-GPU Systems for Big Data” WSU – Wichita State University SMT – Simultaneous Multi-Threading CPU – Central Processing Unit GPU – Graphics Processing Unit Dr. Zaman; WSU-5261