1. 22-02-2016 אלכס לנדסברג אשכול מערכות ממוחשבות בע ” מ

2. 2 תקשורת\ אחסון תקשורת\ אחסון תוכנה לתכנון מערכת אצווה\ ניהול רשיונות מערכת אצווה\ ניהול רשיונות חומרה לריצת המשימות חומרה לריצת המשימות

3. 3 Nehalem Blades Dual-IOH Multiple GPUs Single Nehalem SOHO server Nehalem Twin SystemsNehalem UIO systems Short-depth

4. 4

5. 5

6. Application Optimized Storage SSG-6027R-E1R12N SSG-6037R-E1R16N SSG-6047R-E1R24N SSG-6047R-E1R36N (Double Sided Storage) SuperStorage Servers: Dual Xeon capable motherboard 24x DDR3 Memory slots Hardware RAID 0, 1, 5, 6, 10, 50, 60 with optional BBU 4x open PCIe Gen 3.0 x16 expansion slots* RAID Adapter 10/IB Network Add PCIe Flash Solution 94%+ Platinum level redundant power JBOD expansion ports*

7. 7 Clusters OS – CentOS 6 -> 7 INFINIBAND OFED 20GBE -> 40GBE -> 56GBE -> 100GBE 10GBE/40GBE – SFP+ -> RJ45 Management - OSCAR -> xCAT (IPMI) Compilers – GNU + Intel MPI – OpenMPI, Platform MPI, Intel MPI, MVAPICH2 Storage – NFS 10GBE/IB, LUSTRE Batch – PBS (Torque/MAUI) -> SLURM WINE – Windows Emulator on Linux – RUN Windows over PBS IAI, Mabat, Malam, Rafael, IMI, BSEL,Technion, BIU, MOE, Israel Government

8. רשת מפעלי FO רשת מפעלי FO Mellanox40 GBE IB Switch 10GIGE Fibre Optics Cable 4 x GPU Cluster Corporate 10 GB Ethernet Gigabit Switch

9. רשת מפעלי FO רשת מפעלי FO Mellanox IB/10GBE Switch 16 DISK File Server 10GIGE Fibre Optics Cable 4 x GPU Cluster Corporate 10 GB Ethernet Gigabit Switch IB Cluster 10GBE Cluster

10. 10 BATCH - System You Installed your program Your network is 10GBE or IB The correct compilers and libraries are working Your MPI is working Your Storage is fast and ample enough Your monitoring and management is up and running It’s the WAY your batch/scheduling is setup that will make the difference It can add 30-40% to the effectiveness of your system

11. 11

12. 12 Storage OS – CentOS 5 and 6 or Windows 2008 R2 SuperMicro – 24/36/45 3.5” 108TB – 72/88 2.5” 144TB LSI 9265-8i + CacheCade (SSD Cache) LVM/XFS/EXT4\NTFS Infiniband 40/56 Gbit Adapter OFED – 1.5.4 (IB, TCP-IP, RDMA, OpenMPI) Storage – NFS over IB (RDMA)/NTFS - IB on Windows IAI, Malam, Mabat, Rafael, Israel Government, BSEL, IMI, BGU

13. MegaRAID SAS 9265-8i Eight internal SATA+SAS ports Two mini-SAS SFF-8087 x4 connectors MegaRAID SAS 9285-8e Eight external SATA+SAS ports Two mini-SAS SFF-8088 x4 connectors 6Gb/s throughput per port LSISAS2208 RAID-on-Chip (ROC) X2 800MHz PowerPC® Low-profile MD2 form factor (6.6” X 2.536”) x8 PCI Express 2.0 host interface 1GB DDRIII cache (1333MHz) Optional battery backup unit LSIiBBU09 with DDR III support Connect up to 240 SATA, SAS, SSD devices RAID levels 0, 1, 5, 6, 10, 50 and 60 SSD support with SSD Guard technology MegaRAID CacheCade, FastPath, Recovery and SafeStore software ready LSI Confidential Industry-Leading Performance LSI 2 nd 6Gb/s SATA+SAS MegaRAID Controllers

14. NFS – Server3 IP1 + IP2 + IP3 + IP4 Room for 33 disks IB- IP1 Copper Infiniband Cable NFS – Server 1 IP1 + IP2 IB- IP2 IB- IP3 IB- IP4 2 x Fibre Optics Cable 6metre MC2210310-010 NFS – Server 2 IP3 + IP4 Copper Infiniband Cable Mellanox Switches 2 x 4 Metre QSFP Cable MC2206128- 004

15. 15 Mellanox 56 Gbit/Sec HPC Cluster Metada Server CentOS 6.5 OSS - CentOS 6.5 Ubuntu Kernel 3.1.4 3 x OSS Total 180 Disks 0.5PB Formatted 56Gbit FDR 2+ GB/Sec/OST 6GB+ Overall

16. 16

17. 17

18. רשת מפעלי FO רשת מפעלי FO Mellanox IB Switch Defense HPC Cluster Production File Server IB Adapter TCP/IP + IB DRP Fileserver Corporate Ethernet Gigabit Switch 9micron FO cable 1 k”m Point to Point IB Connection IB Adapter TCP/IP + IB

19. 19

20. 20

21. IAI FULL BUSINESS-JET G150 DRAG PREDICTION NES CL=0.409 CD=382.4 counts WT: 382.7 counts (With Courtesy Dr Stephane Seror IAI Head Hypersonic R&D CFD branch)

22. BUSINESS-JET Flow Analysis OpenFOAM CL=0.409 CD=382.4 counts WT: 382.7 counts (With Courtesy Dr Stephane Seror IAI Head Hypersonic R&D CFD branch)

23. 23 Mellanox IB/10G Mellanox IB/10G אשכול בנית מערכות ותמיכה אשכול בנית מערכות ותמיכה EIMsys אינטגרטור לחומרה EIMsys אינטגרטור לחומרה Supermicro Systems Supermicro Systems OpenStorage

24. 24 תודה רבה Alex.Landsberg@eshkol.com.co Eshkol The Essence of Elegant Computing

25. THIS COULD BE YOU!!!!