© 2012 MELLANOX TECHNOLOGIES 1 Disruptive Technologies in HPC Interconnect HPC User Forum April 16, 2012.

Slides:

Advertisements

Similar presentations

KAIST Computer Architecture Lab. The Effect of Multi-core on HPC Applications in Virtualized Systems Jaeung Han¹, Jeongseob Ahn¹, Changdae Kim¹, Youngjin.

Advertisements

Virtualisation From the Bottom Up From storage to application.

Discussion of Infrastructure Clouds A NERSC Magellan Perspective Lavanya Ramakrishnan Lawrence Berkeley National Lab.

The Development of Mellanox - NVIDIA GPUDirect over InfiniBand A New Model for GPU to GPU Communications Gilad Shainer.

Advanced Virtualization Techniques for High Performance Cloud Cyberinfrastructure Andrew J. Younge Ph.D. Candidate Indiana University Advisor: Geoffrey.

The Who, What, Why and How of High Performance Computing Applications in the Cloud Soheila Abrishami 1.

Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape.

Virtualization in HPC Minesh Joshi CSC 469 Dr. Box Feb 1, 2012.

© 2011 VMware Inc. All rights reserved HPC Cloud Bad; HPC in the Cloud Good Josh Simons, Office of the CTO, VMware, Inc. IPDPS 2013 Cambridge, Massachusetts.

© 2008 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice In search of a virtual yardstick:

Efficient Cloud Computing Through Scalable Networking Solutions.

CON Software-Defined Networking in a Hybrid, Open Data Center Krishna Srinivasan Senior Principal Product Strategy Manager Oracle Virtual Networking.

A. Frank - P. Weisberg Operating Systems Structure of Operating Systems.

Virtualization for Cloud Computing

RDMA in Virtualized and Cloud Environments #OFADevWorkshop Aaron Blasius, ESXi Product Manager Bhavesh Davda, Office of CTO VMware.

Microsoft Virtual Academy Module 4 Creating and Configuring Virtual Machine Networks.

Flat or shrinking IT budgets even as business expectations increase. Efficient datacenter operations across entire customer base. Enterprise- class.

Virtualization Performance H. Reza Taheri Senior Staff Eng. VMware.

Measuring zSeries System Performance Dr. Chu J. Jong School of Information Technology Illinois State University 06/11/2012 Sponsored in part by Deer &

Virtualizing Modern High-Speed Interconnection Networks with Performance and Scalability Institute of Computing Technology, Chinese Academy of Sciences,

Yury Kissin Infrastructure Consultant Storage improvements Dynamic Memory Hyper-V Replica VM Mobility New and Improved Networking Capabilities.

Dual Stack Virtualization: Consolidating HPC and commodity workloads in the cloud Brian Kocoloski, Jiannan Ouyang, Jack Lange University of Pittsburgh.

INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 7 2/23/2015.

1 Advanced Storage Technologies for High Performance Computing Sorin, Faibish EMC NAS Senior Technologist IDC HPC User Forum, April 14-16, Norfolk, VA.

Virtual Machine Course Rofideh Hadighi University of Science and Technology of Mazandaran, 31 Dec 2009.

1 March 2010 A Study of Hardware Assisted IP over InfiniBand and its Impact on Enterprise Data Center Performance Ryan E. Grant 1, Pavan Balaji 2, Ahmad.

Towards a Common Communication Infrastructure for Clusters and Grids Darius Buntinas Argonne National Laboratory.

Improving Network I/O Virtualization for Cloud Computing.

An architecture for space sharing HPC and commodity workloads in the cloud Jack Lange Assistant Professor University of Pittsburgh.

© 2012 MELLANOX TECHNOLOGIES 1 The Exascale Interconnect Technology Rich Graham – Sr. Solutions Architect.

Microsoft Virtual Academy.

The NE010 iWARP Adapter Gary Montry Senior Scientist

CPS Welcome to a new licensing model in SPLA.

Gilad Shainer, VP of Marketing Dec 2013 Interconnect Your Future.

A Brief Intro to Virtualiztion. What is Virtualization? An abstraction Usually performed via software Many different types –Hardware –Software –Data –Network.

CON Software-Defined Networking in a Hybrid, Open Data Center Krishna Srinivasan Senior Principal Product Strategy Manager Oracle Virtual Networking.

Xen (Virtual Machine Monitor) Operating systems laboratory Esmail asyabi- April 2015.

Swapping to Remote Memory over InfiniBand: An Approach using a High Performance Network Block Device Shuang LiangRanjit NoronhaDhabaleswar K. Panda IEEE.

IM&T Vacation Program Benjamin Meyer Virtualisation and Hyper-Threading in Scientific Computing.

Enable Multi Tenant Clouds Network Virtualization. Dynamic VM Placement. Secure Isolation. … High Scale & Low Cost Datacenters Leverage Hardware. High.

Headline in Arial Bold 30pt HPC User Forum, April 2008 John Hesterberg HPC OS Directions and Requirements.

PARALLEL COMPUTING overview What is Parallel Computing? Traditionally, software has been written for serial computation: To be run on a single computer.

1 Public DAFS Storage for High Performance Computing using MPI-I/O: Design and Experience Arkady Kanevsky & Peter Corbett Network Appliance Vijay Velusamy.

Dynamic and Secure Application Consolidation with Nested Virtualization and Library OS in Cloud Kouta Sannomiya and Kenichi Kourai (Kyushu Institute of.

High Performance Network Virtualization with SR-IOV By Yaozu Dong et al. Published in HPCA 2010.

VIRTUAL MACHINES AND OPEN SOURCE SOFTWARE Installing multiple Operating Systems.

IT Pro Day Windows Server 2012 Hyper-V – The next chapter Michel Luescher, Senior Consultant Microsoft Thomas Roettinger, Program Manager Microsoft.

Hyper-V Performance, Scale & Architecture Changes Benjamin Armstrong Senior Program Manager Lead Microsoft Corporation VIR413.

No-Compromise Virtualization: Making Your Data Center Cloud Efficient, Scalable, and Flexible Michael Ramchand Platform Technical Director Oracle EMEA.

The Role of Virtualization in Exascale Production Systems Jack Lange Assistant Professor University of Pittsburgh.

Mellanox Connectivity Solutions for Scalable HPC Highest Performing, Most Efficient End-to-End Connectivity for Servers and Storage April 2010.

Rick Claus Sr. Technical Evangelist,

Full and Para Virtualization

iSER update 2014 OFA Developer Workshop Eyal Salomon

Virtualization One computer can do the job of multiple computers, by sharing the resources of a single computer across multiple environments. Turning hardware.

Mellanox Connectivity Solutions for Scalable HPC Highest Performing, Most Efficient End-to-End Connectivity for Servers and Storage September 2010 Brandon.

Performance Evaluation of Parallel Algorithms on a Computational Grid Environment Simona Blandino 1, Salvatore Cavalieri 2 1 Consorzio COMETA, 2 Faculty.

Network Virtualization Policy-Based Isolation QoS Performance Metrics Live & Storage Migrations Cross-Premise Connectivity Dynamic & Multi-Tenant.

Level 300 Windows Server 2012 Networking Marin Franković, Visoko učilište Algebra.

IT Pro Day Windows Server 2012 Hyper-V – The next chapter Michel Luescher, Senior Consultant Microsoft Thomas Roettinger, Program Manager Microsoft.

A Practical Evaluation of Hypervisor Overheads Matthew Cawood Supervised by: Dr. Simon Winberg University of Cape Town Performance Analysis of Virtualization.

Containers: Life Beyond Microservices? Sushil Kumar Robin Systems.

Enhancements for Voltaire’s InfiniBand simulator

Organizations Are Embracing New Opportunities

HPE SimpliVity 380 Our differentiated approach to hyperconvergence.

Versatile HPC: Comet Virtual Clusters for the Long Tail of Science SC17 Denver Colorado Comet Virtualization Team: Trevor Cooper, Dmitry Mishin, Christopher.

What’s New from Platform Computing

Presentation transcript:

© 2012 MELLANOX TECHNOLOGIES 1 Disruptive Technologies in HPC Interconnect HPC User Forum April 16, 2012

© 2012 MELLANOX TECHNOLOGIES 2 Why Virtualization in HPC?  High Performance Computing Single tasks across multiple CPUs  Traditional virtualization in enterprise Many tasks across multiple CPUs Workload consolidation on less machines Oversubscription of resources Operating System HPC App HPC App HPC App HPC App Operating System HPC App HPC App HPC App HPC App Virtualization Layer  Benefits of Virtual Clusters Efficient cluster management Snapshots (checkpoint/restart) Multi-tenant environments Live workload migration

© 2012 MELLANOX TECHNOLOGIES 3 High Performance Virtualization over SR-IOV  HCA shared among Guest OS’es Virtual Functions assigned to VM Physical Function controlled by Hypervisor  Complete RDMA software stack run in VMs  Very little throughput and latency overhead  Work in progress to support advance features such as live migration over SR-IOV VM VF PF InfiniBand HCA RDMA Stack VM RDMA Stack VM RDMA Stack Hypervisor

© 2012 MELLANOX TECHNOLOGIES 4 Co-Design Strategy for Scalable Computing Network Server/Storage Application Communication Libraries Network Server/Storage Application Communication Libraries Extension of I/O communications (RDMA, collectives, synchronization etc) Throughput Latency Message Rate Transport/Collective Offloads Bottlenecks MPI SHMEM/PGAS

© 2012 MELLANOX TECHNOLOGIES 5 ScableMPIScalableSHMEMScalableUPC Utilizing Co-Design – Mellanox ScalableHPC Mellanox Co-Design MXM - MellanoX Messaging FCA – Fabric Collective Accelerations

© 2012 MELLANOX TECHNOLOGIES 6 OpenMPI Benchmark Results with Accelerators

© 2012 MELLANOX TECHNOLOGIES 7 Collective Acceleration Results for OpenSHMEM

© 2012 MELLANOX TECHNOLOGIES 8 Thank You