Intel MPI OFA Experience Sean Hefty (don’t shoot the messenger)

Slides:



Advertisements
Similar presentations
© 2003 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice Performance Measurements of a User-Space.
Advertisements

Software & Services Group PinPlay: A Framework for Deterministic Replay and Reproducible Analysis of Parallel Programs Harish Patil, Cristiano Pereira,
Uncovering Performance and Interoperability Issues in the OFED Stack March 2008 Dennis Tolstenko Sonoma Workshop Presentation.
OpenFabrics Enterprise Distribution for Windows 1 Stan C. SmithIshai RabinovitzEric Lantz 3/16/2010.
Performance Analysis of Virtualization for High Performance Computing A Practical Evaluation of Hypervisor Overheads Matthew Cawood University of Cape.
RDS and Oracle 10g RAC Update Paul Tsien, Oracle.
Exploring Improvement to Verbs Tom Stachura, OFA TAC Co-chair #OFADevWorkshop.
MPI and RDMA Yufei 10/15/2010. MPI over uDAPL: abstract MPI: most popular parallel computing standard MPI needs the ability to deliver high performace.
Improving the OFED Development Process.
New Direction Proposal: An OpenFabrics Framework for high-performance I/O apps OFA TAC, Key drivers: Sean Hefty, Paul Grun.
OFA-IWG - March 2010 OFA Interoperability Working Group Update Authors: Mikkel Hagen, Rupert Dance Date: 3/15/2010.
Discussing an I/O Framework SC13 - Denver. #OFADevWorkshop 2 The OpenFabrics Alliance has recently undertaken an effort to review the dominant paradigm.
IDC HPC Users Forum Spring 2009 Gilad Shainer, Mellanox Marketing Working Group On behalf of Bill Boas, Executive Director
OFED 1.x Roadmap & Release Process November 06 Jeff Squyres, Woodruff, Robert J, Betsy Zeller, Tziporet Koren,
OpenFabrics 2.0 Sean Hefty Intel Corporation. Claims Verbs is a poor semantic match for industry standard APIs (MPI, PGAS,...) –Want to minimize software.
Roland Dreier Technical Lead – Cisco Systems, Inc. OpenIB Maintainer Sean Hefty Software Engineer – Intel Corporation OpenIB Maintainer Yaron Haviv CTO.
OFA Interoperability Logo Program Sujal Das, April 30, 2007 Sonoma Workshop Presentation.
OFA-IWG Interop Event March 2008 Rupert Dance, Arkady Kanevsky, Tuan Phamdo, Mikkel Hagen Sonoma Workshop Presentation.
RDMA Stacks MOFED, OFED & Linux Kernel
Open Fabrics BOF Supercomputing 2008 Tziporet Koren, Gilad Shainer, Yiftah Shahar, Bob Woodruff, Betsy Zeller.
OFED for Linux: Status and Next Steps 1 Betsy Zeller (Qlogic), Tziporet Koren (Mellanox) 3/16/2010.
OFED 1.2 Lessons, 1.3 Planning and Field Support May 07 Tziporet Koren.
2006 Sonoma Workshop February 2006Page 1 of (#) General Windows Update Gilad Shainer Mellanox Technologies Inc.
The NE010 iWARP Adapter Gary Montry Senior Scientist
OpenFabrics 2.0 or libibverbs 1.0 Sean Hefty Intel Corporation.
VirtualBox What you need to know to build a Virtual Machine.
Slackware 9.1 Installation First prompt in the installation process.
OFI SW - Progress Sean Hefty - Intel Corporation.
uDAPL development Arkady Kanevsky – Network Appliance James Lentini – Network Appliance Arlin Davis – Intel.
Fabric Interfaces Architecture Sean Hefty - Intel Corporation.
OFED Interoperability NetEffect April 30, 2007 Sonoma Workshop Presentation.
OpenFabrics Windows Development and Microsoft Windows CCS 2003 Part1
Open Fabrics BOF Supercomputing 2008 Tziporet Koren, Gilad Shainer, Yiftah Shahar, Bob Woodruff, Betsy Zeller Rev. 0.9.
OFED - Status and Process November 2007 Tziporet Koren.
Scalable RDMA Software Solution Sean Hefty Intel Corporation.
OpenFabrics Enterprise Distribution (OFED) Update
Fabric Interfaces Architecture Sean Hefty - Intel Corporation.
Windows OpenFabrics (WinOF) Update Gilad Shainer, Mellanox Technologies November 2007.
Open Fabrics BOF Supercomputing 2009 Tziporet Koren, Gilad Shainer, Yiftah Shahar, Stan Smith Hal Rosenstock, Jeff Squyres, DK Panda,
Open Fabrics BOF Tziporet Koren, Gilad Shainer, Yiftah Shahar, Bob Woodruff, Betsy Zeller.
InfiniBand at Sun Carl Hensler Distinguished Engineer Solaris Engineering Sun Microsystems.
Server OEM Panel 1 Bob Souza, HP 15 March 2010 OFA Sonoma Workshop.
IB Verbs Compatibility
OpenFabrics Developer Summit at SC06, Tampa Nov. 16,17
Open MPI OpenFabrics Update April 2008 Jeff Squyres.
OFA-IWG Interop Event April 2007 Rupert Dance Lamprey Networks Sonoma Workshop Presentation.
Mellanox Connectivity Solutions for Scalable HPC Highest Performing, Most Efficient End-to-End Connectivity for Servers and Storage September 2010 Brandon.
OpenFabrics 2.0 rsockets+ requirements Sean Hefty - Intel Corporation Bob Russell, Patrick MacArthur - UNH.
HPC pilot code. Danila Oleynik 18 December 2013 from.
Open Fabrics Interfaces Software Sean Hefty - Intel Corporation.
InfiniBand Routing in OFA Jason Gunthorpe – Obsidian Sean Hefty – Intel Hal Rosenstock – Voltaire.
SC’13 BoF Discussion Sean Hefty Intel Corporation.
Robert Horn, Agfa Healthcare
Fabric Interfaces Architecture – v4
Chapter 4 Threads.
Joint Techs Workshop InfiniBand Now and Tomorrow
Rob Davis, Mellanox Ilker Cebeli, Samsung
OpenFabrics Alliance An Update for SSSI
OFED 1.2 Status and Contents
5.6 Real-World Examples of ISAs
HPCC Mid-Morning Break
X10 Future Plans & Discussion
Warmup:Solve for y.
Application taxonomy & characterization
Ашық сабақ 7 сынып Файлдар мен қапшықтар Сабақтың тақырыбы:
Windows басқару элементтері
Қош келдіңіздер!.
Информатика пән мұғалімі : Аитова Карима.
Quality Control for Next Gen Cataloging Workflows
Presentation transcript:

Intel MPI OFA Experience Sean Hefty (don’t shoot the messenger)

2 Performance  OFA uDAPL is the best fit for Intel MPI  uDAPL within 10% of native verbs  Mellanox: 2.8 vs. 2.6 usecs  Qlogic: 4.5 vs 4.1 usecs  The results are NetPipe uDAPL vs. verbs

3 Usability  uDAPL compatibility required between Linux and Windows  Calling conventions must match  Interoperability testing needed  Need to know Endianess and size of keys  uDAPL requires IPoIB  Can we do without?

4 Usability  Improve connection scaling  Longer timeouts  Faster connection setup  Want fewer user controls settable only by root  Is there a way to speed up distros adoption rate?

5 uDAPL  uDAPL provider behavior differs from vendor to vendor  Intel MPI needs special treatment for each provider  Different interpretations of the DAT standard  iWarp: active side of connection must send the data first  Want support for uDAPL 2.0 spec with 1.x compatible library