OpenFabrics Developer Summit at SC06, Tampa Nov. 16,17

Slides:



Advertisements
Similar presentations
NSS 2008, Dresden, High Performance Event Building over InfiniBand Networks GSI Helmholtzzentrum für Schwerionenforschung GmbH
Advertisements

OFED TCP Port Mapper Proposal June 15, Overview Current NE020 Linux OFED driver uses host TCP/IP stack MAC and IP address for RDMA connections Hardware.
Uncovering Performance and Interoperability Issues in the OFED Stack March 2008 Dennis Tolstenko Sonoma Workshop Presentation.
OpenFabrics Enterprise Distribution for Windows 1 Stan C. SmithIshai RabinovitzEric Lantz 3/16/2010.
Windows Compute Cluster Server Overview and Update Paris OpenFabrics Workshop 2006 Xavier Pillons – Principal Consultant Microsoft.
RDS and Oracle 10g RAC Update Paul Tsien, Oracle.
Windows HPC Server 2008 Presented by Frank Chism Windows and Condor: Co-Existence and Interoperation.
Develop Application with Open Fabrics Yufei Ren Tan Li.
WRAP Technical Support System Project Update AoH Call October 19, 2005.
2006 Sonoma Workshop January 2006 Pre-Plugfest Interop Session Tuan Phamdo – Intel – Co-Chair IBTA CIWG Sujal Das - Director, SW Product Mgmt, Mellanox.
Improving the OFED Development Process.
Infiniband enables scalable Real Application Clusters – Update Spring 2008 Sumanta Chatterjee, Oracle Richard Frank, Oracle.
OFA Logo Program Developments #OFADevWorkshop Presented by Bob Noseworthy, Technical Sherpa University of New Hampshire’s InterOperability Laboratory (UNH-IOL)
New Direction Proposal: An OpenFabrics Framework for high-performance I/O apps OFA TAC, Key drivers: Sean Hefty, Paul Grun.
OFA-IWG - March 2010 OFA Interoperability Working Group Update Authors: Mikkel Hagen, Rupert Dance Date: 3/15/2010.
SRP Update Bart Van Assche,.
Discussing an I/O Framework SC13 - Denver. #OFADevWorkshop 2 The OpenFabrics Alliance has recently undertaken an effort to review the dominant paradigm.
IDC HPC Users Forum Spring 2009 Gilad Shainer, Mellanox Marketing Working Group On behalf of Bill Boas, Executive Director
Term 2, 2011 Week 3. CONTENTS The physical design of a network Network diagrams People who develop and support networks Developing a network Supporting.
OFED 1.x Roadmap & Release Process November 06 Jeff Squyres, Woodruff, Robert J, Betsy Zeller, Tziporet Koren,
Page 1 Overview of the OpenFabrics Alliance and OpenFabrics Enterprise Distribution (OFED™) Open Source, High Performance and High Efficiency Software.
Roland Dreier Technical Lead – Cisco Systems, Inc. OpenIB Maintainer Sean Hefty Software Engineer – Intel Corporation OpenIB Maintainer Yaron Haviv CTO.
OFA Interoperability Logo Program Sujal Das, April 30, 2007 Sonoma Workshop Presentation.
Early Experiences with NFS over RDMA OpenFabric Workshop San Francisco, September 25, 2006 Sandia National Laboratories, CA Helen Y. Chen, Dov Cohen, Joe.
OFA-IWG Interop Event March 2008 Rupert Dance, Arkady Kanevsky, Tuan Phamdo, Mikkel Hagen Sonoma Workshop Presentation.
1 March 2010 A Study of Hardware Assisted IP over InfiniBand and its Impact on Enterprise Data Center Performance Ryan E. Grant 1, Pavan Balaji 2, Ahmad.
Open Fabrics BOF Supercomputing 2008 Tziporet Koren, Gilad Shainer, Yiftah Shahar, Bob Woodruff, Betsy Zeller.
OFED for Linux: Status and Next Steps 1 Betsy Zeller (Qlogic), Tziporet Koren (Mellanox) 3/16/2010.
OFED 1.2 Lessons, 1.3 Planning and Field Support May 07 Tziporet Koren.
Boosting Event Building Performance Using Infiniband FDR for CMS Upgrade Andrew Forrest – CERN (PH/CMD) Technology and Instrumentation in Particle Physics.
2006 Sonoma Workshop February 2006Page 1 of (#) General Windows Update Gilad Shainer Mellanox Technologies Inc.
SIMPLE DOES NOT MEAN SLOW: PERFORMANCE BY WHAT MEASURE? 1 Customer experience & profit drive growth First flight: June, minute turn at the gate.
InfiniSwitch Company Confidential. 2 InfiniSwitch Agenda InfiniBand Overview Company Overview Product Strategy Q&A.
Windows 2000 Course Summary Computing Department, Lancaster University, UK.
2006 Sonoma Workshop February 2006Page 1 Sockets Direct Protocol (SDP) for Windows - Motivation and Plans Gilad Shainer Mellanox Technologies Inc.
© 2010 Voltaire Inc. HPCFS AT ORLANDO LUG 2011 BILL BOAS PATH FORWARD FOR LUSTRE COMMUNITY System Fabric Works.
OFED Interoperability NetEffect April 30, 2007 Sonoma Workshop Presentation.
OpenFabrics Windows Development and Microsoft Windows CCS 2003 Part1
Open Fabrics BOF Supercomputing 2008 Tziporet Koren, Gilad Shainer, Yiftah Shahar, Bob Woodruff, Betsy Zeller Rev. 0.9.
Remote Direct Memory Access (RDMA) over IP PFLDNet 2003, Geneva Stephen Bailey, Sandburst Corp., Allyn Romanow, Cisco Systems,
OFED - Status and Process November 2007 Tziporet Koren.
OFED Usage in VMware Virtual Infrastructure Anne Marie Merritt, VMware Tziporet Koren, Mellanox May 1, 2007 Sonoma Workshop Presentation.
IWARP Status Tom Tucker. 2 iWARP Branch Status  OpenFabrics SVN  iWARP in separate branch in SVN  Current with trunk as of SVN 7626  Support for two.
OpenFabrics Enterprise Distribution (OFED) Update
Windows OpenFabrics (WinOF) Update Gilad Shainer, Mellanox Technologies November 2007.
Open Fabrics BOF Supercomputing 2009 Tziporet Koren, Gilad Shainer, Yiftah Shahar, Stan Smith Hal Rosenstock, Jeff Squyres, DK Panda,
Open Fabrics BOF Tziporet Koren, Gilad Shainer, Yiftah Shahar, Bob Woodruff, Betsy Zeller.
InfiniBand at Sun Carl Hensler Distinguished Engineer Solaris Engineering Sun Microsystems.
OpenFabrics Interface WG A brief introduction Paul Grun – co chair OFI WG Cray, Inc.
Shawn Hansen Director of Marketing. Windows Compute Cluster Server 2003 Enable scientist and researcher to focus on Science, not IT. Mission: Enable scientist.
Open MPI OpenFabrics Update April 2008 Jeff Squyres.
Barriers to IB adoption (Storage Perspective) Ashish Batwara Software Solution Architect May 01, 2007.
OFA-IWG Interop Event April 2007 Rupert Dance Lamprey Networks Sonoma Workshop Presentation.
Datacenter Fabric Workshop NFS over RDMA Boris Shpolyansky Mellanox Technologies Inc.
Sockets Direct Protocol for Hybrid Network Stacks: A Case Study with iWARP over 10G Ethernet P. Balaji, S. Bhagvat, R. Thakur and D. K. Panda, Mathematics.
Sonoma Workshop 2008 Introduction Jim Ryan, ChairBill Boas, Vice-Chair
OpenFabrics Developers Summit SC06 QoS Update and Implementation RFC Eitan Zahavi, Mellanox Technologies Nov 2006.
Progress in Standardization of RDMA technology Arkady Kanevsky, Ph.D Chair of DAT Collaborative.
Sonoma Workshop April 30-May 2 Welcome Logistics and Agenda Review of the Alliance Goals of the Workshop.
Intel MPI OFA Experience Sean Hefty (don’t shoot the messenger)
SC’13 BoF Discussion Sean Hefty Intel Corporation.
Advisor: Hung Shi-Hao Presenter: Chen Yu-Jen
Enhancements for Voltaire’s InfiniBand simulator
Joint Techs Workshop InfiniBand Now and Tomorrow
Introduction of Week 3 Assignment Discussion
OpenFabrics Alliance An Update for SSSI
OFED 1.2 Status and Contents
Application taxonomy & characterization
Presentation transcript:

OpenFabrics Developer Summit at SC06, Tampa Nov. 16,17 Bill Boas, Sujal Das, Matt Leininger, Hal Rosenstock, Tom Tucker, Johann George, Bob Woodruff, Pramod Srivatsa

Strawman Agenda Strawman Agenda Thursday Nov 16 Room 17 see attached Tampa Convention Center layout 13.30 Introductions of Attendees and Roles, Process, Agenda, Goals, timelines, etc… 14.00 Share OFED ( Linux and Windows) experience from customers, IB vendors, OEMs 14.45 Break 15.00 Overview feature list and developers for OF-Linux Rel. 2.O – IB and iWARP together 17.00 Overview feature list and developers for OF-Windows Rel. 2.0 18.00 Processes for development, engineering test, bug fix and commit to OF trunk 18.30 Working Supper 19.30 – 21.00 Component by component review of features, task sizing, time requirements along with prioritization and strawman assignment to developers so as to produce an ordered list of features and an assessment/estimate of commitment for the items that are candidates to be included in Release 2.0 development for both Linux and Windows. Friday November 17 Room13 Tampa Convention Center, 08.00 Breakfast 08.30 Continue Component Review as described above until 10.00 Break 10.30-12.00 Complete the ordered list, “draw the line”, finalize developer assignments. 12.00-13.00 Working Lunch 13.00-13.30 Development, engineering test, bug fix, commit and documentation for Rel 2.0 13.30-14.30 OF-OFED handoff and OFED-EWG testing processes review and update etc. 14.30-15.00 OFED 1.x feature road map till OFED 2.0 15.00-15.15 Break 15.15-16.00 Customer, IB Vendor and OEM feedback and contribution discussion 16.00-16.30 Outstanding Issues and follow up activities, wrap-up.

Purposes of Meeting Identify the possible list of features that are candidate items for development for Release 2.0 of the OpenFabrics Stack (note this is not an OFED candidate list); Identify the developers/contributors/maintainers that are candidates to participate in the development team and their prerequisites before commitment to participate can be assured; Recognize these developers as the “OF Release 2.0 Developers Working Group” (OF 2.0 DWG) Allocate developer candidates to items agreed for development and “swag” timelines, engineering test procedures and other resources; Identify Alliance member product managers and customers who will participate in the item prioritization and inclusion process (which also needs to be agreed) Discuss and reach consensus on the agreed development item list, confirm responsible contributor/developer swagged timelines, level of engineering test and trunk commitment process Discuss and agree with the Enterprise Working Group (who are responsible for OFED 1.x and 2.x) the OFED candidate deposition and SVN branching process for OFED 2.0 Review and agree bug identification, logging in Bugzilla, assigning to developer and bug resolution for both DWG and EWG

Attendance Criteria & Company Commitment Meeting attendance is encouraged from OpenFabrics members and selected individuals that can contribute to the negotiation of and commitment to: 1) - the features and components of Release 2.0; 2) - the engineering processes and resources necessary to ensure that Release 2.0 is developed for hand-off to the EWG for OFED quality assurance; 3) – improving the OFED processes to assure that OFED 2.0 meets Enterprise quality and robustness criteria as well as HPC performance and feature requirements; 4) readiness for Interoperability testing. Companies and members participating need to send developers and product managers that can commit (at the meeting) company resources, developer’s time and effort and regression test suites and systems that can engineering test OF 2.0 so that every company believes meet its customers needs with 2.0 after the EWG has put it thru OFED and drop their proprietary competing software stacks. The paragraph above implies that companies must plan their participation and commitment in advance as well as interact with collaborating member companies to workout in advance a strawman division of feature commitment, responsibilities and resources. Linux distros, ISVs Tier 1 and 2 OEMs and Customers who are invited to participate should also understand that they will be expected to participate in detailed technical implementation discussion and prioritization of features. Participation in this meeting is also an indication by the customer that significant testing will be done by qualified customer personnel utilizing significant customer resources sufficient to contribute to the enterprise readiness of OFED 2.0 when it is released

Suggested Attendees Current Developers/Contributors/Maintainers Additional Developers and Contributors particularly from iWARP and Storage communities Engineering and Product Managers from Member companies as well as VPs Make effort to get planning participation from Dell, HP, IBM, Sun, Appro, Linux Networx, PANTA, Rackable, Tyan, LSI Logic, DDN, Novell, Redhat, Oracle, NetApp Designated representatives from XWG, IPWG, EWG, IWG and HSIR (add Oil and Gas, Mfg, EDA, ISVs,etc. to Wall St.) Special Effort to invite participation by qualified European and Asian attendees at SC, e.g. IBM Germany, CEA, HLRS, Bull, CERN, Fujitsu, NEC, Hitachi

Apps & Access Methods for using OF Stack OpenFabrics Software Stack SA Subnet Administrator MAD Management Datagram SMA Subnet Manager Agent PMA Performance Manager Agent IPoIB IP over InfiniBand SDP Sockets Direct Protocol SRP SCSI RDMA Protocol (Initiator) iSER iSCSI RDMA Protocol (Initiator) RDS Reliable Datagram Service UDAPL User Direct Access Programming Lib HCA Host Channel Adapter R-NIC RDMA NIC Application Level IP Based App Access Sockets Based Access Various MPIs Block Storage Access Clustered DB Access Access to File Systems Diag Tools Open SM User Level MAD API UDAPL User APIs InfiniBand OpenFabrics User Level Verbs / API iWARP R-NIC User Space SDP Lib Kernel Space Upper Layer Protocol IPoIB SDP SRP iSER RDS NFS-RDMA RPC Cluster File Sys Connection Manager Abstraction (CMA) Mid-Layer SA Client MAD SMA Connection Manager Connection Manager Kernel bypass Kernel bypass InfiniBand OpenFabrics Kernel Level Verbs / API iWARP R-NIC Provider Hardware Specific Driver Hardware Specific Driver Key Common Apps & Access Methods for using OF Stack InfiniBand Hardware InfiniBand HCA iWARP R-NIC iWARP

Linux Components and Maintainers (and Most Active Participant) Chief maintainer Roland Dreier (Cisco) Core Sean Hefty (Intel), Roland Dreier (Cisco), Hal Rosenstock (Voltaire) IB drivers - mthca Roland Dreier (Cisco), Michael Tsirkin (Mellanox) IB drivers – iPath Bryan O’Sullivan (QLogic), Robert Walsh (QLogic) IB drivers - eHCA Hoang-Nam Nguygen (IBM), Marcus Eder (IBM), Christoph Raisch (IBM) ULPs – IPoIB ULPs – SRP Roland Dreier (Cisco), Ishai Rabinovitz (Mellanox), Madhu Lakshmanan (SilverStorm) ULPs – iSER Or Gerlitz (Voltaire), Erez Zilber (Voltaire) ULPs - NFSoRDMA Tom Talpey (NetApp) ULPs – Lustre NAL Eric Barton (Cluster File Systems)

Linux Components and Maintainers (and Most Active Participant) ULPs – SDP Michael Tsirkin (Mellanox) ULPs – RDS Zach Brown (Oracle) ULPs – VNIC Ramachandra K (SilverStorm) OpenMPI Jeff Squyres (Cisco), Gleb Natapov (Voltaire) MVAPICH DK Panda (OSU) ULPs - uDAPL Arlin Davis (Intel), James Lentini (NetApp) OpenSM Hal Rosenstock (Voltaire), Eitan Zahavi (Mellanox) DIagnostics iWARP Tom Tucker (Open Grid Computing), Krishna Kumar (IBM), Venkata Jagana (IBM)

Verbs Provider Library Windows Architecture Applications Winsock Socket Switch WinSock Provider MPI2* IPoIB NDIS TCP/UDP/ICMP IP User Windows Applications OF Windows Hardware * Windows Compute Cluster Server 2003 ** Will be available in the future SDP** SDP SPI** WSD SAN Provider Management Tools HCA Hardware Access Layer Verbs Provider Driver Verbs Provider Library Access Layer Library Kernel Bypass SRP Miniport StorPort VNIC** Kernel

Windows Components & Maintainers Bus Drivers/Access Layer Yossi Leybovich (Mellanox) HCA driver Leonid Keller (Mellanox) IPoIB Winsock Direct Provider* Tzachi Dar (Mellanox) SRP Initiator** Alex Estrin (SilverStorm), Yossi Leybovich (Mellanox) SDP*** ? OpenSM Eitan Zahavi (Mellanox) uDAPL -- VNIC*** Alex Estrin (SilverStorm) * Not available on Windows XP ** Not available on Windows XP 32 bits *** Will be available in the future

Candidate Component and Feature Description iWARP integration Windows interoperability IPoIB Connected mode Bonding NAPI SDP zcopy netstat AIO uDAPL 2.0 provider for OpenFabrics (Note these are placeholders to get the real list started by contribution from the attendees before the meeting)

Candidate Component and Feature Description Node Description changed trap support Event subscriptions and event handling support Performance Manager Quality of Service Other HA, performance, and scalability enhancements Additional IBA 1.2 verb support Some IB routing support (enablement) Asynchronous get_user_pages ? Tools Other PathForward stage 3 items ? (Note these are placeholders to get the real list started by contribution from the attendees before the meeting)