Windows Compute Cluster Server 2003 Ming Xu Program Manager Windows HPC Microsoft Corporation

Linux is replacing Unix Windows market is growing HPC clusters more than 50% revenue, x64 dominates HPC Market Trend WW Clustered Servers Forecast Windows dominate the x86 server shipments

HPC Market Segments And Growths Capability, Enterprise $1M+ Divisional $250K–$1M Departmental $50–250K Workgroup <$50K 2004 Systems Sold (units) 1,167 3,915 22, ,802 Source: IDC, 2005 <$250K – 97% of systems, 52% of revenue In 2004 clusters grew 96% to 37% by revenue growth 4.2% 5.7% 2004 – 9 CAGR 7.7% 13.4% Administrator Power user IT organization Standalone Lab or cost center Operated By

Source – WW Server Forecast IDC, 2005, MS Analysis Opportunity Departmental and Workgroup segment is the under-represented majority “Takes too long to setup” “Hard to maintain and update” “Don’t integrate with end-user apps” Needs Customers require simple job submission and compute performance Administrators require simplified IT environment Developers require standards-based environment and advanced tools

How Microsoft Partners With The Industry Provide a complete Microsoft platform solution for HPC Enable rapid migration of ISVs to a standard, stable, and supported platform Differentiate by providing turnkey clusters that securely integrate into Windows infrastructure Integrate clusters into end user experience through application/desktop Focus on departmental/workgroup customers in targeted verticals Build deep expertise for Manufacturing, Geosciences, Life Sciences, and Federal Grow the HPC eco-system OEM and networking partners to sell pre-configured HPC clusters Collaborate with HPC cluster ISVs for each targeted verticals Establish credibility in the HPC community Engage Open Source projects and technologies in HPC stack Create world-wide Innovation Centers around top HPC researchers and practitioners

Windows Compute Cluster Server 2003 Mission: Deliver the easiest to deploy and most cost effective solution for solving scaled-out business, engineering and scientific computational problems += Windows Server 2003, Compute Cluster Edition Support for high performance hardware (x64bit architecture) Winsock Direct support for RDMA for high performance interconnects (Gigabit Ethernet, InfiniBand, Myrinet, and others) Compute Cluster Pack Support for Industry Standards MPI2 Integrated Job Scheduler Cluster Resource Management Tools Microsoft Windows Compute Cluster Server 2003 Integrated Solution out-of-the-box Leverages investment in Windows administration and tools Makes cluster operation easy and secure as a single system

How CCS Works User App MPI Node Manager Job Execution DB/FS User Cmd line Desktop App Job Mgr UI Admin Admin Console Cmd line Head Node Job Mgmt Resource Mgmt Cluster Mgmt Scheduling High speed, low latency interconnect Tasks Management Jobs Policy, reports Active Directory Data Input Domain\UserA

MPI Network Private Network Public Network Corporate IT Infrastructure Compute Node Head Node AD DNS DHCP Windows Update Monitoring MOM 3rd party Systems Management SMS 3rd party Compute Cluster Integrated Management Admin / User Cons RIS Job Scheduler MPI Management NAT Node Manager MPI Management Compute Node Node Manager MPI Management

Integrated Job Scheduling And Management Integrated Queue monitoring Integrated Node add/remove operations Integrated administrative command and job scheduling

Integrated Development / Debugging Head Node Compute Node Developer Computer Remote Debug SDK Head Node Compute Node Developer Computer Remote Debug SDK Remote Debug Developer Computer on a Cluster Node Developer Computer on a Corporate Network

Integrated Parallel Programming Message Passing Interface (MPI) Works in shared memory (single chassis) and cluster (multiple chassis) situations Requires moderate-advanced level of programming OpenMP Works in shared memory situations only – inside one physical chassis Easy to program – simply identify parallelizable loops with pragma’s

Technical Drill Down Simplified setup and deployment for OEM pre-installed clusters Simplified and reliable networking infrastructure support for parallel applications

Simple Deployment And Management Prescriptive, simplified cluster setup and administration Automated deployment and configuration Integration with existing Windows and management infrastructure Reduces setup time Requires less specialized skill set

End-To-End Deployment ADDNSDHCP ADDNSDHCP OEM Factory Existing Windows Install Procedure Customer Site Customer Site Deployment/Addition of Compute Nodes Deployment/Addition of Compute Nodes Opportunity for Professional Service Copy lay down the bits Connect Join Corporate AD Configure Build Network Topology

Copy What OEM does Reduce integration complexity by offering preconfigured systems Remove risks with patching by shipping with pre-installed hot-fixes Ensure hardware compatibility (BIOS settings) Reduces network configuration complexity by installing IB drivers at the factory Why is it easy Same OS 64bit Windows → no new cert required InfiniBand are logo’d Use current installation methods Dedicated TAM resources One source for tested and proven drivers for all hardware Copy lay down the bits

Connect What customer does Leverage AD for single sign-on and access to resources Enable secure and transparent file-sharing Leverage existing auditing and group policy already in place Integrate with existing Windows management infrastructure Why is it easy 80% enterprise have deployed AD Everything needed to implement the solution is included in CCS Leverage the breadth of skill set – no need to train specialists ADDNSDHCP Connect Join Corporate AD

Configure What customer does Save customer time on network hardware configuration Provide highly customizable network configuration options Simplified future expansion of the cluster (additional servers or hardware upgrade can be performed without re- building the nodes) Why is it easy Use network topology configuration wizard Automated building of application traffic to a particular network interconnect Configure Build Network Topology

Set Up And Deployment

Networking Challenges Proliferation of MPI Libraries Networking driver quality issues

Proliferation Of MPI Libraries Application MPIImplementations Interconnects OSDistributions KernelVersions

Customers As Integrators IT Manager’s application to node placement challenges How many OS X or OS Y nodes? What versions of the Kernel for node M? If application X has an MPI error, which vendor should I call for support? If application X drops Kernel version Y support, which nodes do I need to upgrade? If I remove a node for maintenance, what applications won’t be able anymore? MPICHLAM VendorNVendorNVendorNVendorN GigE IB Myrinet GigE Myrinet GigE Myrinet GigE IB RH SuSE RH SuSE RH SuSE RH SuSE RH SuSE RH SuSE RH SuSE RH SuSE GigE IB Myrinet GigE IB RH SuSE RH SuSE RH SuSE RH SuSE RH SuSE RH SuSE Application 1 Application 2 Application 3

CCS Brings Back The Sanity Use Winsock Direct for best performance (latency and throughput) and CPU efficiency Increased flexibility Increased utilization Target industry standard interconnect fabrics Gigabit Ethernet to minimize costs for a fast network InfiniBand for latency-sensitive and bandwidth-intensive applications MSMPI AnyInterconnect W2k3 WSD Application

MS MPI Leverages Winsock Direct Networking Hardware Virtual Bus Driver IP TCP User Host Channel Adapter Driver IB WinSock Provider DLL Miniport (GigE) Miniport (IPoIB) Kernel API (verbs based) User API (verbs based) Host Channel Adapter Driver GigE RDMA WinSock Provider DLL IHV-provided component OS component NDIS WinSock DLL IB w/ RDMA GigE w/ RDMA Ethernet User Mode Kernel Mode Switch traffic based on sub-net Manage hardware resources in user space (e.g., Send and receive queues) HPC Application MPI Winsock Switch

Windows Logo Program Testing For InfiniBand Background Driven by Windows Networking Team Available April 21, 2006 Details A test suite for WSD providers and IP over IB Miniport drivers Include functional test only (no code coverage) Signature covers networking only (no storage)

Call To Action Target departmental and workgroup cluster opportunities Pre-install CCS including hotfixes, drivers and licensing scheme Pre-test server and networking infrastructure Build innovative systems for personal and workgroup clusters Make sure your high speed interconnect drivers are logo’d

Resources Microsoft HPC Web site Windows Server x64 information Get the Facts Web site Windows HPC Community Windows Vista Logo Program hwrequirements.mspx hwrequirements.mspx

© 2006 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.