Program Update Presented by Larry Davis, Deputy Director September 2009 Department of Defense High Performance Computing Modernization Program

HPC Forum Briefing – l. Davis Outline Introduction Program Structure  HPC Centers  Networking  Software Applications Support  Resource Management Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis HPC Modernization Program Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis Solving the hard problems... HPC Modernization Program Goals 5/4/

HPC Forum Briefing – l. Davis A Quick History Program initiation — 1992–1993  HPC Modernization Plan  Initial program structure established, S&T  Initial HPC capabilities provided  HPCMP established as an ACAT1 Program formalization — 1994–1995  Program office established  DoD oversight process implemented  Program structure and customer base expanded, include T&E Major acquisitions — 1995–1996  Four major shared resource centers  Defense Research and Engineering Network (DREN)  Programming Environment and Training (PET) contract established Operations focus — 1997–2000  Continuous upgrades at HPC centers  Selection of new distributed centers (DCs)  DoD Challenge Projects established Major contract awards — 2001–2003  DREN contract awarded  HPC Centers contract awards  New PET contract awarded Operations focus — 2003–2006  New DHPIs, Institutes and Portfolios selected  Capability Applications Project (CAPs) established  Minority Undergraduate Education and Research Initiative established  Value to the DoD study–Return on Investment (ROI) project Major contracts & expansion — 2007–2009  Next Generation Technical Services (NGTS) contract awarded  New DHPIs, Institutes and Portfolios selected  Computational Research and Engineering Acquisition Tools and Environments (CREATE) program initiated  New PET 3 contract awarded  New archival storage contract awarded Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis Solving the hard problems... DoD HPC Modernization Program 6/ Army HPCMP Participation ARL & ERDC DSRCs 1,309 Users/22 Organizations/102 Projects 56 DREN Sites 14 Challenge Projects/2 DHPIs 5 Institutes Navy HPCMP Participation NAVY DSRC 1,031 Users/16 Organizations/198 Projects 38 DREN Sites 12 Challenge Projects/3 DHPIs 1 Institute Air Force HPCMP Participation AFRL & MHPCC DSRCs 1,361 Users/24 Organizations/175 Projects 24 DREN Sites 12 Challenge Projects/5 DHPIs 3 Institutes Defense Agencies Participation DARPA, DTRA, JFCOM, MDA, PA&E & OTE 644 Users/4 Organizations/21 Projects 35 DREN Sites 3 Challenge Projects Other ARSC ADC 68 DREN Sites 1 DHPI

HPC Forum Briefing – l. Davis DoD Supercomputing Resource Centers (DSRCs) Six Large HPC Centers Solving the hard problems... 5/7/

HPC Forum Briefing – l. Davis Solving the hard problems... DoD Supercomputing Resource Centers (DSRCs) FY09 Capability As of: July 2009 LocationSystem Processors (Cores) Memory (GB) Capacity (Habus) AFRL HP Opteron Cluster SGI Altix Cluster SGI Altix ,048 9,216 4,096 3,584 20, ARL Linux Networx Cluster Linux Networx Cluster (Classified) Cray XT5 (Classified) SGI Altix ICE 8200 SGI Altix ICE 8200 (Classified) 4,528 3,464 10,540 11,384 7,088 8,976 6,736 40,128 34,152 21, ARSC SUN x4600 Cray XT5 2,320 3,504 9,280 14, ERDC Cray XT3 Cray XT4 SGI Altix ICE ,320 8,760 16,160 16,640 17,696 48, MHPCC Dell PowerEdge 19555,12010,24061 NAVY IBM 1600 Power5 Cluster IBM 1600 Power5 Cluster (Classified) Cray XT5 IBM Power 6 3,072 1,920 12,872 5,312 6,144 3,840 26,592 8, Total117,676301,5601,822 FY09 HPC Systems shown in GREEN FY08 HPC Systems shown in RED FY07 HPC Systems shown in BLUE Older HPC Systems shown in BLACK Solving the hard problems... 7/13/

HPC Forum Briefing – l. Davis TI-09 Installation Status Rackable’s recent purchase of SGI’s assets included all HPCMP contracts – TI-09 systems on track for delivery as scheduled New SGI remains committed to delivering the new system and maintaining existing system Solving the hard problems... ARL – Classified SGI Altix ICE 8200  6,656 core (169 HABUs)  Final acceptance September 18, 2009 ARL – Unclassified SGI Altix ICE 8200  10,752 core (271 HABUs)  Final acceptance late September 2009 ERDC – Unclassified SGI Altix ICE 8200  15,360 core (385 HABUs)  Final acceptance October 2, /3/

HPC Forum Briefing – l. Davis HPC Installations (TI-01 through 09) Added HPC Capability Trend (DSRCs Only) + 30% /3/ Solving the hard problems...

HPC Forum Briefing – l. Davis Performance Increases Come from Both Processor Improvement and Processor Count 8/3/ Solving the hard problems... Implication: Need Software Applications that Scale to 1,000s of Processors

HPC Forum Briefing – l. Davis Next Generation Technical Services Support (NGTS) Contract HPC Center’s Technical Services Support contract provides 30–50 FTEs per Center  Technical Expertise Customer Support System and Network Administration Application/System Performance Analysis Expansion Analysis and Integration Services Operators and Operations Support Outreach  Acquisition Vehicle for Small Purchases (ODCs) Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis NGTS (Continued) Attributes of Contract  One five year contract for four DSRCs Facilitates leveraging innovations and efficiencies across multiple DSRCs Does not include ARSC and MHPCC with the exception of support for the Consolidated Customer Assistance Center  Cost plus type contract with a fixed award fee pool and no base fee  Awarded to Lockheed Martin Information Systems (LMIS) in March 2008  $344M contract ceiling Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis Solving the hard problems... HPCMP Storage Initiative Computing power grows annually—so do stored files Archived data is hard for users to use and manage Costs: User time, labor, hardware, software and media Storage Initiative  Objective: Refresh to manage data for next 10 years  Goals: 10-year architecture Leverage advances in technology Improve user productivity Improve reliability & adaptability Sustain within current storage budget  Funding : Reserved 1/3 of FY09 investment dollars  Challenge: User awareness and behavior changes Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis HPCMP Data Storage Growth Single Copy Data Storage Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis Storage Lifecycle Management (SLM) Three Key Features  Utility Server to provide longer term near-line storage to store data for up to 30 days prior to archiving  Information Lifecycle Management (ILM) system to help user and system to associate important information with data  Establishment of a 10-year contract to facilitate predictable costs (possibly fixed) for data management software Acquisition  Software ILM software, archive software and development services Full and open competition RFP release in March 2009, award made in August 2009  Hardware Execute via NGTS Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis 10 years Storage Hardware Generation 1 Storage Hardware Generation 1 Storage Software Long-term Government Partnership with Industry Hardware Refresh Cycle HPCMP Storage Initiative Overall Acquisition Strategy Storage Hardware Generation 2 Storage Hardware Generation 2 Storage Hardware Generation 3 Storage Hardware Generation 3 Storage Hardware Generation 4 Storage Hardware Generation 4 Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis Storage Target Architecture Short-Term Storage SLM Medium-Term Storage ILM-Driven Long-Term Storage Tape ILM- managed File System Utility Server Archive Server Data Sharing with Other Centers Center Archive Cache DR Cache HPC SYSTEM A HPC File System A HPC File System B Remote Disaster Recovery Facility HPC SYSTEM B Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis User Interface Toolkit – API Solving the hard problems... Single Desktop Interface to Multiple HPC Systems Supports Novice to Expert Users Central Access to HPC Resources Custom Productivity Clients Complete Job Stream Management Fast Large File Transfers Secure Authentication UIT Making High Performance Computing Easy UITAPI 7/9/

HPC Forum Briefing – l. Davis Defense Research & Engineering Network (DREN) (pronounced: 'dē-ren) Solving the hard problems... 5/11/

HPC Forum Briefing – l. Davis DREN – Two Worlds HPCMP - Buy-In Customers Solving the hard problems HPCMP sites 111 Subscriber sites 6/9/

HPC Forum Briefing – l. Davis Software Applications Support Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis Solving the hard problems... HPC Software Applications Institutes 8/27/

HPC Forum Briefing – l. Davis Solving the hard problems... HPC Software Applications Institutes 8/27/

HPC Forum Briefing – l. Davis User Productivity Enhancement, Technology Transfer and Training (PET 3 ) Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis PET 3 Contract Award Update PET 3 was awarded to High Performance Technologies Inc. (HPTi) on July 31, 2009 to start September 1, 2009 Award amount ~$147 million over ten years The HPTi team is made up of major HPC groups around the country, including Texas Advanced Computing Center, Pittsburgh Supercomputing Center, San Diego Supercomputer Center, and 18 other partners One major feature is the combination of Computational Environment (CE) and Enabling Technologies (ET) into Advanced Computational Environments (ACE) Solving the hard problems... 8/27/

HPC Forum Briefing – l. Davis Computational Research and Engineering Acquisition Tools and Environments Solving the hard problems... 5/11/

HPC Forum Briefing – l. Davis Resource Management Solving the hard problems... 5/4/

HPC Forum Briefing – l. Davis Solving the hard problems... Customer Needs, Priorities, and Usage History Drive HPCMP Investments Detailed requirements information collected annually through web-based requirements survey (includes all projects) Requirements information refined through in-person interviews and quality checks Requirements validated by senior S&T and T&E executives in each Service and Agency 7/9/

HPC Forum Briefing – l. Davis Solving the hard problems... DoD Challenge Projects 7/24/

HPC Forum Briefing – l. Davis Dedicated HPC Project Investments Solving the hard problems... 8/27/

HPC Forum Briefing – l. Davis Solving the hard problems... Summary World-class corporate computing capability established for DoD HPC community High Performance Computing capabilities being employed to provide substantial contributions to DoD mission capabilities Successful transition to scalable, parallel computing Leveraging national, academic and federal activities 7/24/