“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 1 Runnemede (Intel, Reservoir, ETI, UIUC, UD, UCSD) UHPC Disruptive Innovation Wilfred Pinfold Intel Labs. April, 2011

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 2 Outline Industry Trends UHPC Innovation Call to action

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 3 Efficiency Trend Mflops/Watt Trend

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 4 Complexity Trend Trend

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 5 Resiliency Trend Trend Time Between Failures

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 6 Power Improvements Required

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 7 Without Disruptive Innovation China takes the Exascale Prize November 15 th, 2018 China builds the first system to achieve a sustained Exaflop and once again takes first place on listing of the world’s Top 500 computers. This year’s results should not come as a surprise. China has been pouring investments into high performance computing for almost two decades and having taken the top slot with a system built from commercial parts in 2010 now has a system with it’s own accelerators. An official policy and strong funding commitment have propelled China from a technological backwater in 2001 when it did not have a single machine in the Top 500 into a supercomputing superpower. The first Exascale supercomputer employs 10 million custom accelerators that draw 200MW to achieve it’s target performance.

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 8 Outline Industry Trends UHPC Innovation Call to action

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 9 Efficiency Embrace Parallelism Improve execution efficiency Push efficiency at cost of complexity/ resiliency Use co-design techniques to target important workloads Manage Locality Improve memory efficiency Stop unnecessary movement (Cache) Programmable memory access Commercial Commercial Commercial

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 10 Complexity New Programming Tools Separate dependencies from implementation (CnC) Provide placement patterns (HTA) Gentle Ramp (Software crutches) Fine Grain Event Driven Execution Scheduler to remove configuration dependencies Execution feedback to optimize performance Power management to enable over provisioning Commercial Commercial

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 11 Resiliency Self Aware Highly instrumented silicon and system Fine grain control of voltage by function/region Adjustable voltage for optimum reliability Hardware Error Detection software correction Pick a fault model and let evolve (we have control) Parity everywhere Robust system oversight through hardware isolation Local state capture local recovery Commercial Commercial Commercial Commercial

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 12 Efficiency Trend Mflops/Watt Trend UHPC

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 13 Complexity Trend Trend UHPC

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 14 Resiliency Trend Trend UHPC

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 15 Power Improvements Required

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 16 With UHPC DARPA leads US government to Exascale November 15 th, 2018 The first system based on technology developed under the UHPC program achieves a sustained Exaflop and takes first place on the listing of the world’s Top 500 computers. While other countries pursued a bruit force approach to Exascale DARPA lead a program to establish a new more efficient, reliable and programmable approach to advanced computing. With a limited investment DARPA launched a program in 2010 that set a new path in research that made this strategically important achievement possible. The new system employs 800 million highly efficient execution cores drawing 20MW.

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 17 Outline Industry Trends UHPC Innovation Call to action

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 18 Opportunity We are proposing a new execution model! We are proposing a new programming model! To be successful This Group must lead

“This research was, in part, funded by the U.S. Government. The views and conclusions contained in this document are those of the authors and should not be interpreted as representing the official policies, either expressed or implied, of the U.S. Government.” 19 Now! Tools need to be developed Programmers need time to learn and adopt Mission planners need time to plan programs Without a usable proof of concept this summer nothing will change for 2018 To impact on system design we must have a proof of concept environment this summer