SOS7 What will Cray do for Supercomputing in this Decade? Asaph Zemach Cray Inc

SOS7 – Durango, CO – March Page: 2 An Apology I am not Burton. Sorry. Where is Burton? Maybe? More likely…

SOS7 – Durango, CO – March Page: 3 What Have You Done For Me Lately? Cray MTA-2 –Accepted by NRL Sept ‘02 –UMA Shared Memory –Latency Tolerant: 128 contexts in processor. Red Storm for Sandia –Contract signed Oct ‘02 –10,000 AMD X86-64 –High Speed Network Cray X1 –FCS Dec 31, 2002 –Scalable vector MSPs –NUMA Shared Memory

SOS7 – Durango, CO – March Page: 4 Cray Products: The Near Future 2003 X GF 35GB/s/p mem BW 76GB/s/p cache BW End of ‘04 X1e Technology Upgrade Faster clock Denser Package Mix&Match with X X2 (Blackwidow) Bigger Faster Cheaper 2003 Red Storm (Development) End of ‘04 Red Storm (Install) Catamount LWK Linux service AMD 2GHz X Red Storm Product (?) Linux Service Compute OS? Synergy? I/O? Synergy? I/O?

SOS7 – Durango, CO – March Page: 5 Cray Products: Not So Near Future Shared Memory Locales –UMA, NUMA Heavy Weight Processors –Multi threading, Vectors, Streams PIM (LWP) 2006(?)2008(?)2010 Cascade X2e BIGGER FASTER CHEAPER X2f BIGGER!! FASTER!! CHEAPER!!

SOS7 – Durango, CO – March Page: 6 SW Controlled Data Cache SW Controlled Data Cache Cascade Locale Heavy Weight Proc Vector MT Streams Heavy Weight Proc Vector MT Streams Multithreaded PIM DRAM Multithreaded PIM DRAM Multithreaded PIM DRAM Multithreaded PIM DRAM Multithreaded PIM DRAM Multithreaded PIM DRAM Locale Interconnect Locale Interconnect Router To other Locales Multithreaded PIM DRAM Multithreaded PIM DRAM Multithreaded PIM DRAM Multithreaded PIM DRAM Multithreaded PIM DRAM Multithreaded PIM DRAM

SOS7 – Durango, CO – March Page: 7 HWP Memory Generic Data Somewhat Localized Data Highly Localized Data Cascade: Lazy Localization Initially all data is considered generic – equally far from everywhere. To improve performance stage generic data near HWP that manipulates it. To improve performance even more, partition data between PIMS. All data always universally accessible but performance varies.

SOS7 – Durango, CO – March Page: 8 Cascade: Software Investigations Compiler controlled cache Compartmentalized OS-es –Introspection using PIM Relative Debugging Abstract locales: virtualize locality management –What needs to be near what –What can/should be distributed (& how)

SOS7 – Durango, CO – March Page: 9 Cascade People Burton Smith David Callahan Steve Scott –Cray Thomas Sterling Larry Bergman Hans Zima –JPL, CalTech Jay Brockman Peter Kogge –Notre Dame Bill Daly –Stanford