Moore’s Law Electronics 19 April 1965

Moore’s Original Data Gordon Moore Electronics 19 April 1965

Graph of Moore’s Law 11/01/2008EADS3

Graph of Moore’s Law – with MS 11/01/2008EADS4

Graph of Moore’s Law – with MS 11/01/2008EADS5 Human Intelligence

Memory bottleneck The CPU can add two numbers in less than one nanosecond. – If they are both in registers Putting a number from memory into a register takes about 100 nanoseconds. “Stall” – the CPU waits on memory. 11/01/2008EADS6

11/01/2008EADS7 Intel Haswell Size/speed 1K / 1 ns 128Kb / 5 ns 1 Mb / 20 ns 4 Gb /125 ns 1 Tb / 1 ms

GPU architecture GPUs have much less space devoted to cache. GPUs have multiple ( ) cores, which are simpler, slower processing units. GPU cores all perform the same instructions, but on different data. Not all the cores can be active at once. When one stalls, another one starts up. 11/01/2008EADS8

GPU and CPU: The Differences DRAM Cache ALU Control ALU DRAM CPU GPU More transistors devoted to computation, instead of caching or flow control Suitable for data-intensive computation High arithmetic/memory operation ratio

Intel Core i Ivy Bridge Processor:

11/01/2008EADS11