1. John Demme Simha Sethumadhavan Columbia University

2. Meet Joe Joe Programmer (Chief) ‏ Smart

3. Joe Needs to Parallelize His Code PThreads? MPI? OpenMP? SSE? CUDA? FPGA? UPC? GPGPU? Multi-core? Transactional Memory? Erlang? Occam? Sisal? Shared Memory? SMP? CMP? NUMA? Cell Processor? Cloud Computing? StreamWare? Synchronization? Fortran? ???

4. Joe Wasn't Trained for This Advanced Programming I Final Exam Fall 2000 Question: Describe a deadlock situation. (2 pts)‏ When two threads are locked in a fight to the death?

5. Wouldn’t it be nice… If we had a system that would offer advice!  Suggest correct compiler optimizations to use  Provide custom code templates to start parallelization  Suggest “patterns” for code reorganization  Worked across different types of applications  Worked across different languages Traditional machine only automation  On going research and most desirable/ideal solution  High precision analysis hindered by ambiguity  Several engineering challenges

6. Alternative: Crowd sourcing Use collective intelligence to solve complex tasks Leverage growth of the Internet How does it apply to parallelization?

7. Database Guru UsersLearners DeveloperExpert Identifies the program to be parallelized; Identifies program hot-spots to be parallelized. Inputs a sequential program and highlights regions being parallelized Receives parallelization suggestions; modifies suggestions if necessary Inputs the corresponding parallel version Provides feedback on the usefulness of the suggestionProvides system information and required libraries for the optimization being entered User Interactions with COMPASS COMPASS System Expert “Ed”

8. Bogus Charts ` COMPASS Usage

9. Bogus Charts ` Physical Device Scaling Stops COMPASS Extends Moore's Law

10. COMPASS DB Mining COMPASS (the connection, at last)‏

11. COMPASS Usage Transistors per die Application Speed Power Efficiency Effects of COMPASS Usage (Another Bogus Chart)‏ `

12. COMPASS Owners make a fortune Gajillion Dollars

13. COMPASS Profits Chip Vendor Profits Chip Vendor and COMPASS Profits

14. 14 10% FFTs, 5% N-Body Simulations, 2% Neural Net Simulations, 15% PDE Solvers, 30% Garbage Collection Processor Unit, Phone Home!

15. I, For One, Welcome our Robotic Overlords

16. 16 2030 OSAKA, JAPAN: VIOLENCE BREAKS OUT AT COMPUTER ARCHITECTURE PROGRAM COMMITTEE MEETING

17. Evolution of the Architect 20092035 Bob's Career Expert Ed's: To join the COMPASS project please subscribe to: compass@lists.cs.columbia.edu URL: compass.cs.columbia.edu