Bev Bachmayer Software and Solutions group With special thanks to Matthew Wolf Georgia Technical Universitiy Pacifying the Pandora's Box of Parallelism: Intel's Curriculum Program for Multi-Core and Multithreaded Programming

Agenda Moving to massively parallel environment Intel Academic community

3 Today’s Processors Designed Within New Metrics Moore’s Law continues to be validated Multiple cores on-die has become the standard to deliver performance at reasonable power 10s and 100s of Cores will happen Intel Research Chip: 80 core Polaris Intel® Core™ 2 Duo (Merom, 65nm Process) L2 4 Cores L2 2 Cores Intel® Core™ 2 Duo (Penryn, 45nm Process)

4 10s and 100s of Cores – Becoming a Reality Core Cache 50% 65nm, 4 Cores 1V, 3GHz 10mm die, 5mm each core Core Logic: 6MT, Cache: 44MT Total transistors: 200M 10mm 45nm 8 Cores, 1V, 3GHz 3.5mm each core Total: 400MT 10mm 32nm 16 Cores, 1V, 3GHz 2.5mm each core Total: 800MT 10mm 22nm 32 Cores, 1V, 3GHz 1.8mm each core Total: 1.6BT 10mm 16nm 64 Cores, 1V, 3GHz 1.3mm each core Total: 3.2BT Note: the above pictures don’t represent any current or future Intel products

5 Where Are We Heading with Many Core? Pentium® II Architecture Pentium® 4 Architecture Pentium® Architecture Merom 1.E+06 1.E E+08 1.E+09 1.E+10 1.E+11 1.E+12 1.E+13 1.E+14 1.E Flops Pentium® III Architecture Tera Peta Giga Projected Multi/Many Core Performance Source: Intel Penryn (2H ’07)

6 SW “joins HW” to lead Performance 65nm process nm 20n m 45nm process nm process nm 22nm process nm Moore’s Law continues transistor density 2X every 24 months But… SW cannot “just” rely on increasing clock speeds Performance will come from Parallelism something new, a paradigm shift Biggest sea of change for software developers since the OOO (Out Of Order Machine) - Herb Sutter, Microsoft

7 Think Parallel something new, a paradigm shift Developers need to “Think Parallel (or perish)” - James Reinders, Intel We have achieved general awareness. Sequential applications do not result in continued performance improvement on future multi-core and many-core platforms. Developers have much to learn! Thinking Parallel Software shipping in 2007 have Quad-core processors available to utilize. What is the useful economic life for SW in this new HW reality? Could be run 16 core processors* in 2010 – is it ready today for a 3 year lifespan? *assumes doubling of cores every 2 years, start with 4 cores in 2006

8 processor cores We have a future ahead with where Processors have more and more cores. CHALLENGE: UNLOCKING THIS TREMENDOUS POWER USING SOFTWARE Think Parallel

9 processor cores software with very limited concurrency Aside from servers, concurrency is mostly outside applications today. Multiple tasks. Environment. Limited concurrency. Think Parallel

10 software with very limited concurrency processor cores Emerging Step are being made today to put concurrency in more software development. Learning to THINK PARALLEL, New methods to use, New methods to explore. Think Parallel

11 software with very limited concurrency processor cores Emerging WE KNOW SOFTWARE DEVELOPERS NEED TO LEARN THIS NEW WORLD IN ORDER TO COMPETE Think Parallel

12 software with very limited concurrency processor cores Emerging Research We already see a future with even more cores. Research today is critical to leading us into the future. Think Parallel

13 What advice we have CS Educators Teach students to think parallel. Help them answer these questions: 1.How will it scale to N processors? 2.How are new correctness issues addressed? 3.How maintainable is the solution we create? Future developers 1.Learn to THINK PARALLEL. 2.Approach all problems looking for parallelism (not step-by- step sequential methods) 3.Use tools designed for concurrent programming. 4.Program to tasks (chores), never threads. Do not use raw threading packages. 5.For debugability, create programs which can be debugged in a single-threaded mode. 6.Minimize explicit synchronization. 7.Use scalable memory allocation. 8.Plan to scale workloads.

14 What we are doing to help Help mainstream programmers to quickly develop quality codeResearchTomorrow’sTechniquesTransactionalMemory SpeculativeMulti-threading Educate Tomorrow’s Experts Helped 45 universities add parallel programming courses Helped 45 universities add parallel programming courses univ students univ students 2008 reaching out to univ2008 reaching out to univ Intel Academic Community ACCELERATE TRANSITION TO PARALLEL PROGRAMMING ProvideToolsToday Architect, Thread, Debug & Tune

Intel ® Academic Community Get Involved! Connect with peers & technologists Access new technology curriculum Lead global discussion forums Share your knowledge! –Join the discussions in the forums –Give your opinions in the blogs –Add your content to the Wiki –Comment on what you are viewing

Join the Intel® Academic Community Forums!  Share your knowledge  Connect with peers  Meet the technologists Join the Intel® Academic Community Forums!  Share your knowledge  Connect with peers  Meet the technologists Do you have an opinion?  How is parallel programming becoming easier?  Many problems can be parallelized as both task and domain decomposition. What types of problems can be parallelized by only one of these methods, but not another? Want to know more about potential parallelism?  Read “Recognizing Potential Parallelism” for the technologist’s point of view. (Available online at the Intel® Academic Community.) Do you have an opinion?  How is parallel programming becoming easier?  Many problems can be parallelized as both task and domain decomposition. What types of problems can be parallelized by only one of these methods, but not another? Want to know more about potential parallelism?  Read “Recognizing Potential Parallelism” for the technologist’s point of view. (Available online at the Intel® Academic Community.)

University Program Supporting Your Curriculum Needs New technology curriculums developed specifically for the needs of the academic community Access to course downloads Obtain the latest Intel® Software Development Products for your classroom Become a member today!

Intel Academic Community – Academic Community Collaborating Worldwide In 51 countries around the world In 51 countries around the world, at more than 460 Universities 800 professors are teaching more than new software professionals Multi-core programming

What are the Universities saying? “The change to multi-core means a re-emphasis on concurrency and parallelism… It's an interesting challenge for us to educate students in that direction. Whether they build gaming applications, vision applications, robotics applications or traditional applications in the high performance domain, they have to always think parallel. That renewed emphasis in understanding parallelism is important to impart to our students.” Professor Karsten Schwan, College of Computing, Georgia Institute of Technology

Intel University Program provides: Recipe for Success Courseware to drop into existing courses Continual technology updates Free Intel® Software Development Tools licenses for the classroom Wiki and blog for collaboration, Forums for specific questions Courseware to drop into existing courses Continual technology updates Free Intel® Software Development Tools licenses for the classroom Wiki and blog for collaboration, Forums for specific questions  

Implementing a parallel curriculum

Summary Visit Intel at booth 317 academiccommunity.intel.com Register for the Intel Academic community

Intel and the Intel logo are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. *Other names and brands may be claimed as the property of others. EUR: Tech U Munich, ETH Zurich, U Politecnica de Catalunya, RWTH Aachen, U Karlsruhe, Budapest Polytechnic Institute

Bev Bachmayer Intel University Program Manager Software and Solutions Group March 14, 2007 Parallelism