Parallel Extensions A glimpse into the parallel universe By Eric De Carufel Microsoft.NET Solution Architect at Orckestra

Who am’I? Eric De Carufel is solution architect at Orckestra Over 15 years experience in software development – Bell Canada, Centre de Recherceh d’emploi St-Denis, Fédération Québécoise de Karaté, AXA Canada Tech, Provigo (5 projects), Metro-Richelieu (2 projects), Imagina, Unipage, APLC, Viasystems, Montreal Jewish Hospital, AGTI, CCQ, Ogilvy Renault, Ivanhoé Cambridge, Microcell (Fido), Cirque du Soleil, TELUS, PSP Investment, CGI, Deutsche Bank, Orckestra, Sobeys, Jean-Coutu, Xtranormal Started with an ADAM computer by Coleco Working with.NET since version 1.0 My coworkers call me.NET Jedi

Agenda Introduction Overview Library Core TPL (Task Parallel Library) Parallel Linq (PLINQ) Parallel Data Structures Questions

Introduction Why do we have to bother? – Moore’s law is over, no more free lunch – Multi cores systems will be more and more available Type of Parallelism – Asynchronous operation (better user experience) – Data parallelism – Task parallelism Options – Manual treading Thread, ThreadPool, BackgroundWorkerThread – Asynchronous calls – Event driven Problems – Resource sharing – Locking – Non-deterministic sequence of execution – Hard to debug

Overview

Task Parallel Library (TPL) Lightweight task framework (Task) – Create(Action ) factory method – Wait, WaitAll, WaitAny to catch exception – ContinueWith to chain Tasks together Lazy function call – Future Task scheduler and manager – TaskManager

Parallel API Parallel Loops – Parallel.For – Parallel.ForEach Lazy Initialisation – LazyInit Locking – SpinWait – SpinLock CountdownEvent

Parallel API Standard for loop – for (int i = 0; i < N; i++) { a[i] = Compute(i); } Parallel for loop – Parallel.For(0, N, i => { a[i] = Compute(i); });

Parallel Linq (PLINQ) Parallel Query – AsParallel() Return to sequential execution – AsSequential() Preserve order – AsOrdered() Order doesn’t matter – AsUnordered()

Parallel Linq (PLINQ) var query = from c in Customers where c.Name = “Smith” select c; var query = from c in Customers.AsParallel() where c.Name = “Smith” select c;

Parallel Data Structures IConcurrentCollection – Add(T item) – Remove(out T item) ConcurrentStack – Push(T item) – TryPop(out T item) ConcurrentQueue – Enqueue(T item) – TryDequeue(out T item) BlockingCollection – Add(T item), – Remove(out T item) – TryAdd(T item), – TryRemove(out T item)

CLR Thread Pool: Work-Stealing Worker Thread 1 Worker Thread p Program Thread User Mode Scheduler For Tasks Global Queue Global Queue Local Queue Local Queue Local Queue Local Queue Task 1 Task 2 Task 3 Task 5 Task 4 Task 6

DEMO TIME

What’s next Visual Studio 2010.NET Framework 4.0 New multi cores computer (4, 16, 32, 64, …) Think parallel! – Thread safety will save your life

Ideas Task stealing Integration into language maybe for later Potentially in parallel Exception Handling Garbage collection Shift from threads to tasks (more than needed) Divide and conquer leads to more parallelism opportunities Use of CPU, GPU or Scale out To get another 100x performance – The Power Wall – The Complexity Wall – The Memory Wall