1 Course Syllabus 1. Introduction - History; Views; Concepts; Structure 2. Process Management - Processes; State + Resources; Threads; Unix implementation of Processes 3. Process Scheduling – Paradigms; Unix; Modeling 4. Process Synchronization - Synchronization primitives and their equivalence; Deadlocks 5. Memory Management - Virtual memory; Page replacement algorithms; Segmentation 6. File Systems - Implementation; Directory and space management; Unix file system; Distributed file systems (NFS) 7. Security – General policies and mechanisms; protection models; authentication 8. Distributed issues – Synchronization; Mutual exclusion Operating Systems, 2012, Danny Hendler & Roie Zivan

2 Mutual exclusion: motivation Race Conditions: Example: Spooler directory with slots; index variables; two processes attempt concurrent access. In points to the next empty slot, Out points to entry holding name of file to print next.... abc.docf.pspaper.ps Process A Process B 4567 Out = 4 In=7

Operating Systems, 2012, Danny Hendler & Roie Zivan 3 Code using reads/writes only Add-file-to-print-spool (char *name) 1.Local-in := In 2.StoreName(Spool-dir[local-in], name) 3.In := (local-in+1) mod DIR-LEN A scenario proving the above code wrong Process A performs line 1 Process A is preempted by Process B Process B performs Add-file-to-print-spool to completion Process A is re-scheduled, completes lines 2-3. Process B's file is never printed.

Operating Systems, 2012, Danny Hendler & Roie Zivan 4 The mutual exclusion problem (Dijkstra, 1965) We need to devise a protocol that guarantees mutually exclusive access by processes to a shared resource (such as a file, printer, etc.) or, more generally, a critical section of code How can we avoid such race conditions?

Operating Systems, 2012, Danny Hendler & Roie Zivan 5 The problem model  Multiple processes  Processes can apply read, write, or stronger operations to shared memory  Completely asynchronous  We assume processes do not fail-stop

Operating Systems, 2012, Danny Hendler & Roie Zivan 6 Mutual exclusion: formal definition loop forever Remainder code Entry code Critical section (CS) Exit code end loop Remainder code Entry code Exit code CS

Operating Systems, 2012, Danny Hendler & Roie Zivan 7 Mutex Requirements  Mutual exclusion: No two processes are at the critical section (CS) at the same time  Deadlock-freedom: If processes are trying to enter their critical section, then some process eventually enters the critical section  Starvation-freedom: If a process is trying to enter its critical section, then this process must eventually enter its critical section

Operating Systems, 2012, Danny Hendler & Roie Zivan 8 Mutual exclusion using critical regions

Operating Systems, 2012, Danny Hendler & Roie Zivan 9 Brute force solution: disabling interrupts Disable interrupts Do your stuff Enable interrupts Problems  User processes are not allowed to disable interrupts  Disabling interrupts must be done for a very short period of time  Does not solve the problem in a multi-processor system

Operating Systems, 2012, Danny Hendler & Roie Zivan 10 2-process Mutual Exclusion with a lock variable Program for both processes 1.await lock=0 2.lock:=1 3.CS 4.lock:=0 initially: lock=0 Does the algorithm satisfy mutex? Does it satisfy deadlock-freedom? Does it satisfy starvation-freedom? No Yes No

Operating Systems, 2012, Danny Hendler & Roie Zivan 11 Mutual Exclusion: strict alternation Does the algorithm satisfy mutex? Does it satisfy deadlock-freedom? Does it satisfy starvation-freedom? Yes No Program for process 0 1.await turn=0 2.CS 3.turn:=1 Program for process 1 1.await turn=1 2.CS 3.turn:=0 initially: turn=0

Operating Systems, 2012, Danny Hendler & Roie Zivan 12 Mutual Exclusion: flag array Does the algorithm satisfy mutex? Does it satisfy deadlock-freedom? Does it satisfy starvation-freedom? Yes No Program for process 0 1.flags[0]:=true 2.await flags[1]=false 3.CS 4.flags[0]:=false Program for process 1 1.flags[1]:=true 2.await flags[0]=false 3.CS 4.flags[1]:=false bool flags[2] initially {false, false}

Operating Systems, 2012, Danny Hendler & Roie Zivan 13 Peterson’s 2-process algorithm (Peterson, 1981) initially: b[0]:=false, b[1]:=false, value of turn immaterial Program for process 0 1.b[0]:=true 2.turn:=0 3.await (b[1]=false or turn=1) 4.CS 5.b[0]:=false Program for process 1 1.b[1]:=true 2.turn:=1 3.await (b[0]=false or turn=0) 4.CS 5.b[1]:=false

Operating Systems, 2012, Danny Hendler & Roie Zivan 14 Schema for Peterson’s 2-process algorithm Indicate participation b[i]:=true Barrier turn:=i Is there contention? b[1-i]=true? yes no Critical Section Exit code b[i]:=false First to cross barrier? turn=1-i? no, maybe yes Synchronization Algorithms and Concurrent Programming, Gadi Taubenfeld © 2006

Operating Systems, 2012, Danny Hendler & Roie Zivan 15 Peterson’s 2-process algorithm satisfies both mutual-exclusion and starvation-freedom

Operating Systems, 2012, Danny Hendler & Roie Zian Observations  Shared register : turn (2-valued) read & write by both processes  Two boolean registers : b[0], b[1] process 0 can write b[0], process 1 can write b[1] both can read b[0] & b[1] Can the algorithm be modified to use only single-writer registers ? 16

17 Operating Systems, 2012, Danny Hendler & Roie Zivan Kessels’ 2-process algorithm (1982) encode turn=0: as turn[0] = turn[1] turn=1: as turn[0] ≠ turn[1] initially: b[0]:=false, b[1]:=false, value of turn[i] immaterial Program for process 0 1.b[0]:=true 2.local[0]:=turn[1] 3.turn[0]:=local[0] 4.await (b[1]=false or local[0] ≠ turn[1]) 5.CS 6.b[0]:=false Program for process 1 1.b[1]:=true 2.local[1]:=1 – turn[0] 3.turn[1]:=local[1] 4.await (b[0]=false or local[1] = turn[0]) 5.CS 6.b[1]:=false

Operating Systems, 2012, Danny Hendler & Roie Zivan 18 Mutual exclusion for n processes: A tournament tree Level 0 Level 1 Level 2 Processes A tree-node is identified by: [level, node#] Synchronization Algorithms and Concurrent Programming, Gadi Taubenfeld © 2006

Operating Systems, 2012, Danny Hendler & Roie Zivan 19 N-process mutual exclusion: a tournament tree Program for process i 1.node:=i 2.For level = 0 to log n-1 do 3. id:=node mod 2 4. node:=  node/2  5. b[level,2node+id]:=true 6. turn[level,node]:=id 7. await (b[level,2node+1-id]=false or turn[level,node]=1-id) 8.od 9.CS 10.for level=log n –1 downto 0 do 11. node:=  i/2 level  12. b[level,node]:=false 13.od Variables Per node: b[level, 2node], b[level, 2node+1], turn[level,node] Per process (local): level, node, id.

Operating Systems, 2012, Danny Hendler & Roie Zivan 20 Fairness: First in First Out (FIFO) entry code exit code critical section remainder  Mutual Exclusion  Deadlock-freedom  Starvation-freedom doorway waiting FIFO: if process p is waiting and process q has not yet started the doorway, then q will not enter the CS before p Synchronization Algorithms and Concurrent Programming, Gadi Taubenfeld © 2006

Operating Systems, 2012, Danny Hendler & Roie Zivan 21 time Lamport’s Bakery Algorithm doorway 12345n CS exit waiting entry remainder Synchronization Algorithms and Concurrent Programming, Gadi Taubenfeld © 2006

Operating Systems, 2012, Danny Hendler & Roie Zivan 22 Implementation 1 code of process i, i  {1,..., n} number[i] := 1 + max {number[j] | (1  j  n)} for j := 1 to n (<> i) { await (number[j] = 0)  (number[j] > number[i]) } critical section number[i] := n numberinteger Answer: No, it can deadlock! Does this implementation work? Synchronization Algorithms and Concurrent Programming, Gadi Taubenfeld © 2006

Operating Systems, 2012, Danny Hendler & Roie Zivan 23 time Implementation 1: deadlock doorway 12345n CS exit waiting entry remainder deadlock Synchronization Algorithms and Concurrent Programming, Gadi Taubenfeld © 2006

Operating Systems, 2012, Danny Hendler & Roie Zivan 24 number[i] := 1 + max {number[j] | (1  j  n)} for j := 1 to n (<> i) { await (number[j] = 0)  (number[j],j) < number[i],i) // lexicographical order } critical section number[i] := n numberinteger Answer: It does not satisfy mutual exclusion! Implementation 2 code of process i, i  {1,..., n} Does this implementation work? Synchronization Algorithms and Concurrent Programming, Gadi Taubenfeld © 2006

Operating Systems, 2012, Danny Hendler & Roie Zivan 25 time Implementation 2: no mutual exclusion doorway 12345n CS exit waiting entry remainder Synchronization Algorithms and Concurrent Programming, Gadi Taubenfeld © 2006

Operating Systems, 2012, Danny Hendler & Roie Zivan 26 The Bakery Algorithm code of process i, i  {1,..., n} 1: choosing[i] := true 2: number[i] := 1 + max {number[j] | (1  j  n)} 3: choosing[i] := false 4: for j := 1 to n do 5: await choosing[j] = false 6: await (number[j] = 0)  (number[j],j)  (number[i],i) 7: od 8: critical section 9: number[i] := n choosingbits false numberinteger false Doorway Waiting Bakery

Operating Systems, 2012, Danny Hendler & Roie Zivan 27 Lamport’s bakery algorithm satisfies mutual-exclusion, starvation-freedom, and FIFO

Operating Systems, 2012, Danny Hendler & Roie Zivan 28 Test-and-set(w) do atomically prev:=w w:=1 return prev The test-and-set instruction Program for process i 1.await test&set(v) = 0 2.Critical Section 3.v:=0 initially: v:=0 Mutual exclusion? Yes Deadlock-freedom? No Starvation-freedom? Yes

Operating Systems, 2012, Danny Hendler & Roie Zivan 29 Starvation-free mutex using test-and-set program for process i 1.interested[i]:=true 2.await ( (test-and-set(lock) = 0) || (interested[i]=false) ) 3.CS 4.interested[i]:=false 5.j:=(i+1) % n 6.while (j != i && !interested[j]) j:=++j % n 7.if (j=i) 8. lock:=0 9.else 10. interested[j]:=false boolean lock initially 0, interested[n] initially false