1. Augmenting AVL trees

2. How we’ve thought about trees so far Good for determining ancestry Can be good for quickly finding an element Good for determining ancestry Can be good for quickly finding an element

3. Other kinds of uses? Any thoughts? Finding a minimum/maximum… – (heaps are probably just as good or better) Finding an average? More complicated things?!!!11one Enter: idea of augmenting a tree

4. Augmenting Can quickly compute many global properties that seem to need knowledge of the whole tree! Examples: – size of any sub-tree – height of any sub-tree – averages of keys/values in a sub-tree – min+max of keys/values in any sub-tree, … Can quickly compute any function f(x) so long as you only need to know f(x.left) and f(x.right)!

5. Augmenting an AVL tree Can augment any kind of tree Only balanced trees are guaranteed to be fast After augmenting an AVL tree to compute f(x), we can still do all operations in O(lg n)!

6. We are going to do one simple example Then, you will help with a harder one! Problem: augment an AVL tree so we can do: – Insert(key): add key in O(lg n) – Delete(key): remove key in O(lg n) – Height(node): get height of sub-tree rooted at node in O(1) Simple first example A regular AVL tree already does this How do we do this? Store some extra data at each node… but what?

7. Function we want to compute: Height(u) = H(u) If someone gives us H(u L ) and H(u R ), can we compute H(u)? What formula should we use? If u = null then – H(u) = 0 Else – H(u) = max{H(u L ), H(u R )}+1 Can we compute this function quickly? uLuL uLuL uRuR uRuR u u H(u L ) H(u R ) H(u)=?

8. Augmenting AVL tree to compute H(u) Each node u contains – key: the key – left, right: child pointers – h: height of sub-tree rooted at u How? The usual stuff… Secret sauce! d, 0 Insert(d) a, 0 Insert(a) d, 1 Insert(e) e, 0 b, 0 Insert(b) a, 1 c, 0 Insert(c) e, 0 d, 2 b, 0 a, 1 c, 0 a, 0 c, 0 b, 1 d, 2d, 1d, 2

9. Algorithm idea: From the last slide, we develop an algorithm Insert(u): 1 BST search for where to put u 2 Insert u into place like in a regular AVL tree 3 Fix balance factors and rotate as you would in AVL insert, but fix heights at the same time. (Remember to fix heights all the way to the root. Don’t stop before reaching the root!) (When you rotate, remember to fix heights of all nodes involved, just like you fix balance factors!)

10. Harder problem: overpaid employees! You have a record for each employee in your company with salary and age. We want to quickly find overpaid employees of age <= A.

11. Breaking the problem down You must design a data structure D of employee records to efficiently do: – Insert(D; x): If x is a pointer to a new employee record, insert the record pointed to by x into D. – Delete(D; x): If x is a pointer to an existing employee record in D, remove that record from D. – MaxSal(D; A): Return the largest salary, amongst all employees in D whose age is <= A; if there is no such employee, then return -1. All functions must run in O(lg n)

12. Part 1 Give a precise and full description of your data structure Illustrate this data structure by giving an example of it on some collection of employee records of your own choice.

13. Figuring out the data structure Iterative process… hard to get it right the first time! What function do we want to compute? Maximum salary for employees with age <= A What info should we store at each node u? Maybe maximum salary for all employees in the sub-tree rooted at u? Let’s call this value MS(u). How can we compute MS(u) quickly (i.e., by looking at a small number of descendents of u)?

14. Organizing nodes inside the tree How can we turn maximum salary in a sub-tree into maximum salary for those with age <= A? For sure, need to relate age with sub-trees! – Things are organized into sub-trees by key… So, age must be related to key. – Let age be the key of each node… – May have 2+ nodes with same key, but that’s okay.

15. Age=17000, MS= Age=1590, MS= Age=3801, MS= Age=1100, MS= Age=1247, MS= Age=24100, MS= Age=30000, MS= Answer to part 1 Age=17000, salary=36000, MS= Age=1590, salary=28000, MS= Age=3801, salary=41000, MS= Age=1100, salary=31000, MS= Age=1247, salary=29000, MS= Age=30000, salary=75000, MS= Age=30000, salary=90000, MS= Age=1247, salary=29000, MS=29000 Age=1100, salary=31000, MS=31000 Age=3801, salary=41000, MS=48000 Age=1590, salary=28000, MS=48000 Age=30000, salary=90000, MS=90000 Age=30000, salary=75000, MS=90000 Age=17000, salary=36000, MS=90000 AgeSalary 110031000 124729000 159028000 159048000 380141000 1700036000 3000090000 3000075000 AgeSalary 110031000 124729000 159028000 159048000 380141000 1700036000 3000090000 3000075000 Age=1590, MS= Age=1590, salary=48000, MS= Age=1590, salary=48000, MS=48000

16. Part 2 Explain how to implement Insert(D, x), Delete(D, x) and MaxSal(D, A) in O(log n) time Insert: 1 Do regular AVL-insert(D, ), except: 2As you move up the tree fixing balance factors, fix MS(u) for every node on the path to the root 3After each rotation, fix each MS(u) for each node that was involved in the rotation 4Remember to fix heights all the way to the root. (Don’t stop early, even if done balance factors/rotations!) Delete: Same as Insert, but “Do regular AVL-delete[…]” How do we do MaxSal??? What does “fix MS(u)” mean? What formula do we use? Set MS(u) = max{u.salary, MS(u L ), MS(u R )}

17. How can we compute MaxSal? Write a recursive function! – Recursion is often very natural for trees Big problem: want MaxSal(D, A) = largest salary for age <= A in tree Smaller problem: MaxSal(u, A) = largest salary for age <= A in sub-tree rooted at u Recursive/inductive measure of problem size: size of sub-tree Therefore, smaller problem = smaller sub-tree.

18. Code for MaxSal // u is a node, A is an age MaxSal(u, A) if u = null then return -1 else if A < u.age then return MaxSal(u L, A) else return max{u.salary, MaxSal(u R,A), MaxSal(u R,A)} u L : salary, age, MS u R : salary, age, MS u: salary, age, MS Calling MaxSal on BOTH sub- trees can take O(n) time!

19. Code for MaxSal // u is a node, A is an age MaxSal(u, A) if u = null then return -1 else if A < u.age then return MaxSal(u L, A) else return max{u.salary, MaxSal(u R,A), MS(u L )} u L : salary, age, MS u R : salary, age, MS u: salary, age, MS

20. Why O(lg n) time? Insert/Delete: normal AVL operation = O(lg n) – PLUS: update MS(u) for each u on path to the root Length of this path <= tree height, so O(lg n) in an AVL tree – PLUS: update MS(u) for each node involved in a rotation At most O(lg n) rotations (one per node on the path from the root <= tree height) Each rotation involves a constant number of nodes Therefore, constant * O(lg n), which is O(lg n). MaxSal – Constant work + recursive call on ONE child – Single recursive call means O(tree height) = O(lg n)