Balancing Binary Search Trees

Slides:



Advertisements
Similar presentations
1 AVL-Trees (Adelson-Velskii & Landis, 1962) In normal search trees, the complexity of find, insert and delete operations in search trees is in the worst.
Advertisements

AVL Trees COL 106 Amit Kumar Shweta Agrawal Slide Courtesy : Douglas Wilhelm Harder, MMath, UWaterloo
Trees Types and Operations
AVL Tree Smt Genap Outline AVL Tree ◦ Definition ◦ Properties ◦ Operations Smt Genap
CS202 - Fundamental Structures of Computer Science II
CSE373: Data Structures & Algorithms Optional Slides: AVL Delete Dan Grossman Fall 2013.
1 AVL-Trees: Motivation Recall our discussion on BSTs –The height of a BST depends on the order of insertion E.g., Insert keys 1, 2, 3, 4, 5, 6, 7 into.
Balancing Binary Search Trees. Balanced Binary Search Trees A BST is perfectly balanced if, for every node, the difference between the number of nodes.
Binary SearchTrees [CLRS] – Chap 12. What is a binary tree ? A binary tree is a linked data structure in which each node is an object that contains following.
1 Trees 4: AVL Trees Section 4.4. Motivation When building a binary search tree, what type of trees would we like? Example: 3, 5, 8, 20, 18, 13, 22 2.
CS 253: Algorithms Chapter 13 Balanced Binary Search Trees (Balanced BST) AVL Trees.
Data Structures AVL Trees.
AVL trees1 AVL Trees Height of a node : The height of a leaf is 1. The height of a null pointer is zero. The height of an internal node is the maximum.
AVL Trees AVL (Adel`son-Vel`skii and Landis) tree = – A BST – With the property: For every node, the heights of the left and right subtrees differ at most.
Balancing Binary Search Trees. Balanced Binary Search Trees A BST is perfectly balanced if, for every node, the difference between the number of nodes.
COSC 2007 Data Structures II Chapter 13 Advanced Implementation of Tables II.
AVL Trees CSE, POSTECH.
Lecture 15 Nov 3, 2013 Height-balanced BST Recall:
AA Trees.
File Organization and Processing Week 3
Lec 13 Oct 17, 2011 AVL tree – height-balanced tree Other options:
BCA-II Data Structure Using C
Data Structures – LECTURE Balanced trees
AVL Trees 5/17/2018 Presentation for use with the textbook Data Structures and Algorithms in Java, 6th edition, by M. T. Goodrich, R. Tamassia, and M.
Search Trees.
AVL Trees 6/25/2018 Presentation for use with the textbook Data Structures and Algorithms in Java, 6th edition, by M. T. Goodrich, R. Tamassia, and M.
Lecture 15 AVL Trees Slides modified from © 2010 Goodrich, Tamassia & by Prof. Naveen Garg’s Lectures.
UNIT III TREES.
Red Black Trees
CSIT 402 Data Structures II
CS202 - Fundamental Structures of Computer Science II
Lecture 17 Red-Black Trees
CS202 - Fundamental Structures of Computer Science II
CSE373: Data Structures & Algorithms Lecture 7: AVL Trees
AVL Tree.
Red-Black Trees 9/12/ :44 AM AVL Trees v z AVL Trees.
Summary of General Binary search tree
AVL Tree 27th Mar 2007.
AVL Trees "The voyage of discovery is not in seeking new landscapes but in having new eyes. " - Marcel Proust.
Lecture 7 Algorithm Analysis
CSE373: Data Structures & Algorithms Lecture 7: AVL Trees
Red-Black Trees Motivations
AVL Trees 11/10/2018 AVL Trees v z AVL Trees.
AVL Trees 4/29/15 Presentation for use with the textbook Data Structures and Algorithms in Java, 6th edition, by M. T. Goodrich, R. Tamassia, and M. H.
AVL Tree A Balanced Binary Search Tree
Red-Black Trees 11/13/2018 2:07 AM AVL Trees v z AVL Trees.
AVL Trees CENG 213 Data Structures.
CS202 - Fundamental Structures of Computer Science II
Red-Black Trees 11/26/2018 3:42 PM AVL Trees v z AVL Trees.
CS202 - Fundamental Structures of Computer Science II
Red-Black Trees 2018年11月26日3时46分 AVL Trees v z AVL Trees.
v z Chapter 10 AVL Trees Acknowledgement: These slides are adapted from slides provided with Data Structures and Algorithms in C++, Goodrich,
Lecture 7 Algorithm Analysis
Algorithms and Data Structures Lecture VIII
AVL Trees CSE 373 Data Structures.
Lecture 7 Algorithm Analysis
AVL Trees 2/23/2019 AVL Trees v z AVL Trees.
CS202 - Fundamental Structures of Computer Science II
Red-Black Trees 2/24/ :17 AM AVL Trees v z AVL Trees.
AVL-Trees.
AVL-Trees (Part 1).
Binary SearchTrees [CLRS] – Chap 12.
Lecture 10 Oct 1, 2012 Complete BST deletion Height-balanced BST
ITCS6114 Algorithms and Data Structures
Richard Anderson Spring 2016
Red-Black Trees 5/19/2019 6:39 AM AVL Trees v z AVL Trees.
CSE 373 Data Structures Lecture 8
CS202 - Fundamental Structures of Computer Science II
CS202 - Fundamental Structures of Computer Science II
CS210- Lecture 19 July 18, 2005 Agenda AVL trees Restructuring Trees
Presentation transcript:

Balancing Binary Search Trees

Binary Search Trees - Review Tree walks Θ(n) Queries Search O(h) Minimum O(h) Maximum O(h) Successor O(h) Predecessor O(h) Modifying Insert O(h) Delete O(h) Each of the basic operations on a binary search tree runs in O(h) time, where h is the height of the tree The height of a binary search tree of n nodes depends on the order in which the keys are inserted The height of a BST with n nodes: Worst case: O(n) => BST operations are also O(n) !!! Best case: O(log n) Average case O(log n)

Binary Search Trees - Review Tree walks Θ(n) Queries Search O(h) Minimum O(h) Maximum O(h) Successor O(h) Predecessor O(h) Modifying Insert O(h) Delete O(h) Each of the basic operations on a binary search tree runs in O(h) time, where h is the height of the tree The height of a binary search tree of n nodes depends on the order in which the keys are inserted The height of a BST with n nodes: Worst case: O(n) => BST operations are also O(n) !!! Best case: O(log n) Average case O(log n) Conclusion: we must do something to make sure that the height is kept small ! The BST must be always (kind of) balanced

Balanced Binary Search Trees A BST is perfectly balanced if, for every node, the difference between the number of nodes in its left subtree and the number of nodes in its right subtree is at most one Example: Balanced tree vs Not balanced tree

Balancing Binary Search Trees Inserting or deleting a node from a (balanced) binary search tree can lead to an unbalance In this case, we perform some operations to rearrange the binary search tree in a balanced form These operations must be easy to perform and must require only a minimum number of links to be reassigned Such kind of operations are Rotations

Tree Rotations The basic tree-restructuring operation There are left rotation and right rotation. They are inverses of each other [CLRS Fig. 13.1]

Tree Rotations Changes the local pointer structure. (Only pointers are changed.) A rotation operation preserves the binary-search-tree property: the keys in α precede x.key, which precedes the keys in β, which precede y.key, which precedes the keys in γ .

Implementing Rotations

[CLRS Fig. 13.3]

Balancing Binary Search Trees Balancing a BST is done by applying simple transformations such as rotations to fix up after an insertion or a deletion Perfectly balanced BST are very difficult to maintain Different approximations are used for more relaxed definitions of “balanced”, for example: AVL trees Red-black trees

AVL trees Adelson Velskii and Landes An AVL tree is a binary search tree that is height balanced: for each node x, the heights of the left and right subtrees of x differ by at most 1. AVL Tree vs Non-AVL Tree

AVL Trees AVL trees are height-balanced binary search trees Balance factor of a node height(left subtree) - height(right subtree) An AVL tree has balance factor calculated at every node For every node, heights of left and right subtree can differ by no more than 1

Height of an AVL Tree How many nodes are there in an AVL tree of height h ? N(h) = minimum number of nodes in an AVL tree of height h. Base Case: N(0) = 1, N(1) = 2 Induction Step: N(h) = N(h-1) + N(h-2) + 1 Solution: (it’s the Fibonacci recurrence) N(h) =h (  1.62) h-1 h-2 h

Height of an AVL Tree N(h)=h (  1.62) What is the height of an AVL Tree with n nodes ? Suppose we have n nodes in an AVL tree of height h. n > N(h) (because N(h) was the minimum) n > h hence log n > h h ≤ log n = log2 n / log2  h < 1.44 log2n ( h is O(logn))

Insertion into an AVL trees place a node into the appropriate place in binary search tree order examine height balancing on insertion path: Tree was balanced (balance=0) => increasing the height of a subtree will be in the tolerated interval +/-1 Tree was not balanced, with a factor +/-1, and the node is inserted in the smaller subtree leading to its height increase => the tree will be balanced after insertion Tree was balanced, with a factor +/-1, and the node is inserted in the taller subtree leading to its height increase => the tree is no longer height balanced (the heights of the left and right children of some node x might differ by 2) we have to balance the subtree rooted at x using rotations How to rotate ? => see 4 cases according to the path to the new node

Example – AVL insertions RIGHT-ROTATE 10 1 2 10 8 15 2 15 1 8 Case 1: Node’s Left – Left grandchild is too tall

AVL insertions – Right Rotation Case 1: Node’s Left – Left grandchild is too tall y h x y Balance: 0 h+2 h+2 Balance: 2 x Balance: 1 h h h Height of tree after balancing is the same as before insertion !

Example – AVL insertions 5 8 3 15 4 2 8 15 5 3 2 4 8 3 15 2 5 4 Solution: do a Double Rotation: LEFT-ROTATE and RIGHT-ROTATE Case 2: Node’s Left-Right grandchild is too tall

Double Rotation – Case Left-Right Case 2: Node’s Left-Right grandchild is too tall Balance: 2 z h+2 x Balance: -1 y h h-1 h-1

Double Rotation – Case Left-Right Balance: 0 h+2 y Balance: 0 or 1 Balance: 0 or -1 x z h-1 h-1 h h Height of tree after balancing is the same as before insertion ! => there are NO upward propagations of the unbalance !

Exercise Insert following keys into an initially empty AVL tree. Indicate the rotation cases: 14, 17, 11, 7, 3, 13

Example – AVL insertions LEFT-ROTATE 10 10 15 2 20 13 25 2 15 13 20 25 Case 3: Node’s Right – Right grandchild is too tall

AVL insertions – Left Rotation Case 3: Node’s Right – Right grandchild is too tall h x y x Balance: 0 Balance: -2 y Balance: -1 h h h

Example – AVL insertions 7 8 5 15 6 3 5 7 3 8 15 6 5 3 8 7 15 6 Solution: do a Double Rotation: RIGHT-ROTATE and LEFT-ROTATE Case 4: Node’s Right – Left grandchild is too tall

Double Rotation – Case Right-Left Case 4: Node’s Right – Left grandchild is too tall x Balance: -2 z Balance: 1 y Balance: 1 or -1 h h h-1 h-1

Double Rotation – Case Right-Left Balance: 0 y Balance: 0 or 1 Balance: -1 or 0 x z h-1 h-1 h h

Implementing AVL Trees Insertion needs information about the height of each node It would be highly inefficient to calculate the height of a subtree every time this information is needed => the tree structure is augmented with height information that is maintained during all operations An AVL Node contains the attributes: Key Left, right, p Height (or Balance Factor)

< Case 2 – Left-Right Case 1 – Left-Left Case 4 – Right-Left Case 3 – Right-Right

Do not forget implementation details: The height information in nodes must be updated during rotations ! ONLY the height information of nodes x and y must be updated !

Analysis of AVL-INSERT Insertion makes O(h) steps, h is O(log n), thus Insertion makes O(log n) steps At every insertion step, there is a call to Balance, but rotations will be performed only once for the insertion of a key. It is not possible that after doing a balancing, unbalances are propagated , because the BALANCE operation restores the height of the subtree before insertion. => number of rotations for one insertion is O(1) AVL-INSERT is O(log n)

Thinking question Can we replace the conditions for performing rotations, by just changing height into number of nodes in order to maintain a perfectly balanced tree instead of an AVL balanced tree ?

<

AVL Delete The procedure of BST deletion of a node z: 1 child: delete it, connect child to parent 2 children: put successor in place of z, delete successor Which nodes’ heights may have changed: 1 child: path from deleted node to root 2 children: path from deleted successor leaf to root AVL Tree may need rebalancing as we return along the deletion path back to the root

AVL delete – Right Rotation Case 1: Node’s Left-Left grandchild is too tall h y x Balance: 0 h-1 y h+1 h+2 Balance: 2 x Balance: 1 h-1 h-1 h Delete node in right child, the height of the right child decreases The height of tree after balancing decreases !=> Unbalance may propagate

AVL delete – Double Rotation Case 2: Node’s Left-Right grandchild is too tall x y Balance: 0 h-1 z h+1 h+2 z Balance: 2 x Balance: 1 h-1 y h-1 h-1 h-1 Delete node in right child, the height of the right child decreases The height of tree after balancing decreases !=> Unbalance may propagate

AVL delete – Left Rotation Case 3: Node’s Right – Right grandchild is too tall h x y Balance: 0 h-1 x h+1 h+2 Balance: -2 y Balance: -1 h-1 h-1 h Delete node in left child, the height of the left child decreases The height of tree after balancing decreases !=> Unbalance may propagate

AVL delete – Double Rotation Case 4: Node’s Right – Left grandchild is too tall x y Balance: 0 h-1 z x h+1 h+2 Balance: -2 z Balance: 1 h-1 y h-1 h-1 h-1 Delete node in left child, the height of the left child decreases The height of tree after balancing decreases !=> Unbalance may propagate

Analysis of AVL-DELETE Deletion makes O(h) steps, h is O(log n), thus deletion makes O(log n) steps At the deletion of a node, rotations may be performed for all the nodes of the deletion path which is O(h)=O(log n) ! In the worst case, it is possible that after doing a balancing, unbalances are propagated on the whole path to the root !

What happens if key 12 is deleted ? Exercise 11 7 14 5 9 12 17 20 3 6 8 10 1 What happens if key 12 is deleted ?

AVL Trees - Summary AVL definition of balance: for each node x, the heights of the left and right subtrees of x differ by at most 1. Maximum height of an AVL tree with n nodes is h < 1.44 log2n AVL-Insert: O(log n), Rotations: O(1) (For Insert, unbalances are not propagated after they are solved once) AVL-Delete: O(log n), Rotations: O(log n) (For Delete, unbalances may be propagated up to the root)

AVL vs Simple BST AVL Simple BST Max Height 1.44 log n n INSERT O(log n) O(n) Rotations at Insert O(1) DELETE O( n) Rotations at Delete

Conclusions - Binary Search Trees BST are well suited to implement Dictionary and Dynamic Sets structures (Insert, Delete, Search) In order to keep their height small, balancing techniques can be applied AVL is one of these techniques