Presentation is loading. Please wait.

Presentation is loading. Please wait.

Tutorial 10 Heap & Priority Queue. Heap – What is it? Special complete binary tree data structure –Complete BT: no empty node when checked top-down (level.

Published byPriscilla Nicholson Modified over 9 years ago

Similar presentations

Presentation on theme: "Tutorial 10 Heap & Priority Queue. Heap – What is it? Special complete binary tree data structure –Complete BT: no empty node when checked top-down (level."— Presentation transcript:

1 Tutorial 10 Heap & Priority Queue

2 Heap – What is it? Special complete binary tree data structure –Complete BT: no empty node when checked top-down (level by level), left to right! –We actually implement this using compact array (or vector for size flexibility) One to one mapping between complete binary tree and compact array! We have a very efficient Heap manipulation using array/vector –Index start from 0 –Parent(i): floor((i-1)/2) –Left(i): 2i+1 –Right(i): 2i+2 –Special because it must satisfy recursive heap property for each node x: The node x is larger than any of its left/right children (MaxHeap), or The node x is smaller than any of its left/right children (MinHeap) PS: Compare this with BST property! –Discussed in q2.

3 Heap – Operations Note: some other lecture notes/text books use different terms! Two key operations: bubble up or bubble down –Fix heap property by bubbling a node upwards (exchange with parent) or downwards (exchange with one of the largest/smallest child). Standard operations –Insertion: HeapInsert() a.k.a: fixHeap(), BubbleUp() Insert to last, then bubble up  O(log n), see q1 –Deletion: HeapDelete() a.k.a: ExtractMax(), ExtractMin() Take the root, replace with last, and then bubble down  O(log n) For deleting non-root nodes, see q1 –No default searching operation: We usually only access root (max/min) in O(1) Accessing any other node will normally incur O(n) cost, but see q3 –Updating a node value requires bubble up or bubble down, see q3 Special operation –Array  Heap: Heapify() a.k.a: HeapConstruction()  O(n), not O(n log n), see q1

4 Heap - Usage Heap can be used as an efficient Priority Queue –Items are inserted as per normal O(log n) –But these items will come out (de-queued) based on their priority value! As we perform ExtractMax() or ExtractMin() from a max (or min) heap! O(log n) –Faster than using other data structure, e.g. sorted array Heap can also be used for sorting (discussed in q3): –HeapSort() – O(n log n) –Or even for “partial sort” – O(k log n), e.g. Google default top 10 search results The term “Barack Obama” on 6 Nov 08 produces 83 million hits Sorting (80m log 80m) and display top 10 is “slow” Create heap O(80m) + take top-10 in O(10 log 80m) is much faster Heap can be built beforehand and stored in Google server, so it is just O(10 log 80m) However, we can do better by mapping search query into an “answer page” in O(1)… –Only possible if we have large storage space. –Other sorting algorithms can do partial sort, but not natural Quick sort can stop processing right part if pivot > k Partitioning algorithm will ensure everything on the left side of pivot is the top k…

5 Student Presentation Gr3 (average: 2 times) 1.Rebecca Chen or Cao Hoangdang or Ding Ying Shiaun or Du Xin 2.Nur Liyana Bte Roslie or Jashan Deep Kaur 3.Huang Chuanxian or Leow Wei Jie or Tan Kar Ann Gr4 (average: 3 times) 1.Cynthia Tan or Tan Peck Luan 2.Liew Hui Sun or Hanyenkno Afi 3.Goh Khoon Hiang or Jasmine Choy Overview of the questions: 1.Trace Heap Operations (1 or 2 students)Trace Heap Operations (1 or 2 students) 2.IsHeap(Array) (1 student)IsHeap(Array) (1 student) 3.FindKthBest (1, 2, or 3 students)FindKthBest (1, 2, or 3 students) Gr5 (average: 4 times) 1.Zheng Yang 2.Stephanie Teo 3.Tan Yan Hao Gr6 (average: 3 times) 1.Koh Jye Yiing or Wang Shuling 2.Siddhartha or Laura Chua 3.Rasheilla or Brenda Koh or Gary Kwong or Low Wei Chen 5

6 Q1 – Trace Heap Operations Insert 3, 1, 4, 1, 5, 9, 2, 6, 4 to empty max heap, delete 5, O(n log n) Heapify array 3, 1, 4, 1, 5, 9, 2, 6, 4 to max heap, delete 6, O(n) The resulting max heap (before deleting 5 and 6, respectively) are different but both are valid. However, Heapify() is faster as it is O(n). Link

7 Q2 –IsHeap(Array)? class BinaryHeap { int currentSize; //maintain the number of elements in the heap Comparable[] array; //stores the heap elements BinaryHeap() { //constructor currentSize = 0; array = new Comparable[ DEFAULT_CAPACITY ]; } // with other standard heap methods... } Give code for checking if the heap is a valid max-heap: (is a complete tree and maintains heap property)

8 Q2 –IsHeap(Array)? (Answer) bool isHeap() { for (int i = 0; i < currentSize; i++) { if (array[i] == NULL) // check if compact array == complete binary tree return false; // not a complete tree int child = 2 * i + 1; // check heap property if (child < currentSize) { if ((child+1) < currentSize) child = (array[child]>array[child+1])?child:(child+1); if (array[child] > array[i]) return false; } return true; } Link

9 Q3 – FindKthBest (1) findKthBest(int k), which returns the athlete with the k th least penalty points. What is the complexity? –Take/delete top k-1 items from min heap, so, after k-1 steps, you get the k th one as the root of the remaining min heap (the answer), this is (k-1) log n –Then, restore the deleted k-1 items into the heap again so that the next queries are correct, this is another (k-1) log n –Overall: (2k-2) log n which is O(k log n) –The complexity depends on k and n, ‘k’ cannot be dropped… update(Athlete, points), which adds the new penalty points to Athletes record. What is the complexity? –Use hash table to map Athlete to index in Heap data structure! Otherwise we need O(n) to scan for the correct index for this Athlete, now just O(1) –When we modify the value (points) in Heap, we need to bubble up/down to fix the heap property, which is maximum O(log n)… Update the corresponding values in Hash Table too, which is O(1) per update. –Overall complexity is O(1) + O(log n) * O(1) = O(log n)

10 Q3 – FindKthBest (2) Is there some other data structure which can be used to give more optimized performance? (findKthBest + update) –If the data is static, we can put the scores in array, sort the array one time O(n log n) and return array[k-1] O(1) as the answer, faster than O(k log n) per query in Q3a. –However, the data will be frequently updated, thus, this method will be slow, as re-sorting the array takes O(n log n)! –Since data is going to be frequently updated and we want top k results, we can use an augmented BST instead of a heap to store the Athlete objects! –http://en.wikipedia.org/wiki/Augmenting_Data_Structureshttp://en.wikipedia.org/wiki/Augmenting_Data_Structures –Store the number of nodes in the left and right sub-tree in each node! Thus, we can know where to go (left or right or stay) to find index-k in O(log n)! –BST would take O(n lg n) time to create (one time task), but the query time for findKthBest will be O(log n), faster than O(k log n) –The time for update would remain unchanged, still O(log n), delete old value O(log n) and re-insert new value to BST O(log n).

11 Homework: Trace Heap Sort Perform partial sort to get top 3 results on this max heap (from q1)! Continue all the way to complete the Heap Sort on this max heap! Link

12 Class Photo I usually take class photo every semester Please move to the center We will take two photos: –One without me. –One with me (one student will do the photo taking) After Thursday, you can see our photos here: –http://www.comp.nus.edu.sg/~stevenha/myteaching/myteachingrecord.htmlhttp://www.comp.nus.edu.sg/~stevenha/myteaching/myteachingrecord.html

13 Advertisement CS1102/C IEEE Revision Series Conducted by: me… Very relevant for this module! –Venue: LT 3 –Time: Friday,14 November 2008, 6-9pm I will discuss past papers and share how to tackle CS1102/C exam! Be there… you do not want to miss this!

14 Questions from last semesters Use them as additional learning materials…

15 Heap Insert/Delete Given the minheap h below, Show what the minheap h would look like after each of the following pseudocode operations one after another: a)h.heapInsert(8) b)h.heapInsert(5) c)h.heapDelete()

16 Solution a)h.heapInsert(8) b)h.heapInsert(5) c)h.heapDelete()

17 Extension After these three operations a)h.heapInsert(8) b)h.heapInsert(5) c)h.heapDelete() Continue with this: d)h.heapInsert(14) e)h.heapInsert(1) // assume this is 1a f)h.heapDelete() g)h.heapInsert(1) // duplicate, this is 1b h)h.heapInsert(15)

18 Extension – Solution Final heap:

19 Heap Construction Show the result of inserting: 12, 10, 1, 14, 6, 5, 8, 15, 3, 9, 7, 4, 11, 13, and 2 One at a time! Into an initially empty maxheap... Then show/compare the result by using the heap construction algorithm instead!

20 Solution Using Individual Insertions Using Heap Construction Algorithm

Download ppt "Tutorial 10 Heap & Priority Queue. Heap – What is it? Special complete binary tree data structure –Complete BT: no empty node when checked top-down (level."

Similar presentations

COL 106 Shweta Agrawal and Amit Kumar

COL 106 Shweta Agrawal and Amit Kumar
CMSC 341 Binary Heaps Priority Queues. 8/3/2007 UMBC CSMC 341 PQueue 2 Priority Queues Priority: some property of an object that allows it to be prioritized.

CMSC 341 Binary Heaps Priority Queues. 8/3/2007 UMBC CSMC 341 PQueue 2 Priority Queues Priority: some property of an object that allows it to be prioritized.
Sorting (2nd part) & Binary Search Tree

Sorting (2nd part) & Binary Search Tree
Heaps CSE 331 Section 2 James Daly. Reminder Project 2 is out Covers tree sets Due Friday at midnight Exam 1 will be Thursday, February 26 Review next.

Heaps CSE 331 Section 2 James Daly. Reminder Project 2 is out Covers tree sets Due Friday at midnight Exam 1 will be Thursday, February 26 Review next.
CS 46101 Section 600 CS 56101 Section 002 Dr. Angela Guercio Spring 2010.

CS Section 600 CS Section 002 Dr. Angela Guercio Spring 2010.
Sorting Chapter 11. 2 Sorting Consider list x 1, x 2, x 3, … x n We seek to arrange the elements of the list in order –Ascending or descending Some O(n.

Sorting Chapter Sorting Consider list x 1, x 2, x 3, … x n We seek to arrange the elements of the list in order –Ascending or descending Some O(n.
CMPT 225 Priority Queues and Heaps. Priority Queues Items in a priority queue have a priority The priority is usually numerical value Could be lowest.

CMPT 225 Priority Queues and Heaps. Priority Queues Items in a priority queue have a priority The priority is usually numerical value Could be lowest.
CS 315 March 24 Goals: Heap (Chapter 6) priority queue definition of a heap Algorithms for Insert DeleteMin percolate-down Build-heap.

CS 315 March 24 Goals: Heap (Chapter 6) priority queue definition of a heap Algorithms for Insert DeleteMin percolate-down Build-heap.
Binary Heaps CSE 373 Data Structures Lecture 11. 2/5/03Binary Heaps - Lecture 112 Readings Reading ›Sections 6.1-6.4.

Binary Heaps CSE 373 Data Structures Lecture 11. 2/5/03Binary Heaps - Lecture 112 Readings Reading ›Sections
Version 1.0 1 TCSS 342, Winter 2006 Lecture Notes Priority Queues Heaps.

Version TCSS 342, Winter 2006 Lecture Notes Priority Queues Heaps.
Binary Heaps What is a Binary Heap? Array representation of a Binary Heap MinHeap implementation Operations on Binary Heaps: enqueue dequeue deleting an.

Binary Heaps What is a Binary Heap? Array representation of a Binary Heap MinHeap implementation Operations on Binary Heaps: enqueue dequeue deleting an.
Binary Heaps What is a Binary Heap? Array representation of a Binary Heap MinHeap implementation Operations on MinHeap: Insert Delete Converting an array.

Binary Heaps What is a Binary Heap? Array representation of a Binary Heap MinHeap implementation Operations on MinHeap: Insert Delete Converting an array.
CS 315 Lecture 18 Nov 15 Goals Complete heap operations review insert, deletemin decreaseKey, increaseKey heap building Heap sorting Some applications.

CS 315 Lecture 18 Nov 15 Goals Complete heap operations review insert, deletemin decreaseKey, increaseKey heap building Heap sorting Some applications.
PQ, binary heaps G.Kamberova, Algorithms Priority Queue ADT Binary Heaps Gerda Kamberova Department of Computer Science Hofstra University.

PQ, binary heaps G.Kamberova, Algorithms Priority Queue ADT Binary Heaps Gerda Kamberova Department of Computer Science Hofstra University.
Heapsort CIS 606 Spring 2010. Overview Heapsort – O(n lg n) worst case—like merge sort. – Sorts in place—like insertion sort. – Combines the best of both.

Heapsort CIS 606 Spring Overview Heapsort – O(n lg n) worst case—like merge sort. – Sorts in place—like insertion sort. – Combines the best of both.
CSC 172 DATA STRUCTURES. Priority Queues Model Set with priorities associatedwith elements Priorities are comparable by a < operator Operations Insert.

CSC 172 DATA STRUCTURES. Priority Queues Model Set with priorities associatedwith elements Priorities are comparable by a < operator Operations Insert.
1 Priority Queues (Heaps)  Sections 6.1 to 6.5. 2 The Priority Queue ADT  DeleteMin –log N time  Insert –log N time  Other operations –FindMin  Constant.

1 Priority Queues (Heaps)  Sections 6.1 to The Priority Queue ADT  DeleteMin –log N time  Insert –log N time  Other operations –FindMin  Constant.
Maps A map is an object that maps keys to values Each key can map to at most one value, and a map cannot contain duplicate keys KeyValue Map Examples Dictionaries:

Maps A map is an object that maps keys to values Each key can map to at most one value, and a map cannot contain duplicate keys KeyValue Map Examples Dictionaries:
Computer Science and Software Engineering University of Wisconsin - Platteville 12. Heap Yan Shi CS/SE 2630 Lecture Notes Partially adopted from C++ Plus.

Computer Science and Software Engineering University of Wisconsin - Platteville 12. Heap Yan Shi CS/SE 2630 Lecture Notes Partially adopted from C++ Plus.
PRIORITY QUEUES (HEAPS). Queues are a standard mechanism for ordering tasks on a first-come, first-served basis However, some tasks may be more important.

PRIORITY QUEUES (HEAPS). Queues are a standard mechanism for ordering tasks on a first-come, first-served basis However, some tasks may be more important.

Similar presentations

Ads by Google