Lecture 12 Algorithm Analysis

Slides:



Advertisements
Similar presentations
Chapter 23 Minimum Spanning Tree
Advertisements

Comp 122, Spring 2004 Greedy Algorithms. greedy - 2 Lin / Devi Comp 122, Fall 2003 Overview  Like dynamic programming, used to solve optimization problems.
Greedy Algorithms Greed is good. (Some of the time)
Minimum Spanning Trees Definition of MST Generic MST algorithm Kruskal's algorithm Prim's algorithm.
Minimum Spanning Tree (MST) form a tree that connects all the vertices (spanning tree). minimize the total edge weight of the spanning tree. Problem Select.
Chapter 23 Minimum Spanning Trees
Data Structures, Spring 2004 © L. Joskowicz 1 Data Structures – LECTURE 13 Minumum spanning trees Motivation Properties of minimum spanning trees Kruskal’s.
CSE 780 Algorithms Advanced Algorithms Minimum spanning tree Generic algorithm Kruskal’s algorithm Prim’s algorithm.
Lecture 18: Minimum Spanning Trees Shang-Hua Teng.
1 Minimum Spanning Trees Definition of MST Generic MST algorithm Kruskal's algorithm Prim's algorithm.
Analysis of Algorithms CS 477/677
Lecture 12 Minimum Spanning Tree. Motivating Example: Point to Multipoint Communication Single source, Multiple Destinations Broadcast – All nodes in.
Minimum Spanning Trees CIS 606 Spring Problem A town has a set of houses and a set of roads. A road connects 2 and only 2 houses. A road connecting.
1 CSE 417: Algorithms and Computational Complexity Winter 2001 Lecture 11 Instructor: Paul Beame.
Design and Analysis of Algorithms Minimum Spanning trees
Midwestern State University Minimum Spanning Trees Definition of MST Generic MST algorithm Kruskal's algorithm Prim's algorithm 1.
Design and Analysis of Computer Algorithm September 10, Design and Analysis of Computer Algorithm Lecture 5-2 Pradondet Nilagupta Department of Computer.
Theory of Computing Lecture 10 MAS 714 Hartmut Klauck.
COSC 3101NJ. Elder Assignment 2 Remarking Assignment 2 Marks y = 0.995x R 2 = Old Mark New Mark.
MST Many of the slides are from Prof. Plaisted’s resources at University of North Carolina at Chapel Hill.
2IL05 Data Structures Fall 2007 Lecture 13: Minimum Spanning Trees.
Spring 2015 Lecture 11: Minimum Spanning Trees
UNC Chapel Hill Lin/Foskey/Manocha Minimum Spanning Trees Problem: Connect a set of nodes by a network of minimal total length Some applications: –Communication.
Minimum Spanning Trees and Kruskal’s Algorithm CLRS 23.
 2004 SDU Lecture 7- Minimum Spanning Tree-- Extension 1.Properties of Minimum Spanning Tree 2.Secondary Minimum Spanning Tree 3.Bottleneck.
1 Minimum Spanning Trees. Minimum- Spanning Trees 1. Concrete example: computer connection 2. Definition of a Minimum- Spanning Tree.
November 13, Algorithms and Data Structures Lecture XII Simonas Šaltenis Aalborg University
Chapter 23: Minimum Spanning Trees: A graph optimization problem Given undirected graph G(V,E) and a weight function w(u,v) defined on all edges (u,v)
F d a b c e g Prim’s Algorithm – an Example edge candidates choosen.
© 2007 Seth James Nielson Minimum Spanning Trees … or how to bring the world together on a budget.
Lecture 13 Algorithm Analysis
Greedy Algorithms Z. GuoUNC Chapel Hill CLRS CH. 16, 23, & 24.
© 2007 Seth James Nielson Minimum Spanning Trees … or how to bring the world together on a budget.
MST Lemma Let G = (V, E) be a connected, undirected graph with real-value weights on the edges. Let A be a viable subset of E (i.e. a subset of some MST),
Lecture 12 Algorithm Analysis Arne Kutzner Hanyang University / Seoul Korea.
Algorithm Design and Analysis June 11, Algorithm Design and Analysis Pradondet Nilagupta Department of Computer Engineering This lecture note.
Minimum Spanning Tree. p2. Minimum Spanning Tree G=(V,E): connected and undirected w: E  R, weight function a b g h i c f d e
Midwestern State University Minimum Spanning Trees Definition of MST Generic MST algorithm Kruskal's algorithm Prim's algorithm 1.
Greedy Algorithms General principle of greedy algorithm
Lecture ? The Algorithms of Kruskal and Prim
Algorithm Analysis Fall 2017 CS 4306/03
Introduction to Algorithms
Spanning Trees Kruskel’s Algorithm Prim’s Algorithm
Introduction to Algorithms`
Minimum Spanning Trees
Lecture 12 Algorithm Analysis
Greedy Algorithms / Minimum Spanning Tree Yin Tat Lee
Minimum Spanning Trees
Minimum Spanning Tree.
Algorithms and Data Structures Lecture XII
Data Structures – LECTURE 13 Minumum spanning trees
Chapter 23 Minimum Spanning Tree
CS 583 Analysis of Algorithms
Minimum Spanning Trees
Kruskal’s Minimum Spanning Tree Algorithm
Analysis of Algorithms CS 477/677
Lecture 13 Algorithm Analysis
Lecture 13 Algorithm Analysis
Lecture 12 Algorithm Analysis
Lecture 13 Algorithm Analysis
Minimum Spanning Trees
Minimum Spanning Trees
Lecture 13 Algorithm Analysis
Minimum Spanning Tree.
Minimum Spanning Trees
Greedy Algorithms Comp 122, Spring 2004.
Introduction to Algorithms: Greedy Algorithms (and Graphs)
Advanced Algorithms Analysis and Design
Chapter 23: Minimum Spanning Trees: A graph optimization problem
Minimum Spanning Trees
Presentation transcript:

Lecture 12 Algorithm Analysis Arne Kutzner Hanyang University / Seoul Korea

Minimum Spanning Trees

Introduction - Problem A town has a set of houses and a set of roads A road connects 2 and only 2 houses A road connecting houses u and v has a repair cost w(u, v) Goal: Repair enough (and no more) roads such that everyone stays connected: can reach every house from all other houses, and total repair cost is minimal 2016/11 Algorithm Analysis

Model as a graph Undirected graph G = (V, E). Weight w(u, v) on each edge (u, v) ∈ E. Find T ⊆ E such that T connects all vertices (T is a spanning tree), and is minimized. A spanning tree whose weight is minimum over all spanning trees is called a minimum spanning tree, or MST. 2016/11 Algorithm Analysis

Example Edges of MST are shaded In the above graph there is more than one MST. Replace edge (e, f ) by (c, e) and you get a different spanning tree with the same weight 2016/11 Algorithm Analysis

Growing a Minimum Spanning Tree Some properties of an MST: It has |V| − 1 edges It has no cycles It might not be unique Building up the solution We will build a set A of edges Initially, A has no edges As we add edges to A, maintain a loop invariant: A is a subset of some MST Add only edges that maintain the invariant. If A is a subset of some MST, an edge (u, v) is safe for A if and only if A ∪ {(u, v)} is also a subset of some MST. So we will add only safe edges. 2016/11 Algorithm Analysis

Generic MST algorithm Use the loop invariant to show that this generic algorithm works. Initialization: The empty set trivially satisfies the loop invariant. Maintenance: Since we add only safe edges, A remains a subset of some MST. Termination: All edges added to A are in a MST, so when we stop, A is a spanning tree that is also an MST. 2016/11 Algorithm Analysis

Some Definitions Let S ⊂ V and A ⊆ E A cut (S, V − S) is a partition of vertices into disjoint sets V and V − S. Edge (u, v) ∈ E crosses cut (S, V − S) if one endpoint is in S and the other is in V − S. A cut respects A if and only if no edge in A crosses the cut. An edge is a light edge crossing a cut if and only if its weight is minimum over all edges crossing the cut. (For a given cut, there can be > 1 light edge crossing it.) 2016/11 Algorithm Analysis

Central Theorem Theorem: Let A be a subset of some MST, (S, V − S) be a cut that respects A, and (u, v) be a light edge crossing (S, V − S). Then (u, v) is safe for A. Proof: Let T be an MST that includes A. (a) If T contains (u, v), done. (b) If T does not contain (u, v), we will construct a different MST T' that includes A ∪ {(u, v)}. 2016/11 Algorithm Analysis

Central Theorem - Proof (cont.) A tree has unique path between each pair of vertices Since T is an MST, it contains a unique path p between u and v. Path p must cross the cut (S, V − S) at least once Let (x, y) be an edge of p that crosses the cut. From how we chose (u, v), must have w(u, v) ≤ w(x, y) 2016/11 Algorithm Analysis

Central Theorem - Proof (cont.) Since the cut respects A, edge (x, y) is not in A. To form T' from T : Remove (x, y) in order to Split T into two components Add (u, v) in order to reconnect. So T' = T − {(x, y)} ∪ {(u, v)}. T' is a MST. Because T' is a spanning tree and: w(T') = w(T ) − w(x, y) + w(u, v) ≤ w(T) 2016/11 Algorithm Analysis

Central Theorem - Proof (cont.) Finally we have to show that (u, v) is safe for A: A ⊆ T and (x, y) A ⇒ A ⊆ T' A ∪ {(u, v)} ⊆ T' Since T' is an MST, (u, v) is safe for A Corollary If C = (VC, EC) is a connected component in the forest GA = (V, A) and (u, v) is a light edge connecting C to some other component in GA (i.e., (u, v) is a light edge crossing the cut (VC, V − VC)), then (u, v) is safe for A. 2016/11 Algorithm Analysis

Kruskal’s Algorithm

Kruskal’s Algorithm - Structure G = (V, E) is a connected, undirected, weighted graph. w : E → R. Starts with each vertex being its own component. Repeatedly merges two components into one by choosing the light edge that connects them (i.e., the light edge crossing the cut between them). Scans the set of edges in monotonically increasing order by weight. Uses a disjoint-set data structure to determine whether an edge connects vertices in different components. 2016/11 Algorithm Analysis

Kruskal’s Algorithm - Pseudocode 2016/11 Algorithm Analysis

Kruskal’s Algorithm - Analysis Basics: Initialize A: O(1) First for loop: |V| MAKE-SETs Sort E: O(E lg E) Second for loop: O(E) FIND-SETs and UNIONs Assuming the implementation of disjoint-set data structure, presented in the Textbook in Chapter 21, that uses union by rank and path compression: O((V + E) α(V)) + O(E lg E) Since G is connected, |E| ≥ |V| − 1⇒ O(E α(V)) + O(E lg E) α(|V|) = O(lg V) = O(lg E) Therefore, total time is O(E lg E) |E| ≤ |V|2 ⇒lg |E| = O(2 lg V) = O(lg V) Therefore we can restate the running time as O(E lg V) 2016/11 Algorithm Analysis

Prim’s Algorithm

Prim’s Algorithm Builds one tree, so A is always a tree Starts from an arbitrary “root” r At each step, find a light edge crossing cut (VA, V − VA), where VA = vertices that A is incident on. Add this edge to A. 2016/11 Algorithm Analysis

Prim’s Algorithm (cont.) How to find the light edge quickly? Use a priority queue Q: Each object is a vertex in V − VA Key of v is minimum weight of any edge (u, v), where u ∈ VA. Then the vertex returned by EXTRACT-MIN is v such that there exists u ∈ VA and (u, v) is light edge crossing (VA, V − VA) Key of v is ∞ if v is not adjacent to any vertices in VA. 2016/11 Algorithm Analysis

Prim’s Algorithm (cont.) The edges of A will form a rooted tree with root r: r is given as an input to the algorithm, but it can be any vertex Each vertex knows its parent in the tree by the attribute π[v] = parent of v π[v] = NIL if v = r or v has no parent As algorithm progresses, A = {(v, π[v]) : v ∈ V − {r} − Q} At termination, VA = V ⇒ Q = ∅, so MST is A = {(v, π[v]) : v ∈ V − {r}} 2016/11 Algorithm Analysis

Prim’s Algorithm - Pseudocode 2016/11 Algorithm Analysis

Complexity - Analysis Depends on how the priority queue is implemented: Suppose Q is a binary heap. Initialize Q and first for loop: O(V lg V) Decrease key of r : O(lg V) while loop: |V| EXTRACT-MIN calls ⇒ O(V lg V) ≤ |E| DECREASE-KEY calls ⇒ O(E lg V) Total: O(E lg V) 2016/11 Algorithm Analysis