C&O 355 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.

Slides:



Advertisements
Similar presentations
Introduction to Algorithms 6.046J/18.401J/SMA5503
Advertisements

The Primal-Dual Method: Steiner Forest TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A AA A A A AA A A.
C&O 355 Lecture 15 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
Beyond Convexity – Submodularity in Machine Learning
Weighted Matching-Algorithms, Hamiltonian Cycles and TSP
COMP 482: Design and Analysis of Algorithms
C&O 355 Lecture 16 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
Min-Max Relations, Hall’s Theorem, and Matching-Algorithms Graphs & Algorithms Lecture 5 TexPoint fonts used in EMF. Read the TexPoint manual before you.
C&O 355 Lecture 6 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
C&O 355 Lecture 8 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
Bart Jansen 1.  Problem definition  Instance: Connected graph G, positive integer k  Question: Is there a spanning tree for G with at least k leaves?
Planar Graphs: Coloring and Drawing
CPSC 455/555 Combinatorial Auctions, Continued… Shaili Jain September 29, 2011.
C&O 355 Mathematical Programming Fall 2010 Lecture 9
C&O 355 Lecture 5 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
C&O 355 Lecture 23 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
Solving IPs – Cutting Plane Algorithm General Idea: Begin by solving the LP relaxation of the IP problem. If the LP relaxation results in an integer solution,
Walks, Paths and Circuits Walks, Paths and Circuits Sanjay Jain, Lecturer, School of Computing.
C&O 355 Mathematical Programming Fall 2010 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
1 Discrete Structures & Algorithms Graphs and Trees: III EECE 320.
Greedy Algorithms Be greedy! always make the choice that looks best at the moment. Local optimization. Not always yielding a globally optimal solution.
October 31, Algorithms and Data Structures Lecture XIII Simonas Šaltenis Nykredit Center for Database Research Aalborg University
November 14, Algorithms and Data Structures Lecture XIII Simonas Šaltenis Aalborg University
C&O 355 Mathematical Programming Fall 2010 Lecture 20 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Mathematical Programming Fall 2010 Lecture 21 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Lecture 20 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
C&O 355 Lecture 12 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
Totally Unimodular Matrices Lecture 11: Feb 23 Simplex Algorithm Elliposid Algorithm.
Greedy Algorithms Reading Material: Chapter 8 (Except Section 8.5)
Greedy Algorithms Like dynamic programming algorithms, greedy algorithms are usually designed to solve optimization problems Unlike dynamic programming.
1 Spanning Tree Polytope x1 x2 x3 Lecture 11: Feb 21.
Approximation Algorithms: Bristol Summer School 2008 Seffi Naor Computer Science Dept. Technion Haifa, Israel TexPoint fonts used in EMF. Read the TexPoint.
Theory of Computing Lecture 7 MAS 714 Hartmut Klauck.
C&O 355 Mathematical Programming Fall 2010 Lecture 17 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Lecture 2 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
Using Dijkstra’s Algorithm to Find a Shortest Path from a to z 1.
C&O 355 Mathematical Programming Fall 2010 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A.
C&O 355 Mathematical Programming Fall 2010 Lecture 4 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Topics in Algorithms 2005 Constructing Well-Connected Networks via Linear Programming and Primal Dual Algorithms Ramesh Hariharan.
© 2015 JW Ryder CSCI 203 Data Structures1. © 2015 JW Ryder CSCI 203 Data Structures2.
C&O 355 Mathematical Programming Fall 2010 Lecture 18 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Lecture 7 All-Pairs Shortest Paths. All-Pairs Shortest Paths.
Introduction to Algorithms Jiafen Liu Sept
CSE 2331 / 5331 Topic 12: Shortest Path Basics Dijkstra Algorithm Relaxation Bellman-Ford Alg.
Shortest Path Algorithms. Definitions Variants  Single-source shortest-paths problem: Given a graph, finding a shortest path from a given source.
C&O 355 Mathematical Programming Fall 2010 Lecture 16 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A.
Union Find ADT Data type for disjoint sets: makeSet(x): Given an element x create a singleton set that contains only this element. Return a locator/handle.
C&O 355 Mathematical Programming Fall 2010 Lecture 5 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A.
C&O 355 Lecture 7 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A.
C&O 355 Lecture 24 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA A A A A A A A A.
Nirmalya Roy School of Electrical Engineering and Computer Science Washington State University Cpt S 223 – Advanced Data Structures Math Review 1.
1 Approximation algorithms Algorithms and Networks 2015/2016 Hans L. Bodlaender Johan M. M. van Rooij TexPoint fonts used in EMF. Read the TexPoint manual.
Introduction to Algorithms All-Pairs Shortest Paths My T. UF.
EMIS 8374 Shortest Path Trees Updated 11 February 2008 Slide 1.
FORMAL LANGUAGES, AUTOMATA AND COMPUTABILITY TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AA.
C&O 355 Lecture 19 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A.
CS38 Introduction to Algorithms Lecture 3 April 8, 2014.
Linear program Separation Oracle. Rounding We consider a single-machine scheduling problem, and see another way of rounding fractional solutions to integer.
Ford-Fulkerson Recap.
Lap Chi Lau we will only use slides 4 to 19
Topics in Algorithms Lap Chi Lau.
COMP 6/4030 ALGORITHMS Prim’s Theorem 10/26/2000.
CS 154, Lecture 6: Communication Complexity
Lecture 7 All-Pairs Shortest Paths
Analysis of Algorithms
3.5 Minimum Cuts in Undirected Graphs
CS 583 Analysis of Algorithms
Problem Solving 4.
Shortest-Path Property 4.1
Presentation transcript:

C&O 355 Lecture 22 N. Harvey TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: A A A A A A A A A A

Topics Integral Polyhedra Minimum s-t Cuts via Ellipsoid Method Weight-Splitting Method Shortest Paths

Minimum s-t Cuts (LP) Theorem: Every optimal BFS of (LP) is optimal for (IP). (IP) So to solve (IP), we can just solve (LP) and return an optimal BFS. To solve (LP), the separation oracle is: (Lecture 12) Check if y a < 0 for any a 2 A. If so, the constraint “y a ¸ 0” is violated. Check if dist y (s,t)<1. If so, let p be an s-t path with length y (p)<1. Then the constraint for path p is violated. So to compute min s-t cuts, we just need an algorithm to compute shortest dipaths! (Lecture 21)

Shortest Paths in a Digraph Let G=(V,A) be a directed graph. Every arc a has a “length” w a >0. Given two vertices s and t, find a path from s to t of minimum total length s t These edges form a shortest s-t path

Shortest Paths in a Digraph Let b be vector with b s =1, b t =-1, b v =0 8 v 2 V n {s,t} Consider the IP: And the LP relaxation: Theorem: Every optimal BFS of (LP) is optimal for (IP). (Assignment 5) Claim: Every optimal solution of (IP) is a shortest s-t path.

Minimum S-T Cut Problem Shortest Path Problem Solve by Ellipsoid Method Separation oracle is… Solve by Ellipsoid Method! Our Min s-t Cut Algorithm Inner LP Has |V| constraints, |A| variables. Our analysis in Lecture 12: roughly O(|A| 6 ) iterations (actually, depends on # bits to represent lengths w) Outer LP Has | P | constraints, |A| variables Can show O(|A| 2 (log 2 |A| + log 2 c max ) ) iterations suffice Total Roughly O(|A| 8 ) iterations, each taking roughly O(|A| 3 ) time Total running time: roughly O(|A| 11 ) Best-known algorithm has running time: O(|A| 1.5 )

Combinatorial Algorithms We’ve used the ellipsoid method to prove several problems are solvable in “polynomial time” – LPs, Maximum Bipartite Matching, Max Weight Perfect Matching, Min s-t Cut, Shortest Paths – Approximate solutions to SDPs and some Convex Programs In practice, no one uses the ellipsoid method. It should be viewed as a “proof of concept” that efficient algorithms exist For many combinatorial optimization problems, combinatorial algorithms exist and are much faster Next: a slick way to design combinatorial algorithms, based on weight splitting.

k Weight-Splitting Method Let C ½ R n be set of feasible solutions to some optimization problem. Let w 2 R n be a “weight vector”. x is “optimal under w” if x optimizes min { w T y : y 2 C } Lemma: Suppose w = w 1 + w 2. Suppose that x is optimal under w 1, and x is optimal under w 2. Then x is optimal under w. Proof: Let z be optimal under w. Then: w T x = w 1 T x + w 2 T x · w 1 T z + w 2 T z = w T z So x is also optimal under w. ¥ HassinFrankBar-YehudaEven

ShortestPath( G, S, t, w ) Input: Digraph G = (V,A), source vertices S µ V, destination vertex t 2 V, and integer lengths w a, such that w a >0, unless both endpoints of a are in S. Output: A shortest path from some s 2 S to t. If t 2 S, return the empty path p=() Set w 1 (a)=1 for all a 2 ± + (S), and w 1 (a)=0 otherwise Set w 2 = w - w 1. Set S’ = S [ { u : 9 s 2 S with w 2 ( (s,u) ) = 0 } Set p’ = (v 1,v 2 ,t) = ShortestPath( G, S’, t, w 2 ) If v 1 2 S, then set p=p’ Else, set p=(s,v 1,v 2, ,t) where s 2 S and w 2 ( (s,v 1 ) )=0 Return path p To find shortest s-t path, run ShortestPath(G, {s}, t, w)

w s t S w1w s t w2w s t S w1w s t w2w s t S w1w s t w2w s t S

w s t S w1w s t w2w s t S w1w s t w2w s t S w1w s t w2w s t S

Claim: Algorithm returns a shortest path from S to t. Proof: By induction on number of recursive calls. If t 2 S, then the empty path is trivially shortest. Otherwise, p’ is a shortest path from S’ to t under w 2. So p is a shortest path from S to t under w 2. (Note: length w 2 (p)=length w 2 (p’), because if we added an arc, it has w 2 -length 0.) Note: p cannot re-enter S, otherwise a subpath of p would be a shorter S-t path. So p uses exactly one arc of ± + (S). So length w 1 (p)=1. But any S-t path has length at least 1 under w 1. So p is a shortest path from S to t under w 1. By Weight-Splitting Lemma, p is a shortest S-t path under arc-lengths w. ¥ Correctness of Algorithm