1 COMBINATORIAL OPTIMIZATION : an instance s : Solutions Set f : s → Cost function to minimize (Max) Find s* S s.t. f ( s* ) f ( s ), s S ( MIN) or f (

Slides:



Advertisements
Similar presentations
Max Flow Min Cut. Theorem The maximum value of an st-flow in a digraph equals the minimum capacity of an st-cut. Theorem If every arc has integer capacity,
Advertisements

1 LP Duality Lecture 13: Feb Min-Max Theorems In bipartite graph, Maximum matching = Minimum Vertex Cover In every graph, Maximum Flow = Minimum.
Approximation Algorithms
Carthagène A brief introduction to combinatorial optimization: The Traveling Salesman Problem Simon de Givry.
Carthagène A brief introduction to combinatorial optimization: The Traveling Salesman Problem Simon de Givry Thales Research & Technology, France (minor.
Design and Analysis of Algorithms Approximation algorithms for NP-complete problems Haidong Xue Summer 2012, at GSU.
Polynomial Time Approximation Schemes Presented By: Leonid Barenboim Roee Weisbert.
Online Social Networks and Media. Graph partitioning The general problem – Input: a graph G=(V,E) edge (u,v) denotes similarity between u and v weighted.
Discrete Optimization Shi-Chung Chang. Discrete Optimization Lecture #1 Today: Reading Assignments 1.Chapter 1 and the Appendix of [Pas82] 2.Chapter 1.
Computability and Complexity 23-1 Computability and Complexity Andrei Bulatov Search and Optimization.
Introduction to Approximation Algorithms Lecture 12: Mar 1.
1 Optimization problems such as MAXSAT, MIN NODE COVER, MAX INDEPENDENT SET, MAX CLIQUE, MIN SET COVER, TSP, KNAPSACK, BINPACKING do not have a polynomial.
Math443/543 Mathematical Modeling and Optimization
1 Traveling Salesman Problem (TSP) Given n £ n positive distance matrix (d ij ) find permutation  on {0,1,2,..,n-1} minimizing  i=0 n-1 d  (i),  (i+1.
1 Maximum matching Max Flow Shortest paths Min Cost Flow Linear Programming Mixed Integer Linear Programming Worst case polynomial time by Local Search.
QAP/MPI Adam Gaweda Anthony Habash Ray Brown. What is QAP Stands for Quadratic Assignment Problem The QAP is the problem of assigning a set of facilities.
Utrecht, february 22, 2002 Applications of Tree Decompositions Stan van Hoesel KE-FdEWB Universiteit Maastricht
Ant Colony Optimization Optimisation Methods. Overview.
Optimization problems INSTANCE FEASIBLE SOLUTIONS COST.
Ch 13 – Backtracking + Branch-and-Bound
Facility Location with Nonuniform Hard Capacities Tom Wexler Martin Pál Éva Tardos Cornell University ( A 9-Approximation)
1 Combinatorial Dominance Analysis Keywords: Combinatorial Optimization (CO) Approximation Algorithms (AA) Approximation Ratio (a.r) Combinatorial Dominance.
Josu Ceberio Alexander Mendiburu Jose A. Lozano
1 Integrality constraints Integrality constraints are often crucial when modeling optimizayion problems as linear programs. We have seen that if our linear.
Ant Colony Optimization: an introduction
Metaheuristics The idea: search the solution space directly. No math models, only a set of algorithmic steps, iterative method. Find a feasible solution.
Hon Wai Leong, NUS (CS6234, Spring 2009) Page 1 Copyright © 2009 by Leong Hon Wai CS6234 Lecture 1 -- (14-Jan-09) “Introduction”  Combinatorial Optimization.
Algorithms for Network Optimization Problems This handout: Minimum Spanning Tree Problem Approximation Algorithms Traveling Salesman Problem.
Design Techniques for Approximation Algorithms and Approximation Classes.
Lecture 16 Maximum Matching. Incremental Method Transform from a feasible solution to another feasible solution to increase (or decrease) the value of.
Design & Analysis of Algorithms Combinatory optimization SCHOOL OF COMPUTING Pasi Fränti
Design and Analysis of Algorithms - Chapter 111 How to tackle those difficult problems... There are two principal approaches to tackling NP-hard problems.
Chapter 12 Coping with the Limitations of Algorithm Power Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
Ant Colony Optimization Algorithms for TSP: 3-6 to 3-8 Timothy Hahn February 13, 2008.
Chapter 2 Greedy Strategy I. Independent System Ding-Zhu Du.
Approximation Algorithms for NP-hard Combinatorial Problems Magnús M. Halldórsson Reykjavik University Local Search, Greedy and Partitioning
CSE 589 Part VI. Reading Skiena, Sections 5.5 and 6.8 CLR, chapter 37.
1/24 Introduction to Graphs. 2/24 Graph Definition Graph : consists of vertices and edges. Each edge must start and end at a vertex. Graph G = (V, E)
Optimizing Pheromone Modification for Dynamic Ant Algorithms Ryan Ward TJHSST Computer Systems Lab 2006/2007 Testing To test the relative effectiveness.
Introducing Mixtures of Generalized Mallows in Estimation of Distribution Algorithms Josian Santamaria Josu Ceberio Roberto Santana Alexander Mendiburu.
Ant Colony Optimization Quadratic Assignment Problem Hernan AGUIRRE, Adel BEN HAJ YEDDER, Andre DIAS and Pascalis RAPTIS Problem Leader: Marco Dorigo Team.
Clase 3: Basic Concepts of Search. Problems: SAT, TSP. Tarea 1 Computación Evolutiva Gabriela Ochoa
CSCI-256 Data Structures & Algorithm Analysis Lecture Note: Some slides by Kevin Wayne. Copyright © 2005 Pearson-Addison Wesley. All rights reserved. 25.
Vasilis Syrgkanis Cornell University
NP-completeness NP-complete problems. Homework Vertex Cover Instance. A graph G and an integer k. Question. Is there a vertex cover of cardinality k?
Approximation Algorithms Duality My T. UF.
Exhaustive search Exhaustive search is simply a brute- force approach to combinatorial problems. It suggests generating each and every element of the problem.
Particle Swarm Optimization
Hamiltonian Cycle and TSP
Hamiltonian Cycle and TSP
Graph Theory and Algorithm 02
Richard Anderson Lecture 23 Network Flow
Lecture 22 Network Flow, Part 2
Subject Name: Operation Research Subject Code: 10CS661 Prepared By:Mrs
Lecture 16 Maximum Matching
3-3 Optimization with Linear Programming
Ant Colony Optimization Quadratic Assignment Problem
Heuristic Algorithms via VBA
Introduction Basic formulations Applications
Lecture 19-Problem Solving 4 Incremental Method
Unit-4: Dynamic Programming
Lecture 11 Overview Self-Reducibility.
Lecture 11 Overview Self-Reducibility.
Problem Solving 4.
Design & Analysis of Algorithms Combinatorial optimization
X y y = x2 - 3x Solutions of y = x2 - 3x y x –1 5 –2 –3 6 y = x2-3x.
Heuristic Algorithms via VBA
Heuristic Algorithms via VBA
Lecture 22 Network Flow, Part 2
Lecture 24 Vertex Cover and Hamiltonian Cycle
Presentation transcript:

1 COMBINATORIAL OPTIMIZATION : an instance s : Solutions Set f : s → Cost function to minimize (Max) Find s* S s.t. f ( s* ) f ( s ), s S ( MIN) or f ( s* ) f ( s ), s S ( MAX)

2 Local Search ( LS) Neighborhood structure : - i solution - N : S → i→ N ( i ) S N ( i ) = ¨ near ¨ to i solutions ĩ is a local minimum if f ( i ) f ( j ), j N ( i ) ĩ is a local maximum if f ( i ) f ( j ), j N ( i )

3 Local Search Algorithm Define a neighborhood N ( ) Initial solution = Find a solution ΄ N ( ) improving the cost : = ´ If ´ does not exist STOP ( local optimum)

4 The local search algorithm

5 Examples The Traveling Salesman Problem 2 - opt, 3 – opt,..., k – opt 2 - exchange

6

7 Examples The Bipartitioning of a weighted graph G ( V, E, W ), = 2 n. Find partitions A, B of V with = and Minimizing f ( A, B ) =

8 Graph Bipartitioning

9 Search strategies in LS First improvement Best improvement Worst improvement

10 The Quadratic Assignment Problem (QAP) n locations : distance n facilities: flow f ij π(i)=k: facility i  location k minimize the local cost

11 The Quadratic Assignment Problem (QAP) n locations : distance n facilities: flow f ij π(i)=k: facility i  location k minimize the total cost

12 The QAP  2-exchange: π=(π(1),...,π(i),...,π(j),...π(n)) π ij =(π(1),...,π(j),...,π(i),...π(n)) N(π)=(n*(n-1))/2

13 The QAP: an example π= exch. π ij = locations

14 Traveling Salesman Problem (2-exchange)

15 Bipartitioning weighted graph G(V,E) 2-exchange

16 Particular cases(Bipartitioning) h/2

17 K-densest and k-lightest

18 Results (2-exchange) m n-m

19 The Local Search: The MIS example : The maximum Independent Set problem in a graph G(V,E)

20 The MIS by the Local Search Solution coding : Function :

21 Neighborhood : FLIP

22 LS Drawbacks Local optimum “good“ neighborhoods exploration strategies Performances guarantee ? Parallelization ?