Hopfield net and Traveling Salesman problem

Slides:



Advertisements
Similar presentations
CSE 211 Discrete Mathematics
Advertisements

22C:19 Discrete Math Graphs Fall 2010 Sukumar Ghosh.
Introduction to Graph Theory Instructor: Dr. Chaudhary Department of Computer Science Millersville University Reading Assignment Chapter 1.
22C:19 Discrete Math Graphs Fall 2014 Sukumar Ghosh.
Review Binary Search Trees Operations on Binary Search Tree
Reducibility Class of problems A can be reduced to the class of problems B Take any instance of problem A Show how you can construct an instance of problem.
1 MERLIN A polynomial solution for the Traveling Salesman Problem Dr. Joachim Mertz, 2005.
9.2 The Traveling Salesman Problem. Let us return to the question of finding a cheapest possible cycle through all the given towns: We have n towns (points)
Graphs. Overview What is a graph? Some terminology Types of graph Implementing graphs (briefly) Some graph algorithms Graphs 2/18.
Branch and Bound Similar to backtracking in generating a search tree and looking for one or more solutions Different in that the “objective” is constrained.
Energy function: E(S 1,…,S N ) = - ½ Σ W ij S i S j + C (W ii = P/N) (Lyapunov function) Attractors= local minima of energy function. Inverse states Mixture.
Linear Programming Applications
IT 60101: Lecture #201 Foundation of Computing Systems Lecture 20 Classic Optimization Problems.
Graph Theory Topics to be covered:
Structures 7 Decision Maths: Graph Theory, Networks and Algorithms.
Euler and Hamilton Paths. Euler Paths and Circuits The Seven bridges of Königsberg a b c d A B C D.
Algebra 3: Section 5.5 Objectives of this Section Find the Sum and Difference of Two Matrices Find Scalar Multiples of a Matrix Find the Product of Two.
Activations, attractors, and associators Jaap Murre Universiteit van Amsterdam
Optimization with Neural Networks Presented by: Mahmood Khademi Babak Bashiri Instructor: Dr. Bagheri Sharif University of Technology April 2007.
An Algorithm for the Traveling Salesman Problem John D. C. Little, Katta G. Murty, Dura W. Sweeney, and Caroline Karel 1963 Speaker: Huang Cheng-Kang.
Activations, attractors, and associators Jaap Murre Universiteit van Amsterdam en Universiteit Utrecht
Hopfield Neural Networks for Optimization 虞台文 大同大學資工所 智慧型多媒體研究室.
Source: CSE 214 – Computer Science II Graphs.
Chapter 20: Graphs. Objectives In this chapter, you will: – Learn about graphs – Become familiar with the basic terminology of graph theory – Discover.
Graphs Definition: a graph is an abstract representation of a set of objects where some pairs of the objects are connected by links. The interconnected.
(CSC 102) Lecture 30 Discrete Structures. Graphs.
Exhaustive search Exhaustive search is simply a brute- force approach to combinatorial problems. It suggests generating each and every element of the problem.
1 Minimum Spanning Tree: Solving TSP for Metric Graphs using MST Heuristic Soheil Shafiee Shabnam Aboughadareh.
Lecture 39 Hopfield Network
11/30/2006 Travelling Salesman Problem Sebastian Dittmann COSC 6111 Advanced Design and Analysis of Algorithms.
Limitation of Computation Power – P, NP, and NP-complete
More NP-complete problems
NP-completeness Ch.34.
Homework 8 Graph G is given by the figure below.
Graphs Chapter 20.
EMIS 8373: Integer Programming
Shortest Path Problems
Hopfield Networks MacKay - Chapter 42.
Solving Traveling salesman Problem with Hopfield Net
CSC 172 DATA STRUCTURES.
Lecture 2-2 NP Class.
Ch7: Hopfield Neural Model
Lecture 6B – Optimality Criteria: ML & ME
More NP-complete Problems
SULE SOLMAZ BEYZA AYTAR
Matrix Representation of Graph
CS120 Graphs.
Comp 245 Data Structures Graphs.
Spanning Trees Discrete Mathematics.
CSC 172 DATA STRUCTURES.
Lecture 24 NP-Complete Problems
Introduction to Graph Theory Euler and Hamilton Paths and Circuits
Graph Theory.
Lecture 15: Graph Theory II
Neural Networks for Vertex Covering
Genome Assembly.
Maximum Flows of Minimum Cost
ECE/CS/ME 539 Neural Networks and Fuzzy Systems
Neural Networks Chapter 4
CS623: Introduction to Computing with Neural Nets (lecture-15)
A path that uses every vertex of the graph exactly once.
Lecture 6B – Optimality Criteria: ML & ME
Dynamic Programming.
Backtracking and Branch-and-Bound
Dynamic Programming.
CS623: Introduction to Computing with Neural Nets (lecture-14)
Hopfield Neural Networks for Optimization
Graphs CS 2606.
Lecture 24 Classical NP-hard Problems
Lecture 24 Vertex Cover and Hamiltonian Cycle
Presentation transcript:

Hopfield net and Traveling Salesman problem We consider the problem for n=4 cities In the given figure, nodes represent cities and edges represent the paths between the cities with associated distance. D C A B dDA dBC dCD dAB dBD dAC

Traveling Salesman Problem Goal Come back to the city A, visiting j = 2 to n (n is number of cities) exactly once and minimize the total distance. To solve by Hopfield net we need to decide the architecture: How many neurons? What are the weights?

Constraints decide the parameters For n cities and n positions, establish city to position correspondence, i.e. Number of neurons = n cities * n positions Each position can take one and only one city Each city can be in exactly one position Total distance should be minimum

Architecture n * n matrix where rows denote cities and columns denote positions cell(i, j) = 1 if and only if ith city is in jth position Each cell is a neuron nr neurons, O(n4) connections pos(α) city(i)

Expressions corresponding to constraints Each city in one and only one position i.e. a row has a single 1. Above equation partially ensures each row has a single 1 xiα is I/O cost at the cell(i, α)

Expressions corresponding to constraints (contd.) 2. Each position has a single city i.e. each column has at most single 1.

Expressions corresponding to constraints (contd.) 3. Each city must be in exactly one position i.e. Each position must have a city This can be ensured by exactly n 1’s in the matrix We want quadratic expression because the energy expression of the Hopfield net is quadratic

Expressions corresponding to constraints (contd.) E1, E2, E3 ensure that each row has exactly one 1 and each column has exactly one 1 If we minimize E1 + E2 + E3 Ensures a Hamiltonian circuit on the city graph which is NP-complete problem

Expressions corresponding to constraints (contd.) 4. Minimum Distance traversed. dij = distance between city i and city j

Expressions corresponding to constraints (contd.) We minimize constraint energy

Expressions corresponding to constraints (contd.) We equate constraint energy: EP = Enet Find the weights