CS623: Introduction to Computing with Neural Nets (lecture-14)

Slides:



Advertisements
Similar presentations
CS344: Introduction to Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 15, 16: Perceptrons and their computing power 6 th and.
Advertisements

ECIV 301 Programming & Graphics Numerical Methods for Engineers Lecture 15 Solution of Systems of Equations.
Lecture#6: segmentation Anat Levin Introduction to Computer Vision Class Fall 2009 Department of Computer Science and App math, Weizmann Institute of Science.
CE 311 K - Introduction to Computer Methods Daene C. McKinney
Combined Lecture CS621: Artificial Intelligence (lecture 25) CS626/449: Speech-NLP-Web/Topics-in- AI (lecture 26) Pushpak Bhattacharyya Computer Science.
CS623: Introduction to Computing with Neural Nets (lecture-6) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
CS623: Introduction to Computing with Neural Nets (lecture-10) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
CS623: Introduction to Computing with Neural Nets (lecture-20) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
CS621: Artificial Intelligence Lecture 11: Perceptrons capacity Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
Prof. Pushpak Bhattacharyya, IIT Bombay 1 CS 621 Artificial Intelligence Lecture /10/05 Prof. Pushpak Bhattacharyya Linear Separability,
CS621 : Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 28: Principal Component Analysis; Latent Semantic Analysis.
CS344: Introduction to Artificial Intelligence (associated lab: CS386) Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 31: Feedforward N/W; sigmoid.
CS344: Introduction to Artificial Intelligence (associated lab: CS386) Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 30: Perceptron training convergence;
CS621 : Artificial Intelligence
1 10/15/04CS150 Introduction to Computer Science 1 Reading from and Writing to Files Part 2.
Hopfield Neural Networks for Optimization 虞台文 大同大學資工所 智慧型多媒體研究室.
CS623: Introduction to Computing with Neural Nets (lecture-16) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
CS623: Introduction to Computing with Neural Nets (lecture-12) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
CS623: Introduction to Computing with Neural Nets (lecture-17) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
Matrix Multiplication The Introduction. Look at the matrix sizes.
CS623: Introduction to Computing with Neural Nets (lecture-7) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
CS344 : Introduction to Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 23- Forward probability and Robot Plan; start of plan.
Notes Over 4.2 Finding the Product of Two Matrices Find the product. If it is not defined, state the reason. To multiply matrices, the number of columns.
CS623: Introduction to Computing with Neural Nets (lecture-9) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
Prof. Pushpak Bhattacharyya, IIT Bombay1 CS 621 Artificial Intelligence Lecture /08/05 Prof. Pushpak Bhattacharyya Fuzzy Inferencing.
Lecture 39 Hopfield Network
CS621 : Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 20: Neural Net Basics: Perceptron.
CS621: Artificial Intelligence Lecture 10: Perceptrons introduction Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
Fig. 6-CO, p p. 185a p. 185b p. 185c p. 185d.
CS623: Introduction to Computing with Neural Nets (lecture-18) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.
CS344 : Introduction to Artificial Intelligence Pushpak Bhattacharyya CSE Dept., IIT Bombay Lecture 5- Deduction Theorem.
REVIEW Linear Combinations Given vectors and given scalars
Solving Traveling salesman Problem with Hopfield Net
Hopfield net and Traveling Salesman problem
CS623: Introduction to Computing with Neural Nets (lecture-5)
CS344: Introduction to Artificial Intelligence (associated lab: CS386)
Pushpak Bhattacharyya Computer Science and Engineering Department
Linear Algebra Lecture 17.
CS621: Artificial Intelligence
CS344 : Introduction to Artificial Intelligence
CS623: Introduction to Computing with Neural Nets (lecture-2)
CS621: Artificial Intelligence Lecture 17: Feedforward network (lecture 16 was on Adaptive Hypermedia: Debraj, Kekin and Raunak) Pushpak Bhattacharyya.
Neural Networks Chapter 4
Pushpak Bhattacharyya Computer Science and Engineering Department
CS623: Introduction to Computing with Neural Nets (lecture-15)
CS623: Introduction to Computing with Neural Nets (lecture-4)
Department of Computer Science & Engineering, HITEC University, Taxila
CS100: Discrete structures
CS344 : Introduction to Artificial Intelligence
CS623: Introduction to Computing with Neural Nets (lecture-9)
Pushpak Bhattacharyya Computer Science and Engineering Department
CS344 : Introduction to Artificial Intelligence
CS621: Artificial Intelligence
CS 621 Artificial Intelligence Lecture 27 – 21/10/05
Fig. 6-CO, p. 211.
07CO, p. 190.
ARTIFICIAL INTELLIGENCE
CS621: Artificial Intelligence Lecture 12: Counting no
CS623: Introduction to Computing with Neural Nets (lecture-5)
3.6 Multiply Matrices.
Hopfield Neural Networks for Optimization
CS623: Introduction to Computing with Neural Nets (lecture-3)
CS621 : Artificial Intelligence
Centre for Technology Alternatives for Rural Areas, IIT Bombay
CS621: Artificial Intelligence Lecture 22-23: Sigmoid neuron, Backpropagation (Lecture 20 and 21 taken by Anup on Graphical Models) Pushpak Bhattacharyya.
Prof. Pushpak Bhattacharyya, IIT Bombay
CS621: Artificial Intelligence Lecture 14: perceptron training
CS621: Artificial Intelligence Lecture 18: Feedforward network contd
CS623: Introduction to Computing with Neural Nets (lecture-11)
CS621: Artificial Intelligence Lecture 17: Feedforward network (lecture 16 was on Adaptive Hypermedia: Debraj, Kekin and Raunak) Pushpak Bhattacharyya.
Presentation transcript:

CS623: Introduction to Computing with Neural Nets (lecture-14) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay

Finding weights for Hopfield Net applied to TSP Alternate and more convenient Eproblem EP = E1 + E2 where E1 is the equation for n cities, each city in one position and each position with one city. E2 is the equation for distance

Expressions for E1 and E2

Explanatory example 1 2 3 x11 x12 x13 x21 x22 x23 x31 x32 x33 3 1 2 Fig. 1 shows two possible directions in which tour can take place Fig. 1 pos 1 2 3 x11 x12 x13 x21 x22 x23 x31 x32 x33 city For the matrix alongside, xiα = 1, if and only if, ith city is in position α

Kinds of weights Row weights: w11,12 w11,13 w12,13 Column weights w11,21 w11,31 w21,31 w12,22 w12,32 w22,32 w13,23 w13,33 w23,33

Cross weights w11,22 w11,23 w11,32 w11,33 w12,21 w12,23 w12,31 w12,33

Expressions

Expressions (contd.)

Enetwork

Find row weight To find, w11,12 = -(co-efficient of x11x12) in Enetwork Search x11x12 in Eproblem w11,12 = -A ...from E1. E2 cannot contribute

Find column weight To find, w11,21 = -(co-efficient of x11x21) in Enetwork Search co-efficient of x11x21 in Eproblem w11,21 = -A ...from E1. E2 cannot contribute

Find Cross weights To find, w11,22 = -(co-efficient of x11x22) Search x11x22 from Eproblem. E1 cannot contribute Co-eff. of x11x22 in E2 (d12 + d21) / 2 Therefore, w11,22 = -( (d12 + d21) / 2)

Find Cross weights To find, w11,33 = -(co-efficient of x11x33) Search for x11x33 in Eproblem w11,33 = -( (d13 + d31) / 2)

Summary Row weights = -A Column weights = -A Cross weights = - ( (dij + dji) / 2), j = i ± 1