Graham Kendall +44 (0) 115 846 6514 G5AIAI Introduction to AI Graham Kendall Combinatorial Explosion.

Slides:



Advertisements
Similar presentations
State Space Representation and Search
Advertisements

Lecture 24 Coping with NPC and Unsolvable problems. When a problem is unsolvable, that's generally very bad news: it means there is no general algorithm.
Lecture # 38 Algorithms & Problem Solving: How Hard Can it Get?
Part2 AI as Representation and Search
 The amount of time it takes a computer to solve a particular problem depends on:  The hardware capabilities of the computer  The efficiency of the.
Vehicle Routing & Scheduling: Part 1
Algorithm Strategies Nelson Padua-Perez Chau-Wen Tseng Department of Computer Science University of Maryland, College Park.
Nature’s Algorithms David C. Uhrig Tiffany Sharrard CS 477R – Fall 2007 Dr. George Bebis.
P, NP and more.
1 Efficiency of Algorithms. 2  Two main issues related to the efficiency of algorithms:  Speed of algorithm  Efficient memory allocation  We will.
MAE 552 – Heuristic Optimization Lecture 5 February 1, 2002.
Solution methods for Discrete Optimization Problems.
TK3043 Analysis and Design of Algorithms Introduction to Algorithms.
CSc /6 Week nine 1 CSc142 Algorithms and efficiency Week 9 Pete Bagnall Elizabeth Phillips
Dr Rong Qu History of AI.  AI ◦ Originated in 1956, John McCarthy coined the term ◦ very successful at early stage  “Within 10 years a computer will.
Copyright R. Weber Search in Problem Solving Search in Problem Solving INFO 629 Dr. R. Weber.
Busby, Dodge, Fleming, and Negrusa. Backtracking Algorithm Is used to solve problems for which a sequence of objects is to be selected from a set such.
Towers of Hanoi. Introduction This problem is discussed in many maths texts, And in computer science an AI as an illustration of recursion and problem.
Copyright R. Weber Search in Problem Solving ISYS 370 Dr. R. Weber.
Branch & Bound UPPER =  LOWER = 0.
Chapter 7 Inefficiency and Intractability CS 345 Spring Quarter, 2014.
Fundamentals of Algorithms MCS - 2 Lecture # 7
Mary Beth Kurz, PhD Assistant Professor Department of Industrial Engineering Clemson University Utilizing Condor to Support Genetic Algorithm Design Research.
Search Methods An Annotated Overview Edward Tsang.
Genetic Algorithms Michael J. Watts
Spring 2015 Mathematics in Management Science Traveling Salesman Problem Approximate solutions for TSP NNA, RNN, SEA Greedy Heuristic Algorithms.
1 CO Games Development 1 Week 11 Search Methods Gareth Bellaby.
Unsolvability and Infeasibility. Computability (Solvable) A problem is computable if it is possible to write a computer program to solve it. Can all problems.
Problems you shouldn’t tackle. Problem Complexity.
Complexity A decidable problem is computationally solvable. But what resources are needed to solve the problem? –How much time will it require? –How much.
G5BAIM Artificial Intelligence Methods Graham Kendall History.
Lawrence Snyder University of Washington, Seattle © Lawrence Snyder 2004 What can a computer be commanded to do?
Cliff Shaffer Computer Science Computational Complexity.
1 Genetic Algorithms and Ant Colony Optimisation.
1 Branch and Bound Searching Strategies Updated: 12/27/2010.
Introduction to Genetic Algorithms. Genetic Algorithms We’ve covered enough material that we can write programs that use genetic algorithms! –More advanced.
Genetic Algorithms CSCI-2300 Introduction to Algorithms
SNU OOPSLA Lab. 1 Great Ideas of CS with Java Part 1 WWW & Computer programming in the language Java Ch 1: The World Wide Web Ch 2: Watch out: Here comes.
Complexity & Computability. Limitations of computer science  Major reasons useful calculations cannot be done:  execution time of program is too long.
Analysis of the Traveling Salesman Problem and current approaches for solving it. Rishi B. Jethwa and Mayank Agarwal. CSE Department. University of Texas.
Data Structures, Algorithms & Complexity
Chapter VI What should I know about the sizes and speeds of computers?
Chapter 3.5 and 3.6 Heuristic Search Continued. Review:Learning Objectives Heuristic search strategies –Best-first search –A* algorithm Heuristic functions.
Genetic Algorithms and TSP Thomas Jefferson Computer Research Project by Karl Leswing.
G5AIAI Introduction to AI Graham Kendall Heuristic Searches.
INTRO2CS Tirgul 13 – More GUI and Optimization. Today:  GUI  Packing  Events  Canvas  OptionMenu  Optimization  Traveling Sales Man  Questions.
(Complexity) Analysis of Algorithms Algorithm Input Output 1Analysis of Algorithms.
Tower of Hanoi problem: Move the pile of rings from one peg to another
CS1022 Computer Programming & Principles
Solving Complex Problems
TK3043 Analysis and Design of Algorithms
Chapter 1 Introduction Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
Here is a puzzle I found on a t-shirt
G5AIAI – Introduction to AI
Introduction to the Analysis of Complexity
CS 2210 Discrete Structures Algorithms and Complexity
Study Guide for ES205 Yu-Chi Ho Jonathan T. Lee Nov. 7, 2000
Genetic Algorithms CSCI-2300 Introduction to Algorithms
Java Coding 6-extra David Davenport Computer Eng. Dept.,
Tower of Hanoi problem: Move the pile of rings from one peg to another
3. Brute Force Selection sort Brute-Force string matching
Tower of Hanoi Algorithm
3. Brute Force Selection sort Brute-Force string matching
Artificial Intelligence CIS 342
CSC 380: Design and Analysis of Algorithms
G5BAIM Artificial Intelligence Methods
Tower of Hanoi problem: Move the pile of rings from one peg to another
Chapter 1 Introduction Copyright © 2007 Pearson Addison-Wesley. All rights reserved.
3. Brute Force Selection sort Brute-Force string matching
CS 2210 Discrete Structures Algorithms and Complexity
Presentation transcript:

Graham Kendall (0) G5AIAI Introduction to AI Graham Kendall Combinatorial Explosion

G5AIAI History of AI The Travelling Salesman Problem A salesperson has to visit a number of cities (S)He can start at any city and must finish at that same city The salesperson must visit each city only once The number of possible routes is (n!)/2 (where n is the number of cities)

G5AIAI History of AI Combinatorial Explosion

G5AIAI History of AI Combinatorial Explosion

G5AIAI History of AI Combinatorial Explosion A 10 city TSP has 181,000 possible solutions A 20 city TSP has 10,000,000,000,000,000 possible solutions A 50 City TSP has 100,000,000,000,000,000,000,000,000,000,00 0,000,000,000,000,000,000,000,000,000,000 possible solutions There are 1,000,000,000,000,000,000,000 litres of water on the planet Mchalewicz, Z, Evolutionary Algorithms for Constrained Optimization Problems, CEC 2000 (Tutorial)

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi How many moves does it take to move four rings? You might like to try writing a towers of hanoi program (and you may well have to in one of your courses!)

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi If you are interested in an algorithm here is a very simple one Assume the pegs are arranged in a circle 1. Do the following until 1.2 cannot be done –1.1 Move the smallest ring to the peg residing next to it, in clockwise order –1.2 Make the only legal move that does not involve the smallest ring 2. Stop P. Buneman and L.Levy (1980). The Towers of Hanoi Problem, Information Processing Letters, 10, 243-4

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi A time analysis of the problem shows that the lower bound for the number of moves is 2 N -1 Since N appears as the exponent we have an exponential function

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi The original problem was stated that a group of tibetan monks had to move 64 gold rings which were placed on diamond pegs. When they finished this task the world would end. Assume they could move one ring every second (or more realistically every five seconds). How long till the end of the world?

G5AIAI History of AI Combinatorial Explosion - Towers of Hanoi > 500,000 years!!!!! Or 3 Trillion years Using a computer we could do many more moves than one a second so go and try implementing the 64 rings towers of hanoi problem. If you are still alive at the end, try 1,000 rings!!!!

G5AIAI History of AI Combinatorial Explosion - Optimization Optimize f(x 1, x 2,…, x 100 ) where f is complex and x i is 0 or 1 The size of the search space is  An exhaustive search is not an option –At 1000 evaluations per second –Start the algorithm at the time the universe was created –As of now we would have considered 1% of all possible solutions

G5AIAI History of AI Combinatorial Explosion Microseconds in a Day Microseconds since Big Bang

G5AIAI History of AI Combinatorial Explosion N2N2 N5N5 1/10,000 second 1/2500 second 1/400 second 1/100 second 1/25 second 1/10 second 3.2 seconds 5.2 minutes 2.8 hours 3.7 days 2N2N N 1/1000 second 1 second 35.7 years > 400 trillion centuries 45 digit no. of centuries 2.8 hours 3.3 trillion years 70 digit no. of centuries 185 digit no. of centuries 445 digit no. of centuries Running on a computer capable of 1 million instructions/second Ref : Harel, D Computer Ltd. : What they really can’t do, Oxford University Press

G5AIAI Introduction to AI Graham Kendall End Combinatorial Explosion