Choose A Subgame to Play by Zhichao “Leaf” Li October 20th, 2003.

Slides:



Advertisements
Similar presentations
Adversarial Search Chapter 6 Section 1 – 4. Types of Games.
Advertisements

5. Combining simultaneous and sequential moves.
Adversarial Search We have experience in search where we assume that we are the only intelligent being and we have explicit control over the “world”. Lets.
Games & Adversarial Search Chapter 5. Games vs. search problems "Unpredictable" opponent  specifying a move for every possible opponent’s reply. Time.
Two-Player Zero-Sum Games
Game Playing Games require different search procedures. Basically they are based on generate and test philosophy. At one end, generator generates entire.
Adversarial Search Chapter 5.
Adversarial Search Chapter 6.
MINIMAX SEARCH AND ALPHA- BETA PRUNING: PLAYER 1 VS. PLAYER 2.
Adversarial Search 對抗搜尋. Outline  Optimal decisions  α-β pruning  Imperfect, real-time decisions.
Chess AI’s, How do they work? Math Club 10/03/2011.
State Space 4 Chapter 4 Adversarial Games. Two Flavors Games of Perfect Information ◦Each player knows everything that can be known ◦Chess, Othello Games.
CPSC 322 Introduction to Artificial Intelligence October 25, 2004.
All rights reservedL. Manevitz Lecture 31 Artificial Intelligence A/O* and Minimax L. Manevitz.
1 Using Search in Problem Solving Part II. 2 Basic Concepts Basic concepts: Initial state Goal/Target state Intermediate states Path from the initial.
Using Search in Problem Solving
Game Playing CSC361 AI CSC361: Game Playing.
Solving Probabilistic Combinatorial Games Ling Zhao & Martin Mueller University of Alberta September 7, 2005 Paper link:
Strategies Based On Threats Ling Zhao University of Alberta March 10, 2003 Comparative evaluation of strategies based on the values of direct threats by.
Min-Max Trees Based on slides by: Rob Powers Ian Gent Yishay Mansour.
1 search CS 331/531 Dr M M Awais A* Examples:. 2 search CS 331/531 Dr M M Awais 8-Puzzle f(N) = g(N) + h(N)
Temperature Discovery Martin M ü ller, Markus Enzenberger and Jonathan Schaeffer zIntroduction: local and global search yLocal search algorithms yTemperature.
Playing Konane Mathematically with Combinatorial Game Theory
Sum of Combinatorial Games by Leaf Wednesday, October 12th, 2004.
Max Min Max Min Starting node and labels Figure 4.15 (pp. 148) MiniMax Search.
Combinatorial Games Martin Müller. Contents Combinatorial game theory Thermographs Go and Amazons as combinatorial games.
4th year Dance Tactics Theory Lesson 3.
CIS 310: Visual Programming, Spring 2006 Western State College 310: Visual Programming Othello.
Game Tree Search based on Russ Greiner and Jean-Claude Latombe’s notes.
Choose A Subgame to Play by Zhichao “Leaf” Li August 1 st, 2003.
Alpha Beta Search how computers make decisions Elena Eneva 10 October 2001.
Choose A Subgame to Play by Zhichao “Leaf” Li January 27 th, 2004.
Computer Chess. Humble beginnings The Turk Ajeeb Mephisto El Ajedrecista.
Game Playing State-of-the-Art  Checkers: Chinook ended 40-year-reign of human world champion Marion Tinsley in Used an endgame database defining.
Game Trees: MiniMax strategy, Tree Evaluation, Pruning, Utility evaluation Adapted from slides of Yoonsuck Choe.
Minimax Trees: Utility Evaluation, Tree Evaluation, Pruning CPSC 315 – Programming Studio Spring 2008 Project 2, Lecture 2 Adapted from slides of Yoonsuck.
CISC 235: Topic 6 Game Trees.
Game Playing. Introduction Why is game playing so interesting from an AI point of view? –Game Playing is harder then common searching The search space.
Game Playing.
Temperature Discovery Search Temperature Discovery Search (TDS) is a new minimaxbased game tree search method designed to compute or approximate the temperature.
Game Playing. Towards Intelligence? Many researchers attacked “intelligent behavior” by looking to strategy games involving deep thought. Many researchers.
Pitch Playing Agent Project for Into to AI Jody Ammeter.
Games. Adversaries Consider the process of reasoning when an adversary is trying to defeat our efforts In game playing situations one searches down the.
1 Adversarial Search CS 171/271 (Chapter 6) Some text and images in these slides were drawn from Russel & Norvig’s published material.
Amazons Experiments in Computer Amazons, Martin Mueller and Theodore Tegos, 2002 Exhaustive Search in the Game Amazons Raymond Georg Snatzke, 2002 Presented.
Game Playing. Introduction One of the earliest areas in artificial intelligence is game playing. Two-person zero-sum game. Games for which the state space.
The Rules When every member of your group gets the question right, you have the opportunity to play the following game:
Rates For this project, I am comparing the number of points over the number of games played by the Wisconsin Badger Basketball team. Example: 345 points.
Adversarial Games. Two Flavors  Perfect Information –everything that can be known is known –Chess, Othello  Imperfect Information –Player’s have each.
 Construct a stem and leaf plot: 15, 4, 28, 23, 21, 9, 8, 11, 15, 9 1 leaf 0 stem 2 4, 8, 9, 9 1, 5, 5 1,3, 8.
Introduction to Game Theory Kamal Aboul-Hosn Cornell University Computers Playing Games.
ARTIFICIAL INTELLIGENCE (CS 461D) Princess Nora University Faculty of Computer & Information Systems.
Adversarial Search. Regular Tic Tac Toe Play a few games. –What is the expected outcome –What kinds of moves “guarantee” that?
Adversarial Search Chapter 6 Section 1 – 4. Games vs. search problems "Unpredictable" opponent  specifying a move for every possible opponent reply Time.
Explorations in Artificial Intelligence Prof. Carla P. Gomes Module 5 Adversarial Search (Thanks Meinolf Sellman!)
Understanding AI of 2 Player Games. Motivation Not much experience in AI (first AI project) and no specific interests/passion that I wanted to explore.
Game Playing Why do AI researchers study game playing?
By: Casey Savage, Hayley Stueber, and James Olson
Pengantar Kecerdasan Buatan
Game Playing.
State Space 4 Chapter 4 Adversarial Games.
CSCI 5582 Artificial Intelligence
Here is the graph of a function
Heuristic search INT 404.
Kevin Mason Michael Suggs
NIM - a two person game n objects are in one pile
CS 260 Search Exercise A B C D E F G H I J K L M
Based on slides by: Rob Powers Ian Gent
Heuristic Search in Empire-Based Games
Minimax Trees: Utility Evaluation, Tree Evaluation, Pruning
Presentation transcript:

Choose A Subgame to Play by Zhichao “Leaf” Li October 20th, 2003

Choose a Subgame to Play Problem Description Minimax and Hotstrat Improvement on Hotstrat Thermostrat Depthfixed Search Future Work

Problem Description Go endgame usually can be decomposed into several Subgames Play a single Subgame is trivial But, Question: Which Subgame should be chosen to play?

Game Decomposed Decompose the game (3 subgames here) Search out Combinatorial Games mapping to Subgames 0 | -1 0 | -2 || -3 5 || 2 | 0 Choose a Subgame (How?)

Methods of Choosing a Subgame Minimax Search Hotstrat Thermostrat Depthfixed Search Subgame 1: 0 | -1 Subgame 2: 0 | -2 || -3 Subgame 3: 5 || 2 | 0 Play Which Subgame?

Minimax Strategy Use Minimax to find out the best Subgame Advantage: Best Results Disadvantage: needs Time and Space

Hotstrat Choose Subgame with highest Temperature Advantage: Fast Disadvantage: often not the Best Result Improvement: Consider Sente position

Improvement on Hotstrat Consider Sente consider ‘one more move’ Example: Right to Move Subgame 1: 8 | 6 || 5 | -1Temp = 3(not 2) Subgame 2: 4 | -1Temp = 2.5 Play on Subgame 1 rather than 2

Results after Improvement level 5-Subgame Games beforenow Minimax vs. Hotstrat Hotstrat vs. Minimax level 5-Subgame Games beforenow Minimax vs. Hotstrat Hotstrat vs. Minimax

Thermostrat Use the Thermograph to find the best move 1. Combine subgames’ Thermographs 2. Find the Ambient where Left Most in Combined Graph (suppose Left to move) 3. Select the Subgame which widest at Ambient

Thermostrat Make mistakes Example: Left to Move Subgame 1: 19 | 0 Subgame 2: 39 | 12 || 3 | 0 Thermostrat chooses Subgame 1, not 2 How to improve it?

Depthfixed Search Minimax plays Best, but Slow Hotstrat plays Fast, but not best Combine these two strategies: 1. Set Max Search Depth 2. Search the move until it reaches Max Search Depth 3. Hotstrat plays the position to get the evaluation score

Results on 2-level Games DepthMinMin - DepMinDepMin – MinMin

Results on 3-level Games DepthMinMin – DepMinDepMin - MinMin

Depthfixed Search Make mistakes Example: Right to move Subgame 1 : 56 | 41 || 39 | 0 Subgame 2 : 67 | 31 || 6 | 0 Subgame 3 : 84 | 38 || 14 | 0 Subgame 4 : 96 | 86 Subgame 5 : 65 | 23 || 14 | 0 Depthfixed choses Subgame 2, not 3 (Max Search Depth = 2)

Depthfixed Search Hotstrat makes mistakes Subgame 2 : 67 | 31 || 6 | 0temp = 23 Subgame 5 : 65 | 23temp = 21 Right to move Hotstrat choses the wrong Subgame, therefore Depthfixed choses the wrong one

Future Work How to improve Thermostrat How to improve Hotstrat (help Depthfixed) Other evaluation functions for Depthfixed Others?