PN, PN2 and PN* in Lines of Action

Slides:



Advertisements
Similar presentations
Adversarial Search We have experience in search where we assume that we are the only intelligent being and we have explicit control over the “world”. Lets.
Advertisements

Adversarial Search Reference: “Artificial Intelligence: A Modern Approach, 3 rd ed” (Russell and Norvig)
Games & Adversarial Search Chapter 5. Games vs. search problems "Unpredictable" opponent  specifying a move for every possible opponent’s reply. Time.
Games & Adversarial Search
ICS-271:Notes 6: 1 Notes 6: Game-Playing ICS 271 Fall 2008.
Game Playing Games require different search procedures. Basically they are based on generate and test philosophy. At one end, generator generates entire.
Adversarial Search: Game Playing Reading: Chapter next time.
Lecture 12 Last time: CSPs, backtracking, forward checking Today: Game Playing.
Adversarial Search CSE 473 University of Washington.
Search Strategies.  Tries – for word searchers, spell checking, spelling corrections  Digital Search Trees – for searching for frequent keys (in text,
Games CPSC 386 Artificial Intelligence Ellen Walker Hiram College.
Adversarial Search Board games. Games 2 player zero-sum games Utility values at end of game – equal and opposite Games that are easy to represent Chess.
Minimax and Alpha-Beta Reduction Borrows from Spring 2006 CS 440 Lecture Slides.
Abstract Proof Search Studied by Tristan Cazenave Surveyed by Akihiro Kishimoto.
This time: Outline Game playing The minimax algorithm
Game Playing CSC361 AI CSC361: Game Playing.
Df-pn: Depth-first Proof Number Search
The 6 th Computer Olympiad: Computer-Games Workshop (Maastricht, 2001) Advances of AND/OR-tree Search Algorithms in Shogi Mating Search Hiroyuki Iida and.
ICS-271:Notes 6: 1 Notes 6: Game-Playing ICS 271 Fall 2006.
1 Solving Ponnuki-Go on Small Board Paper: Solving Ponnuki-Go on small board Authors: Erik van der Werf, Jos Uiterwijk, Jaap van den Herik Presented by:
Adversarial Search: Game Playing Reading: Chess paper.
Applying proof numbers to Life and Death: First Result Akihiro Kishimoto
double AlphaBeta(state, depth, alpha, beta) begin if depth
Games & Adversarial Search Chapter 6 Section 1 – 4.
A Solution to the GHI Problem for Best-First Search D. M. Breuker, H. J. van den Herik, J. W. H. M. Uiterwijk, and L. V. Allis Surveyed by Akihiro Kishimoto.
Game Playing: Adversarial Search Chapter 6. Why study games Fun Clear criteria for success Interesting, hard problems which require minimal “initial structure”
1 Adversary Search Ref: Chapter 5. 2 Games & A.I. Easy to measure success Easy to represent states Small number of operators Comparison against humans.
Game Trees: MiniMax strategy, Tree Evaluation, Pruning, Utility evaluation Adapted from slides of Yoonsuck Choe.
Minimax Trees: Utility Evaluation, Tree Evaluation, Pruning CPSC 315 – Programming Studio Spring 2008 Project 2, Lecture 2 Adapted from slides of Yoonsuck.
Game Playing Chapter 5. Game playing §Search applied to a problem against an adversary l some actions are not under the control of the problem-solver.
Game Playing Chapter 5. Game playing §Search applied to a problem against an adversary l some actions are not under the control of the problem-solver.
October 3, 2012Introduction to Artificial Intelligence Lecture 9: Two-Player Games 1 Iterative Deepening A* Algorithm A* has memory demands that increase.
Algorithms & Data Structures for Games
Evaluation-Function Based Monte-Carlo LOA Mark H.M. Winands and Yngvi Björnsson.
Game Playing. Introduction One of the earliest areas in artificial intelligence is game playing. Two-person zero-sum game. Games for which the state space.
Randomized Parallel Proof-Number Search ACG 12, Pamplona, May 2009.
Solving Kriegspiel endings with brute force: the case of KR vs. K Paolo Ciancarini Gian Piero Favini University of Bologna.
Game Playing Revision Mini-Max search Alpha-Beta pruning General concerns on games.
Game tree search Thanks to Andrew Moore and Faheim Bacchus for slides!
Solving Tsumego on Computers M2 Hirokazu Ishii Chikayama & Taura Lab.
ARTIFICIAL INTELLIGENCE (CS 461D) Princess Nora University Faculty of Computer & Information Systems.
Adversarial Search 2 (Game Playing)
Adversarial Search In this lecture, we introduce a new search scenario: game playing 1.two players, 2.zero-sum game, (win-lose, lose-win, draw) 3.perfect.
Understanding AI of 2 Player Games. Motivation Not much experience in AI (first AI project) and no specific interests/passion that I wanted to explore.
Adversarial Search and Game-Playing
ADVERSARIAL GAME SEARCH: Min-Max Search
EA C461 – Artificial Intelligence Adversarial Search
Announcements Homework 1 Full assignment posted..
By Kevin Madison and Emma Drobina
Last time: search strategies
Iterative Deepening A*
Two-Player Games A4B33ZUI, LS 2016
Adversarial Search and Game Playing (Where making good decisions requires respecting your opponent) R&N: Chap. 6.
Optimizing Minmax Alpha-Beta Pruning Real Time Decisions
A Distributed Genetic Algorithm for Learning Evaluation Parameters in a Strategy Game Gary Matthias.
Two-player Games (2) ZUI 2013/2014
Dakota Ewigman Jacob Zimmermann
CSCI 5582 Artificial Intelligence
Game playing.
Chapter 6 : Game Search 게임 탐색 (Adversarial Search)
Kevin Mason Michael Suggs
NIM - a two person game n objects are in one pile
Introduction to Artificial Intelligence Lecture 9: Two-Player Games I
Mini-Max search Alpha-Beta pruning General concerns on games
Artificial Intelligence
Games & Adversarial Search
CS51A David Kauchak Spring 2019
Unit II Game Playing.
Minimax Trees: Utility Evaluation, Tree Evaluation, Pruning
Presentation transcript:

PN, PN2 and PN* in Lines of Action Mark Winands and Jos Uiterwijk

Overview LOA PN Search PN2 Search PN* Search Results Conclusions 13-Jul-19

Board Set-up of LOA 13-Jul-19

Movement of pieces 13-Jul-19

A Final Position 13-Jul-19

Position with a long forcing line Black to move and to win in 21 plies. Mona vs. YL, Game 4 13-Jul-19

Problems in the endgame Evaluation functions for LOA are not good predictors in the case of forced wins. Most terminal positions still have more than 10 pieces remaining on the board, which makes the game not suitable for endgame databases. Mate provers like proof number search are probably a better method for this issue. 13-Jul-19

Proof-number (PN) Search 13-Jul-19 Proof-number (PN) Search Inspired by conspiracy-number search (McAllester 1988). PN is invented by Allis (1994). Best-first search algorithm. Goal is to prove that there exists a win for the player to move in a certain position. Not a heuristic is used to select the most-proving node, but the shape of the tree and the value of the leaf nodes. Mostly (dis)proves faster than alpha-beta for a certain position. 13-Jul-19

PN search 1 a b c l k j i d e g f 2  draw ? loss h win 13-Jul-19

Enhancements of PN Set the proof number and disproof number to 1 and n for a MAX node (and the reverse for a MIN node), where n is the number of legal moves. (Thus, using a mobility component.) Nodes once proved by PN search are stored in a transposition table (TT), which is used in the - search. What is the effect of this TT in the PN search? 13-Jul-19

PN2 search(Breuker, 1998) Bounded by 13-Jul-19

PN2 (2) Other enhancements of PN can also be used in PN2. Deleting also (dis)proven subtrees in the second level search. If there are a lot of (dis)proven subtrees, the second level search will search more nodes than usual (deeper). Possibly one of the reasons is that trees are regenerated less. Almost (dis)proven subtrees in the normal situation are now proved. Caching instead of deleting second-level search trees Leaving probably-unsolvable trees prematurely. 13-Jul-19

PN* (Seo et al., 2001) PN* solves two problems of PN and PN2 (i.e, memory and sub optimal solutions) PN* transforms the PN-search algorithm into an iterative- deepening depth-first approach PN* is enhanced with methods as recursive iterative deepening and dynamic evaluation. 13-Jul-19

Experimental set-up The proof number search algorithms and enhancements are tested on a test set of 116 forced win positions The maximum number of nodes searched is 50,000,000. The maximum number of nodes stored in the memory is 900,000. PN, PN2 and PN* search are compared with an iterative alpha-beta search. 13-Jul-19

Results (1) 13-Jul-19

Results (2) 13-Jul-19

Results (3) 13-Jul-19

Results (4) 13-Jul-19

Position with a long forcing line Black to move and to win in 21 plies. Mona vs. YL, Game 4 13-Jul-19

PN* is sometimes better White to move and win in 13 plies. Fifth Annual E-mail Tournament, Thordsen vs. Mona 13-Jul-19

Conclusions PN, PN*, PN2 search are quite good proving LOA positions. Even a poor implemented PN* outperforms - in LOA positions. Mobility improves the PN search. Deleting (dis)proved nodes in the second-level search improves the PN2 search. Caching second-level trees or leaving probably-unsolvable trees prematurely has not paid of yet 13-Jul-19

Epilogue Currently PN2 search is combined with alpha-beta search in MIA II. PN2 search is done for some fixed time after some moves in the player’s own time. During this search proven position are stored in transposition table (PN-TT). If PN2 proves the position the (sub) optimal move is played. Otherwise the normal alpha beta search is applied using the PN-TT. Experiments reveal that this strengthens the program. 13-Jul-19