The Computer Vision Game Assistant C H E C K E R S M A T E S Levante Savo, Camelia Popa, Serban Meza, Oscar Medina, Ross Foley
Build a Machine Vision System that: 1. Reads the current state of a board game using a webcam 2. Feeds the current game state into a game playing engine 3. Retrieves a suggestion for the next move 1
Game: Checkers/Draughts Very popular Many game playing engines available on the web Pieces relatively easy to segment Programming Language: Matlab Powerful IP functionality Direst access to webcam using Simulink Simple access to game playing engine.exe file 2
3
Image taken every 2 seconds Movement Detection Compares image to reference image If large difference, presume a hand is obstructing the view and no game is extracted If small difference, give image to the game extraction module and this image becomes the reference 4
Board & Piece Detection & Combination 5 C H E C K E R S M A T E S
6
7
Centroid positions combined with box information 8x8 matrix created Each entry represents 1 box on the board Contains flags indicating whether box is not used, empty, black/white, man/king 10
Query Generation & Results Visualisation 11 C H E C K E R S M A T E S
12 Found on the web Application written in C++ Takes 8x8 matrix as input Outputs 2 co-ordinates, starting position and finishing position Also a string detailing an error or if a player has won/lost
13
14
15