Senior Design Team sdmay21-05 • AR Chess Advisor

Problem Statement

Tabletop game enthusiasts are constantly looking for ways to improve their skill at these games. Currently, their options are limited to reading books and articles on game strategy, learning from skilled professionals such as chess Grandmasters, practicing by playing more games against peers and bots, solving situational puzzles, or following recommendations given by a game engine.

These current methods are not only time consuming, but also lack the levels of engagement and excitement required to make them worthwhile, especially for younger players.

Our solution is a system that uses augmented reality (AR) glasses to analyze the state of the game board and game pieces. Using computer vision algorithms, we determine the state of the game board and pass it to a game engine for analysis. Finally, we deliver a recommended move to be displayed on the AR glasses in real-time. The AR glasses are responsible for capturing images of the game board, processing them, and, using computer vision algorithms, determining the game state. The game state is then communicated to a game engine and the resulting recommended move is sent back to the AR glasses to be displayed to the end user.

Users of our application can get move recommendations from a game engine or build skill by playing games against a computer controlled by a game engine.