A case study on logging visual activities: Chess game

Abstract

Automatically recognizing and analyzing visual activities in complex environments is a challenging and open-ended problem. In this study this task is performed in a chess game scenario where the rules, actions and the environment are well defined. The purpose here is to detect and observe a FIDE (Fédération International des Ėchecs) compatible chess board, generating a log file of the moves made by human players. A series of basic image processing operations have been applied to perform the desired task. The first step of automatically detecting a chess board is followed by locating the positions of the pieces. After the initial setup is established every move made by a player is automatically detected and verified. Intel® Open Source Computer Vision Library (OpenCV) is used in the current software implementation.