Computer Game Bot Turing Test - Implementation

Implementation

The Computer Game Bot Turing Test was designed to test a bot's ability to interact with a game environment in comparison with a human player, simply 'winning' was insufficient. This evolved into a contest with a few important goals in mind:

• There are three participants: a human player, a computer-game bot, and a judge.
• The bot needs to appear more human-like than the human player. Judge scores are not bipolar — both human and bot can be scored anywhere on a scale from 1 to 5 (1=not humanlike, 5=human).
• All three participants are to be indistinguishable in the arena, with the exception of a randomly generated name tag, so as to reduce the chance of random elements such as name or appearance influencing the judges.
• Chat is disabled throughout the match.
• Bots were not given omniscient powers as they may be in other games. Bots must react only to the data that might be reasonably available to a human player.
• Human participants were of a moderate skill range, with no participant either ignorant to the game or capable of playing at a professional level.

In 2008, the first 2K BotPrize tournament took place. The contest was held with the game Unreal Tournament 2004 as the platform. Contestants created their bots in advance using the GameBots interface. GameBots had some modifications made so as to adhere to the above conditions, such as removing data about vantage points or weapon damage that unfairly informed the bots of relevant strengths/weakness that a human would otherwise need to learn.