
OK computer, letās see you do this (Image: Katarina Lƶfgren/Maskot/Plainpicture)
ITāS humans versus machine at the Rivers casino in Pittsburgh, Pennsylvania. Four professional poker players are squaring up to an artificial intelligence over two weeks, duking it out by playing a total of 80,000 hands of poker for a $100,000 cash prize.
This may turn out to be the latest instalment in a grand tradition of computers beating us at our own games. In 1997, IBMās Deep Blue computer famously beat chess great Garry Kasparov. Four years ago, IBMās Watson took part in the TV quiz show Jeopardy! and crushed two contestants with a strong track record. AI has even mastered the popular smartphone game 2048.
Advertisement
, poker is a tough nut to crack. In a game like chess, everyone knows where all the pieces are on the board. By contrast, poker is a game of imperfect information: players donāt know for sure what cards the others hold or what will come up next in the deck. That makes it a challenge for any player, human or computer, to choose the right play.
Computer scientists have already made some progress, at least with simpler forms of the game. But the version being played at the Pittsburgh tournament, called Heads Up No Limit Texas Hold āem, is āa completely different beastā, says pro player Vanessa Selbst. āThereās much more human elements and game strategies to employ, so itās a much more complex game.ā Whatās more, there are no betting limits, so the computer also has to take into account how much players might stake on each game.
Competing in Pittsburgh is Claudico, a program created at the cityās Carnegie Mellon University. Claudico taught itself poker skills by playing trillions of games in search of some kind of optimal strategy. Whatever it has picked is pretty good: last year, Claudico beat all 13 other computer competitors at no-limit poker in the annual contest run by the Association for the Advancement of Artificial Intelligence.
Computers have a few edges over humans, says graduate student Noam Brown, part of the team behind Claudico. For example, a computer can switch randomly between various betting strategies, which may confuse human opponents.
On the other hand, Claudico is slow to pick up on and adapt to peopleās playing styles ā something that many pro players do with ease. āOne of our big concerns is that the human will be able to identify weaknesses that Claudico has and exploit them,ā says Brown.
Because Claudico taught itself to play, even the team that built it donāt quite know how it picks its moves. āWeāre putting our faith in Claudico. It knows much better than we do what itās doing.ā
ĀWeāre putting our faith in our program. It knows what itās doing much better than we doĀ
Algorithms like those used to play poker could be valuable for other kinds of problems characterised by imperfect information. They could suggest optimal locations for military resources in a war, for example. Rival AIs could also be tasked to negotiate with each other over insurance rates or handle legal squabbles. āIn society, sometimes you see one side getting screwed over because someone has more lawyers or more information or more resources at their disposal,ā says Brown. āSomething like this can really level the playing field.ā
The winner of the poker tournament wonāt be crowned until the event ends on 7 May. Eric Jackson, a software engineer who creates poker bots as a hobby, is cautiously optimistic that Claudico can win. As we went to press, the pros and Claudico .
Even if AI triumphs, it wonāt mean programmers have conquered the game. āBeating humans decisively would be a landmark, but it wouldnāt mean the end of work on poker,ā says Jackson. āWe still donāt know what the perfect strategy is.ā
This article appeared in print under the headline āAI wears its best poker face to take on the prosā