The film captures Sedol\u2019s distress, courage, brilliance, then humility, as he realizes that this match against the machine isn\u2019t just a game, but the emergence of a new world order. Not a programmer, Sedol didn\u2019t appreciate what he would be up against, but as an expert at his craft, on the board he could feel the relentless, impenetrable weight of his opponent.<\/p>\n\n\n\n
After you enjoy AlphaGo, I recommend (actually, Google recommends) that you watch some of the poker match between old-school Dan Negreanu and modern computer-clone Doug Polk. The best player on earth is the machine, so a clever human like Polk emulates the machine\u2019s strategy. Adapt or die.<\/p>\n\n\n\n
I once had a brief exchange with Howard Lederer. I asked him about bots on the poker sites. He dismissed the issue by saying: \u201cPoker isn\u2019t like chess. Poker is a game of incomplete information. Computers aren\u2019t good at that.\u201d I couldn\u2019t tell whether he was a na\u00efve fool or a conman shill for Full Tilt Poker. Either way, I didn\u2019t want to continue that conversation 15 years ago. But now here we are, in 2021, and it\u2019s time to continue that conversation, by refuting that first fallacy regarding the GTO (game-theory optimal) computers, and all the other overlapping fallacies that the poker dinosaurs and self-proclaimed poker savants are desperately clinging to:
<\/p>\n\n\n\n
Fallacy #1<\/strong>: Computers aren\u2019t good at games of incomplete information. <\/em><\/p>\n\n\n\n This is just ignorant. It is true that Zermelo\u2019s Theorem does not apply to games like poker. For poker, there are OTHER theorems that basically say that there is a solution to the game, and a computer solution will generally involve \u201cmixed strategies\u201d meaning that there is some randomizing component to the strategy (such as calling Scissors with probability 1\/3). Computers are quite good, better than humans, at calculating expectation over probabilistic outcomes, especially when the probability distributions are known precisely, as they are in card games. For example, the computer knows exactly what the probability of drawing a backdoor Flush is and what pot odds it needs to justify chasing. Though poker involves incomplete information, heads-up no limit poker is a simpler game than Go, even though Go involves full information (common-knowledge information).<\/p>\n\n\n\n Fallacy #2<\/strong>: The computer\u2019s superiority comes from being able to remember every hand I\u2019ve played, and adjust accordingly. <\/em><\/p>\n\n\n\n While an \u201cexploitive bot\u201d would indeed analyze your past play and adjust to perceived weaknesses, a standard GTO bot (which we used to call a \u201cNash bot\u201d) is the poker equivalent of BS in blackjack. The GTO strategy does not change, regardless of how you played past hands. It doesn\u2019t need that information, and doesn\u2019t care.<\/p>\n\n\n\n Fallacy #3<\/strong>: The GTO solution is only \u201ccorrect\u201d if playing against another GTO bot, because that is what was assumed when the bot was developed\u2014the bot \u201clearned\u201d by playing against itself. <\/em><\/p>\n\n\n\n This is false. \u201cThe bot played against itself to learn poker\u201d is a mischaracterization of the development process. The media likes to hype its clickbait to make every result in computing sound like a generational breakthrough, invoking HAL and Skynet. A GTO bot doesn\u2019t know a thing about poker. Deriving the GTO strategy is an exercise in calculation, made possible by the massive memory and CPU speed available in today\u2019s computers and development of an efficient algorithm to do the computation (\u201cregret minimization\u201d). We never used to describe the algorithm as \u201cmachine learning\u201d or \u201cAI\u201d–we used to just call it \u201chill climbing\u201d or \u201cmaximization\u201d or \u201coptimization.\u201d At each step of the iterative algorithm, the computer has the current strategy under development for each seat at the table, and this current strategy could be popularly described as \u201citself,\u201d as in: \u201cPokerSnowie plays against itself.\u201d But it\u2019s really just an iteration on its path of climbing the hill to converge at the peak\u2014an optimal strategy for poker. That optimum does not assume any particular opponent. There are other ways we could have computed the solution (though maybe not as fast), and it would be just as valid. This GTO strategy is \u201cThe Book\u201d for poker, and it would never be at a disadvantage, regardless of its opponent. There is no strategy that can get an edge against it.<\/p>\n\n\n\n Fallacy #4<\/strong>: The GTO bot assumes I\u2019ll play a certain way, but I\u2019ll trick it by playing my off-suit 72 out of position. <\/em><\/p>\n\n\n\n Wrong. The GTO bot doesn\u2019t assume anything about how you play. It doesn\u2019t care. It is unbeatable against ANY opposing strategy. Imagine you have an upcoming fight against Floyd Mayweather, and you say, \u201cFloyd expects me to show up in impeccable physical conditioning. He assumes I\u2019m going to train hard for the next six months. I\u2019ll trick him\u2014I\u2019ll just watch Netflix and eat donuts for the next six months.\u201d Floyd has no idea how much you\u2019ll train. He knows that if he himself shows up in perfect shape, then no opponent can get an edge against him. Does it make sense to say, \u201cThe bot assumes I will play well. I\u2019ll trick the bot by playing bad poker!\u201d Yeah, you sure showed them!<\/p>\n\n\n\n Fallacy #5<\/strong>: I found a weakness\u2014when I have such and such, from such and such a position, then the bot should do X, but it does Y. <\/em><\/p>\n\n\n\n Wrong. The bot doesn\u2019t have a weakness. You\u2019re looking at a particular hand holding, and a particular result, but based on the likelihood of being in that scenario, and all the possible hands you could hold viewed from the bot\u2019s point of view, its play is correct, and you can\u2019t find a hole there. It is very dangerous to look at a play in isolation. The bot makes moves to balance its ranges, so that you can\u2019t chisel in other situations, or if different cards came on the river. If you don\u2019t see it, then the flaw is in your own poker thinking, not the bot\u2019s.<\/p>\n\n\n\n Fallacy #6<\/strong>: If I play it for a while, I\u2019ll figure out how it plays and find a weakness. <\/em><\/p>\n\n\n\n Wrong. There is no weakness. In fact, we could publish the bot\u2019s strategy, and it wouldn\u2019t make any difference. If I tell you that I\u2019m going to play Scissors, Rock, and Paper with probability 1\/3 on each, the fact that you know my strategy gives you no ability to get an edge. There is no Achilles heel.<\/p>\n\n\n\n Fallacy #7<\/strong>: The Heads-Up Limit bots introduced into casinos were highly beatable, so probably GTO bots are as well. <\/em><\/p>\n\n\n\n This is not a meaningful comparison. Some of the casino bots were instructed to not play their A game, because it was too strong against average humans. If the casino sets the bot to play its B game, to achieve, say, a 5% edge against most players, then a really good human could have made money against that GTSO bot (game-theory sub-optimal bot). But that\u2019s a different issue. I don\u2019t care who you are: If you play heads-up against PokerSnowie, you will lose.<\/p>\n\n\n\n Fallacy #8<\/strong>: GTO bots can beat weak players, but the bots will have trouble against top opponents like Phil Ivey or Dan Negreanu.<\/em> <\/p>\n\n\n\n Wrong. A beautiful thing about a GTO bot is that it doesn\u2019t matter who the opponent is. At best, someone could play even with the bot. A ring of GTO bots would be like a sink, with the money flowing clockwise chasing the button, and draining out the center of the table due to the rake. A practical problem that real-world pros used to have was deciding when their skill was sufficient to step up to the next higher stakes available, where the players were presumably stronger. But now, a player who mimics GTO strategy can sit down at any table in the world, at any stakes, and not have to worry about being the fish. At best, the game would be even (outside of the rake), and in practice, a GTO strategy confers a sizeable edge against anyone you\u2019ll encounter in the wild.<\/p>\n\n\n\n Fallacy #9<\/strong>: Dan Negreanu is a longtime poker pro with N bracelets, so he\u2019ll crush computer nits like Doug Polk who don\u2019t understand the nuances of real poker. <\/em><\/p>\n\n\n\n If a guy like Polk just memorizes \u201cthe charts\u201d and mimics GTO strategy, he doesn\u2019t need to understand a damn thing. He doesn\u2019t need to know what the word \u201cnuance\u201d means. Poker experience of pros like Negreanu is what enabled them to figure out the best play in scenarios that were complicated. That experience is obsolete now that the computers have just computed what the right plays are. Perhaps in 1950, a player\u2019s experience enabled him to determine that hitting 14 v T was better than standing. Once the Four Horsemen computed the BS chart, that blackjack experience became irrelevant. The Book renders experience unnecessary.<\/p>\n\n\n\n Now Doug Polk is not a GTO bot. He is a top pro who employs GTO strategies. So, Negreanu\u2019s only shot to beat Polk is if Polk\u2019s emulation of GTO is not accurate, and if the holes are big enough for Negreanu to find and exploit. I doubt it. Another longshot would be if they play live, and if Polk has physical tells that give away information about his hole cards, and if Negreanu can read him that way. Or if Polk has tilt issues and starts to stray from GTO if he has a bad run of cards. Not likely. Or, perhaps the game is short enough that Negreanu gets lucky in a small sample.<\/p>\n\n\n\n After playing against AlphaGo, Lee Sedol elevated his game and started crushing everyone (not that he didn\u2019t already), but then retired from the game! He conceded that he had been bested (what a concept!), and that no human would ever again challenge the best player on earth, AlphaGo.<\/p>\n\n\n\n We will see if Negreanu will have the same epiphany. A recent tweet makes me wonder, because Negreanu seemed to be questioning a bot play, and suggesting that there is a thin line between genius and donkishness. I think he is still hoping that there is a flaw in the GTO strategy. There isn\u2019t. Last I heard, Negreanu was catching up in the contest, and there is some indication that one reason is that, to his credit, Negreanu is practicing with PokerSnowie, and adapting! If Negreanu can quickly learn GTO strategy, then he could level the playing field, which would be a tremendous achievement. The only way a dinosaur can survive is by evolving. We\u2019ll see in 2021.<\/p>\n\n\n\n [Next time, I’ll discuss some of the limitations and weaknesses of the poker bots, unless we thrash them out in the Comments below.]<\/p>\n by James Grosjean Count me among the Netflix drones who loved The Queen\u2019s Gambit (2020), but I\u2019ve always been a chess enthusiast. During my college years, I probably ate a thousand chocolate croissants while watching the quirky, magnificent Murray Turnbull (aka \u201cThe Chess Master\u201d) take on all comers in the town square\u2014\u201c$2, refund if you […]<\/p>\n","protected":false},"author":13,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_exactmetrics_skip_tracking":false,"_exactmetrics_sitenote_active":false,"_exactmetrics_sitenote_note":"","_exactmetrics_sitenote_category":0,"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[2],"tags":[2031,1385,2026,2027,2023,2029,2030,2025,2024],"yoast_head":"\n![\"Facebook\"](\"https:\/\/www.lasvegasadvisor.com\/gambling-with-an-edge\/wp-content\/plugins\/social-media-feather\/synved-social\/image\/social\/regular\/96x96\/facebook.png\" "\\"Follow")
<\/a>![\"twitter\"](\"https:\/\/www.lasvegasadvisor.com\/gambling-with-an-edge\/wp-content\/plugins\/social-media-feather\/synved-social\/image\/social\/regular\/96x96\/twitter.png\" "\\"Follow")
<\/a>![\"youtube\"](\"https:\/\/www.lasvegasadvisor.com\/gambling-with-an-edge\/wp-content\/plugins\/social-media-feather\/synved-social\/image\/social\/regular\/96x96\/youtube.png\" "\\"Find")
<\/a>![\"instagram\"](\"https:\/\/www.lasvegasadvisor.com\/gambling-with-an-edge\/wp-content\/plugins\/social-media-feather\/synved-social\/image\/social\/regular\/96x96\/instagram.png\" "\\"Check")
<\/a>","protected":false},"excerpt":{"rendered":"