POKER Q'z Blog

Poker strategies, techniques, and the latest information to help you improve

Articles

Learn Poker Theory 2: Finding the Mathematically Optimal Bet Sizing Split in the AKQJT9 Game考察

Learn Poker Theory 2: Finding the Mathematically Optimal Bet Sizing Split in the AKQJT9 Game

IntroductionThis article is a continuation of the previous one. If you haven’t read it yet, please start there first: https://pokerqz.com/blog/theoretical_poker_1This time, the topic is bet size splitting. In GTO, stronger value hands generally tend to use larger bet sizes. But why does that happen? In this article, we’ll explore that question from a mathematical perspective using a toy game called the AKQJT9 game.1. What is the AKQJT9 game?The AKQJT9 game is a toy game I created for this topic, and it’s a variation of the AKQ game introduced last time. Compared to AKQ, the only change is that the number of cards increases from 3 to 6, but let’s quickly review the rules.PlayersThis game is played heads-up between Hero and Villain.CardsThe deck consists of only six cards: As, Ks, Qs, Js, Ts, 9s. Hand strength is A > K > Q > J > T > 9. Each player is dealt one random card, and no two players can receive the same rank.PositionHero is always in position, and Villain is always out of position.ActionsThe game starts directly on the river, and Villain (OOP) acts first. Villain always checks.Then Hero (IP) can choose any bet size or check back.If Hero checks back in step 2, the hand goes straight to showdown.If Hero bets in step 2, Villain can only call or fold. Raising is not allowed.Pot sizeThe initial pot is 1.2. The GTO solution computed by an algorithmNext, we want to compute the optimal solution with formulas. But to make the intuition easier to grasp, let’s first look at a GTO solution computed using the CFR algorithm. (I’d like to cover CFR in more detail another time.)Figure 1 GTO solution on the river when the board is 2s 2h 2d 3s 3hFigure 1 visualizes the GTO solution using a tool I built. The range chart is styled similarly to GTO Wizard. This chart shows Hero’s full-range strategy in a real poker spot where the board is 2s 2h 2d 3s 3h (a board unrelated to A through 9 in this toy game) after Villain checks.However, both players’ hand ranges are restricted to six combos: AsAh, KsKh, ... , 9s9h (only the spade-heart pocket pair combos are used).Hand strength is AsAh > KsKh > ... > 9s9h, and since the players can’t hold the same hand, this situation is equivalent to the AKQJT9 game.This time, I included many bet size options from 15% to 160%. Red indicates large bets, orange indicates small bets, and green indicates checks.You can see that the nuts A uses a larger value bet size than the second nuts K, meaning the strategy splits bet sizes.Figure 2 Strategy for KsKh in Figure 1 (left column: frequency, right column: EV; EV is shown multiplied by 100)Figure 3 Strategy for AsAh in Figure 1 (left column: frequency, right column: EV; EV is shown multiplied by 100)Figures 2 and 3 show the detailed strategies when Hero holds KsKh and AsAh. For each hand, the best approach is to use the bet size that maximizes EV, and you can see that actions with higher EV get higher frequency.Here’s what we can summarize about the AKQJT9 game from Figures 1 through 3.Summary so farThe nuts A uses a pure large bet. The optimal size seems to be between 120% and 130% pot, slightly closer to 120%.The second nuts K uses a pure small bet. The optimal size seems to be between 25% and 30% pot, slightly closer to 30%.Marginal hands Q through T pure check.The weakest hand 9 uses the same sizes as A and K for value betting, and bluffs at the appropriate frequencies.Additional notesQ cannot value bet. If Hero bets Q, Villain will always call with A and K and always fold 9. Even if Villain bluff-catches with J and T at 100% frequency, Hero’s equity when called becomes 50%, so the bet does not function as a value bet.T never bluffs. From a combo-count perspective, 9 alone provides enough bluff combos (explained later).3. The optimal solution when the AKQJT9 game allows two arbitrary bet sizesNow let’s move into the mathematical analysis.Since this game features bet size splitting, let’s define the value bet size used with A as $b_{A}$, and the value bet size used with K as $b_{K}$.From the previous article, when you pure value bet a strong hand at size $b$, the bluffing frequency that makes Villain’s marginal hands indifferent between calling and folding is $\frac{b}{1+b}$. Because we use two bet sizes this time, Hero’s optimal strategy becomes the following.Hero’s strategyHero (IP) handFrequency of bet $b_{A}$Frequency of bet $b_{K}$Frequency of checkA100K010Q , J , T0019$\frac{b_{A}}{1+b_{A}}$$\frac{b_{K}}{1+b_{K}}$$1 - \frac{b_{A}}{1+b_{A}} -\frac{b_{K}}{1+b_{K}}$Against this strategy, Villain responds as follows. For now, let $f_{1}$ be the bluff-catch frequency of Villain’s marginal hands (K through T) versus bet $b_{A}$, and let $f_{2}$ be the bluff-catch frequency of Villain’s marginal hands (Q through T) versus bet $b_{K}$. (We will compute the exact values next.)Villain’s strategy versus Hero’s bet $b_{A}$Villain handFrequency of callFrequency of foldA (1 combo)10K , Q , J , T (4 combos)$f_{1}$$1 - f_{1}$9 (1 combo)01Villain’s strategy versus Hero’s bet $b_{K}$Villain handFrequency of callFrequency of foldA , K (2 combos)10Q , J , T (3 combos)$f_{2}$$1 - f_{2}$9 (1 combo)01From the previous article, Villain’s optimal bluff-catch frequency makes Hero’s weak hand indifferent between bluffing and giving up by checking. In other words, we want(EV of Hero’s 9 betting $b_{A}$) = (EV of Hero’s 9 betting $b_{K}$) = (EV of Hero’s 9 checking)So the following equation must hold:$$\frac{1 ・ (-b_{A}) + 4f_1 ・(-b_{A}) + 4(1-f_1) ・1 }{5} = \frac{2 ・ (-b_{K}) + 3f_2 ・(-b_{K}) + 3(1-f_2) ・1 }{5} = 0$$Solving this gives $f_1 = \frac{4-b_{A}}{4(1 + b_{A})}$ and $f_2 = \frac{3-2b_{K}}{3(1 + b_{K})}$.Also, $1 - f_1 = \frac{5b_{A}}{4(1 + b_{A})}$ and $1 - f_2 = \frac{5b_{K}}{3(1 + b_{K})}$. (We’ll use these later.)4. Which $b_{A}$ and $b_{K}$ maximize Hero’s overall range EV?Now that we know both players’ optimal strategies, let’s find $b_{A}$ and $b_{K}$ that maximize Hero’s overall range EV. In the previous article, we noted that the EV of marginal hands and weak hands does not depend on Hero’s bet size. Therefore, the optimal $b_{A}$ and $b_{K}$ can be found by focusing only on the EV of A and K (the value hands).Let’s compute the EV for A and K. We can compute A’s EV the same way as before, but K’s EV requires one important caution: K can value-own itself against Villain’s A. Keeping that in mind, let Hero’s EV with A be $E_{A}(b_{A})$ and with K be $E_{K}(b_{K})$. Then:$$E_{A}(b_{A}) = \frac{4f_1・(1 + b_{A}) + (4(1-f_1) + 1)・1}{5} = \frac{1}{5} ((4-b_{A}) + \frac{5b_{A}}{1 + b_{A}} + 1) = \frac{1}{5} (5 + \frac{5b_{A}}{1 + b_{A}} - b_{A})$$$$E_{K}(b_{K}) = \frac{1・(-b_{K}) + 3f_2・(1 + b_{K}) + (3(1-f_2) + 1)・1}{5} = \frac{1}{5} (-b_{K} + (3-2b_{K}) + \frac{5b_{K}}{1 + b_{K}} + 1) = \frac{1}{5} (4 + \frac{5b_{K}}{1 + b_{K}} - 3b_{K})$$Next, we find the $b_{A}$ that maximizes $E_{A}(b_{A})$ and the $b_{K}$ that maximizes $E_{K}(b_{K})$ by differentiating each function.Using the standard derivative rule for rational functions:$$\frac{d}{db_{A}} E_{A}(b_{A}) = \frac{1}{(1 + b_{A} )^2} - \frac{1}{5}$$$$\frac{d}{db_{K}} E_{K}(b_{K}) = \frac{1}{(1 + b_{K} )^2} - \frac{3}{5}$$Both $\frac{d}{db_{A}} E_{A}(b_{A})$ and $\frac{d}{db_{K}} E_{K}(b_{K})$ are monotonically decreasing, so the optimal bet sizes are the values of $b_{A}$ and $b_{K}$ that make these derivatives equal to 0.Solving gives $b_{A} =\sqrt{5} -1 \approx 1.236$ and $b_{K} = \sqrt{\frac{5}{3}} -1 \approx 0.291$.This means Hero’s optimal bet size is 123.6% pot with A, and 29.1% pot with K. Earlier, based on the algorithmic results, we predicted:The nuts A uses a pure large bet. The optimal size seems to be between 120% and 130% pot, slightly closer to 120%.The second nuts K uses a pure small bet. The optimal size seems to be between 25% and 30% pot, slightly closer to 30%.And the math matches perfectly. Also, the bluffing frequencies for 9 are:For 123.6% pot: $\frac{b_{A}}{1 +b_{A}} \approx \frac{1.236}{1 + 1.236} \approx 0.553$For 29.1% pot: $\frac{b_{K}}{1 +b_{K}} \approx \frac{0.291}{1 + 0.291} \approx 0.225$Even combined, they do not exceed 1. In other words, 9 alone provides enough bluff combos, so there’s no need to turn T into a bluff.5. A key warning when applying bet size splitting in real gamesSo far, we’ve discussed how bet size splitting can increase the EV of your range. But you need to be careful when applying this concept in real poker.In this toy game, Villain had no option to raise. But in real poker, your opponent can raise.If your small-bet range contains zero nut hands, and your opponent realizes it, they can exploit you by responding with a wide, polarized raising strategy.That can significantly reduce your range EV.So if your opponent is strong enough to raise properly, you should include some nut hands in your small-bet range to stay balanced (especially when you are out of position).ConclusionThis ended up being another advanced article, but thank you for reading all the way through. In this article, I explained that GTO bet size splitting is an effective strategy with solid mathematical justification.To summarize the key takeaways:When you split bet sizes, using larger bet sizes with stronger value hands increases EV.Select bluff hands from the weakest, lowest-equity hands, and bluff at the correct frequency for each bet size (in practice, hands with better blockers tend to choose larger bluff sizes; this toy game had no blocker effects).In real poker, opponents can raise, so even if you split bet sizes, you need to distribute some nut hands across sizes to avoid being exploited.

812
Learn Poker Theory 1: Finding the Mathematically Optimal Value Bet Sizing in the AKQ Game考察

Learn Poker Theory 1: Finding the Mathematically Optimal Value Bet Sizing in the AKQ Game

1. IntroductionIn poker, choosing the right value bet size is crucial for maximizing expected value (EV). In this article, we’ll use a simple AKQ game to take a deep dive into the optimal bet size for value hands.2. What Is the AKQ Game?The AKQ game is a simplified model designed to teach the fundamentals of poker strategy. There are several variations, but in this article we’ll use the following rules.PlayersThis game is played heads-up between Hero (you) and Villain (your opponent).CardsThe deck contains only three cards: As, Ks, Qs. Hand strength is A > K > Q. Each player is dealt one card at random, and no two players can receive the same rank (ignore suits).PositionHero is always in position (IP), and Villain is always out of position (OOP).ActionThe game starts directly on the river, and Villain (OOP) acts first. Villain always checks.Then Hero (IP) can choose any bet size or check back.If Hero checks back, the hand goes straight to showdown.If Hero bets, Villain can only call or fold. Raising is not allowed.Pot sizeThe initial pot is 1.This simple model helps you learn core ideas like betting strategy and range construction.3. Building Strategies by Hand and Pure StrategiesFirst, let’s summarize the optimal play for each hand for both Hero and Villain.Hero’s Optimal Strategy1. AsSince this is the strongest hand, you should always value bet to target Villain’s K.2. KsA always calls and beats you, and Q just folds, so betting loses EV. Always check.3. QsThis is the weakest hand, but you should mix it in as a bluff alongside your A value bets, bluffing at a frequency that makes Villain’s K indifferent.Villain’s Optimal Response After Facing a Bet4. AsVillain is always ahead, so they always call.5. KsVillain loses to Hero’s A, but to avoid folding too often versus Hero’s Q bluffs, Villain should bluff-catch at the correct frequency (call often enough that Hero is indifferent about bluffing with Q).6. QsVillain is always behind, so they always fold.Here, actions 1, 3, 4, and 6 are fixed at 100% frequency. If you deviate, you clearly lose EV for the reasons above.A strategy where an action is taken with 100% frequency is called a pure strategy. Getting a pure strategy wrong causes a large EV loss, so you need to be careful.Since you can’t change the pure strategies, the key to solving this game is determining:Hero’s Q bluff frequency (3), andVillain’s K calling frequency (5).For 3 and 5, the optimal approach is to balance both actions. This is called a mixed strategy. If you don’t balance properly and lean too far in one direction, your opponent can exploit you. Here’s what that looks like.If Hero bluffs too often with Q, Villain exploits by calling with K 100% of the time. If Hero bluffs too rarely with Q, Hero becomes too value-heavy with A, and Villain exploits by folding K 100% of the time.If Villain calls too often with K, Villain becomes too bluff-catch heavy, and Hero exploits by bluffing with Q 0% of the time. If Villain calls too rarely with K, Villain overfolds, and Hero exploits by bluffing with Q 100% of the time.So how do we find the correct frequencies for 3 and 5? We’ll cover that in the next section.4. Mixed Strategy Frequencies and IndifferenceTo find optimal mixed strategy frequencies, we need to define what it really means to “make the opponent unsure.” The key concept here is indifference.Indifference means a hand has the same EV between multiple actions.That definition can feel abstract, so here’s a concrete example. Suppose the pot is 100, and your opponent bets 100 (a pot-sized bet).You must call 100. If you call, the final pot becomes 100 (pot) + 100 (opponent bet) + 100 (your call) = 300. In other words, you pay 100 to compete for 300, so when your equity is exactly 100/300 = 1/3, calling and folding have the same EV (0).This situation is called call-fold indifference. In general, when a hand is indifferent, it tends to remain in a mixed strategy to maintain balance.In this AKQ game, the key to determining the mixed strategies in 3 and 5 is to adjust frequencies so that a specific opponent hand becomes indifferent.Specifically:3. Hero’s Q: choose a bluff frequency that makes Villain’s K call-fold indifferent.5. Villain’s K: choose a calling frequency that makes Hero’s Q bet-check indifferent.5. Solving the AKQ Game When the Only Bet Size Is 50% PotTo keep things simple, in this section we’ll restrict Hero’s bet size to 50% pot (0.5).Hero’s StrategyHero value bets A at frequency 1, bluffs with Q at an optimal frequency ($f_Q$), and chooses $f_Q$ so that Villain’s K has the same EV for calling and folding. If Villain holds K and calls, the payoff is:Hero has A (1 combo): -0.5 (Villain loses the 0.5 call)Hero has Q ($f_Q$ combos): 1 + 0.5 (Villain wins the pot 1 plus Hero’s bet 0.5)If Villain folds K, their stack doesn’t change, so the payoff is 0.Setting EV(call) = EV(fold), we get:$$\frac{1 ・ (-0.5) +f_Q ・(1 + 0.5)}{1+f_Q} = 0$$Solving gives $f_Q =\frac{1}{3}$.Villain’s StrategyVillain calls with K at an optimal frequency ($f_K$) and chooses $f_K$ so that Hero’s Q has the same EV for betting and checking.If Hero holds Q and bets, the payoff is:Villain has A (1 combo): -0.5 (Hero gets called and loses)Villain has K and calls ($f_K$ combos): -0.5 (Hero gets called and loses)Villain has K and folds ($1 - f_K$ combos): 1 (Hero wins the pot 1)If Hero checks Q, Hero always loses at showdown, so the payoff is 0.Setting EV(bet) = EV(check), we get:$$\frac{1 ・ (-0.5) +f_K ・(-0.5) + (1-f_K) ・1 }{2} = 0$$Solving gives $f_K =\frac{1}{3}$.Putting it all together, the optimal strategies are:Hero’s StrategyHero hand50% pot frequencyCheck frequencyA1 (100%)0 (0%)K0 (0%)1 (100%)Q0.3333 (33.33%)0.6667 (66.67%)Villain’s Strategy (vs Hero bet 0.5)Villain handCall frequencyFold frequencyA1 (100%)0 (0%)K0.3333 (33.33%)0.6667 (66.67%)Q0 (0%)1 (100%)6. Solving the AKQ Game With a Single Arbitrary Bet Size (b)In the previous section, we solved the game with a fixed bet size of 0.5. We can solve the same way for a single bet size of $b$ (a constant). Replacing 0.5 with $b$ in the two equations gives:$$\frac{1 ・ (-b) +f_Q ・(1 + b)}{1+f_Q} = 0$$$$\frac{1 ・ (-b) + f_K ・(-b) + (1-f_K) ・1 }{2} = 0$$Solving yields $f_Q = \frac{b}{1+b}$ and $f_K = \frac{1-b}{1+b}$.Summarizing the optimal strategies:Hero’s StrategyHero handBet $b$ frequencyCheck frequencyA10K01Q$\frac{b}{1+b}$$\frac{1}{1+b}$Villain’s Strategy (vs Hero bet $b$)Villain handCall frequencyFold frequencyA10K$\frac{1-b}{1+b}$$\frac{2b}{1+b}$Q01Now look at $f_K = \frac{1-b}{1+b}$. When $b$ is greater than 1 (a pot-sized overbet), $f_K$ becomes negative, which clearly makes no sense. What’s happening?In general, an overbet bluff requires a bluff success rate above 50%. When Hero bluffs with Q in this game, Villain holds either A or K. But Villain never folds A, so the bluff can never succeed more than 50% of the time.That leads to an important conclusion: in the AKQ game, Hero should not use overbet bluffs. And if bluffs don’t exist at that size, value bets can’t be balanced either, so Hero won’t use overbets in this game. Therefore, from here on we assume $0 < b \leq 1$.7. What Bet Size Maximizes EV for Hero’s Entire Range?So far, we’ve solved the game for any single bet size $b$. Now we get to the main point.In fact, Hero’s EV with K and Q does not change with the bet size $b$. Here’s why:Hero’s K: you always check, then lose to A and beat Q at showdown. You win the pot 1 with 50% probability, so EV is always 0.5.Hero’s Q: Villain’s K calling frequency makes Q indifferent between bluffing and giving up, so EV is always 0.That means only A’s EV changes with bet size. So Hero’s optimal bet size is the one that maximizes EV when Hero holds A. Let’s compute the EV of betting A with size $b$.$$(EV\text{ of Hero’s A}) = (P(\text{call}))・(1+b) + (P(\text{fold}))・1$$Villain calls when they hold K ($\frac{1}{2}$) and choose to call ($\frac{1-b}{1+b}$), so:$$P(\text{call}) = \frac{1}{2}\frac{1-b}{1+b}$$Let this be $P(b)$. Then:$$(EV\text{ of Hero’s A}) = P(b)・(1+b) + (1-P(b))・1 = bP(b) + 1 = \frac{1}{2}\frac{b(1-b)}{1+b} +1$$Ignoring the constant term, we just need to maximize $\frac{b(1-b)}{1+b}$.$$\frac{b(1-b)}{1+b} = \frac{-b(1+b) + 2(1+b) -2 }{1+b} = 2 -(b+ \frac{2}{1+b}) = 3 -((1+b) + \frac{2}{1+b})$$By the arithmetic-geometric mean inequality, $(1+b) + \frac{2}{1+b}$ is minimized when $1+b = \sqrt{2}$, meaning $b = \sqrt{2} -1 \approx 0.414$. At that point, $\frac{b(1-b)}{1+b}$ reaches its maximum value of $3-2\sqrt{2}$.This means Hero’s optimal bet size is 41.4% pot, because it maximizes the EV of A. We started with poker bet sizing, and somehow a square root appeared. Interesting.If we plug this maximum back into the original EV expression:$$(\text{Maximum EV of Hero’s A}) = \frac{1}{2} ・(3-2\sqrt{2}) +1 = \frac{5}{2} - \sqrt{2} \approx 1.086$$If Hero couldn’t bet, A’s EV would be 1. So being in position clearly increases the EV of Hero’s overall range.8. SummaryThanks for reading through a long and challenging article. Here, we analyzed how Hero’s bet size affects expected value (EV). The key takeaways are:The AKQ game is a simplified poker model, and studying it in detail helps you learn many theories used in real poker.When the opponent cannot raise, value hands can have an optimal bet size that maximizes EV.By analyzing the AKQ game, you can build a deeper understanding of bet sizing and GTO (Game Theory Optimal) strategy. In the next article, we’ll explore optimal bet sizing in more complex situations and how to apply these ideas in real games.https://pokerqz.com/blog/theoretical_poker_2

1222