Games and decisions · Optimal stopping · Medium
Twenty-five cents a roll
You pay 25 cents to roll a fair six-sided die. After any roll you may stop and collect the face shown in dollars, or pay another 25 cents and roll again; only the last roll counts, and you may roll as many times as you like. Playing the best way, what is the game worth in dollars before you have paid anything, counting every fee including the first?
Answer and solution
Answer
19/4 ≈ 4.75
Solution
Every roll starts the same game again, so its value satisfies one equation; then check the stopping rule against that value.
Stopping on 5 and 6: V = −0.25 + 11/6 + (2/3)V, so V = 3 × (11/6 − 1/4) = 4.75. That is consistent: 5 and 6 beat 4.75 and 4 does not. Stopping only on 6 gives 4.5, and stopping on 4 as well gives 4.5, both lower.
Optimal stopping comes up in 10 firms' roundsJane Street · Hudson River Trading · Citadel Securities · +7
These 12 rounds ask this kind of problem live, with follow-ups. Every round on every track is in Premium.