IDEAS home Printed from https://ideas.repec.org/a/gam/jgames/v14y2023i6p73-d1290608.html
   My bibliography  Save this article

Factors in Learning Dynamics Influencing Relative Strengths of Strategies in Poker Simulation

Author

Listed:
  • Aaron Foote

    (Hazel Quantitative Analysis Center, Wesleyan University, Middletown, NJ 06459, USA)

  • Maryam Gooyabadi

    (Hazel Quantitative Analysis Center, Wesleyan University, Middletown, NJ 06459, USA)

  • Nikhil Addleman

    (Independent Researcher, Middletown, CT 06457, USA)

Abstract

Poker is a game of skill, much like chess or go, but distinct as an incomplete information game. Substantial work has been done to understand human play in poker, as well as the optimal strategies in poker. Evolutionary game theory provides another avenue to study poker by considering overarching strategies, namely rational and random play. In this work, a population of poker playing agents is instantiated to play the preflop portion of Texas Hold’em poker, with learning and strategy revision occurring over the course of the simulation. This paper aims to investigate the influence of learning dynamics on dominant strategies in poker, an area that has yet to be investigated. Our findings show that rational play emerges as the dominant strategy when loss aversion is included in the learning model, not when winning and magnitude of win are of the only considerations. The implications of our findings extend to the modeling of sub-optimal human poker play and the development of optimal poker agents.

Suggested Citation

  • Aaron Foote & Maryam Gooyabadi & Nikhil Addleman, 2023. "Factors in Learning Dynamics Influencing Relative Strengths of Strategies in Poker Simulation," Games, MDPI, vol. 14(6), pages 1-16, November.
    • Handle: RePEc:gam:jgames:v:14:y:2023:i:6:p:73-:d:1290608
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2073-4336/14/6/73/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2073-4336/14/6/73/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sarin, Rajiv & Vahid, Farshid, 2001. "Predicting How People Play Games: A Simple Dynamic Model of Choice," Games and Economic Behavior, Elsevier, vol. 34(1), pages 104-122, January.
    2. Robert J. Leonard, 1995. "From Parlor Games to Social Science: Von Neumann, Morgenstern, and the Creation of Game Theory, 1928-1994," Journal of Economic Literature, American Economic Association, vol. 33(2), pages 730-761, June.
    3. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    4. Arthur, W Brian, 1991. "Designing Economic Agents that Act Like Human Agents: A Behavioral Approach to Bounded Rationality," American Economic Review, American Economic Association, vol. 81(2), pages 353-359, May.
    5. Rapoport, Amnon & Erev, Ido & Abraham, Elizabeth V. & Olson, David E., 1997. "Randomization and Adaptive Learning in a Simplified Poker Game," Organizational Behavior and Human Decision Processes, Elsevier, vol. 69(1), pages 31-49, January.
    6. Kalai, Ehud & Lehrer, Ehud, 1993. "Rational Learning Leads to Nash Equilibrium," Econometrica, Econometric Society, vol. 61(5), pages 1019-1045, September.
    7. Laurent Keller & Kenneth G. Ross, 1998. "Selfish genes: a green beard in the red fire ant," Nature, Nature, vol. 394(6693), pages 573-575, August.
    8. Friedman, Daniel, 1991. "Evolutionary Games in Economics," Econometrica, Econometric Society, vol. 59(3), pages 637-666, May.
    9. Weber, Roberto A., 2003. "'Learning' with no feedback in a competitive guessing game," Games and Economic Behavior, Elsevier, vol. 44(1), pages 134-144, July.
    10. Sarin, Rajiv & Vahid, Farshid, 1999. "Payoff Assessments without Probabilities: A Simple Dynamic Model of Choice," Games and Economic Behavior, Elsevier, vol. 28(2), pages 294-309, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Duffy, John, 2006. "Agent-Based Models and Human Subject Experiments," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 19, pages 949-1011, Elsevier.
    2. Hopkins, Ed, 1999. "Learning, Matching, and Aggregation," Games and Economic Behavior, Elsevier, vol. 26(1), pages 79-110, January.
    3. Naoki Funai, 2019. "Convergence results on stochastic adaptive learning," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 68(4), pages 907-934, November.
    4. Stahl, Dale O., 2000. "Rule Learning in Symmetric Normal-Form Games: Theory and Evidence," Games and Economic Behavior, Elsevier, vol. 32(1), pages 105-138, July.
    5. Yechiam, Eldad & Busemeyer, Jerome R., 2008. "Evaluating generalizability and parameter consistency in learning models," Games and Economic Behavior, Elsevier, vol. 63(1), pages 370-394, May.
    6. Ho, Teck H. & Camerer, Colin F. & Chong, Juin-Kuan, 2007. "Self-tuning experience weighted attraction learning in games," Journal of Economic Theory, Elsevier, vol. 133(1), pages 177-198, March.
    7. Schuster, Stephan, 2012. "Applications in Agent-Based Computational Economics," MPRA Paper 47201, University Library of Munich, Germany.
    8. Roth, Alvin E. & Erev, Ido, 1995. "Learning in extensive-form games: Experimental data and simple dynamic models in the intermediate term," Games and Economic Behavior, Elsevier, vol. 8(1), pages 164-212.
    9. Waltman, Ludo & Kaymak, Uzay, 2008. "Q-learning agents in a Cournot oligopoly model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(10), pages 3275-3293, October.
    10. David Cooper & Nick Feltovich & Alvin Roth & Rami Zwick, 2003. "Relative versus Absolute Speed of Adjustment in Strategic Environments: Responder Behavior in Ultimatum Games," Experimental Economics, Springer;Economic Science Association, vol. 6(2), pages 181-207, October.
    11. Marimon, R. & McGraltan, E., 1993. "On Adaptative Learning in Strategic Games," Papers 190, Cambridge - Risk, Information & Quantity Signals.
    12. Friedman, Eric & Shor, Mikhael & Shenker, Scott & Sopher, Barry, 2004. "An experiment on learning with limited information: nonconvergence, experimentation cascades, and the advantage of being slow," Games and Economic Behavior, Elsevier, vol. 47(2), pages 325-352, May.
    13. Weibull, Jörgen W., 1997. "What have we learned from Evolutionary Game Theory so far?," Working Paper Series 487, Research Institute of Industrial Economics, revised 26 Oct 1998.
    14. Terracol, Antoine & Vaksmann, Jonathan, 2009. "Dumbing down rational players: Learning and teaching in an experimental game," Journal of Economic Behavior & Organization, Elsevier, vol. 70(1-2), pages 54-71, May.
    15. Erhao Xie, 2019. "Monetary Payoff and Utility Function in Adaptive Learning Models," Staff Working Papers 19-50, Bank of Canada.
    16. Thorsten Chmura & Thomas Pitz, 2007. "An Extended Reinforcement Algorithm for Estimation of Human Behaviour in Experimental Congestion Games," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 10(2), pages 1-1.
    17. Sent, Esther-Mirjam, 2004. "The legacy of Herbert Simon in game theory," Journal of Economic Behavior & Organization, Elsevier, vol. 53(3), pages 303-317, March.
    18. Osili, Una Okonkwo & Paulson, Anna, 2014. "Crises and confidence: Systemic banking crises and depositor behavior," Journal of Financial Economics, Elsevier, vol. 111(3), pages 646-660.
    19. Sarin, Rajiv, 1999. "Simple play in the Prisoner's Dilemma," Journal of Economic Behavior & Organization, Elsevier, vol. 40(1), pages 105-113, September.
    20. Emilio Calvano & Giacomo Calzolari & Vincenzo Denicolò & Sergio Pastorello, 2019. "Algorithmic Pricing What Implications for Competition Policy?," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 55(1), pages 155-171, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jgames:v:14:y:2023:i:6:p:73-:d:1290608. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.