IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v63y2024i2d10.1007_s10614-022-10348-1.html
   My bibliography  Save this article

Analyzing the Impact of Strategic Behavior in an Evolutionary Learning Model Using a Genetic Algorithm

Author

Listed:
  • Vinícius Ferraz

    (University of Heidelberg)

  • Thomas Pitz

    (Rhine-Waal University of Applied Sciences)

Abstract

This study presents an experimental approach to strategic behavior and economic learning by integrating game theory and Genetic Algorithms in a novel heuristic-based simulation model. Inspired by strategic scenarios that change over time, we propose a model where games can change based on agents’ behavior. The goal is to document the model design and examine how strategic behavior impacts the evolution of optimal outcomes in various choice scenarios. For diversity, 144 unique $$ 2\times 2 $$ 2 × 2 games and three different strategy selection criteria were used: Nash equilibrium, Hurwicz rule, and a random selection technique. The originality of this study is that the introduced evolutionary algorithm changes the games based on their overall outcome rather than changing the strategies or player-specific traits. The results indicated optimal player scenarios for both The Nash equilibrium and Hurwicz rules, the first being the best-performing strategy. The random selection method failed to converge to optimal values in most of the selected populations, acting as a control feature and reinforcing the need for strategic behavior in evolutionary learning. Two further observations were recorded. First, games were frequently transformed so agents could coordinate their strategies to create stable optimal equilibria. Second, we observed the evolution of game populations into groups of fewer (repeating) isomorphic games with strong preceding game characteristics.

Suggested Citation

  • Vinícius Ferraz & Thomas Pitz, 2024. "Analyzing the Impact of Strategic Behavior in an Evolutionary Learning Model Using a Genetic Algorithm," Computational Economics, Springer;Society for Computational Economics, vol. 63(2), pages 437-475, February.
  • Handle: RePEc:kap:compec:v:63:y:2024:i:2:d:10.1007_s10614-022-10348-1
    DOI: 10.1007/s10614-022-10348-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-022-10348-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-022-10348-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. John C. Harsanyi & Reinhard Selten, 1988. "A General Theory of Equilibrium Selection in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262582384, December.
    2. Nahoko Hayashi & Elinor Ostrom & James Walker & Toshio Yamagishi, 1999. "Reciprocity, Trust, And The Sense Of Control," Rationality and Society, , vol. 11(1), pages 27-46, February.
    3. Colin Camerer & Teck-Hua Ho, 1999. "Experience-weighted Attraction Learning in Normal Form Games," Econometrica, Econometric Society, vol. 67(4), pages 827-874, July.
    4. Savin, Ivan & Egbetokun, Abiodun, 2016. "Emergence of innovation networks from R&D cooperation with endogenous absorptive capacity," Journal of Economic Dynamics and Control, Elsevier, vol. 64(C), pages 82-103.
    5. Kalai, Ehud & Lehrer, Ehud, 1993. "Rational Learning Leads to Nash Equilibrium," Econometrica, Econometric Society, vol. 61(5), pages 1019-1045, September.
    6. D. Blueschke & I. Savin & V. Blueschke-Nikolaeva, 2020. "An Evolutionary Approach to Passive Learning in Optimal Control Problems," Computational Economics, Springer;Society for Computational Economics, vol. 56(3), pages 659-673, October.
    7. Ivan Savin & Dmitri Blueschke, 2016. "Lost in Translation: Explicitly Solving Nonlinear Stochastic Optimal Control Problems Using the Median Objective Value," Computational Economics, Springer;Society for Computational Economics, vol. 48(2), pages 317-338, August.
    8. Tim Gooding, 2014. "Modelling Society's Evolutionary Forces," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 17(3), pages 1-3.
    9. Jasmina Arifovic & John Ledyard, 2012. "Individual Evolutionary Learning, Other-regarding Preferences, and the Voluntary Contributions Mechanism," Discussion Papers wp12-01, Department of Economics, Simon Fraser University.
    10. Alan G. Isaac, 2008. "Simulating Evolutionary Games: A Python-Based Introduction," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 11(3), pages 1-8.
    11. Friedman, Daniel, 1991. "Evolutionary Games in Economics," Econometrica, Econometric Society, vol. 59(3), pages 637-666, May.
    12. Duffy, John, 2006. "Agent-Based Models and Human Subject Experiments," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 19, pages 949-1011, Elsevier.
    13. Carl Henning Reschke, 2001. "Evolutionary Perspectives on Simulations of Social Systems," Journal of Artificial Societies and Social Simulation, Journal of Artificial Societies and Social Simulation, vol. 4(4), pages 1-8.
    14. Holland, John H & Miller, John H, 1991. "Artificial Adaptive Agents in Economic Theory," American Economic Review, American Economic Association, vol. 81(2), pages 365-371, May.
    15. Jasmina Arifovic & John Ledyard, 2004. "Scaling Up Learning Models in Public Good Games," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 6(2), pages 203-238, May.
    16. Tony Curzon Price, 1997. "Using co-evolutionary programming to simulate strategic behaviour in markets," Journal of Evolutionary Economics, Springer, vol. 7(3), pages 219-254.
    17. Arifovic, Jasmina & Ledyard, John, 2012. "Individual evolutionary learning, other-regarding preferences, and the voluntary contributions mechanism," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 808-823.
    18. Helena Gaspars-Wieloch, 2014. "Modifications of the Hurwicz’s decision rule," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 22(4), pages 779-794, December.
    19. Erev, Ido & Roth, Alvin E, 1998. "Predicting How People Play Games: Reinforcement Learning in Experimental Games with Unique, Mixed Strategy Equilibria," American Economic Review, American Economic Association, vol. 88(4), pages 848-881, September.
    20. Michael Kopel & Herbert Dawid, 1998. "On economic applications of the genetic algorithm: a model of the cobweb type," Journal of Evolutionary Economics, Springer, vol. 8(3), pages 297-315.
    21. Jorgen W. Weibull, 1997. "Evolutionary Game Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262731215, December.
    22. Glynatsi, Nikoleta E. & Knight, Vincent & Lee, Tamsin E., 2018. "An evolutionary game theoretic model of rhino horn devaluation," Ecological Modelling, Elsevier, vol. 389(C), pages 33-40.
    23. Bullard, James & Duffy, John, 1998. "Learning And The Stability Of Cycles," Macroeconomic Dynamics, Cambridge University Press, vol. 2(1), pages 22-48, March.
    24. Arifovic, Jasmina & Ledyard, John, 2011. "A behavioral model for mechanism design: Individual evolutionary learning," Journal of Economic Behavior & Organization, Elsevier, vol. 78(3), pages 374-395, May.
    25. Tony Curson Price, 1997. "Using co-evolutionary programming to simulate strategic behaviour in markets," Levine's Working Paper Archive 588, David K. Levine.
    26. Luís Lobato Macedo & Pedro Godinho & Maria João Alves, 2020. "A Comparative Study of Technical Trading Strategies Using a Genetic Algorithm," Computational Economics, Springer;Society for Computational Economics, vol. 55(1), pages 349-381, January.
    27. Camerer, Colin & Weigelt, Keith, 1988. "Experimental Tests of a Sequential Equilibrium Reputation Model," Econometrica, Econometric Society, vol. 56(1), pages 1-36, January.
    28. Lensberg, Terje & Schenk-Hoppé, Klaus Reiner, 2021. "Cold play: Learning across bimatrix games," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 419-441.
    29. Riechmann, Thomas, 2001. "Genetic algorithm learning and evolutionary games," Journal of Economic Dynamics and Control, Elsevier, vol. 25(6-7), pages 1019-1037, June.
    30. Schmertmann, Carl P, 1996. "Functional Search in Economics Using Genetic Programming," Computational Economics, Springer;Society for Computational Economics, vol. 9(4), pages 275-298, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weidlich, Anke & Veit, Daniel, 2008. "A critical survey of agent-based wholesale electricity market models," Energy Economics, Elsevier, vol. 30(4), pages 1728-1759, July.
    2. Jasmina Arifovic & John Ledyard, 2018. "Learning to alternate," Experimental Economics, Springer;Economic Science Association, vol. 21(3), pages 692-721, September.
    3. Chernomaz, K. & Goertz, J.M.M., 2023. "(A)symmetric equilibria and adaptive learning dynamics in small-committee voting," Journal of Economic Dynamics and Control, Elsevier, vol. 147(C).
    4. Graubner, Marten, 2011. "The Spatial Agent-based Competition Model (SpAbCoM)," IAMO Discussion Papers 109915, Institute of Agricultural Development in Transition Economies (IAMO).
    5. Graupner, Marten, 2011. "The Spatial Agent-based Competition Model (SpAbCoM) [Das räumliche agenten-basierte Wettbewerbsmodell SpAbCoM]," IAMO Discussion Papers 135, Leibniz Institute of Agricultural Development in Transition Economies (IAMO).
    6. Alejandro Lee-Penagos, 2016. "Modelling Contributions in Public Good Games with Punishment," Discussion Papers 2016-15, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    7. Mikhail Anufriev & Jasmina Arifovic & John Ledyard & Valentyn Panchenko, 2013. "Efficiency of continuous double auctions under individual evolutionary learning with full or limited information," Journal of Evolutionary Economics, Springer, vol. 23(3), pages 539-573, July.
    8. repec:zbw:iamodp:109915 is not listed on IDEAS
    9. Ian McCarthy, 2008. "Simulating Sequential Search Models with Genetic Algorithms: Analysis of Price Ceilings, Taxes, Advertising and Welfare," CAEPR Working Papers 2008-010, Center for Applied Economics and Policy Research, Department of Economics, Indiana University Bloomington.
    10. Bao, Te & Hommes, Cars & Pei, Jiaoying, 2021. "Expectation formation in finance and macroeconomics: A review of new experimental evidence," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
    11. Masiliūnas, Aidas, 2023. "Learning in rent-seeking contests with payoff risk and foregone payoff information," Games and Economic Behavior, Elsevier, vol. 140(C), pages 50-72.
    12. Shu-Heng Chen & Chia-Hsuan Yeh, 1999. "Evolving Traders and the Faculty of the Business School: A New Architecture of the Artificial Stock Market," Computing in Economics and Finance 1999 613, Society for Computational Economics.
    13. Eric Guerci & Nobuyuki Hanaki & Naoki Watanabe, 2017. "Meaningful learning in weighted voting games: an experiment," Theory and Decision, Springer, vol. 83(1), pages 131-153, June.
    14. Chernov, G. & Susin, I., 2019. "Models of learning in games: An overview," Journal of the New Economic Association, New Economic Association, vol. 44(4), pages 77-125.
    15. Weibull, Jörgen W., 1997. "What have we learned from Evolutionary Game Theory so far?," Working Paper Series 487, Research Institute of Industrial Economics, revised 26 Oct 1998.
    16. Alexander Smajgl, 2007. "Modelling evolving rules for the use of common-pool resources in an agent-based model," Interdisciplinary Description of Complex Systems - scientific journal, Croatian Interdisciplinary Society Provider Homepage: http://indecs.eu, vol. 5(2), pages 56-80.
    17. Friedman, Daniel & Zhao, Shuchen, 2021. "When are mixed equilibria relevant?," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 51-65.
    18. Arifovic, Jasmina & Duffy, John & Jiang, Janet Hua, 2023. "Adoption of a new payment method: Experimental evidence," European Economic Review, Elsevier, vol. 154(C).
    19. Chen, Shu-Heng & Yeh, Chia-Hsuan, 2001. "Evolving traders and the business school with genetic programming: A new architecture of the agent-based artificial stock market," Journal of Economic Dynamics and Control, Elsevier, vol. 25(3-4), pages 363-393, March.
    20. Jasmina Arifovic & Michael Maschek, 2006. "Revisiting Individual Evolutionary Learning in the Cobweb Model – An Illustration of the Virtual Spite-Effect," Computational Economics, Springer;Society for Computational Economics, vol. 28(4), pages 333-354, November.
    21. Ian McCarthy, 2008. "Simulating Sequential Search Models with Genetic Algorithms: Analysis of Price Ceilings, Taxes, Advertising and Welfare," Caepr Working Papers 2008-010, Center for Applied Economics and Policy Research, Economics Department, Indiana University Bloomington.

    More about this item

    Keywords

    Game theory; Simulation; Genetic algorithms; Economic learning; Artificial intelligence;
    All these keywords.

    JEL classification:

    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics
    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:63:y:2024:i:2:d:10.1007_s10614-022-10348-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.