IDEAS home Printed from https://ideas.repec.org/a/spr/dyngam/v14y2024i3d10.1007_s13235-023-00513-y.html
   My bibliography  Save this article

Deterministic Approximation of a Stochastic Imitation Dynamics with Memory

Author

Listed:
  • Ozgur Aydogmus

    (University of Ankara)

  • Yun Kang

    (Arizona State University)

Abstract

We provide results of a deterministic approximation for non-Markovian stochastic processes modeling finite populations of individuals who recurrently play symmetric finite games and imitate each other according to payoffs. We show that a system of delay differential equations can be obtained as the deterministic approximation of such a non-Markovian process. We also show that if the initial states of stochastic process and the corresponding deterministic model are close enough, then the trajectory of stochastic process stays close to that of the deterministic model up to any given finite time horizon with a probability exponentially approaching one as the population size increases. We use this result to obtain that the lower bound of the population size on the absorption time of the non-Markovian process is exponentially increasing. Additionally, we obtain the replicator equations with distributed and discrete delay terms as examples and analyze how the memory of individuals can affect the evolution of cooperation in a two-player symmetric snow-drift game. We investigate the stability of the evolutionary stable state of the game when agents have the memory of past population states, and implications of these results are given for the stochastic model.

Suggested Citation

  • Ozgur Aydogmus & Yun Kang, 2024. "Deterministic Approximation of a Stochastic Imitation Dynamics with Memory," Dynamic Games and Applications, Springer, vol. 14(3), pages 525-548, July.
  • Handle: RePEc:spr:dyngam:v:14:y:2024:i:3:d:10.1007_s13235-023-00513-y
    DOI: 10.1007/s13235-023-00513-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s13235-023-00513-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s13235-023-00513-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Daniel Friedman, 1998. "On economic applications of evolutionary game theory," Journal of Evolutionary Economics, Springer, vol. 8(1), pages 15-43.
    2. Ozgur Aydogmus & Hasan Cagatay & Erkan Gürpinar, 2020. "Does social learning promote cooperation in social dilemmas?," Journal of Economic Interaction and Coordination, Springer;Society for Economic Science with Heterogeneous Interacting Agents, vol. 15(3), pages 633-648, July.
    3. Michel BenaÔm & J–rgen W. Weibull, 2003. "Deterministic Approximation of Stochastic Evolution in Games," Econometrica, Econometric Society, vol. 71(3), pages 873-903, May.
    4. Borgers, Tilman & Sarin, Rajiv, 1997. "Learning Through Reinforcement and Replicator Dynamics," Journal of Economic Theory, Elsevier, vol. 77(1), pages 1-14, November.
    5. , & Katsoulakis, Markos & ,, 2013. "Deterministic equations for stochastic spatial evolutionary games," Theoretical Economics, Econometric Society, vol. 8(3), September.
    6. Jacek Miȩkisz & Sergiusz Wesołowski, 2011. "Stochasticity and Time Delays in Evolutionary Games," Dynamic Games and Applications, Springer, vol. 1(3), pages 440-448, September.
    7. Paul E. Turner & Lin Chao, 1999. "Prisoner's dilemma in an RNA virus," Nature, Nature, vol. 398(6726), pages 441-443, April.
    8. Binmore, Ken & Samuelson, Larry, 1997. "Muddling Through: Noisy Equilibrium Selection," Journal of Economic Theory, Elsevier, vol. 74(2), pages 235-265, June.
    9. Marek Bodnar & Jacek Miȩkisz & Raffi Vardanyan, 2020. "Three-Player Games with Strategy-Dependent Time Delays," Dynamic Games and Applications, Springer, vol. 10(3), pages 664-675, September.
    10. Corradi, Valentina & Sarin, Rajiv, 2000. "Continuous Approximations of Stochastic Evolutionary Game Dynamics," Journal of Economic Theory, Elsevier, vol. 94(2), pages 163-191, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sandholm, William H., 2015. "Population Games and Deterministic Evolutionary Dynamics," Handbook of Game Theory with Economic Applications,, Elsevier.
    2. Erik Mohlin & Robert Ostling & Joseph Tao-yi Wang, 2014. "Learning by Imitation in Games: Theory, Field, and Laboratory," Economics Series Working Papers 734, University of Oxford, Department of Economics.
    3. Sandholm, William H., 2003. "Evolution and equilibrium under inexact information," Games and Economic Behavior, Elsevier, vol. 44(2), pages 343-378, August.
    4. Vassili Kolokoltsov, 2017. "The Evolutionary Game of Pressure (or Interference), Resistance and Collaboration," Mathematics of Operations Research, INFORMS, vol. 42(4), pages 915-944, November.
    5. Tanabe, Yasuo, 2006. "The propagation of chaos for interacting individuals in a large population," Mathematical Social Sciences, Elsevier, vol. 51(2), pages 125-152, March.
    6. Alanyali, Murat, 2010. "A note on adjusted replicator dynamics in iterated games," Journal of Mathematical Economics, Elsevier, vol. 46(1), pages 86-98, January.
    7. Sandholm,W.H., 1999. "Markov evolution with inexact information," Working papers 15, Wisconsin Madison - Social Systems.
    8. Dehai Liu & Hongyi Li & Weiguo Wang & Chuang Zhou, 2015. "Scenario forecast model of long term trends in rural labor transfer based on evolutionary games," Journal of Evolutionary Economics, Springer, vol. 25(3), pages 649-670, July.
    9. Ianni, A., 2002. "Reinforcement learning and the power law of practice: some analytical results," Discussion Paper Series In Economics And Econometrics 203, Economics Division, School of Social Sciences, University of Southampton.
    10. Norman, Thomas W.L., 2009. "Rapid evolution under inertia," Games and Economic Behavior, Elsevier, vol. 66(2), pages 865-879, July.
    11. Demichelis, Stefano & Ritzberger, Klaus, 2003. "From evolutionary to strategic stability," Journal of Economic Theory, Elsevier, vol. 113(1), pages 51-75, November.
    12. Boyu Zhang & Josef Hofbauer, 2015. "Equilibrium selection via replicator dynamics in $$2 \times 2$$ 2 × 2 coordination games," International Journal of Game Theory, Springer;Game Theory Society, vol. 44(2), pages 433-448, May.
    13. Hopkins, Ed, 1999. "Learning, Matching, and Aggregation," Games and Economic Behavior, Elsevier, vol. 26(1), pages 79-110, January.
    14. Peyton Young, H., 1998. "Individual learning and social rationality1," European Economic Review, Elsevier, vol. 42(3-5), pages 651-663, May.
    15. Sandholm, William H., 2012. "Stochastic imitative game dynamics with committed agents," Journal of Economic Theory, Elsevier, vol. 147(5), pages 2056-2071.
    16. Dai, Darong, 2012. "On the Existence of Pareto Optimal Endogenous Matching," MPRA Paper 43125, University Library of Munich, Germany.
    17. Battalio,R. & Samuelson,L. & Huyck,J. van, 1998. "Risk dominance, payoff dominance and probabilistic choice learning," Working papers 2, Wisconsin Madison - Social Systems.
    18. Carlos Alós-Ferrer & Georg Kirchsteiger & Markus Walzl, 2010. "On the Evolution of Market Institutions: The Platform Design Paradox," Economic Journal, Royal Economic Society, vol. 120(543), pages 215-243, March.
    19. Mertikopoulos, Panayotis & Sandholm, William H., 2018. "Riemannian game dynamics," Journal of Economic Theory, Elsevier, vol. 177(C), pages 315-364.
    20. Mengel, Friederike, 2012. "Learning across games," Games and Economic Behavior, Elsevier, vol. 74(2), pages 601-619.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:dyngam:v:14:y:2024:i:3:d:10.1007_s13235-023-00513-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.