IDEAS home Printed from https://ideas.repec.org/a/eee/jetheo/v205y2022ics0022053122001417.html
   My bibliography  Save this article

Learning efficient equilibria in repeated games

Author

Listed:
  • Jindani, Sam

Abstract

The folk theorem tells us that a wide range of payoffs can be sustained as equilibria in an infinitely repeated game. Existing results about learning in repeated games suggest that players may converge to an equilibrium, but do not address selection between equilibria. I propose a stochastic learning rule that selects a subgame-perfect equilibrium of the repeated game in which payoffs are efficient. The exact payoffs selected depend on how players experiment; two natural specifications yield the Kalai–Smorodinsky and maxmin bargaining solutions, respectively.

Suggested Citation

  • Jindani, Sam, 2022. "Learning efficient equilibria in repeated games," Journal of Economic Theory, Elsevier, vol. 205(C).
  • Handle: RePEc:eee:jetheo:v:205:y:2022:i:c:s0022053122001417
    DOI: 10.1016/j.jet.2022.105551
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0022053122001417
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jet.2022.105551?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Fudenberg, Drew & Levine, David, 1998. "Learning in games," European Economic Review, Elsevier, vol. 42(3-5), pages 631-639, May.
    2. Glenn Ellison, 2000. "Basins of Attraction, Long-Run Stochastic Stability, and the Speed of Step-by-Step Evolution," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 67(1), pages 17-45.
    3. Robson, Arthur J. & Vega-Redondo, Fernando, 1996. "Efficient Equilibrium Selection in Evolutionary Games with Random Matching," Journal of Economic Theory, Elsevier, vol. 70(1), pages 65-92, July.
    4. John H. Nachbar, 1997. "Prediction, Optimization, and Learning in Repeated Games," Econometrica, Econometric Society, vol. 65(2), pages 275-310, March.
    5. Kalai, Ehud, 1977. "Proportional Solutions to Bargaining Situations: Interpersonal Utility Comparisons," Econometrica, Econometric Society, vol. 45(7), pages 1623-1630, October.
    6. Burkhard C. Schipper, 2022. "Strategic Teaching and Learning in Games," American Economic Journal: Microeconomics, American Economic Association, vol. 14(3), pages 321-352, August.
    7. Drew Fudenberg & David K. Levine, 2009. "Learning and Equilibrium," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 385-420, May.
    8. Young, H Peyton, 1993. "The Evolution of Conventions," Econometrica, Econometric Society, vol. 61(1), pages 57-84, January.
    9. Drew Fudenberg & Eric Maskin, 2008. "The Folk Theorem In Repeated Games With Discounting Or With Incomplete Information," World Scientific Book Chapters, in: Drew Fudenberg & David K Levine (ed.), A Long-Run Collaboration On Long-Run Games, chapter 11, pages 209-230, World Scientific Publishing Co. Pte. Ltd..
    10. Young, H. Peyton, 2004. "Strategic Learning and its Limits," OUP Catalogue, Oxford University Press, number 9780199269181.
    11. Kalai, Ehud & Lehrer, Ehud, 1993. "Rational Learning Leads to Nash Equilibrium," Econometrica, Econometric Society, vol. 61(5), pages 1019-1045, September.
    12. Kandori, Michihiro & Mailath, George J & Rob, Rafael, 1993. "Learning, Mutation, and Long Run Equilibria in Games," Econometrica, Econometric Society, vol. 61(1), pages 29-56, January.
    13. Barlo, Mehmet & Carmona, Guilherme & Sabourian, Hamid, 2016. "Bounded memory Folk Theorem," Journal of Economic Theory, Elsevier, vol. 163(C), pages 728-774.
    14. Bergin, James & Lipman, Barton L, 1996. "Evolution with State-Dependent Mutations," Econometrica, Econometric Society, vol. 64(4), pages 943-956, July.
    15. John H. Nachbar, 2005. "Beliefs in Repeated Games," Econometrica, Econometric Society, vol. 73(2), pages 459-480, March.
    16. Pradelski, Bary S.R. & Young, H. Peyton, 2012. "Learning efficient Nash equilibria in distributed systems," Games and Economic Behavior, Elsevier, vol. 75(2), pages 882-897.
    17. Hart, Sergiu, 2002. "Evolutionary dynamics and backward induction," Games and Economic Behavior, Elsevier, vol. 41(2), pages 227-264, November.
    18. Arieli, Itai & Babichenko, Yakov, 2012. "Average testing and Pareto efficiency," Journal of Economic Theory, Elsevier, vol. 147(6), pages 2376-2398.
    19. David Pearce, 2002. "Bargaining, Reputation, and Equilibrium Selection in Repeated Games (joint with Dilip Abreu)," Theory workshop papers 357966000000000094, UCLA Department of Economics.
    20. Yuichi Noguchi, 2015. "Bayesian Learning, Smooth Approximate Optimal Behavior, and Convergence to ε‐Nash Equilibrium," Econometrica, Econometric Society, vol. 83, pages 353-373, January.
    21. Young H. P., 1993. "An Evolutionary Model of Bargaining," Journal of Economic Theory, Elsevier, vol. 59(1), pages 145-168, February.
    22. Kalai, Ehud & Smorodinsky, Meir, 1975. "Other Solutions to Nash's Bargaining Problem," Econometrica, Econometric Society, vol. 43(3), pages 513-518, May.
    23. Foster, Dean P. & Young, H. Peyton, 2003. "Learning, hypothesis testing, and Nash equilibrium," Games and Economic Behavior, Elsevier, vol. 45(1), pages 73-96, October.
    24. Aumann, Robert J. & Sorin, Sylvain, 1989. "Cooperation and bounded recall," Games and Economic Behavior, Elsevier, vol. 1(1), pages 5-39, March.
    25. Nash, John, 1950. "The Bargaining Problem," Econometrica, Econometric Society, vol. 18(2), pages 155-162, April.
    26. Rubinstein, Ariel, 1979. "Equilibrium in supergames with the overtaking criterion," Journal of Economic Theory, Elsevier, vol. 21(1), pages 1-9, August.
    27. Yaw Nyarko, 1998. "Bayesian learning and convergence to Nash equilibria without common priors," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 11(3), pages 643-655.
    28. Drew Fudenberg & David K. Levine, 1998. "The Theory of Learning in Games," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262061945, December.
    29. Sergiu Hart & Andreu Mas-Colell, 2013. "Uncoupled Dynamics Do Not Lead To Nash Equilibrium," World Scientific Book Chapters, in: Simple Adaptive Strategies From Regret-Matching to Uncoupled Dynamics, chapter 7, pages 153-163, World Scientific Publishing Co. Pte. Ltd..
    30. Sandroni, Alvaro, 1998. "Necessary and Sufficient Conditions for Convergence to Nash Equilibrium: The Almost Absolute Continuity Hypothesis," Games and Economic Behavior, Elsevier, vol. 22(1), pages 121-147, January.
    31. Juang, W-T. & Sabourian, H., 2021. "Rules and Mutation - A Theory of How Efficiency and Rawlsian Egalitarianism/Symmetry May Emerge," Cambridge Working Papers in Economics 2101, Faculty of Economics, University of Cambridge.
    32. Dilip Abreu & David Pearce, 2007. "Bargaining, Reputation, and Equilibrium Selection in Repeated Games with Contracts," Econometrica, Econometric Society, vol. 75(3), pages 653-710, May.
    33. Lim, Wooyoung & Neary, Philip R., 2016. "An experimental investigation of stochastic adjustment dynamics," Games and Economic Behavior, Elsevier, vol. 100(C), pages 208-219.
    34. H. Peyton Young, 1998. "Conventional Contracts," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(4), pages 773-792.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yulhendri Yulhendri & Muhammad Rizki Prima Sakti & Rani Sofya & Mentari Ritonga & Wyanet Putri Alisha & Agung Sudjatmoko & Nora Susanti, 2023. "Strategies for Project Based Learning during the Pandemic: The Benefits of Reflective Learning Approach," SAGE Open, , vol. 13(4), pages 21582440231, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jonathan Newton, 2018. "Evolutionary Game Theory: A Renaissance," Games, MDPI, vol. 9(2), pages 1-67, May.
    2. Hwang, Sung-Ha & Lim, Wooyoung & Neary, Philip & Newton, Jonathan, 2018. "Conventional contracts, intentional behavior and logit choice: Equality without symmetry," Games and Economic Behavior, Elsevier, vol. 110(C), pages 273-294.
    3. Burkhard C. Schipper, 2022. "Strategic Teaching and Learning in Games," American Economic Journal: Microeconomics, American Economic Association, vol. 14(3), pages 321-352, August.
    4. Burkhard Schipper, 2015. "Strategic teaching and learning in games," Working Papers 151, University of California, Davis, Department of Economics.
    5. Hwang, Sung-Ha & Rey-Bellet, Luc, 2021. "Positive feedback in coordination games: Stochastic evolutionary dynamics and the logit choice rule," Games and Economic Behavior, Elsevier, vol. 126(C), pages 355-373.
    6. Binmore, Ken & Samuelson, Larry & Young, Peyton, 2003. "Equilibrium selection in bargaining models," Games and Economic Behavior, Elsevier, vol. 45(2), pages 296-328, November.
    7. Lim, Wooyoung & Neary, Philip R., 2016. "An experimental investigation of stochastic adjustment dynamics," Games and Economic Behavior, Elsevier, vol. 100(C), pages 208-219.
    8. Carlos Alós-Ferrer & Fei Shi, 2012. "Imitation with asymmetric memory," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 49(1), pages 193-215, January.
    9. Germano, Fabrizio & Lugosi, Gabor, 2007. "Global Nash convergence of Foster and Young's regret testing," Games and Economic Behavior, Elsevier, vol. 60(1), pages 135-154, July.
    10. Bilancini, Ennio & Boncinelli, Leonardo & Newton, Jonathan, 2020. "Evolution and Rawlsian social choice in matching," Games and Economic Behavior, Elsevier, vol. 123(C), pages 68-80.
    11. Demichelis, Stefano & Ritzberger, Klaus, 2003. "From evolutionary to strategic stability," Journal of Economic Theory, Elsevier, vol. 113(1), pages 51-75, November.
    12. Khan, Abhimanyu, 2022. "Expected utility versus cumulative prospect theory in an evolutionary model of bargaining," Journal of Economic Dynamics and Control, Elsevier, vol. 137(C).
    13. Ge Jiang & Simon Weidenholzer, 2017. "Local interactions under switching costs," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 64(3), pages 571-588, October.
    14. Marden, Jason R. & Shamma, Jeff S., 2015. "Game Theory and Distributed Control****Supported AFOSR/MURI projects #FA9550-09-1-0538 and #FA9530-12-1-0359 and ONR projects #N00014-09-1-0751 and #N0014-12-1-0643," Handbook of Game Theory with Economic Applications,, Elsevier.
    15. Wallace, Chris & Young, H. Peyton, 2015. "Stochastic Evolutionary Game Dynamics," Handbook of Game Theory with Economic Applications,, Elsevier.
    16. Carlos Alós-Ferrer & Nick Netzer, 2015. "Robust stochastic stability," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 58(1), pages 31-57, January.
    17. Norman, Thomas W.L., 2022. "The possibility of Bayesian learning in repeated games," Games and Economic Behavior, Elsevier, vol. 136(C), pages 142-152.
    18. Simon Weidenholzer, 2010. "Coordination Games and Local Interactions: A Survey of the Game Theoretic Literature," Games, MDPI, vol. 1(4), pages 1-35, November.
    19. Sawa, Ryoji, 2021. "A prospect theory Nash bargaining solution and its stochastic stability," Journal of Economic Behavior & Organization, Elsevier, vol. 184(C), pages 692-711.
    20. Neary, Philip R., 2012. "Competing conventions," Games and Economic Behavior, Elsevier, vol. 76(1), pages 301-328.

    More about this item

    Keywords

    Repeated games; Learning; Equilibrium selection; Pareto efficiency;
    All these keywords.

    JEL classification:

    • C70 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - General
    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jetheo:v:205:y:2022:i:c:s0022053122001417. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622869 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.