IDEAS home Printed from https://ideas.repec.org/a/eee/jeborg/v157y2019icp171-190.html
   My bibliography  Save this article

Learning correlated equilibria: An evolutionary approach

Author

Listed:
  • Arifovic, Jasmina
  • Boitnott, Joshua F.
  • Duffy, John

Abstract

Correlated equilibrium (Aumann, 1974, 1987) is an important generalization of the Nash equilibrium concept for multiplayer non-cooperative games. In a correlated equilibrium, players rationally condition their strategies on realizations of a common external randomization device and, as a consequence, can achieve payoffs that Pareto dominate any of the game's Nash equilibria. In this paper we explore whether such correlated equilibria can be learned over time using an evolutionary learning model where agents do not start with any knowledge of the distribution of random draws made by the external randomization device. Furthermore, we validate our learning algorithm findings by comparing the end behavior of simulations of our algorithm with both the correlated equilibrium of the game and the behavior of human subjects that play that same game. Our results suggest that the evolutionary learning model is capable of learning the correlated equilibria of these games in a manner that approximates well the learning behavior of human subjects and that our findings are robust to changes in the specification and parameterization of the model.

Suggested Citation

  • Arifovic, Jasmina & Boitnott, Joshua F. & Duffy, John, 2019. "Learning correlated equilibria: An evolutionary approach," Journal of Economic Behavior & Organization, Elsevier, vol. 157(C), pages 171-190.
  • Handle: RePEc:eee:jeborg:v:157:y:2019:i:c:p:171-190
    DOI: 10.1016/j.jebo.2016.09.011
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167268116302025
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jebo.2016.09.011?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johne Bone & Michalis Drouvelis & Indrajit Ray, 2013. "Coordination in 2 x 2 Games by Following Recommendations from Correlated Equilibria," Discussion Papers 12-04, Department of Economics, University of Birmingham.
    2. Kuzmics, Christoph & Palfrey, Thomas & Rogers, Brian W., 2014. "Symmetric play in repeated allocation games," Journal of Economic Theory, Elsevier, vol. 154(C), pages 25-67.
    3. Timothy Cason & Tridib Sharma, 2007. "Recommended play and correlated equilibria: an experimental study," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 33(1), pages 11-27, October.
    4. Fudenberg, Drew & Levine, David K., 1999. "Conditional Universal Consistency," Games and Economic Behavior, Elsevier, vol. 29(1-2), pages 104-130, October.
    5. Aumann, Robert J, 1987. "Correlated Equilibrium as an Expression of Bayesian Rationality," Econometrica, Econometric Society, vol. 55(1), pages 1-18, January.
    6. Aumann, Robert J., 1974. "Subjectivity and correlation in randomized strategies," Journal of Mathematical Economics, Elsevier, vol. 1(1), pages 67-96, March.
    7. Lehrer, Ehud, 2003. "A wide range no-regret theorem," Games and Economic Behavior, Elsevier, vol. 42(1), pages 101-115, January.
    8. Moreno, Diego & Wooders, John, 1998. "An Experimental Study of Communication and Coordination in Noncooperative Games," Games and Economic Behavior, Elsevier, vol. 24(1-2), pages 47-76, July.
    9. Sergiu Hart & Andreu Mas-Colell, 2013. "A Simple Adaptive Procedure Leading To Correlated Equilibrium," World Scientific Book Chapters, in: Simple Adaptive Strategies From Regret-Matching to Uncoupled Dynamics, chapter 2, pages 17-46, World Scientific Publishing Co. Pte. Ltd..
    10. Arifovic, Jasmina & Ledyard, John, 2007. "Call market book information and efficiency," Journal of Economic Dynamics and Control, Elsevier, vol. 31(6), pages 1971-2000, June.
    11. Johne Bone & Michalis Drouvelis & Indrajit Ray, 2013. "Coordination in 2 x 2 Games by Following Recommendations from Correlated Equilibria," Discussion Papers 12-04r, Department of Economics, University of Birmingham.
    12. Jasmina Arifovic & John Ledyard, 2012. "Individual Evolutionary Learning, Other-regarding Preferences, and the Voluntary Contributions Mechanism," Discussion Papers wp12-01, Department of Economics, Simon Fraser University.
    13. Françoise Forges, 1990. "Equilibria with Communication in a Job Market Example," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 105(2), pages 375-398.
    14. Ben-Porath, Elchanan, 1998. "Correlation without Mediation: Expanding the Set of Equilibrium Outcomes by "Cheap" Pre-play Procedures," Journal of Economic Theory, Elsevier, vol. 80(1), pages 108-122, May.
    15. Foster, Dean P. & Vohra, Rakesh V., 1997. "Calibrated Learning and Correlated Equilibrium," Games and Economic Behavior, Elsevier, vol. 21(1-2), pages 40-55, October.
    16. John Duffy & Nick Feltovich, 2010. "Correlated Equilibria, Good And Bad: An Experimental Study," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 51(3), pages 701-721, August.
    17. Jasmina Arifovic & John Ledyard, 2004. "Scaling Up Learning Models in Public Good Games," Journal of Public Economic Theory, Association for Public Economic Theory, vol. 6(2), pages 203-238, May.
    18. Arifovic, Jasmina & Ledyard, John, 2012. "Individual evolutionary learning, other-regarding preferences, and the voluntary contributions mechanism," Journal of Public Economics, Elsevier, vol. 96(9-10), pages 808-823.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Siebert, Jan & Yang, Guanzhong, 2021. "Coordination problems triggered by sunspots in the laboratory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    2. Friedman, Daniel & Rabanal, Jean Paul & Rud, Olga A. & Zhao, Shuchen, 2022. "On the empirical relevance of correlated equilibrium," Journal of Economic Theory, Elsevier, vol. 205(C).
    3. Chiara Scarampi & Richard Fairchild & Luca Fumarco & Alberto Palermo & Neal Hinvest, 2021. "Social Metacognition: A Correlational Device for Strategic Interactions," Working Papers 2111, Tulane University, Department of Economics.
    4. Trivikram Dokka & Jorge Bruno & Sonali SenGupta & Chowdhury Mohammad Sakib Anwar, 2022. "Pricing and Electric Vehicle Charging Equilibria," Papers 2210.15035, arXiv.org, revised Dec 2022.
    5. Chernomaz, K. & Goertz, J.M.M., 2023. "(A)symmetric equilibria and adaptive learning dynamics in small-committee voting," Journal of Economic Dynamics and Control, Elsevier, vol. 147(C).
    6. Arifovic, Jasmina & Duffy, John & Jiang, Janet Hua, 2023. "Adoption of a new payment method: Experimental evidence," European Economic Review, Elsevier, vol. 154(C).
    7. Siebert, Jan & Yang, Guanzhong, 2017. "Discoordination and miscoordination caused by sunspots in the laboratory," Working Papers on East Asian Studies 114/2017, University of Duisburg-Essen, Institute of East Asian Studies IN-EAST.
    8. Dokka, Trivikram & Bruno, Jorge & SenGupta, Sonali & Anwar, Sakib, 2022. "Pricing and Electric Vehicle Charging Equilibria," QBS Working Paper Series 2022/10, Queen's University Belfast, Queen's Business School.
    9. Jasmina Arifovic & John Duffy & Janet Jiang, 2017. "Adoption of a New Payment System: Theory and Experimental Evidence," Working Papers 171801, University of California-Irvine, Department of Economics.
    10. Alejandro Lee-Penagos, 2016. "Learning to Coordinate: Co-Evolution and Correlated Equilibrium," Discussion Papers 2016-11, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    11. Marcelle Caroline Thimotheo de Brito & Amaro O. Pereira Junior & Mario Veiga Ferraz Pereira & Julio César Cahuano Simba & Sergio Granville, 2022. "Competitive Behavior of Hydroelectric Power Plants under Uncertainty in Spot Market," Energies, MDPI, vol. 15(19), pages 1-22, October.
    12. Anufriev, Mikhail & Arifovic, Jasmina & Ledyard, John & Panchenko, Valentyn, 2022. "The role of information in a continuous double auction: An experiment and learning model," Journal of Economic Dynamics and Control, Elsevier, vol. 141(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Friedman, Daniel & Rabanal, Jean Paul & Rud, Olga A. & Zhao, Shuchen, 2022. "On the empirical relevance of correlated equilibrium," Journal of Economic Theory, Elsevier, vol. 205(C).
    2. Konstantinos Georgalos & Indrajit Ray & Sonali SenGupta, 2020. "Nash versus coarse correlation," Experimental Economics, Springer;Economic Science Association, vol. 23(4), pages 1178-1204, December.
    3. Antonio Cabrales & Michalis Drouvelis & Zeynep Gurguy & Indrajit Ray, 2017. "Transparency is Overrated: Communicating in a Coordination Game with Private Information," CESifo Working Paper Series 6781, CESifo.
    4. Ozdogan, Ayca & Saglam, Ismail, 2021. "Correlated equilibrium under costly disobedience," Mathematical Social Sciences, Elsevier, vol. 114(C), pages 98-104.
    5. Georgalos, Konstantinos & Ray, Indrajit & Gupta, Sonali Sen, 2019. "Nash vs. Coarse Correlation," Cardiff Economics Working Papers E2019/3, Cardiff University, Cardiff Business School, Economics Section.
    6. Cabrales, Antonio & Drouvelis, Michalis & Gurguc, Zeynep & Ray, Indrajit, 2018. "Do we need to listen to all stakeholders?: communicating in a coordination game with private information," Cardiff Economics Working Papers E2018/23, Cardiff University, Cardiff Business School, Economics Section.
    7. John Duffy & Ernest K. Lai & Wooyoung Lim, 2017. "Coordination via correlation: an experimental study," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 64(2), pages 265-304, August.
    8. Alejandro Lee-Penagos, 2016. "Learning to Coordinate: Co-Evolution and Correlated Equilibrium," Discussion Papers 2016-11, The Centre for Decision Research and Experimental Economics, School of Economics, University of Nottingham.
    9. Marcelle Caroline Thimotheo de Brito & Amaro O. Pereira Junior & Mario Veiga Ferraz Pereira & Julio César Cahuano Simba & Sergio Granville, 2022. "Competitive Behavior of Hydroelectric Power Plants under Uncertainty in Spot Market," Energies, MDPI, vol. 15(19), pages 1-22, October.
    10. Timothy N. Cason & Tridib Sharma & Radovan Vadovic, 2019. "Corelated beliefs: Predicting outcomes in 2X2 games," Purdue University Economics Working Papers 1321, Purdue University, Department of Economics.
    11. Giovanni Di Bartolomeo & Debora Di Gioacchino, 2005. "Fiscal-Monetary Policy Coordination And Debt Management: A Two Stage Dynamic Analysis," Macroeconomics 0504024, University Library of Munich, Germany.
    12. Konstantinos Georgalos & Indrajit Ray & Sonali Sen Gupta, 2017. "Coarse correlation and coordination in a game," Working Papers 151235570, Lancaster University Management School, Economics Department.
    13. Stoltz, Gilles & Lugosi, Gabor, 2007. "Learning correlated equilibria in games with compact sets of strategies," Games and Economic Behavior, Elsevier, vol. 59(1), pages 187-208, April.
    14. Arifovic, Jasmina & Jiang, Janet Hua, 2019. "Strategic uncertainty and the power of extrinsic signals– evidence from an experimental study of bank runs," Journal of Economic Behavior & Organization, Elsevier, vol. 167(C), pages 1-17.
    15. Cason, Timothy N. & Sharma, Tridib & Vadovič, Radovan, 2020. "Correlated beliefs: Predicting outcomes in 2 × 2 games," Games and Economic Behavior, Elsevier, vol. 122(C), pages 256-276.
    16. Chiara Scarampi & Richard Fairchild & Luca Fumarco & Alberto Palermo & Neal Hinvest, 2021. "Social Metacognition: A Correlational Device for Strategic Interactions," Working Papers 2111, Tulane University, Department of Economics.
    17. Ehud Lehrer & Eilon Solan, 2007. "Learning to play partially-specified equilibrium," Levine's Working Paper Archive 122247000000001436, David K. Levine.
    18. Siebert, Jan & Yang, Guanzhong, 2017. "Discoordination and miscoordination caused by sunspots in the laboratory," Working Papers on East Asian Studies 114/2017, University of Duisburg-Essen, Institute of East Asian Studies IN-EAST.
    19. Siebert, Jan & Yang, Guanzhong, 2021. "Coordination problems triggered by sunspots in the laboratory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 94(C).
    20. Giovanni Di Bartolomeo & Debora Di Gioacchino, 2008. "Fiscal-monetary policy coordination and debt management: a two-stage analysis," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 35(4), pages 433-448, September.

    More about this item

    Keywords

    Correlated equilibrium; Learning; Evolutionary algorithms; Adaptation; Game theory; Experimental economics;
    All these keywords.

    JEL classification:

    • C63 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling - - - Computational Techniques
    • C72 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Noncooperative Games
    • C73 - Mathematical and Quantitative Methods - - Game Theory and Bargaining Theory - - - Stochastic and Dynamic Games; Evolutionary Games
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jeborg:v:157:y:2019:i:c:p:171-190. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jebo .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.