IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2106.15844.html
   My bibliography  Save this paper

Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-making

Author

Listed:
  • Benjamin Patrick Evans
  • Mikhail Prokopenko

Abstract

While game theory has been transformative for decision-making, the assumptions made can be overly restrictive in certain instances. In this work, we investigate some of the underlying assumptions of rationality, such as mutual consistency and best response, and consider ways to relax these assumptions using concepts from level-$k$ reasoning and quantal response equilibrium (QRE) respectively. Specifically, we propose an information-theoretic two-parameter model called the Quantal Hierarchy model, which can relax both mutual consistency and best response while still approximating level-$k$, QRE, or typical Nash equilibrium behaviour in the limiting cases. The model is based on a recursive form of the variational free energy principle, representing higher-order reasoning as (pseudo) sequential decision-making in extensive-form game tree. This representation enables us to treat simultaneous games in a similar manner to sequential games, where reasoning resources deplete throughout the game-tree. Bounds in player processing abilities are captured as information costs, where future branches of reasoning are discounted, implying a hierarchy of players where lower-level players have fewer processing resources. We demonstrate the effectiveness of the Quantal Hierarchy model in several canonical economic games, {both simultaneous and sequential}, using out-of-sample modelling.

Suggested Citation

  • Benjamin Patrick Evans & Mikhail Prokopenko, 2021. "Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-making," Papers 2106.15844, arXiv.org, revised Mar 2023.
  • Handle: RePEc:arx:papers:2106.15844
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2106.15844
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yukio Koriyama & Ali Ihsan Ozkes, 2017. "Condorcet Jury Theorem and Cognitive Hierarchies: Theory and Experiments," Working Papers halshs-01485748, HAL.
    2. McKelvey, Richard D & Palfrey, Thomas R, 1992. "An Experimental Study of the Centipede Game," Econometrica, Econometric Society, vol. 60(4), pages 803-836, July.
    3. Ke, Shaowei, 2019. "Boundedly rational backward induction," Theoretical Economics, Econometric Society, vol. 14(1), January.
    4. Breitmoser, Yves & Tan, Jonathan H.W. & Zizzo, Daniel John, 2014. "On the beliefs off the path: Equilibrium refinement due to quantal response and level-k," Games and Economic Behavior, Elsevier, vol. 86(C), pages 102-125.
    5. Stahl Dale O. & Wilson Paul W., 1995. "On Players' Models of Other Players: Theory and Experimental Evidence," Games and Economic Behavior, Elsevier, vol. 10(1), pages 218-254, July.
    6. Binmore, Ken & McCarthy, John & Ponti, Giovanni & Samuelson, Larry & Shaked, Avner, 2002. "A Backward Induction Experiment," Journal of Economic Theory, Elsevier, vol. 104(1), pages 48-88, May.
    7. Amnon Rapoport & Darryl A. Seale & Ido Erev & James A. Sundali, 1998. "Equilibrium Play in Large Group Market Entry Games," Management Science, INFORMS, vol. 44(1), pages 119-141, January.
    8. Philip A. Haile & Ali Hortaçsu & Grigory Kosenok, 2008. "On the Empirical Content of Quantal Response Equilibrium," American Economic Review, American Economic Association, vol. 98(1), pages 180-200, March.
    9. McKelvey, Richard D. & Palfrey, Thomas R. & Weber, Roberto A., 2000. "The effects of payoff magnitude and heterogeneity on behavior in 2 x 2 games with unique mixed strategy equilibria," Journal of Economic Behavior & Organization, Elsevier, vol. 42(4), pages 523-548, August.
    10. Lipman, Barton L, 1991. "How to Decide How to Decide How to. . . : Modeling Limited Rationality," Econometrica, Econometric Society, vol. 59(4), pages 1105-1125, July.
    11. Hoppe, Hans-Hermann, 1997. "On Certainty and Uncertainty, or: How Rational Can Our Expectations Be?," The Review of Austrian Economics, Springer;Society for the Development of Austrian Economics, vol. 10(1), pages 49-78.
    12. J. M. Keynes, 1937. "The General Theory of Employment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 51(2), pages 209-223.
    13. Konstantinos Georgalos, 2020. "Comparing Behavioral Models Using Data From Experimental Centipede Games," Economic Inquiry, Western Economic Association International, vol. 58(1), pages 34-48, January.
    14. Chong, Juin-Kuan & Ho, Teck-Hua & Camerer, Colin, 2016. "A generalized cognitive hierarchy model of games," Games and Economic Behavior, Elsevier, vol. 99(C), pages 257-274.
    15. Sundali, James A. & Rapoport, Amnon & Seale, Darryl A., 1995. "Coordination in Market Entry Games with Symmetric Players," Organizational Behavior and Human Decision Processes, Elsevier, vol. 64(2), pages 203-218, November.
    16. Xavier Gabaix & David Laibson & Guillermo Moloche & Stephen Weinberg, 2006. "Costly Information Acquisition: Experimental Analysis of a Boundedly Rational Model," American Economic Review, American Economic Association, vol. 96(4), pages 1043-1068, September.
    17. W. Brian Arthur, 1994. "Inductive Reasoning, Bounded Rationality and the Bar Problem," Working Papers 94-03-014, Santa Fe Institute.
    18. Richard Mckelvey & Thomas Palfrey, 1998. "Quantal Response Equilibria for Extensive Form Games," Experimental Economics, Springer;Economic Science Association, vol. 1(1), pages 9-41, June.
    19. John C. Harsanyi, 1968. "Games with Incomplete Information Played by "Bayesian" Players Part II. Bayesian Equilibrium Points," Management Science, INFORMS, vol. 14(5), pages 320-334, January.
    20. John C. Harsanyi, 1967. "Games with Incomplete Information Played by "Bayesian" Players, I-III Part I. The Basic Model," Management Science, INFORMS, vol. 14(3), pages 159-182, November.
    21. Koriyama, Yukio & Ozkes, Ali I., 2021. "Inclusive cognitive hierarchy," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 458-480.
    22. Stahl Dale O., 1993. "Evolution of Smartn Players," Games and Economic Behavior, Elsevier, vol. 5(4), pages 604-617, October.
    23. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    24. Johnson, Joseph, 2006. "Paradoxes of Perfect Foresight in General Equilibrium Theory," MPRA Paper 85, University Library of Munich, Germany.
    25. Binmore, Ken, 1987. "Modeling Rational Players: Part I," Economics and Philosophy, Cambridge University Press, vol. 3(2), pages 179-214, October.
    26. MERTENS, Jean-François & ZAMIR, Shmuel, 1985. "Formulation of Bayesian analysis for games with incomplete information," LIDAM Reprints CORE 608, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    27. Friedman, Evan, 2020. "Endogenous quantal response equilibrium," Games and Economic Behavior, Elsevier, vol. 124(C), pages 620-643.
    28. Duffy, John & Hopkins, Ed, 2005. "Learning, information, and sorting in market entry games: theory and evidence," Games and Economic Behavior, Elsevier, vol. 51(1), pages 31-62, April.
    29. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    30. Krockow, Eva M. & Pulford, Briony D. & Colman, Andrew M., 2018. "Far but finite horizons promote cooperation in the Centipede game," Journal of Economic Psychology, Elsevier, vol. 67(C), pages 191-199.
    31. Jacob Goeree & Charles Holt & Thomas Palfrey, 2005. "Regular Quantal Response Equilibrium," Experimental Economics, Springer;Economic Science Association, vol. 8(4), pages 347-367, December.
    32. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    33. Thomas Webster, 2013. "A Note on the Ultimatum Paradox, Bounded Rationality, and Uncertainty," International Advances in Economic Research, Springer;International Atlantic Economic Society, vol. 19(1), pages 1-10, February.
    34. Avi Goldfarb & Mo Xiao, 2011. "Who Thinks about the Competition? Managerial Ability and Strategic Entry in US Local Telephone Markets," American Economic Review, American Economic Association, vol. 101(7), pages 3130-3161, December.
    35. Challet, Damien & Marsili, Matteo & Zhang, Yi-Cheng, 2013. "Minority Games: Interacting agents in financial markets," OUP Catalogue, Oxford University Press, number 9780199686698.
    36. Goeree, Jacob K. & Holt, Charles A., 2004. "A model of noisy introspection," Games and Economic Behavior, Elsevier, vol. 46(2), pages 365-382, February.
    37. Binmore, Ken, 1988. "Modeling Rational Players: Part II," Economics and Philosophy, Cambridge University Press, vol. 4(1), pages 9-55, April.
    38. Arthur, W Brian, 1994. "Inductive Reasoning and Bounded Rationality," American Economic Review, American Economic Association, vol. 84(2), pages 406-411, May.
    39. Johnson, Eric J. & Camerer, Colin & Sen, Sankar & Rymon, Talia, 2002. "Detecting Failures of Backward Induction: Monitoring Information Search in Sequential Bargaining," Journal of Economic Theory, Elsevier, vol. 104(1), pages 16-47, May.
    40. Benjamin Patrick Evans & Mikhail Prokopenko, 2021. "A maximum entropy model of bounded rational decision-making with prior beliefs and market feedback," Papers 2102.09180, arXiv.org, revised May 2021.
    41. Teck-Hua Ho & Xuanming Su, 2013. "A Dynamic Level-k Model in Sequential Games," Management Science, INFORMS, vol. 59(2), pages 452-469, March.
    42. Roger Koppl & J. Barkley Rosser Jr, 2002. "All That I Have to Say Has Already Crossed Your Mind," Metroeconomica, Wiley Blackwell, vol. 53(4), pages 339-360, November.
    43. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    44. Kawagoe, Toshiji & Takizawa, Hirokazu, 2012. "Level-k analysis of experimental centipede games," Journal of Economic Behavior & Organization, Elsevier, vol. 82(2), pages 548-566.
    45. Benjamin Patrick Evans & Kirill Glavatskiy & Michael S. Harr'e & Mikhail Prokopenko, 2020. "The impact of social influence in Australian real-estate: market forecasting with a spatial agent-based model," Papers 2009.06914, arXiv.org, revised Feb 2021.
    46. Juin-Kuan Chong & Colin F. Camerer & Teck-Hua Ho, 2005. "Cognitive Hierarchy: A Limited Thinking Theory in Games," Springer Books, in: Rami Zwick & Amnon Rapoport (ed.), Experimental Business Research, chapter 0, pages 203-228, Springer.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Benjamin Patrick Evans & Sumitra Ganesh, 2024. "Learning and Calibrating Heterogeneous Bounded Rational Market Behaviour with Multi-Agent Reinforcement Learning," Papers 2402.00787, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Patrick Evans & Mikhail Prokopenko, 2024. "Bounded rationality for relaxing best response and mutual consistency: the quantal hierarchy model of decision making," Theory and Decision, Springer, vol. 96(1), pages 71-111, February.
    2. García-Pola, Bernardo & Iriberri, Nagore & Kovářík, Jaromír, 2020. "Non-equilibrium play in centipede games," Games and Economic Behavior, Elsevier, vol. 120(C), pages 391-433.
    3. Rogers, Brian W. & Palfrey, Thomas R. & Camerer, Colin F., 2009. "Heterogeneous quantal response equilibrium and cognitive hierarchies," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1440-1467, July.
    4. Vincent P. Crawford & Miguel A. Costa-Gomes & Nagore Iriberri, 2010. "Strategic Thinking," Levine's Working Paper Archive 661465000000001148, David K. Levine.
    5. Philippe Jehiel, 2022. "Analogy-Based Expectation Equilibrium and Related Concepts:Theory, Applications, and Beyond," Working Papers halshs-03735680, HAL.
    6. Alan Kirman & François Laisney & Paul Pezanis-Christou, 2023. "Relaxing the symmetry assumption in participation games: a specification test for cluster-heterogeneity," Experimental Economics, Springer;Economic Science Association, vol. 26(4), pages 850-878, September.
    7. Willemien Kets, 2007. "The minority game: An economics perspective," Papers 0706.4432, arXiv.org.
    8. Kirman, Alan P. & Laisney, François & Pezanis-Christou, Paul, 2018. "Exploration vs exploitation, impulse balance equilibrium, and a specification test for the El Farol bar problem," ZEW Discussion Papers 18-038, ZEW - Leibniz Centre for European Economic Research.
    9. Georganas, Sotiris & Healy, Paul J. & Weber, Roberto A., 2015. "On the persistence of strategic sophistication," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 369-400.
    10. Colin F. Camerer & Thomas R. Palfrey & Brian W. Rogers, 2006. "Heterogeneous Quantal Response Equilibrium," Levine's Bibliography 321307000000000193, UCLA Department of Economics.
    11. Dan Levin & Luyao Zhang, 2022. "Bridging Level-K to Nash Equilibrium," Papers 2202.12292, arXiv.org, revised Feb 2022.
    12. Choo, Lawrence C.Y & Kaplan, Todd R., 2014. "Explaining Behavior in the "11-20" Game," MPRA Paper 52808, University Library of Munich, Germany.
    13. Miguel A Costa-Gomes & Vincent P Crawford & Nagore Iriberri, 2008. "Comparing Models of Strategic Thinking in Van Huyck, Battalio, and Beil’s Coordination Games," Levine's Working Paper Archive 122247000000002346, David K. Levine.
    14. Benndorf, Volker & Kübler, Dorothea & Normann, Hans-Theo, 2015. "Privacy concerns, voluntary disclosure of information, and unraveling: An experiment," European Economic Review, Elsevier, vol. 75(C), pages 43-59.
    15. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    16. Le Coq, Chloé & Tremewan, James & Wagner, Alexander K., 2015. "On the effects of group identity in strategic environments," European Economic Review, Elsevier, vol. 76(C), pages 239-252.
    17. Feng, Jun & Qin, Xiangdong & Wang, Xiaoyuan, 2021. "A Bayesian cognitive hierarchy model with fixed reasoning levels," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 704-723.
    18. Dieter Balkenborg & Rosemarie Nagel, 2016. "An Experiment on Forward vs. Backward Induction: How Fairness and Level k Reasoning Matter," German Economic Review, Verein für Socialpolitik, vol. 17(3), pages 378-408, August.
    19. Haruvy, Ernan & Stahl, Dale O., 2007. "Equilibrium selection and bounded rationality in symmetric normal-form games," Journal of Economic Behavior & Organization, Elsevier, vol. 62(1), pages 98-119, January.
    20. Jacob K. Goeree & Charles A. Holt, 2001. "Ten Little Treasures of Game Theory and Ten Intuitive Contradictions," American Economic Review, American Economic Association, vol. 91(5), pages 1402-1422, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2106.15844. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.