IDEAS home Printed from https://ideas.repec.org/a/kap/theord/v96y2024i1d10.1007_s11238-023-09941-z.html
   My bibliography  Save this article

Bounded rationality for relaxing best response and mutual consistency: the quantal hierarchy model of decision making

Author

Listed:
  • Benjamin Patrick Evans

    (University of Sydney)

  • Mikhail Prokopenko

    (University of Sydney)

Abstract

While game theory has been transformative for decision making, the assumptions made can be overly restrictive in certain instances. In this work, we investigate some of the underlying assumptions of rationality, such as mutual consistency and best response, and consider ways to relax these assumptions using concepts from level-k reasoning and quantal response equilibrium (QRE) respectively. Specifically, we propose an information-theoretic two-parameter model called the quantal hierarchy model, which can relax both mutual consistency and best response while still approximating level-k, QRE, or typical Nash equilibrium behavior in the limiting cases. The model is based on a recursive form of the variational free energy principle, representing higher-order reasoning as (pseudo) sequential decision-making in extensive-form game tree. This representation enables us to treat simultaneous games in a similar manner to sequential games, where reasoning resources deplete throughout the game-tree. Bounds in player processing abilities are captured as information costs, where future branches of reasoning are discounted, implying a hierarchy of players where lower-level players have fewer processing resources. We demonstrate the effectiveness of the quantal hierarchy model in several canonical economic games, both simultaneous and sequential, using out-of-sample modelling.

Suggested Citation

  • Benjamin Patrick Evans & Mikhail Prokopenko, 2024. "Bounded rationality for relaxing best response and mutual consistency: the quantal hierarchy model of decision making," Theory and Decision, Springer, vol. 96(1), pages 71-111, February.
  • Handle: RePEc:kap:theord:v:96:y:2024:i:1:d:10.1007_s11238-023-09941-z
    DOI: 10.1007/s11238-023-09941-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11238-023-09941-z
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11238-023-09941-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ke, Shaowei, 2019. "Boundedly rational backward induction," Theoretical Economics, Econometric Society, vol. 14(1), January.
    2. Stahl Dale O. & Wilson Paul W., 1995. "On Players' Models of Other Players: Theory and Experimental Evidence," Games and Economic Behavior, Elsevier, vol. 10(1), pages 218-254, July.
    3. Binmore, Ken & McCarthy, John & Ponti, Giovanni & Samuelson, Larry & Shaked, Avner, 2002. "A Backward Induction Experiment," Journal of Economic Theory, Elsevier, vol. 104(1), pages 48-88, May.
    4. Antoni Bosch-Domènech & José G. Montalvo & Rosemarie Nagel & Albert Satorra, 2002. "One, Two, (Three), Infinity, ...: Newspaper and Lab Beauty-Contest Experiments," American Economic Review, American Economic Association, vol. 92(5), pages 1687-1701, December.
    5. Yukio Koriyama & Ali Ihsan Ozkes, 2017. "Condorcet Jury Theorem and Cognitive Hierarchies: Theory and Experiments," AMSE Working Papers 1708, Aix-Marseille School of Economics, France.
    6. Philip A. Haile & Ali Hortaçsu & Grigory Kosenok, 2008. "On the Empirical Content of Quantal Response Equilibrium," American Economic Review, American Economic Association, vol. 98(1), pages 180-200, March.
    7. Xavier Gabaix & David Laibson & Guillermo Moloche & Stephen Weinberg, 2006. "Costly Information Acquisition: Experimental Analysis of a Boundedly Rational Model," American Economic Review, American Economic Association, vol. 96(4), pages 1043-1068, September.
    8. McKelvey Richard D. & Palfrey Thomas R., 1995. "Quantal Response Equilibria for Normal Form Games," Games and Economic Behavior, Elsevier, vol. 10(1), pages 6-38, July.
    9. David Glasner, 2022. "Hayek, Hicks, Radner and four equilibrium concepts: Perfect foresight, sequential, temporary, and rational expectations," The Review of Austrian Economics, Springer;Society for the Development of Austrian Economics, vol. 35(1), pages 39-61, March.
    10. Christian Bach & Andrés Perea, 2014. "Utility proportional beliefs," International Journal of Game Theory, Springer;Game Theory Society, vol. 43(4), pages 881-902, November.
    11. McKelvey, Richard D & Palfrey, Thomas R, 1992. "An Experimental Study of the Centipede Game," Econometrica, Econometric Society, vol. 60(4), pages 803-836, July.
    12. Larbi Alaoui & Antonio Penta, 2016. "Endogenous Depth of Reasoning," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1297-1333.
    13. Goeree, Jacob K. & Holt, Charles A., 2004. "A model of noisy introspection," Games and Economic Behavior, Elsevier, vol. 46(2), pages 365-382, February.
    14. Binmore, Ken, 1988. "Modeling Rational Players: Part II," Economics and Philosophy, Cambridge University Press, vol. 4(1), pages 9-55, April.
    15. Mattsson, Lars-Goran & Weibull, Jorgen W., 2002. "Probabilistic choice and procedurally bounded rationality," Games and Economic Behavior, Elsevier, vol. 41(1), pages 61-78, October.
    16. Arthur, W Brian, 1994. "Inductive Reasoning and Bounded Rationality," American Economic Review, American Economic Association, vol. 84(2), pages 406-411, May.
    17. Roger Koppl & J. Barkley Rosser Jr, 2002. "All That I Have to Say Has Already Crossed Your Mind," Metroeconomica, Wiley Blackwell, vol. 53(4), pages 339-360, November.
    18. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    19. Dan Levin & Luyao Zhang, 2022. "Bridging Level-K to Nash Equilibrium," Papers 2202.12292, arXiv.org, revised Feb 2022.
    20. Jacob Goeree & Charles Holt & Thomas Palfrey, 2005. "Regular Quantal Response Equilibrium," Experimental Economics, Springer;Economic Science Association, vol. 8(4), pages 347-367, December.
    21. Polonio, Luca & Coricelli, Giorgio, 2019. "Testing the level of consistency between choices and beliefs in games using eye-tracking," Games and Economic Behavior, Elsevier, vol. 113(C), pages 566-586.
    22. Andrew Caplin & Mark Dean & John Leahy, 2019. "Rational Inattention, Optimal Consideration Sets, and Stochastic Choice," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(3), pages 1061-1094.
    23. John C. Harsanyi, 1967. "Games with Incomplete Information Played by "Bayesian" Players, I-III Part I. The Basic Model," Management Science, INFORMS, vol. 14(3), pages 159-182, November.
    24. Theodore Turocy, 2010. "Computing sequential equilibria using agent quantal response equilibria," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 42(1), pages 255-269, January.
    25. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    26. Duffy, John & Hopkins, Ed, 2005. "Learning, information, and sorting in market entry games: theory and evidence," Games and Economic Behavior, Elsevier, vol. 51(1), pages 31-62, April.
    27. Avi Goldfarb & Mo Xiao, 2011. "Who Thinks about the Competition? Managerial Ability and Strategic Entry in US Local Telephone Markets," American Economic Review, American Economic Association, vol. 101(7), pages 3130-3161, December.
    28. Challet, Damien & Marsili, Matteo & Zhang, Yi-Cheng, 2013. "Minority Games: Interacting agents in financial markets," OUP Catalogue, Oxford University Press, number 9780199686698, Decembrie.
    29. Benjamin Patrick Evans & Mikhail Prokopenko, 2021. "A maximum entropy model of bounded rational decision-making with prior beliefs and market feedback," Papers 2102.09180, arXiv.org, revised May 2021.
    30. Goeree, Jacob K. & Holt, Charles A., 2005. "An Explanation of Anomalous Behavior in Models of Political Participation," American Political Science Review, Cambridge University Press, vol. 99(2), pages 201-213, May.
    31. Teck-Hua Ho & Xuanming Su, 2013. "A Dynamic Level-k Model in Sequential Games," Management Science, INFORMS, vol. 59(2), pages 452-469, March.
    32. Colin Camerer & Teck Ho & Kuan Chong, 2003. "Models of Thinking, Learning, and Teaching in Games," American Economic Review, American Economic Association, vol. 93(2), pages 192-195, May.
    33. Hoppe, Hans-Hermann, 1997. "On Certainty and Uncertainty, or: How Rational Can Our Expectations Be?," The Review of Austrian Economics, Springer;Society for the Development of Austrian Economics, vol. 10(1), pages 49-78.
    34. J. M. Keynes, 1937. "The General Theory of Employment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 51(2), pages 209-223.
    35. Dan Levin & Luyao Zhang, 2022. "Bridging Level-K to Nash Equilibrium," The Review of Economics and Statistics, MIT Press, vol. 104(6), pages 1329-1340, November.
    36. Rogers, Brian W. & Palfrey, Thomas R. & Camerer, Colin F., 2009. "Heterogeneous quantal response equilibrium and cognitive hierarchies," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1440-1467, July.
    37. W. Brian Arthur, 1994. "Inductive Reasoning, Bounded Rationality and the Bar Problem," Working Papers 94-03-014, Santa Fe Institute.
    38. Richard Mckelvey & Thomas Palfrey, 1998. "Quantal Response Equilibria for Extensive Form Games," Experimental Economics, Springer;Economic Science Association, vol. 1(1), pages 9-41, June.
    39. Koriyama, Yukio & Ozkes, Ali I., 2021. "Inclusive cognitive hierarchy," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 458-480.
    40. Binmore, Ken, 1987. "Modeling Rational Players: Part I," Economics and Philosophy, Cambridge University Press, vol. 3(2), pages 179-214, October.
    41. MERTENS, Jean-François & ZAMIR, Shmuel, 1985. "Formulation of Bayesian analysis for games with incomplete information," LIDAM Reprints CORE 608, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    42. Stahl, D O, 1990. "Entropy Control Costs and Entropic Equilibria," International Journal of Game Theory, Springer;Game Theory Society, vol. 19(2), pages 129-138.
    43. Anufriev, Mikhail & Duffy, John & Panchenko, Valentyn, 2022. "Learning in two-dimensional beauty contest games: Theory and experimental evidence," Journal of Economic Theory, Elsevier, vol. 201(C).
    44. Jacob K. Goeree & Charles A. Holt & Thomas R. Palfrey, 2016. "Quantal Response Equilibrium:A Stochastic Theory of Games," Economics Books, Princeton University Press, edition 1, number 10743.
    45. Larbi Alaoui & Antonio Penta, 2022. "Cost-Benefit Analysis in Reasoning," Journal of Political Economy, University of Chicago Press, vol. 130(4), pages 881-925.
    46. Amnon Rapoport & Darryl A. Seale & Ido Erev & James A. Sundali, 1998. "Equilibrium Play in Large Group Market Entry Games," Management Science, INFORMS, vol. 44(1), pages 119-141, January.
    47. Breitmoser, Yves, 2012. "Strategic reasoning in p-beauty contests," Games and Economic Behavior, Elsevier, vol. 75(2), pages 555-569.
    48. Lipman, Barton L, 1991. "How to Decide How to Decide How to. . . : Modeling Limited Rationality," Econometrica, Econometric Society, vol. 59(4), pages 1105-1125, July.
    49. Konstantinos Georgalos, 2020. "Comparing Behavioral Models Using Data From Experimental Centipede Games," Economic Inquiry, Western Economic Association International, vol. 58(1), pages 34-48, January.
    50. Chong, Juin-Kuan & Ho, Teck-Hua & Camerer, Colin, 2016. "A generalized cognitive hierarchy model of games," Games and Economic Behavior, Elsevier, vol. 99(C), pages 257-274.
    51. Friedman, Evan, 2020. "Endogenous quantal response equilibrium," Games and Economic Behavior, Elsevier, vol. 124(C), pages 620-643.
    52. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    53. Krockow, Eva M. & Pulford, Briony D. & Colman, Andrew M., 2018. "Far but finite horizons promote cooperation in the Centipede game," Journal of Economic Psychology, Elsevier, vol. 67(C), pages 191-199.
    54. Johnson, Eric J. & Camerer, Colin & Sen, Sankar & Rymon, Talia, 2002. "Detecting Failures of Backward Induction: Monitoring Information Search in Sequential Bargaining," Journal of Economic Theory, Elsevier, vol. 104(1), pages 16-47, May.
    55. Kawagoe, Toshiji & Takizawa, Hirokazu, 2012. "Level-k analysis of experimental centipede games," Journal of Economic Behavior & Organization, Elsevier, vol. 82(2), pages 548-566.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benjamin Patrick Evans & Mikhail Prokopenko, 2021. "Bounded rationality for relaxing best response and mutual consistency: The Quantal Hierarchy model of decision-making," Papers 2106.15844, arXiv.org, revised Mar 2023.
    2. Alan Kirman & François Laisney & Paul Pezanis-Christou, 2023. "Relaxing the symmetry assumption in participation games: a specification test for cluster-heterogeneity," Experimental Economics, Springer;Economic Science Association, vol. 26(4), pages 850-878, September.
    3. Choo, Lawrence C.Y & Kaplan, Todd R., 2014. "Explaining Behavior in the "11-20" Game," MPRA Paper 52808, University Library of Munich, Germany.
    4. García-Pola, Bernardo & Iriberri, Nagore & Kovářík, Jaromír, 2020. "Non-equilibrium play in centipede games," Games and Economic Behavior, Elsevier, vol. 120(C), pages 391-433.
    5. Dan Levin & Luyao Zhang, 2022. "Bridging Level-K to Nash Equilibrium," Papers 2202.12292, arXiv.org, revised Feb 2022.
    6. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    7. Vincent P. Crawford & Miguel A. Costa-Gomes & Nagore Iriberri, 2010. "Strategic Thinking," Levine's Working Paper Archive 661465000000001148, David K. Levine.
    8. Georganas, Sotiris & Healy, Paul J. & Weber, Roberto A., 2015. "On the persistence of strategic sophistication," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 369-400.
    9. Alan Kirman & François Laisney & Paul Pezanis-Christou, 2018. "Exploration vs Exploitation, Impulse Balance Equilibrium and a specification test for the El Farol bar problem," School of Economics and Public Policy Working Papers 2018-11, University of Adelaide, School of Economics and Public Policy.
    10. Koriyama, Yukio & Ozkes, Ali I., 2021. "Inclusive cognitive hierarchy," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 458-480.
    11. Philippe Jehiel, 2022. "Analogy-Based Expectation Equilibrium and Related Concepts:Theory, Applications, and Beyond," PSE Working Papers halshs-03735680, HAL.
    12. Rogers, Brian W. & Palfrey, Thomas R. & Camerer, Colin F., 2009. "Heterogeneous quantal response equilibrium and cognitive hierarchies," Journal of Economic Theory, Elsevier, vol. 144(4), pages 1440-1467, July.
    13. Benndorf, Volker & Kübler, Dorothea & Normann, Hans-Theo, 2015. "Privacy concerns, voluntary disclosure of information, and unraveling: An experiment," European Economic Review, Elsevier, vol. 75(C), pages 43-59.
    14. Feng, Jun & Qin, Xiangdong & Wang, Xiaoyuan, 2021. "A Bayesian cognitive hierarchy model with fixed reasoning levels," Journal of Economic Behavior & Organization, Elsevier, vol. 192(C), pages 704-723.
    15. Breitmoser, Yves & Tan, Jonathan H.W. & Zizzo, Daniel John, 2014. "On the beliefs off the path: Equilibrium refinement due to quantal response and level-k," Games and Economic Behavior, Elsevier, vol. 86(C), pages 102-125.
    16. Le Coq, Chloé & Tremewan, James & Wagner, Alexander K., 2015. "On the effects of group identity in strategic environments," European Economic Review, Elsevier, vol. 76(C), pages 239-252.
    17. Friedman, Evan, 2020. "Endogenous quantal response equilibrium," Games and Economic Behavior, Elsevier, vol. 124(C), pages 620-643.
    18. Breitmoser, Yves, 2012. "Strategic reasoning in p-beauty contests," Games and Economic Behavior, Elsevier, vol. 75(2), pages 555-569.
    19. Kets, W., 2007. "The Minority Game : An Economics Perspective," Other publications TiSEM 65d52a6a-b27d-45a9-93a7-e, Tilburg University, School of Economics and Management.
    20. Oren Bar-Gill & Christoph Engel, 2020. "Property is Dummy Proof: An Experiment," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2020_02, Max Planck Institute for Research on Collective Goods.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:theord:v:96:y:2024:i:1:d:10.1007_s11238-023-09941-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.