IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2309.07427.html
   My bibliography  Save this paper

Measuring Higher-Order Rationality with Belief Control

Author

Listed:
  • Wei James Chen
  • Meng-Jhang Fong
  • Po-Hsuan Lin

Abstract

Determining an individual's strategic reasoning capability based solely on choice data is a complex task. This complexity arises because sophisticated players might have non-equilibrium beliefs about others, leading to non-equilibrium actions. In our study, we pair human participants with computer players known to be fully rational. This use of robot players allows us to disentangle limited reasoning capacity from belief formation and social biases. Our results show that, when paired with robots, subjects consistently demonstrate higher levels of rationality and maintain stable rationality levels across different games compared to when paired with humans. This suggests that strategic reasoning might indeed be a consistent trait in individuals. Furthermore, the identified rationality limits could serve as a measure for evaluating an individual's strategic capacity when their beliefs about others are adequately controlled.

Suggested Citation

  • Wei James Chen & Meng-Jhang Fong & Po-Hsuan Lin, 2023. "Measuring Higher-Order Rationality with Belief Control," Papers 2309.07427, arXiv.org.
    • Handle: RePEc:arx:papers:2309.07427
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2309.07427
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. John H. Kagel & Alvin E. Roth, 2016. "The Handbook of Experimental Economics, Volume 2," Economics Books, Princeton University Press, edition 1, volume 2, number 10874.
    2. Nobuyuki Hanaki & Nicolas Jacquemet & Stéphane Luchini & Adam Zylbersztejn, 2016. "Cognitive ability and the effect of strategic uncertainty," Theory and Decision, Springer, vol. 81(1), pages 101-121, June.
    3. Ohtsubo, Yohsuke & Rapoport, Amnon, 2006. "Depth of reasoning in strategic form games," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 35(1), pages 31-47, February.
    4. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    5. Vincent P. Crawford & Miguel A. Costa-Gomes, 2006. "Cognition and Behavior in Two-Person Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 96(5), pages 1737-1768, December.
    6. Alaoui, Larbi & Janezic, Katharina A. & Penta, Antonio, 2020. "Reasoning about others' reasoning," Journal of Economic Theory, Elsevier, vol. 189(C).
    7. Ciril Bosch-Rosa & Thomas Meissner, 2020. "The one player guessing game: a diagnosis on the relationship between equilibrium play, beliefs, and best responses," Experimental Economics, Springer;Economic Science Association, vol. 23(4), pages 1129-1147, December.
    8. Francesco Cerigioni & Fabrizio Germano & Pedro Rey-Biel & Peio Zuazo-Garin, 2019. "Higher orders of rationality and the structure of games," Economics Working Papers 1672, Department of Economics and Business, Universitat Pompeu Fabra.
    9. Georganas, Sotiris & Healy, Paul J. & Weber, Roberto A., 2015. "On the persistence of strategic sophistication," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 369-400.
    10. Terri Kneeland, 2015. "Identifying Higher‐Order Rationality," Econometrica, Econometric Society, vol. 83(5), pages 2065-2079, September.
    11. Burchardi, Konrad B. & Penczynski, Stefan P., 2014. "Out of your mind: Eliciting individual reasoning in one shot games," Games and Economic Behavior, Elsevier, vol. 84(C), pages 39-57.
    12. Bernheim, B Douglas, 1984. "Rationalizable Strategic Behavior," Econometrica, Econometric Society, vol. 52(4), pages 1007-1028, July.
    13. Larbi Alaoui & Antonio Penta, 2016. "Endogenous Depth of Reasoning," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(4), pages 1297-1333.
    14. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    15. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    16. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    17. Vincent P. Crawford & Nagore Iriberri, 2007. "Level-k Auctions: Can a Nonequilibrium Model of Strategic Thinking Explain the Winner's Curse and Overbidding in Private-Value Auctions?," Econometrica, Econometric Society, vol. 75(6), pages 1721-1770, November.
    18. Devetag, Giovanna & Warglien, Massimo, 2003. "Games and phone numbers: Do short-term memory bounds affect strategic behavior?," Journal of Economic Psychology, Elsevier, vol. 24(2), pages 189-202, April.
    19. Po-Hsuan Lin, 2022. "Cognitive Hierarchies in Multi-Stage Games of Incomplete Information: Theory and Experiment," Papers 2208.11190, arXiv.org, revised Nov 2023.
    20. Daniel Houser & Robert Kurzban, 2002. "Revisiting Kindness and Confusion in Public Goods Experiments," American Economic Review, American Economic Association, vol. 92(4), pages 1062-1069, September.
    21. Agranov, Marina & Potamites, Elizabeth & Schotter, Andrew & Tergiman, Chloe, 2012. "Beliefs and endogenous cognitive levels: An experimental study," Games and Economic Behavior, Elsevier, vol. 75(2), pages 449-463.
    22. Costa-Gomes, Miguel & Crawford, Vincent P & Broseta, Bruno, 2001. "Cognition and Behavior in Normal-Form Games: An Experimental Study," Econometrica, Econometric Society, vol. 69(5), pages 1193-1235, September.
    23. Rapoport, Amnon & Amaldoss, Wilfred, 2000. "Mixed strategies and iterative elimination of strongly dominated strategies: an experimental investigation of states of knowledge," Journal of Economic Behavior & Organization, Elsevier, vol. 42(4), pages 483-521, August.
    24. repec:cup:judgdm:v:3:y:2008:i:7:p:483-492 is not listed on IDEAS
    25. Joseph Tao-yi Wang & Michael Spezio & Colin F. Camerer, 2010. "Pinocchio's Pupil: Using Eyetracking and Pupil Dilation to Understand Truth Telling and Deception in Sender-Receiver Games," American Economic Review, American Economic Association, vol. 100(3), pages 984-1007, June.
    26. Cai, Hongbin & Wang, Joseph Tao-Yi, 2006. "Overcommunication in strategic information transmission games," Games and Economic Behavior, Elsevier, vol. 56(1), pages 7-36, July.
    27. March, Christoph, 2021. "Strategic interactions between humans and artificial intelligence: Lessons from experiments with computer players," Journal of Economic Psychology, Elsevier, vol. 87(C).
    28. Vincent P. Crawford & Nagore Iriberri, 2007. "Fatal Attraction: Salience, Naïveté, and Sophistication in Experimental "Hide-and-Seek" Games," American Economic Review, American Economic Association, vol. 97(5), pages 1731-1750, December.
    29. Vincent P. Crawford & Nagore Iriberri, 2007. "Fatal Attraction: Salience, Naivete, and Sophistication in Experimental Hide-and-Seek Games," Levine's Bibliography 321307000000000861, UCLA Department of Economics.
    30. Stahl Dale O., 1993. "Evolution of Smartn Players," Games and Economic Behavior, Elsevier, vol. 5(4), pages 604-617, October.
    31. Ye Jin, 2021. "Does level-k behavior imply level-k thinking?," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 330-353, March.
    32. Larbi Alaoui & Antonio Penta, 2022. "Cost-Benefit Analysis in Reasoning," Journal of Political Economy, University of Chicago Press, vol. 130(4), pages 881-925.
    33. Pearce, David G, 1984. "Rationalizable Strategic Behavior and the Problem of Perfection," Econometrica, Econometric Society, vol. 52(4), pages 1029-1050, July.
    34. repec:mpr:mprres:7497 is not listed on IDEAS
    35. Shane Frederick, 2005. "Cognitive Reflection and Decision Making," Journal of Economic Perspectives, American Economic Association, vol. 19(4), pages 25-42, Fall.
    36. Sascha Grehl & Andreas Tutić, 2015. "Experimental Evidence on Iterated Reasoning in Games," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-19, August.
    37. Grosskopf, Brit & Nagel, Rosemarie, 2008. "The two-person beauty contest," Games and Economic Behavior, Elsevier, vol. 62(1), pages 93-99, January.
    38. Bayer, Ralph C. & Renou, Ludovic, 2016. "Logical omniscience at the laboratory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 41-49.
    39. Ben Meijering & Hedderik van Rijn & Niels A Taatgen & Rineke Verbrugge, 2012. "What Eye Movements Can Tell about Theory of Mind in a Strategic Game," PLOS ONE, Public Library of Science, vol. 7(9), pages 1-8, September.
    40. Chen, Chun-Ting & Huang, Chen-Ying & Wang, Joseph Tao-yi, 2018. "A window of cognition: Eyetracking the reasoning process in spatial beauty contest games," Games and Economic Behavior, Elsevier, vol. 111(C), pages 143-158.
    41. Johnson, Eric J. & Camerer, Colin & Sen, Sankar & Rymon, Talia, 2002. "Detecting Failures of Backward Induction: Monitoring Information Search in Sequential Bargaining," Journal of Economic Theory, Elsevier, vol. 104(1), pages 16-47, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    2. Allred, Sarah & Duffy, Sean & Smith, John, 2016. "Cognitive load and strategic sophistication," Journal of Economic Behavior & Organization, Elsevier, vol. 125(C), pages 162-178.
    3. Nagel, Rosemarie & Bühren, Christoph & Frank, Björn, 2017. "Inspired and inspiring: Hervé Moulin and the discovery of the beauty contest game," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 191-207.
    4. Duffy, Sean & Smith, John, 2014. "Cognitive load in the multi-player prisoner's dilemma game: Are there brains in games?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 51(C), pages 47-56.
    5. Giovanna Devetag & Sibilla Guida & Luca Polonio, 2016. "An eye-tracking study of feature-based choice in one-shot games," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 177-201, March.
    6. Ye Jin, 2021. "Does level-k behavior imply level-k thinking?," Experimental Economics, Springer;Economic Science Association, vol. 24(1), pages 330-353, March.
    7. Georganas, Sotiris & Healy, Paul J. & Weber, Roberto A., 2015. "On the persistence of strategic sophistication," Journal of Economic Theory, Elsevier, vol. 159(PA), pages 369-400.
    8. Duffy, Sean & Smith, John, 2011. "Cognitive load in the multi-player prisoner's dilemma game," MPRA Paper 30856, University Library of Munich, Germany.
    9. Gill, David & Prowse, Victoria, 2012. "Cognitive ability and learning to play equilibrium: A level-k analysis," MPRA Paper 38317, University Library of Munich, Germany, revised 23 Apr 2012.
    10. Po-Hsuan Lin, 2022. "Cognitive Hierarchies in Multi-Stage Games of Incomplete Information: Theory and Experiment," Papers 2208.11190, arXiv.org, revised Nov 2023.
    11. Choo, Lawrence & Kaplan, Todd R. & Zhou, Xiaoyu, 2019. "Can auctions select people by their level-k types?," MPRA Paper 95987, University Library of Munich, Germany.
    12. Dietmar Fehr & Steffen Huck, 2016. "Who knows it is a game? On strategic awareness and cognitive ability," Experimental Economics, Springer;Economic Science Association, vol. 19(4), pages 713-726, December.
    13. Bayer, Ralph C. & Renou, Ludovic, 2016. "Logical omniscience at the laboratory," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 64(C), pages 41-49.
    14. Vincent P. Crawford & Miguel A. Costa-Gomes & Nagore Iriberri, 2010. "Strategic Thinking," Levine's Working Paper Archive 661465000000001148, David K. Levine.
    15. García-Pola, Bernardo & Iriberri, Nagore & Kovářík, Jaromír, 2020. "Non-equilibrium play in centipede games," Games and Economic Behavior, Elsevier, vol. 120(C), pages 391-433.
    16. Koriyama, Yukio & Ozkes, Ali I., 2021. "Inclusive cognitive hierarchy," Journal of Economic Behavior & Organization, Elsevier, vol. 186(C), pages 458-480.
    17. Ellingsen, Tore & Östling, Robert & Wengström, Erik, 2018. "How does communication affect beliefs in one-shot games with complete information?," Games and Economic Behavior, Elsevier, vol. 107(C), pages 153-181.
    18. Oren Bar-Gill & Christoph Engel, 2020. "Property is Dummy Proof: An Experiment," Discussion Paper Series of the Max Planck Institute for Research on Collective Goods 2020_02, Max Planck Institute for Research on Collective Goods.
    19. Strzalecki, Tomasz, 2014. "Depth of reasoning and higher order beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 108(C), pages 108-122.
    20. Marchiori, Davide & Di Guida, Sibilla & Polonio, Luca, 2021. "Plasticity of strategic sophistication in interactive decision-making," Journal of Economic Theory, Elsevier, vol. 196(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2309.07427. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.