IDEAS home Printed from https://ideas.repec.org/a/wly/quante/v15y2024i1p175-211.html
   My bibliography  Save this article

On the complexity of forming mental models

Author

Listed:
  • Chad Kendall
  • Ryan Oprea

Abstract

We experimentally study how people form predictive models of simple data generating processes (DGPs), by showing subjects data sets and asking them to predict future outputs. We find that subjects: (i) often fail to predict in this task, indicating a failure to form a model, (ii) often cannot explicitly describe the model they have formed even when successful, and (iii) tend to be attracted to the same, simple models when multiple models fit the data. Examining a number of formal complexity metrics, we find that all three patterns are well organized by metrics suggested by Lipman (1995) and Gabaix (2014) that describe the information processing required to deploy models in prediction.

Suggested Citation

  • Chad Kendall & Ryan Oprea, 2024. "On the complexity of forming mental models," Quantitative Economics, Econometric Society, vol. 15(1), pages 175-211, January.
  • Handle: RePEc:wly:quante:v:15:y:2024:i:1:p:175-211
    DOI: 10.3982/QE2264
    as

    Download full text from publisher

    File URL: https://doi.org/10.3982/QE2264
    Download Restriction: no

    File URL: https://libkey.io/10.3982/QE2264?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Drew Fudenberg & Philipp Strack & Tomasz Strzalecki, 2018. "Speed, Accuracy, and the Optimal Timing of Choices," American Economic Review, American Economic Association, vol. 108(12), pages 3651-3684, December.
    2. Joshua Schwartzstein & Adi Sunderam, 2021. "Using Models to Persuade," American Economic Review, American Economic Association, vol. 111(1), pages 276-323, January.
    3. Banks, Jeffrey S. & Sundaram, Rangarajan K., 1990. "Repeated games, finite automata, and complexity," Games and Economic Behavior, Elsevier, vol. 2(2), pages 97-117, June.
    4. David Gill & Victoria Prowse, 2023. "Strategic Complexity and the Value of Thinking," The Economic Journal, Royal Economic Society, vol. 133(650), pages 761-786.
    5. Ryan Oprea, 2021. "What Makes a Rule Complex? Erratum," American Economic Review, American Economic Association, vol. 111(2), pages 755-755, February.
    6. Paul Heidhues & Botond Kőszegi & Philipp Strack, 2018. "Unrealistic Expectations and Misguided Learning," Econometrica, Econometric Society, vol. 86(4), pages 1159-1214, July.
    7. Benjamin Handel & Joshua Schwartzstein, 2018. "Frictions or Mental Gaps: What's Behind the Information We (Don't) Use and When Do We Care?," Journal of Economic Perspectives, American Economic Association, vol. 32(1), pages 155-178, Winter.
    8. Bohren, Aislinn & Hauser, Daniel, 2017. "Learning with Heterogeneous Misspecified Models: Characterization and Robustness," CEPR Discussion Papers 12036, C.E.P.R. Discussion Papers.
    9. Andrew Caplin, 2016. "Measuring and Modeling Attention," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 379-403, October.
    10. Benjamin Enke, 2020. "What You See Is All There Is," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1363-1398.
    11. Barton L. Lipman, 1995. "Information Processing and Bounded Rationality: A Survey," Canadian Journal of Economics, Canadian Economics Association, vol. 28(1), pages 42-67, February.
    12. Ran Spiegler, 2016. "Bayesian Networks and Boundedly Rational Expectations," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1243-1290.
    13. Xavier Gabaix, 2014. "A Sparsity-Based Model of Bounded Rationality," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(4), pages 1661-1710.
    14. Pedro Dal Bo & Guillaume R. Frochette, 2011. "The Evolution of Cooperation in Infinitely Repeated Games: Experimental Evidence," American Economic Review, American Economic Association, vol. 101(1), pages 411-429, February.
    15. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: A Study of Response Times," Economic Journal, Royal Economic Society, vol. 117(523), pages 1243-1259, October.
    16. Rubinstein, Ariel, 1993. "On Price Recognition and Computational Complexity in a Monopolistic Model," Journal of Political Economy, University of Chicago Press, vol. 101(3), pages 473-484, June.
    17. Sims, Christopher A., 2003. "Implications of rational inattention," Journal of Monetary Economics, Elsevier, vol. 50(3), pages 665-690, April.
    18. Kfir Eliaz & Ran Spiegler, 2020. "A Model of Competing Narratives," American Economic Review, American Economic Association, vol. 110(12), pages 3786-3816, December.
    19. J. Aislinn Bohren & Daniel N. Hauser, 2021. "Learning With Heterogeneous Misspecified Models: Characterization and Robustness," Econometrica, Econometric Society, vol. 89(6), pages 3025-3077, November.
    20. Mark Dean & Nathaniel Neligh, 2023. "Experimental Tests of Rational Inattention," Journal of Political Economy, University of Chicago Press, vol. 131(12), pages 3415-3461.
    21. Thomas Graeber, 2023. "Inattentive Inference," Journal of the European Economic Association, European Economic Association, vol. 21(2), pages 560-592.
    22. Fudenberg, Drew & Romanyuk, Gleb & Strack, Philipp, 2017. "Active learning with a misspecified prior," Theoretical Economics, Econometric Society, vol. 12(3), September.
    23. Kalai, Ehud & Stanford, William, 1988. "Finite Rationality and Interpersonal Complexity in Repeated Games," Econometrica, Econometric Society, vol. 56(2), pages 397-410, March.
    24. Abreu, Dilip & Rubinstein, Ariel, 1988. "The Structure of Nash Equilibrium in Repeated Games with Finite Automata," Econometrica, Econometric Society, vol. 56(6), pages 1259-1281, November.
    25. Lipman, Barton L. & Srivastava, Sanjay, 1990. "Informational requirements and strategic complexity in repeated games," Games and Economic Behavior, Elsevier, vol. 2(3), pages 273-290, September.
    26. Rubinstein, Ariel, 1986. "Finite automata play the repeated prisoner's dilemma," Journal of Economic Theory, Elsevier, vol. 39(1), pages 83-96, June.
    27. Rema Hanna & Sendhil Mullainathan & Joshua Schwartzstein, 2014. "Learning Through Noticing: Theory and Evidence from a Field Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1311-1353.
    28. Andrew Schotter & Barry Sopher, 2003. "Social Learning and Coordination Conventions in Intergenerational Games: An Experimental Study," Journal of Political Economy, University of Chicago Press, vol. 111(3), pages 498-529, June.
    29. Ariel Rubinstein, 2007. "Instinctive and Cognitive Reasoning: Response Times Study," Levine's Bibliography 321307000000001011, UCLA Department of Economics.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Paul Grass & Philipp Schirmer & Malin Siemers, 2025. "Sticky Models," CRC TR 224 Discussion Paper Series crctr224_2025_655, University of Bonn and University of Mannheim, Germany.
    2. Alda Botelho Azevedo & Inês Gonçalves & João Pereira dos Santos, 2025. "Can’t Buy Me Home – Beliefs, Facts, and Policy in the Housing Affordability Crisis," GEE Papers 191, Gabinete de Estratégia e Estudos, Ministério da Economia, revised Jun 2025.
    3. repec:cdl:ucsdec:qt57x6d5sw is not listed on IDEAS
    4. Botelho Azevedo, Alda & Gonçalves, Inês & Pereira dos Santos, João, 2025. "Can’t Buy Me Home: Beliefs, Facts, and Policy in the Housing Affordability Crisis," IZA Discussion Papers 18073, Institute of Labor Economics (IZA).
    5. Kevin He & Ran Shorrer & Mengjia Xia, 2025. "Human Misperception of Generative-AI Alignment: A Laboratory Experiment," Papers 2502.14708, arXiv.org, revised Jun 2025.
    6. Chiara Aina & Florian H. Schneider, 2025. "Weighting Competing Models," CEBI working paper series 25-04, University of Copenhagen. Department of Economics. The Center for Economic Behavior and Inequality (CEBI).
    7. Brian Jabarian & Elia Sartori, 2024. "Critical Thinking and Storytelling Contexts," CESifo Working Paper Series 11282, CESifo.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:cdl:ucsdec:qt8cb387t8 is not listed on IDEAS
    2. George Loewenstein & Zachary Wojtowicz, 2023. "The Economics of Attention," CESifo Working Paper Series 10712, CESifo.
    3. Robin Musolff & Florian Zimmermann, 2025. "Model Uncertainty," CRC TR 224 Discussion Paper Series crctr224_2025_697, University of Bonn and University of Mannheim, Germany.
    4. Yuval Salant & Jörg L. Spenkuch, 2021. "Complexity and Choice," CESifo Working Paper Series 9239, CESifo.
    5. Robin Musolff & Florian Zimmermann, 2025. "Model Uncertainty," ECONtribute Discussion Papers Series 369, University of Bonn and University of Cologne, Germany.
    6. Jones, Matthew T., 2014. "Strategic complexity and cooperation: An experimental study," Journal of Economic Behavior & Organization, Elsevier, vol. 106(C), pages 352-366.
    7. Robin Musolff & Florian Zimmermann, 2025. "Model Uncertainty," CESifo Working Paper Series 12041, CESifo.
    8. Philippe Jehiel, 2022. "Analogy-Based Expectation Equilibrium and Related Concepts:Theory, Applications, and Beyond," PSE Working Papers halshs-03735680, HAL.
    9. Fries, Tilman & Barron, Kai, 2023. "Narrative Persuasion," VfS Annual Conference 2023 (Regensburg): Growth and the "sociale Frage" 277691, Verein für Socialpolitik / German Economic Association.
    10. Gagnon-Bartsch, Tristan & Bushong, Benjamin, 2022. "Learning with misattribution of reference dependence," Journal of Economic Theory, Elsevier, vol. 203(C).
    11. Xavier Gabaix, 2017. "Behavioral Inattention," NBER Working Papers 24096, National Bureau of Economic Research, Inc.
    12. Ueda, Masahiko, 2023. "Memory-two strategies forming symmetric mutual reinforcement learning equilibrium in repeated prisoners’ dilemma game," Applied Mathematics and Computation, Elsevier, vol. 444(C).
    13. Ana Costa-Ramón & Ursina Schaede & Michaela Slotwinski & Anne Ardila Brenøe, 2024. "(Not) thinking about the future: inattention and maternal labor supply," ECON - Working Papers 452, Department of Economics - University of Zurich.
    14. Mira Frick & Ryota Iijima & Yuhta Ishii, 2018. "Dispersed Behavior and Perceptions in Assortative Societies," Cowles Foundation Discussion Papers 2128R2, Cowles Foundation for Research in Economics, Yale University, revised Oct 2021.
    15. Benjamin Enke, 2020. "What You See Is All There Is," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1363-1398.
    16. Fudenberg, Drew & Lanzani, Giacomo & Strack, Philipp, 2023. "Pathwise concentration bounds for Bayesian beliefs," Theoretical Economics, Econometric Society, vol. 18(4), November.
    17. Bednar, Jenna & Chen, Yan & Liu, Tracy Xiao & Page, Scott, 2012. "Behavioral spillovers and cognitive load in multiple games: An experimental study," Games and Economic Behavior, Elsevier, vol. 74(1), pages 12-31.
    18. Spiegler, Ran, 2004. "Simplicity of beliefs and delay tactics in a concession game," Games and Economic Behavior, Elsevier, vol. 47(1), pages 200-220, April.
    19. Binmore, Ken & Piccione, Michele & Samuelson, Larry, 1998. "Evolutionary Stability in Alternating-Offers Bargaining Games," Journal of Economic Theory, Elsevier, vol. 80(2), pages 257-291, June.
    20. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    21. Erin T. Bronchetti & Judd B. Kessler & Ellen B. Magenheim & Dmitry Taubinsky & Eric Zwick, 2023. "Is Attention Produced Optimally? Theory and Evidence From Experiments With Bandwidth Enhancements," Econometrica, Econometric Society, vol. 91(2), pages 669-707, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:quante:v:15:y:2024:i:1:p:175-211. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/essssea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.