IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2403.11240.html
   My bibliography  Save this paper

Speed, Accuracy, and Complexity

Author

Listed:
  • Duarte Gonc{c}alves

Abstract

This paper re-examines the use of response time to infer problem complexity. It revisits a canonical Wald model of optimal stopping, taking signal-to-noise ratio as a measure of problem complexity. While choice quality is monotone in problem complexity, expected stopping time is inverse U-shaped. Indeed, decisions are fast in both very simple and very complex problems: in simple problems, it is quick to understand which alternative is best, while in complex problems it would be too costly -- an insight which extends to general costly information acquisition models. This non-monotonicity also underlies an ambiguous relationship between response time and ability, whereby higher ability entails slower decisions in very complex problems, but faster decisions in simple problems. Finally, this paper proposes a new method to correctly infer problem complexity based on the finding that distorting incentives in favour of an alternative has a greater effect on choices in more complex problems.

Suggested Citation

  • Duarte Gonc{c}alves, 2024. "Speed, Accuracy, and Complexity," Papers 2403.11240, arXiv.org, revised Jun 2024.
    • Handle: RePEc:arx:papers:2403.11240
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2403.11240
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Benjamin Enke, 2020. "What You See Is All There Is," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(3), pages 1363-1398.
    2. Leonidas Spiliopoulos & Andreas Ortmann, 2018. "The BCD of response time analysis in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 21(2), pages 383-433, June.
    3. Elliot Lipnowski & Doron Ravid, 2022. "Predicting Choice from Information Costs," Papers 2205.10434, arXiv.org, revised Apr 2023.
    4. Clithero, John A., 2018. "Improving out-of-sample predictions using response times and a model of the decision process," Journal of Economic Behavior & Organization, Elsevier, vol. 148(C), pages 344-375.
    5. Brent Moritz & Enno Siemsen & Mirko Kremer, 2014. "Judgmental Forecasting: Cognitive Reflection and Decision Speed," Production and Operations Management, Production and Operations Management Society, vol. 23(7), pages 1146-1160, July.
    6. Carlos Alós-Ferrer & Ernst Fehr & Nick Netzer, 2021. "Time Will Tell: Recovering Preferences When Choices Are Noisy," Journal of Political Economy, University of Chicago Press, vol. 129(6), pages 1828-1877.
    7. Marina Agranov & Andrew Caplin & Chloe Tergiman, 2015. "Naive play and the process of choice in guessing games," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(2), pages 146-157, December.
    8. David Gill & Victoria Prowse, 2023. "Strategic Complexity and the Value of Thinking," The Economic Journal, Royal Economic Society, vol. 133(650), pages 761-786.
    9. James J. Choi & David Laibson & Brigitte C. Madrian, 2011. "$100 Bills on the Sidewalk: Suboptimal Investment in 401(k) Plans," The Review of Economics and Statistics, MIT Press, vol. 93(3), pages 748-763, August.
    10. Recalde, María P. & Riedl, Arno & Vesterlund, Lise, 2018. "Error-prone inference from response time: The case of intuitive generosity in public-good games," Journal of Public Economics, Elsevier, vol. 160(C), pages 132-147.
    11. Carlos Alós-Ferrer & Michele Garagnani, 2022. "Strength of preference and decisions under risk," Journal of Risk and Uncertainty, Springer, vol. 64(3), pages 309-329, June.
    12. Marek Pycia & Peter Troyan, 2023. "A Theory of Simplicity in Games and Mechanism Design," Econometrica, Econometric Society, vol. 91(4), pages 1495-1526, July.
    13. Kenan Kalaycı & Marta Serra-Garcia, 2016. "Complexity and biases," Experimental Economics, Springer;Economic Science Association, vol. 19(1), pages 31-50, March.
    14. Saurabh Bhargava & George Loewenstein & Justin Sydnor, 2017. "Choose to Lose: Health Plan Choices from a Menu with Dominated Option," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(3), pages 1319-1372.
    15. Ernst Fehr & Antonio Rangel, 2011. "Neuroeconomic Foundations of Economic Choice--Recent Advances," Journal of Economic Perspectives, American Economic Association, vol. 25(4), pages 3-30, Fall.
    16. Grabiszewski, Konrad & Horenstein, Alex, 2022. "Measuring tree complexity with response times," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    17. Marina Halac & Navin Kartik & Qingmin Liu, 2016. "Optimal Contracts for Experimentation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(3), pages 1040-1091.
    18. Giuseppe Moscarini & Lones Smith, 2001. "The Optimal Level of Experimentation," Econometrica, Econometric Society, vol. 69(6), pages 1629-1644, November.
    19. Ariel Rubinstein, 2016. "A Typology of Players: Between Instinctive and Contemplative," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(2), pages 859-890.
    20. Frederick Mosteller & Philip Nogee, 1951. "An Experimental Measurement of Utility," Journal of Political Economy, University of Chicago Press, vol. 59(5), pages 371-371.
    21. Steven Callander, 2011. "Searching and Learning by Trial and Error," American Economic Review, American Economic Association, vol. 101(6), pages 2277-2308, October.
    22. Glenn Ellison & Alexander Wolitzky, 2012. "A search cost model of obfuscation," RAND Journal of Economics, RAND Corporation, vol. 43(3), pages 417-441, September.
    23. Cary Frydman & Lawrence J Jin, 2022. "Efficient Coding and Risky Choice," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 137(1), pages 161-213.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Clithero, John A., 2018. "Response times in economics: Looking through the lens of sequential sampling models," Journal of Economic Psychology, Elsevier, vol. 69(C), pages 61-86.
    2. Cary Frydman & Ian Krajbich, 2022. "Using Response Times to Infer Others’ Private Information: An Application to Information Cascades," Management Science, INFORMS, vol. 68(4), pages 2970-2986, April.
    3. Carlos Alós-Ferrer & Johannes Buckenmaier, 2021. "Cognitive sophistication and deliberation times," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 558-592, June.
    4. S. Cerreia-Vioglio & F. Maccheroni & M. Marinacci & A. Rustichini, 2017. "Multinomial logit processes and preference discovery: inside and outside the black box," Working Papers 615, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    5. Simone Cerreia-Vioglio & Fabio Maccheroni & Massimo Marinacci, 2020. "Multinomial logit processes and preference discovery: outside and inside the black box," Working Papers 663, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    6. Grabiszewski, Konrad & Horenstein, Alex, 2020. "Effort is not a monotonic function of skills: Results from a global mobile experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 176(C), pages 634-652.
    7. Hébert, Benjamin & Woodford, Michael, 2023. "Rational inattention when decisions take time," Journal of Economic Theory, Elsevier, vol. 208(C).
    8. Anna Conte & Gianmarco Santis & John D. Hey & Ivan Soraperra, 2023. "The determinants of decision time in an ambiguous context," Journal of Risk and Uncertainty, Springer, vol. 67(3), pages 271-297, December.
    9. Grabiszewski, Konrad & Horenstein, Alex, 2022. "Measuring tree complexity with response times," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 98(C).
    10. David J. Cooper & Ian Krajbich & Charles N. Noussair, 2019. "Choice-Process Data in Experimental Economics," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(1), pages 1-13, August.
    11. Alós-Ferrer, Carlos & Garagnani, Michele, 2022. "The gradual nature of economic errors," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 55-66.
    12. Carlos Alós-Ferrer & Michele Garagnani, 2022. "Strength of preference and decisions under risk," Journal of Risk and Uncertainty, Springer, vol. 64(3), pages 309-329, June.
    13. Duffy, Sean & Smith, John, 2020. "An economist and a psychologist form a line: What can imperfect perception of length tell us about stochastic choice?," MPRA Paper 99417, University Library of Munich, Germany.
    14. Alós-Ferrer, Carlos & Garagnani, Michele, 2020. "The cognitive foundations of cooperation," Journal of Economic Behavior & Organization, Elsevier, vol. 175(C), pages 71-85.
    15. Sandro Ambuehl & B. Douglas Bernheim & Annamaria Lusardi, 2022. "Evaluating Deliberative Competence: A Simple Method with an Application to Financial Choice," American Economic Review, American Economic Association, vol. 112(11), pages 3584-3626, November.
    16. Guidon Fenig & Giovanni Gallipoli & Yoram Halevy, 2018. "Piercing the 'Payoff Function' Veil: Tracing Beliefs and Motives," Working Papers tecipa-619, University of Toronto, Department of Economics.
    17. Carlos Alós-Ferrer & Ernst Fehr & Nick Netzer, 2021. "Time Will Tell: Recovering Preferences When Choices Are Noisy," Journal of Political Economy, University of Chicago Press, vol. 129(6), pages 1828-1877.
    18. Carlo Baldassi & Simone Cerreia-Vioglio & Fabio Maccheroni & Massimo Marinacci & Marco Pirazzini, 2020. "A Behavioral Characterization of the Drift Diffusion Model and Its Multialternative Extension for Choice Under Time Pressure," Management Science, INFORMS, vol. 66(11), pages 5075-5093, November.
    19. Avoyan, Ala & Schotter, Andrew, 2020. "Attention in games: An experimental study," European Economic Review, Elsevier, vol. 124(C).
    20. Benjamin Hébert & Michael Woodford, 2018. "Information Costs and Sequential Information Sampling," NBER Working Papers 25316, National Bureau of Economic Research, Inc.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2403.11240. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.