IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/116382.html
   My bibliography  Save this paper

Stochastic choice and imperfect judgments of line lengths: What is hiding in the noise?

Author

Listed:
  • Sean, Duffy
  • John, Smith

Abstract

Noise is a pervasive feature of economic choice. However, standard economics experiments are not well equipped to study the noise because experiments are constrained: preferences are either unknown or only imperfectly measured by experimenters. As a result of these designs--where the optimal choice is not observable to the analyst--many important questions about the noise in apparently random choice cannot be addressed. We design an experiment to better understand stochastic choice by directing subjects to make incentivized binary choices between lines. Subjects are paid a function of the length of the selected line, so subjects will attempt to select the longer of the lines. We find a gradual (not sudden) relationship between the difference in the lengths of the lines and the optimal choice. Our analysis suggests that the errors are better described as having a Gumbel distribution rather than a normal distribution, and our simulated data increase our confidence in this inference. We find evidence that suboptimal choices are associated with longer response times than optimal choices, which appears to be consistent with the predictions of Fudenberg, Strack, and Strzalecki (2018). Although we note that the relationship between response time and the optimality of choice becomes weaker across trials. In our experiment, 54 of 56 triples are consistent with Strong Stochastic Transitivity and this is the median outcome in our simulated data. Finally, we find a relationship between choice and attention, although we find strong evidence that the relationship is endogenous.

Suggested Citation

  • Sean, Duffy & John, Smith, 2023. "Stochastic choice and imperfect judgments of line lengths: What is hiding in the noise?," MPRA Paper 116382, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:116382
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/116382/1/MPRA_paper_116382.pdf
    File Function: original version
    Download Restriction: no

    File URL: https://mpra.ub.uni-muenchen.de/116473/1/MPRA_paper_116473.pdf
    File Function: revised version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Drew Fudenberg & Philipp Strack & Tomasz Strzalecki, 2018. "Speed, Accuracy, and the Optimal Timing of Choices," American Economic Review, American Economic Association, vol. 108(12), pages 3651-3684, December.
    2. John D. Hey, 2018. "Why We Should Not Be Silent About Noise," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 13, pages 309-329, World Scientific Publishing Co. Pte. Ltd..
    3. Carlos Alós-Ferrer & Ernst Fehr & Nick Netzer, 2021. "Time Will Tell: Recovering Preferences When Choices Are Noisy," Journal of Political Economy, University of Chicago Press, vol. 129(6), pages 1828-1877.
    4. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    5. Paola Manzini & Marco Mariotti, 2014. "Stochastic Choice and Consideration Sets," Econometrica, Econometric Society, vol. 82(3), pages 1153-1176, May.
    6. Filip Matêjka & Alisdair McKay, 2015. "Rational Inattention to Discrete Choices: A New Foundation for the Multinomial Logit Model," American Economic Review, American Economic Association, vol. 105(1), pages 272-298, January.
    7. Peter Moffatt, 2005. "Stochastic Choice and the Allocation of Cognitive Effort," Experimental Economics, Springer;Economic Science Association, vol. 8(4), pages 369-388, December.
    8. repec:cup:judgdm:v:14:y:2019:i:4:p:381-394 is not listed on IDEAS
    9. Civelli, Andrea & Deck, Cary & Tutino, Antonella, 2022. "Attention and choices with multiple states and actions: A laboratory experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 199(C), pages 86-102.
    10. Corgnet, Brice & Hernán-González, Roberto & Kujal, Praveen, 2020. "On booms that never bust: Ambiguity in experimental asset markets with bubbles," Journal of Economic Dynamics and Control, Elsevier, vol. 110(C).
    11. Gerasimou, Georgios, 2021. "Simple preference intensity comparisons," Journal of Economic Theory, Elsevier, vol. 192(C).
    12. Sillamaa, M. A., 1999. "How work effort responds to wage taxation: A non-linear versus a linear tax experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 39(2), pages 219-233, June.
    13. Alós-Ferrer, Carlos & Garagnani, Michele, 2021. "Choice consistency and strength of preference," Economics Letters, Elsevier, vol. 198(C).
    14. Goryunov, Maxim & Rigos, Alexandros, 2022. "Discontinuous and continuous stochastic choice and coordination in the lab," Journal of Economic Theory, Elsevier, vol. 206(C).
    15. Duffy, Sean & Gussman, Steven & Smith, John, 2021. "Visual judgments of length in the economics laboratory: Are there brains in stochastic choice?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 93(C).
    16. Smith, Vernon L, 1976. "Experimental Economics: Induced Value Theory," American Economic Review, American Economic Association, vol. 66(2), pages 274-279, May.
    17. Elena Reutskaja & Rosemarie Nagel & Colin F. Camerer & Antonio Rangel, 2011. "Search Dynamics in Consumer Choice under Time Pressure: An Eye-Tracking Study," American Economic Review, American Economic Association, vol. 101(2), pages 900-926, April.
    18. Andrew Caplin & Mark Dean, 2015. "Revealed Preference, Rational Inattention, and Costly Information Acquisition," American Economic Review, American Economic Association, vol. 105(7), pages 2183-2203, July.
    19. Uri Gneezy & Aldo Rustichini, 2000. "Pay Enough or Don't Pay at All," The Quarterly Journal of Economics, Oxford University Press, vol. 115(3), pages 791-810.
    20. David S. Ahn & Todd Sarver, 2013. "Preference for Flexibility and Random Choice," Econometrica, Econometric Society, vol. 81(1), pages 341-361, January.
    21. Marina Agranov & Pietro Ortoleva, 2017. "Stochastic Choice and Preferences for Randomization," Journal of Political Economy, University of Chicago Press, vol. 125(1), pages 40-68.
    22. Alós-Ferrer, Carlos & Garagnani, Michele, 2022. "The gradual nature of economic errors," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 55-66.
    23. Dewan, Ambuj & Neligh, Nathaniel, 2020. "Estimating information cost functions in models of rational inattention," Journal of Economic Theory, Elsevier, vol. 187(C).
    24. Dan Ariely & Uri Gneezy & George Loewenstein & Nina Mazar, 2009. "Large Stakes and Big Mistakes," Review of Economic Studies, Oxford University Press, vol. 76(2), pages 451-469.
    25. Michael Woodford, 2014. "Stochastic Choice: An Optimizing Neuroeconomic Model," American Economic Review, American Economic Association, vol. 104(5), pages 495-500, May.
    26. Simone Cerreia-Vioglio & David Dillenberger & Pietro Ortoleva & Gil Riella, 2019. "Deliberately Stochastic," American Economic Review, American Economic Association, vol. 109(7), pages 2425-2445, July.
      • Simone Cerreia-Vioglio & David Dillenberger & Pietro Ortoleva & Gil Riella, 2012. "Deliberately Stochastic," PIER Working Paper Archive 17-013, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 25 May 2017.
    27. David J. Butler & Graham C. Loomes, 2007. "Imprecision as an Account of the Preference Reversal Phenomenon," American Economic Review, American Economic Association, vol. 97(1), pages 277-297, March.
    28. Echenique, Federico & Saito, Kota, 2017. "Response time and utility," Journal of Economic Behavior & Organization, Elsevier, vol. 139(C), pages 49-59.
    29. Pokorny, Kathrin, 2008. "Pay--but do not pay too much: An experimental study on the impact of incentives," Journal of Economic Behavior & Organization, Elsevier, vol. 66(2), pages 251-264, May.
    30. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    31. Loomes, Graham & Starmer, Chris & Sugden, Robert, 1989. "Preference Reversal: Information-Processing Effect or Rational Non-transitive Choice?," Economic Journal, Royal Economic Society, vol. 99(395), pages 140-151, Supplemen.
    32. Kota Saito, 2015. "Preferences for Flexibility and Randomization under Uncertainty," American Economic Review, American Economic Association, vol. 105(3), pages 1246-1271, March.
    33. Emir Kamenica, 2012. "Behavioral Economics and Psychology of Incentives," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 427-452, July.
    34. Sillamaa, M. A., 1999. "How work effort responds to wage taxation: An experimental test of a zero top marginal tax rate," Journal of Public Economics, Elsevier, vol. 73(1), pages 125-134, July.
    35. Pavlo R. Blavatskyy & Ganna Pogrebna, 2010. "Models of stochastic choice and decision theories: why both are important for analyzing decisions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(6), pages 963-986.
    36. Charness, Gary & Kuhn, Peter, 2011. "Lab Labor: What Can Labor Economists Learn from the Lab?," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 3, pages 229-330, Elsevier.
    37. Blair R. K. Shevlin & Stephanie M. Smith & Jan Hausfeld & Ian Krajbich, 2022. "High-value decisions are fast and accurate, inconsistent with diminishing value sensitivity," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(6), pages 2101508119-, February.
    38. Dickinson, David L, 1999. "An Experimental Examination of Labor Supply and Work Intensities," Journal of Labor Economics, University of Chicago Press, vol. 17(4), pages 638-670, October.
    39. Daniel Read, 2005. "Monetary incentives, what are they good for?," Journal of Economic Methodology, Taylor & Francis Journals, vol. 12(2), pages 265-276.
    40. Frederick Mosteller & Philip Nogee, 1951. "An Experimental Measurement of Utility," Journal of Political Economy, University of Chicago Press, vol. 59, pages 371-371.
    41. Payzan-LeNestour, Elise & Woodford, Michael, 2022. "Outlier blindness: A neurobiological foundation for neglect of financial risk," Journal of Financial Economics, Elsevier, vol. 143(3), pages 1316-1343.
    42. Carlos Alós-Ferrer & Michele Garagnani, 2022. "Strength of preference and decisions under risk," Journal of Risk and Uncertainty, Springer, vol. 64(3), pages 309-329, June.
    43. Ballinger, T Parker & Wilcox, Nathaniel T, 1997. "Decisions, Error and Heterogeneity," Economic Journal, Royal Economic Society, vol. 107(443), pages 1090-1105, July.
    44. K. Carrie Armel & Antonio Rangel, 2008. "The Impact of Computation Time and Experience on Decision Values," American Economic Review, American Economic Association, vol. 98(2), pages 163-168, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Duffy, Sean & Gussman, Steven & Smith, John, 2021. "Visual judgments of length in the economics laboratory: Are there brains in stochastic choice?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 93(C).
    2. Duffy, Sean & Smith, John, 2020. "An economist and a psychologist form a line: What can imperfect perception of length tell us about stochastic choice?," MPRA Paper 99417, University Library of Munich, Germany.
    3. Duffy, Sean & Gussman, Steven & Smith, John, 2019. "Judgments of length in the economics laboratory: Are there brains in choice?," MPRA Paper 93126, University Library of Munich, Germany.
    4. Alós-Ferrer, Carlos & Garagnani, Michele, 2022. "The gradual nature of economic errors," Journal of Economic Behavior & Organization, Elsevier, vol. 200(C), pages 55-66.
    5. Carlos Alós-Ferrer & Ernst Fehr & Nick Netzer, 2021. "Time Will Tell: Recovering Preferences When Choices Are Noisy," Journal of Political Economy, University of Chicago Press, vol. 129(6), pages 1828-1877.
    6. S. Cerreia-Vioglio & F. Maccheroni & M. Marinacci & A. Rustichini, 2017. "Multinomial logit processes and preference discovery: inside and outside the black box," Working Papers 615, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    7. Carlos Alós-Ferrer & Michele Garagnani, 2022. "Strength of preference and decisions under risk," Journal of Risk and Uncertainty, Springer, vol. 64(3), pages 309-329, June.
    8. Simone Cerreia-Vioglio & Fabio Maccheroni & Massimo Marinacci, 2020. "Multinomial logit processes and preference discovery: outside and inside the black box," Working Papers 663, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    9. Erkal, Nisvan & Gangadharan, Lata & Koh, Boon Han, 2018. "Monetary and non-monetary incentives in real-effort tournaments," European Economic Review, Elsevier, vol. 101(C), pages 528-545.
    10. Cary Frydman & Ian Krajbich, 2022. "Using Response Times to Infer Others’ Private Information: An Application to Information Cascades," Management Science, INFORMS, vol. 68(4), pages 2970-2986, April.
    11. Guo, Liang, 2021. "Contextual deliberation and the choice-valuation preference reversal," Journal of Economic Theory, Elsevier, vol. 195(C).
    12. Carlo Baldassi & Simone Cerreia-Vioglio & Fabio Maccheroni & Massimo Marinacci & Marco Pirazzini, 2020. "A Behavioral Characterization of the Drift Diffusion Model and Its Multialternative Extension for Choice Under Time Pressure," Management Science, INFORMS, vol. 66(11), pages 5075-5093, November.
    13. Clithero, John A., 2018. "Response times in economics: Looking through the lens of sequential sampling models," Journal of Economic Psychology, Elsevier, vol. 69(C), pages 61-86.
    14. Jan Hausfeld & Sven Resnjanskij, 2017. "Risky Decisions and the Opportunity Costs of Time," TWI Research Paper Series 108, Thurgauer Wirtschaftsinstitut, Universität Konstanz.
    15. David J. Cooper & Ian Krajbich & Charles N. Noussair, 2019. "Choice-Process Data in Experimental Economics," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 5(1), pages 1-13, August.
    16. Simone Cerreia-Vioglio & David Dillenberger & Pietro Ortoleva & Gil Riella, 2019. "Deliberately Stochastic," American Economic Review, American Economic Association, vol. 109(7), pages 2425-2445, July.
      • Simone Cerreia-Vioglio & David Dillenberger & Pietro Ortoleva & Gil Riella, 2012. "Deliberately Stochastic," PIER Working Paper Archive 17-013, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania, revised 25 May 2017.
    17. Ryan Webb, 2019. "The (Neural) Dynamics of Stochastic Choice," Management Science, INFORMS, vol. 65(1), pages 230-255, January.
    18. Chew, Soo Hong & Miao, Bin & Shen, Qiang & Zhong, Songfa, 2022. "Multiple-switching behavior in choice-list elicitation of risk preference," Journal of Economic Theory, Elsevier, vol. 204(C).
    19. Berg, Joyce E. & Dickhaut, John W. & Rietz, Thomas A., 2010. "Preference reversals: The impact of truth-revealing monetary incentives," Games and Economic Behavior, Elsevier, vol. 68(2), pages 443-468, March.
    20. Carlos Alós-Ferrer & Johannes Buckenmaier & Michele Garagnani, 2020. "Stochastic choice and preference reversals," ECON - Working Papers 370, Department of Economics - University of Zurich, revised Jul 2021.

    More about this item

    Keywords

    Stochastic transitivity; choice theory; judgment; memory; search;
    All these keywords.

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D12 - Microeconomics - - Household Behavior - - - Consumer Economics: Empirical Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:116382. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.