IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2609.12291.html

Measuring Economic Preferences in the Presence of Noise: The Connections Between Choices and Valuations

Author

Listed:
  • Ted O'Donoghue
  • Charles Sprenger
  • Po Hyun Sung
  • Ben Wincelberg

Abstract

Past research highlights failures of "procedural invariance" when measuring economic preferences using choices versus valuations. We reassess these failures by examining theoretical connections between choices and valuations when preferences are stable but measurements are noisy and individuals are heterogeneous. Even under strong assumptions governing noise and heterogeneity, stability does not generally imply identical measurements. We develop new tests of stable preferences in conjunction with various ancillary assumptions about heterogeneity and noise. We implement these tests using existing data to understand if, in the domain of risk preferences, choices and valuations truly differ and to provide quantitative assessments of any deviations. Limiting to the types of data used in the prior literature, we rarely reject the null of stable preferences. With richer data linking individual choices and valuations and structural assumptions, we find evidence of instability which differs qualitatively from the received wisdom that choices implicate greater risk aversion than valuations.

Suggested Citation

  • Ted O'Donoghue & Charles Sprenger & Po Hyun Sung & Ben Wincelberg, 2026. "Measuring Economic Preferences in the Presence of Noise: The Connections Between Choices and Valuations," Papers 2609.12291, arXiv.org.
    • Handle: RePEc:arx:papers:2609.12291
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2609.12291
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. David J. Freeman & Guy Mayraz, 2019. "Why choice lists increase risk taking," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 131-154, March.
    2. Christina McGranaghan & Kirby Nielsen & Ted O'Donoghue & Jason Somerville & Charles D. Sprenger, 2024. "Distinguishing Common Ratio Preferences from Common Ratio Effects Using Paired Valuation Tasks," American Economic Review, American Economic Association, vol. 114(2), pages 307-347, February.
    3. Mel Win Khaw & Ziang Li & Michael Woodford, 2021. "Cognitive Imprecision and Small-Stakes Risk Aversion," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(4), pages 1979-2013.
    4. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    5. David J. Freeman & Yoram Halevy & Terri Kneeland, 2019. "Eliciting risk preferences using choice lists," Quantitative Economics, Econometric Society, vol. 10(1), pages 217-237, January.
    6. Tversky, Amos & Thaler, Richard H, 1990. "Anomalies: Preference Reversals," Journal of Economic Perspectives, American Economic Association, vol. 4(2), pages 201-211, Spring.
    7. Holt, Charles A, 1986. "Preference Reversals and the Independence Axiom," American Economic Review, American Economic Association, vol. 76(3), pages 508-515, June.
    8. Frederick Mosteller & Philip Nogee, 1951. "An Experimental Measurement of Utility," Journal of Political Economy, University of Chicago Press, vol. 59(5), pages 371-371.
    9. James Cox & Vjollca Sadiraj & Ulrich Schmidt, 2015. "Paradoxes and mechanisms for choice under risk," Experimental Economics, Springer;Economic Science Association, vol. 18(2), pages 215-250, June.
    10. Grether, David M & Plott, Charles R, 1979. "Economic Theory of Choice and the Preference Reversal Phenomenon," American Economic Review, American Economic Association, vol. 69(4), pages 623-638, September.
    11. Stephan Meier & Charles D. Sprenger, 2015. "Temporal Stability of Time Preferences," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 273-286, May.
    12. Starmer, Chris & Sugden, Robert, 1991. "Does the Random-Lottery Incentive System Elicit True Preferences? An Experimental Investigation," American Economic Review, American Economic Association, vol. 81(4), pages 971-978, September.
    13. Glenn Harrison & J. Swarthout, 2014. "Experimental payment protocols and the Bipolar Behaviorist," Theory and Decision, Springer, vol. 77(3), pages 423-438, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Drichoutis, Andreas C. & Palma, Marco & Feldman, Paul, 2024. "Incentives and Payment Mechanisms in Preference Elicitation," MPRA Paper 120898, University Library of Munich, Germany.
    2. Yaron Azrieli & Christopher P. Chambers & Paul J. Healy, 2020. "Incentives in experiments with objective lotteries," Experimental Economics, Springer;Economic Science Association, vol. 23(1), pages 1-29, March.
    3. James C. Cox & Vjollca Sadiraj, 2018. "Incentives," Experimental Economics Center Working Paper Series 2018-01, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University.
    4. Uri Gneezy & Yoram Halevy & Brian Hall & Theo Offerman & Jeroen van de Ven, 2024. "How Real is Hypothetical? A High-Stakes Test of the Allais Paradox," Working Papers tecipa-783, University of Toronto, Department of Economics.
    5. Heutel, Garth, 2019. "Prospect theory and energy efficiency," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 236-254.
    6. Nathaniel T. Wilcox, 2024. "Conditional independence in a binary choice experiment," Journal of Risk and Uncertainty, Springer, vol. 68(3), pages 205-225, June.
    7. Yaron Azrieli & Christopher P. Chambers & Paul J. Healy, 2018. "Incentives in Experiments: A Theoretical Analysis," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1472-1503.
    8. Nathaniel T. Wilcox, 2015. "Error and Generalization in Discrete Choice Under Risk," Working Papers 15-11, Chapman University, Economic Science Institute.
    9. Yi Li, 2021. "The ABC mechanism: an incentive compatible payoff mechanism for elicitation of outcome and probability transformations," Experimental Economics, Springer;Economic Science Association, vol. 24(3), pages 1019-1046, September.
    10. Brown, Alexander L. & Healy, Paul J., 2018. "Separated decisions," European Economic Review, Elsevier, vol. 101(C), pages 20-34.
    11. David J. Freeman & Guy Mayraz, 2019. "Why choice lists increase risk taking," Experimental Economics, Springer;Economic Science Association, vol. 22(1), pages 131-154, March.
    12. Cathleen Johnson & Aurélien Baillon & Han Bleichrodt & Zhihua Li & Dennie Dolder & Peter P. Wakker, 2021. "Prince: An improved method for measuring incentivized preferences," Journal of Risk and Uncertainty, Springer, vol. 62(1), pages 1-28, February.
    13. James C. Cox & Vjollca Sadiraj, 2025. "Salient Rewards, Payoff Protocols and Biased Data," Experimental Economics Center Working Paper Series 2025-03, Experimental Economics Center, Andrew Young School of Policy Studies, Georgia State University, revised Jul 2026.
    14. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2015. "Reduction of compound lotteries with objective probabilities: Theory and evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 32-55.
    15. Nathaniel T. Wilcox, 2023. "Unusual Estimates of Probability Weighting Functions," Research in Experimental Economics, in: Models of Risk Preferences: Descriptive and Normative Challenges, volume 22, pages 69-106, Emerald Group Publishing Limited.
    16. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    17. Cheung, Paul H.Y. & Ellis, Keaton, 2025. "Non-isolation, reversals, and social preference," Games and Economic Behavior, Elsevier, vol. 154(C), pages 159-174.
    18. Herranz-Zarzoso, Noemí & Sabater-Grande, Gerardo & Jaramillo-Gutiérrez, Ainhoa, 2020. "Framing and repetition effects on risky choices: A behavioural approach," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 84(C).
    19. Andreas C. Drichoutis & Varvara Kechagia, 2016. "The effect of olfactory sensory cues on economic decision making," Working Papers 2016-4, Agricultural University of Athens, Department Of Agricultural Economics.
    20. Noemí Herranz-Zarzoso & Gerardo Sabater-Grande, 2018. "Framing and repetition effects on risky choices: A behavioral approach," Working Papers 2018/04, Economics Department, Universitat Jaume I, Castellón (Spain).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2609.12291. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.