IDEAS home Printed from https://ideas.repec.org/a/eee/soceco/v119y2025ics2214804325001144.html

Experimental methods: Learning your own risk preferences under different risk elicitation methods

Author

Listed:
  • Caferra, Rocco
  • Morone, Andrea
  • Pierno, Donato

Abstract

This paper examines whether changes in risk preferences reflect genuine behavioural shifts or result from the elicitation method used. In a within-subject experiment, participants made initial risky choices, completed 24 unpaid learning rounds with real dice and recorded outcomes, and then made final choices. We compare four risk elicitation methods: two Ordered Lottery Selection (OLS) and two Multiple Price List (MPL) tasks. Our analysis focuses on how preferences evolve with experience, the role of reported errors during the learning phase, and the effect of method complexity (i.e., the number of potential payoff outcomes in a given lottery) on revealed risk attitudes. Results show that MPL tasks, particularly when more complex, produce stronger changes in behaviour. Participants who made errors during the MPL learning phase were more likely to display increased risk aversion. This suggests that task comprehension and cognitive load influence the stability of preferences. The findings contribute to the broader debate on preference stability and highlight the methodological relevance of comparing elicitation tools within the same experimental framework.

Suggested Citation

  • Caferra, Rocco & Morone, Andrea & Pierno, Donato, 2025. "Experimental methods: Learning your own risk preferences under different risk elicitation methods," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 119(C).
  • Handle: RePEc:eee:soceco:v:119:y:2025:i:c:s2214804325001144
    DOI: 10.1016/j.socec.2025.102450
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S2214804325001144
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.socec.2025.102450?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Hans P. Binswanger, 1980. "Attitudes Toward Risk: Experimental Measurement in Rural India," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 62(3), pages 395-407.
    2. Gary Charness & Nir Chemaya & Dario Trujano-Ochoa, 2023. "Learning your own risk preferences," Journal of Risk and Uncertainty, Springer, vol. 67(1), pages 1-19, August.
    3. Kirby Nielsen & John Rehbeck, 2022. "When Choices Are Mistakes," American Economic Review, American Economic Association, vol. 112(7), pages 2237-2268, July.
    4. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    5. Giuseppe Attanasi & Nikolaos Georgantzís & Valentina Rotondi & Daria Vigani, 2018. "Lottery- and survey-based risk attitudes linked through a multichoice elicitation task," Theory and Decision, Springer, vol. 84(3), pages 341-372, May.
    6. Marielle Brunette & Jonas Ngouhouo-Poufoun, 2022. "Are risk preferences consistent across elicitation procedures? A field experiment in Congo basin countries," The Geneva Risk and Insurance Review, Palgrave Macmillan;International Association for the Study of Insurance Economics (The Geneva Association), vol. 47(1), pages 122-140, March.
    7. Glenn W. Harrison & E. Elisabet Rutström, 2008. "Risk Aversion in the Laboratory," Research in Experimental Economics, in: Risk Aversion in Experiments, pages 41-196, Emerald Group Publishing Limited.
    8. Felix Holzmeister & Matthias Stefan, 2021. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 593-616, June.
    9. Anwesha Bandyopadhyay & Lutfunnahar Begum & Philip J. Grossman, 2021. "Gender differences in the stability of risk attitudes," Journal of Risk and Uncertainty, Springer, vol. 63(2), pages 169-201, October.
    10. Binswanger, Hans P, 1981. "Attitudes toward Risk: Theoretical Implications of an Experiment in Rural India," Economic Journal, Royal Economic Society, vol. 91(364), pages 867-890, December.
    11. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David B. Huffman & Uwe Sunde, 2017. "Global Evidence on Economic Preferences," NBER Working Papers 23943, National Bureau of Economic Research, Inc.
    12. Catherine C. Eckel & Philip J. Grossman, 2008. "Forecasting Risk Attitudes: An Experimental Study Using Actual and Forecast Gamble Choices," Monash Economics Working Papers archive-01, Monash University, Department of Economics.
    13. Armin Falk & Anke Becker & Thomas Dohmen & Benjamin Enke & David Huffman & Uwe Sunde, 2018. "Global Evidence on Economic Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(4), pages 1645-1692.
    14. Arnaud Reynaud & Stéphane Couture, 2012. "Stability of risk preference measures: results from a field experiment on French farmers," Theory and Decision, Springer, vol. 73(2), pages 203-221, August.
    15. Charness, Gary & Gneezy, Uri & Imas, Alex, 2013. "Experimental methods: Eliciting risk preferences," Journal of Economic Behavior & Organization, Elsevier, vol. 87(C), pages 43-51.
    16. Rachel Croson & Uri Gneezy, 2009. "Gender Differences in Preferences," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 448-474, June.
    17. Chetan Dave & Catherine Eckel & Cathleen Johnson & Christian Rojas, 2010. "Eliciting risk preferences: When is simple better?," Journal of Risk and Uncertainty, Springer, vol. 41(3), pages 219-243, December.
    18. Charness, Gary & Gneezy, Uri, 2012. "Strong Evidence for Gender Differences in Risk Taking," Journal of Economic Behavior & Organization, Elsevier, vol. 83(1), pages 50-58.
    19. Ert, Eyal & Haruvy, Ernan, 2017. "Revisiting risk aversion: Can risk preferences change with experience?," Economics Letters, Elsevier, vol. 151(C), pages 91-95.
    20. Miller, Joshua Benjamin & Sanjurjo, Adam, 2018. "Surprised by the Hot Hand Fallacy? A Truth in the Law of Small Numbers," OSF Preprints sv9x2, Center for Open Science.
    21. repec:osf:osfxxx:sv9x2_v1 is not listed on IDEAS
    22. Yaron Azrieli & Christopher P. Chambers & Paul J. Healy, 2018. "Incentives in Experiments: A Theoretical Analysis," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1472-1503.
    23. Jason Delaney & Sarah Jacobson & Thorsten Moenig, 2020. "Preference discovery," Experimental Economics, Springer;Economic Science Association, vol. 23(3), pages 694-715, September.
    24. Andreas Pedroni & Renato Frey & Adrian Bruhin & Gilles Dutilh & Ralph Hertwig & Jörg Rieskamp, 2017. "The risk elicitation puzzle," Nature Human Behaviour, Nature, vol. 1(11), pages 803-809, November.
    25. Robin Cubitt & Chris Starmer & Robert Sugden, 1998. "On the Validity of the Random Lottery Incentive System," Experimental Economics, Springer;Economic Science Association, vol. 1(2), pages 115-131, September.
    26. Joshua B. Miller & Adam Sanjurjo, 2018. "Surprised by the Hot Hand Fallacy? A Truth in the Law of Small Numbers," Econometrica, Econometric Society, vol. 86(6), pages 2019-2047, November.
    27. Georgalos, Konstantinos & Nabil, Nathan, 2025. "Testing models of complexity aversion," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 116(C).
    28. Willadsen, Helene & Zaccagni, Sarah & Piovesan, Marco & Wengström, Erik, 2024. "Measures of cognitive ability and choice inconsistency," Journal of Economic Behavior & Organization, Elsevier, vol. 220(C), pages 495-506.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Caferra, Rocco & Morone, Andrea & Pierno, Donato, 2024. "From Measurements to Measures: Learning Risk Preferences under Different Risk Elicitation Methods," MPRA Paper 121590, University Library of Munich, Germany.
    2. Holzmeister, Felix & Stefan, Matthias, 2019. "The Risk Elicitation Puzzle Revisited: Across-Methods (In)consistency?," OSF Preprints pj9u2, Center for Open Science.
    3. Felix Holzmeister & Matthias Stefan, 2019. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Working Papers 2019-19, Faculty of Economics and Statistics, Universität Innsbruck.
    4. Gary Charness & Nir Chemaya & Dario Trujano-Ochoa, 2023. "Learning your own risk preferences," Journal of Risk and Uncertainty, Springer, vol. 67(1), pages 1-19, August.
    5. repec:osf:osfxxx:pj9u2_v1 is not listed on IDEAS
    6. Felix Holzmeister & Matthias Stefan, 2021. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Experimental Economics, Springer;Economic Science Association, vol. 24(2), pages 593-616, June.
    7. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    8. Fidanoski, Filip & Johnson, Timothy, 2023. "A z-Tree implementation of the Dynamic Experiments for Estimating Preferences [DEEP] method," Journal of Behavioral and Experimental Finance, Elsevier, vol. 38(C).
    9. Michele Garagnani, 2023. "The predictive power of risk elicitation tasks," Journal of Risk and Uncertainty, Springer, vol. 67(2), pages 165-192, October.
    10. Utteeyo Dasgupta & Subha Mani & Smriti Sharma & Saurabh Singhal, 2016. "Eliciting risk preferences: Firefighting in the field," WIDER Working Paper Series wp-2016-47, World Institute for Development Economic Research (UNU-WIDER).
    11. Gary Charness & Thomas Garcia & Theo Offerman & Marie Claire Villeval, 2020. "Do measures of risk attitude in the laboratory predict behavior under risk in and outside of the laboratory?," Journal of Risk and Uncertainty, Springer, vol. 60(2), pages 99-123, April.
    12. Auriol, Emmanuelle & Delissaint, Diego & Fourati, Maleke & Miquel-Florensa, Josepa & Seabright, Paul, 2021. "Betting on the lord: Lotteries and religiosity in Haiti," World Development, Elsevier, vol. 144(C).
    13. Paolo Crosetto & Antonio Filippin, 2013. "A Theoretical and Experimental Appraisal of Five Risk Elicitation Methods," SOEPpapers on Multidisciplinary Panel Data Research 547, DIW Berlin, The German Socio-Economic Panel (SOEP).
    14. Paolo Crosetto & Antonio Filippin, 2016. "A theoretical and experimental appraisal of four risk elicitation methods," Experimental Economics, Springer;Economic Science Association, vol. 19(3), pages 613-641, September.
    15. Catherine Eckel & Rick Wilson & Nanyin Yang, 2025. "The evolution of risk attitudes: A panel study of the university years," Journal of Risk and Uncertainty, Springer, vol. 70(3), pages 225-248, June.
    16. Estepa-Mohedano, Lorenzo & Espinosa, María Paz, 2023. "Comparing risk elicitation in lotteries with visual or contextual aids," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 103(C).
    17. Anwesha Bandyopadhyay & Lutfunnahar Begum & Philip J. Grossman, 2021. "Gender differences in the stability of risk attitudes," Journal of Risk and Uncertainty, Springer, vol. 63(2), pages 169-201, October.
    18. Daniel Montoya Herrera & Marc Willinger, 2025. "Are risk-tolerant individuals more trustful? A representative sample study," Post-Print hal-05234962, HAL.
    19. Dasgupta, Utteeyo & Mani, Subha & Sharma, Smriti & Singhal, Saurabh, 2016. "Eliciting Risk Preferences: Firefighting in the Field," IZA Discussion Papers 9765, Institute of Labor Economics (IZA).
    20. Tamás Csermely & Alexander Rabas, 2016. "How to reveal people’s preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 107-136, December.
    21. Gruner, Sven & Lehberger, Mira & Hirschauer, Norbert & Mußhoff, Oliver, 2022. "How (un)informative are experiments with students for other social groups? A study of agricultural students and farmers," Australian Journal of Agricultural and Resource Economics, Australian Agricultural and Resource Economics Society, vol. 66(03), January.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D81 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Criteria for Decision-Making under Risk and Uncertainty
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceco:v:119:y:2025:i:c:s2214804325001144. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/620175 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.