IDEAS home Printed from https://ideas.repec.org/p/cwm/wpaper/74.html
   My bibliography  Save this paper

Are Risk Preferences Stable? Comparing an Experimental Measure with a Validated Survey-Based Measure

Author

Listed:
  • Lisa R. Anderson

    () (Department of Economics, College of William and Mary)

  • Jennifer M. Mellor

    () (Department of Economics, College of William and Mary)

Abstract

We examine the stability of risk preference within subjects by comparing measures obtained from two elicitation methods, an economics experiment with real monetary rewards and a survey with questions on hypothetical gambles. The survey questions have been validated by numerous empirical studies of investment, insurance demand, smoking and alcohol use, and recent studies have shown the experimental measure is associated with several real-world risky behaviors. For the majority of subjects, we find that risk preferences are not stable across elicitation methods. In interval regression models, subjects’ risk preference classifications from survey questions on job-based gambles are not associated with risk preference estimates from the experiment. However, we find that risk classifications from inheritance-based gambles are significantly associated with the experimental measure. We identify some subjects for whom risk preference estimates are more strongly correlated across elicitation methods, suggesting that unobserved subject traits like comprehension or effort influence risk preference stability.

Suggested Citation

  • Lisa R. Anderson & Jennifer M. Mellor, 2008. "Are Risk Preferences Stable? Comparing an Experimental Measure with a Validated Survey-Based Measure," Working Papers 74, Department of Economics, College of William and Mary.
  • Handle: RePEc:cwm:wpaper:74
    as

    Download full text from publisher

    File URL: http://economics.wm.edu/wp/cwm_wp74.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. Catherine C. Eckel & Philip J. Grossman, 2002. "Sex Differences and Statistical Stereotyping in Attitudes Toward Financial Risk," Monash Economics Working Papers archive-03, Monash University, Department of Economics.
    2. John Hey & Andrea Morone & Ulrich Schmidt, 2009. "Noise and bias in eliciting preferences," Journal of Risk and Uncertainty, Springer, vol. 39(3), pages 213-235, December.
    3. Robert B. Barsky & Miles S. Kimball & F. Thomas Juster & Matthew D. Shapiro, 1995. "Preference Parameters and Behavioral Heterogeneity: An Experimental Approach in the Health and Retirement Survey," NBER Working Papers 5213, National Bureau of Economic Research, Inc.
    4. repec:feb:framed:0074 is not listed on IDEAS
    5. Claudia R. Sahm, 2012. "How Much Does Risk Tolerance Change?," Quarterly Journal of Finance (QJF), World Scientific Publishing Co. Pte. Ltd., vol. 2(04), pages 1-38.
    6. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
    7. Glenn W. Harrison & Eric Johnson & Melayne M. McInnes & E. Elisabet Rutström, 2005. "Temporal stability of estimates of risk aversion," Applied Financial Economics Letters, Taylor and Francis Journals, vol. 1(1), pages 31-35, January.
    8. Jayson L. Lusk & Keith H. Coble, 2005. "Risk Perceptions, Risk Preference, and Acceptance of Risky Food," American Journal of Agricultural Economics, Agricultural and Applied Economics Association, vol. 87(2), pages 393-405.
    9. Anderson, Lisa R. & Mellor, Jennifer M., 2008. "Predicting health behaviors with an experimental measure of risk preference," Journal of Health Economics, Elsevier, vol. 27(5), pages 1260-1274, September.
    10. Camerer, Colin F & Hogarth, Robin M, 1999. "The Effects of Financial Incentives in Experiments: A Review and Capital-Labor-Production Framework," Journal of Risk and Uncertainty, Springer, vol. 19(1-3), pages 7-42, December.
    11. Eckel, Catherine C. & Grossman, Philip J., 2008. "Men, Women and Risk Aversion: Experimental Evidence," Handbook of Experimental Economics Results, in: Charles R. Plott & Vernon L. Smith (ed.),Handbook of Experimental Economics Results, edition 1, volume 1, chapter 113, pages 1061-1073, Elsevier.
    12. von Gaudecker, H.M. & van Soest, A.H.O. & Wengstrom, E., 2008. "Selection and Mode Effects in Risk Preference Elicitation Experiments," Other publications TiSEM 35714555-f654-4522-bcb1-b, Tilburg University, School of Economics and Management.
    13. Kimball, Miles S & Sahm, Claudia R & Shapiro, Matthew D, 2008. "Imputing Risk Tolerance From Survey Responses," Journal of the American Statistical Association, American Statistical Association, vol. 103(483), pages 1028-1038.
    14. Sloan, Frank A & Norton, Edward C, 1997. "Adverse Selection, Bequests, Crowding Out, and Private Demand for Insurance: Evidence from the Long-Term Care Insurance Market," Journal of Risk and Uncertainty, Springer, vol. 15(3), pages 201-219, December.
    15. Rosen, H.S.Harvey S. & Wu, Stephen, 2004. "Portfolio choice and health status," Journal of Financial Economics, Elsevier, vol. 72(3), pages 457-484, June.
    16. Dhaval Dave & Henry Saffer, 2007. "Risk Tolerance and Alcohol Demand Among Adults and Older Adults," NBER Working Papers 13482, National Bureau of Economic Research, Inc.
    17. Kerwin Kofi Charles & Erik Hurst, 2003. "The Correlation of Wealth across Generations," Journal of Political Economy, University of Chicago Press, vol. 111(6), pages 1155-1182, December.
    18. Robert B. Barsky & F. Thomas Juster & Miles S. Kimball & Matthew D. Shapiro, 1997. "Preference Parameters and Behavioral Heterogeneity: An Experimental Approach in the Health and Retirement Study," The Quarterly Journal of Economics, Oxford University Press, vol. 112(2), pages 537-579.
    19. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Juergen Schupp & Gert Wagner, 2005. "Individual Risk Attitudes: New Evidence from a Large, Representative, Experimentally-Validated Survey," Working Papers 2096, The Field Experiments Website.
    20. Isaac, R Mark & James, Duncan, 2000. "Just Who Are You Calling Risk Averse?," Journal of Risk and Uncertainty, Springer, vol. 20(2), pages 177-187, March.
    21. Sarah Brown & Karl Taylor, 2006. "Education, Risk Preference and Wages," Working Papers 2006002, The University of Sheffield, Department of Economics, revised Feb 2006.
    22. Gabriel Picone & Frank Sloan & Donald Taylor, 2004. "Effects of Risk and Time Preference and Expected Longevity on Demand for Medical Tests," Journal of Risk and Uncertainty, Springer, vol. 28(1), pages 39-53, January.
    23. Norton, Edward C., 2000. "Long-term care," Handbook of Health Economics, in: A. J. Culyer & J. P. Newhouse (ed.),Handbook of Health Economics, edition 1, volume 1, chapter 17, pages 955-994, Elsevier.
    24. Lucie Schmidt, 2008. "Risk preferences and the timing of marriage and childbearing," Demography, Springer;Population Association of America (PAA), vol. 45(2), pages 439-460, May.
    25. Duncan James, 2007. "Stability of risk preference parameter estimates within the Becker-DeGroot-Marschak procedure," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 123-141, June.
    26. Glenn W Harrison & John A List & Charles Towe, 2007. "Naturally Occurring Preferences and Exogenous Laboratory Experiments: A Case Study of Risk Aversion," Econometrica, Econometric Society, vol. 75(2), pages 433-458, March.
    27. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
    28. Steffen Andersen & Glenn Harrison & Morten Lau & E. Rutström, 2009. "Elicitation using multiple price list formats," Experimental Economics, Springer;Economic Science Association, vol. 12(3), pages 365-366, September.
    29. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Lost In State Space: Are Preferences Stable?," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 49(3), pages 1091-1112, August.
    30. Julie R. Agnew & Lisa R. Anderson & Jeffrey R. Gerlach & Lisa R. Szykman, 2008. "Who Chooses Annuities? An Experimental Investigation of the Role of Gender, Framing, and Defaults," American Economic Review, American Economic Association, vol. 98(2), pages 418-422, May.
    31. Kan, Kamhon, 2003. "Residential mobility and job changes under uncertainty," Journal of Urban Economics, Elsevier, vol. 54(3), pages 566-586, November.
    32. Kajal Lahiri & Jae G. Song, 2000. "The effect of smoking on health using a sequential self‐selection model," Health Economics, John Wiley & Sons, Ltd., vol. 9(6), pages 491-511, September.
    33. Kruse, Jamie Brown & Thompson, Mark A., 2003. "Valuing low probability risk: survey and experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 50(4), pages 495-505, April.
    34. Lusardi, Annamaria, 1998. "On the Importance of the Precautionary Saving Motive," American Economic Review, American Economic Association, vol. 88(2), pages 449-453, May.
    35. Chetan Dave & Catherine Eckel & Cathleen Johnson & Christian Rojas, 2010. "Eliciting risk preferences: When is simple better?," Journal of Risk and Uncertainty, Springer, vol. 41(3), pages 219-243, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Anderson, Lisa R. & Mellor, Jennifer M., 2008. "Predicting health behaviors with an experimental measure of risk preference," Journal of Health Economics, Elsevier, vol. 27(5), pages 1260-1274, September.
    2. Tamás Csermely & Alexander Rabas, 2016. "How to reveal people’s preferences: Comparing time consistency and predictive power of multiple price list risk elicitation methods," Journal of Risk and Uncertainty, Springer, vol. 53(2), pages 107-136, December.
    3. Stefan Zeisberger & Dennis Vrecko & Thomas Langer, 2012. "Measuring the time stability of Prospect Theory preferences," Theory and Decision, Springer, vol. 72(3), pages 359-386, March.
    4. Holzmeister, Felix & Stefan, Matthias, 2019. "The Risk Elicitation Puzzle Revisited: Across-Methods (In)consistency?," OSF Preprints pj9u2, Center for Open Science.
    5. Felix Holzmeister & Matthias Stefan, 2019. "The risk elicitation puzzle revisited: Across-methods (in)consistency?," Working Papers 2019-19, Faculty of Economics and Statistics, University of Innsbruck.
    6. Menkhoff, Lukas & Sakha, Sahra, 2017. "Estimating risky behavior with multiple-item risk measures," Journal of Economic Psychology, Elsevier, vol. 59(C), pages 59-86.
    7. Galizzi, Matteo M. & Machado, Sara R. & Miniaci, Raffaele, 2016. "Temporal stability, cross-validity, and external validity of risk preferences measures: experimental evidence from a UK representative sample," LSE Research Online Documents on Economics 67554, London School of Economics and Political Science, LSE Library.
    8. Antonio Filippin & Paolo Crosetto, 2016. "A Reconsideration of Gender Differences in Risk Attitudes," Management Science, INFORMS, vol. 62(11), pages 3138-3160, November.
    9. Menkhoff, Lukas & Sakha, Sahra, 2014. "Multiple-item risk measures," Kiel Working Papers 1980, Kiel Institute for the World Economy (IfW).
    10. Antonio FILIPPIN & Paolo CROSETTO, 2014. "A Reconsideration of Gender Differences in Risk Attitudes," Departmental Working Papers 2014-01, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    11. Goldzahl, Léontine, 2017. "Contributions of risk preference, time orientation and perceptions to breast cancer screening regularity," Social Science & Medicine, Elsevier, vol. 185(C), pages 147-157.
    12. Fossen, Frank M. & Glocker, Daniela, 2017. "Stated and revealed heterogeneous risk preferences in educational choice," European Economic Review, Elsevier, vol. 97(C), pages 1-25.
    13. Paolo Crosetto & Antonio Filippin, 2016. "A theoretical and experimental appraisal of four risk elicitation methods," Experimental Economics, Springer;Economic Science Association, vol. 19(3), pages 613-641, September.
    14. Adam Booij & Bernard Praag & Gijs Kuilen, 2010. "A parametric analysis of prospect theory’s functionals for the general population," Theory and Decision, Springer, vol. 68(1), pages 115-148, February.
    15. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
    16. Zafer Akýn & Ý. Erdem Seçilmiþ, 2015. "Risk Behavior, Risk Perception and Online Shopping: An Experimental Approach," IPEK Working Papers 1507, Ipek University, Department of Economics, revised Sep 2015.
    17. Roland Olbrich & Martin F. Quaas & Andreas Haensler & Stefan Baumgaertner, 2011. "Risk preferences under heterogeneous environmental risk," Working Paper Series in Economics 208, University of Lüneburg, Institute of Economics.
    18. Jonathan P. Beauchamp & David Cesarini & Magnus Johannesson, 2017. "The psychometric and empirical properties of measures of risk preferences," Journal of Risk and Uncertainty, Springer, vol. 54(3), pages 203-237, June.
    19. Sophie Massin & Antoine Nebout & Bruno Ventelou, 2018. "Predicting medical practices using various risk attitude measures," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 19(6), pages 843-860, July.
    20. Alejandro Arrieta & Ariadna García‐Prado & Paula González & José Luis Pinto‐Prades, 2017. "Risk attitudes in medical decisions for others: An experimental approach," Health Economics, John Wiley & Sons, Ltd., vol. 26(S3), pages 97-113, December.

    More about this item

    Keywords

    Risk Preferences; Laboratory Experiment; Survey;
    All these keywords.

    JEL classification:

    • C9 - Mathematical and Quantitative Methods - - Design of Experiments
    • D8 - Microeconomics - - Information, Knowledge, and Uncertainty

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwm:wpaper:74. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Daifeng He) The email address of this maintainer does not seem to be valid anymore. Please ask Daifeng He to update the entry or send us the correct email address or (Alfredo Pereira). General contact details of provider: http://edirc.repec.org/data/decwmus.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.