IDEAS home Printed from
MyIDEAS: Log in (now much improved!) to save this paper

Selection and Mode Effects in Risk Preference Elicitation Experiments

  • von Gaudecker, Martin


    (Free University Amsterdam)

  • van Soest, Arthur


    (Tilburg University)

  • Wengström, Erik


    (University of Copenhagen)

We combine data from a risk preference elicitation experiment conducted on a representative sample via the Internet with laboratory data on students for the same experiment to investigate effects of implementation mode and of subject pool selection. We find that the frequency of errors in the lab experiment ist drastically below that of the representative sample in the Internet experiment, and average risk aversion is also lower. Considering the student-like subsample of the Internet subjects and comparing a tradtitional lab design with an Internet-like design in the lab gives two ways to decompose these differences into differences due to subject pool selection and differences due to implementation mode. Both lead to the conclusion that the differences are due to selection and not implementation mode. An analysis of the various steps leading to participation or non-participation in the Internet survey shows that these processes are selective in selecting subjects who make fewer errors, but do not lead to biased conclusions on risk preferences. These findings point a the usefulness of the Internet survey as an alternative to a student pool in the laboratory if the ambition is to use the experiments to draw inference on a broad population.

To our knowledge, this item is not available for download. To find whether it is available, there are three options:
1. Check below under "Related research" whether another version of this item is available online.
2. Check on the provider's web page whether it is in fact available.
3. Perform a search for a similarly titled item that would be available.

Paper provided by Sonderforschungsbereich 504, Universität Mannheim & Sonderforschungsbereich 504, University of Mannheim in its series Sonderforschungsbereich 504 Publications with number 08-46.

in new window

Length: 29 pages
Date of creation: 02 Feb 2008
Date of revision:
Handle: RePEc:xrs:sfbmaa:08-46
Note: Financial support from the Deutsche Forschungsgemeinschaft, SFB 504, at the University of Mannheim, is gratefully acknowledged by Hans-Martin von Gaudecker.
Contact details of provider: Postal:
D-68131 Mannheim

Phone: (49) (0) 621-292-2547
Fax: (49) (0) 621-292-5594
Web page:

More information through EDIRC

Web page:

Order Information: Email:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

as in new window
  1. Charles Bellemare & Sabine Kröger & Arthur van Soest, 2008. "Measuring Inequity Aversion in a Heterogeneous Population Using Experimental Decisions and Subjective Probabilities," Econometrica, Econometric Society, vol. 76(4), pages 815-839, 07.
  2. von Gaudecker, H.M. & van Soest, A.H.O. & Wengstrom, E., 2009. "Heterogeneity in Risky Choice Behavior in a Broad Population," Discussion Paper 2009-12, Tilburg University, Center for Economic Research.
  3. Syngjoo Choi & Shachar Kariv & Wieland Mueller & Dan Silverman, 2011. "Who Is (More) Rational?," Vienna Economics Papers 1105, University of Vienna, Department of Economics.
  4. Loomes, Graham & Moffatt, Peter G & Sugden, Robert, 2002. "A Microeconometric Test of Alternative Stochastic Theories of Risky Choice," Journal of Risk and Uncertainty, Springer, vol. 24(2), pages 103-30, March.
  5. Glenn W Harrison & John A List & Charles Towe, 2007. "Naturally Occurring Preferences and Exogenous Laboratory Experiments: A Case Study of Risk Aversion," Econometrica, Econometric Society, vol. 75(2), pages 433-458, 03.
  6. Armin Falk & David Huffman & Gert Wagner & Jurgen Schupp & Thomas Dohmen & Uwe Sunde, 2005. "Individual risk attitudes: New evidence from a large, representative, experimentally-validated survey," Framed Field Experiments 00140, The Field Experiments Website.
  7. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency, Heterogeneity, and Granularity of Individual Behavior under Uncertainty," Levine's Bibliography 321307000000000793, UCLA Department of Economics.
  8. Thomas Dohmen & Armin Falk & David Huffman & Uwe Sunde & Jürgen Schupp & Gert G. Wagner, 2011. "Individual Risk Attitudes: Measurement, Determinants, And Behavioral Consequences," Journal of the European Economic Association, European Economic Association, vol. 9(3), pages 522-550, 06.
  9. David Revelt and Kenneth Train., 2000. "Customer-Specific Taste Parameters and Mixed Logit: Households' Choice of Electricity Supplier," Economics Working Papers E00-274, University of California at Berkeley.
  10. Charles A. Holt & Susan K. Laury, 2002. "Risk Aversion and Incentive Effects," American Economic Review, American Economic Association, vol. 92(5), pages 1644-1655, December.
  11. Charles Bellemare & Sabine Kroger, 2005. "On Representative Social Capital," Cahiers de recherche 0504, CIRPEE.
  12. Glenn W. Harrison & John A. List, 2007. "Naturally Occurring Markets and Exogenous Laboratory Experiments: A Case Study of the Winner's Curse," NBER Working Papers 13072, National Bureau of Economic Research, Inc.
  13. Elisabet Rutstrom & Glenn Harrison & Melonie Williams & Morten Lau, 2002. "Estimating individual discount rates in denmark: A field experiment," Artefactual Field Experiments 00062, The Field Experiments Website.
  14. Fehr, Ernst & Fischbacher, Urs & Schupp, Jürgen & von Rosenbladt, Bernhard & Wagner, Gert Georg, 2003. "A Nationwide Laboratory Examining Trust and Trustworthiness by Integrating Behavioural Experiments into Representative Surveys," CEPR Discussion Papers 3858, C.E.P.R. Discussion Papers.
  15. Brigitte C. Madrian & Dennis F. Shea, 2001. "The Power of Suggestion: Inertia in 401(k) Participation and Savings Behavior," The Quarterly Journal of Economics, Oxford University Press, vol. 116(4), pages 1149-1187.
  16. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
  17. Alessie, Rob & Hochguertel, Stefan & van Soest, Arthur, 2006. "Non-take-up of tax-favored savings plans: Evidence from Dutch employees," Journal of Economic Psychology, Elsevier, vol. 27(4), pages 483-501, August.
  18. Shlomo Benartzi & Richard H. Thaler, 1995. "Myopic Loss Aversion and the Equity Premium Puzzle," The Quarterly Journal of Economics, Oxford University Press, vol. 110(1), pages 73-92.
  19. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency and Heterogeneity of Individual Behavior under Uncertainty," American Economic Review, American Economic Association, vol. 97(5), pages 1921-1938, December.
  20. Hans-Martin Gaudecker & Arthur Soest & Erik Wengström, 2012. "Experts in experiments," Journal of Risk and Uncertainty, Springer, vol. 45(2), pages 159-190, October.
  21. Carsten Schmidt & Matthias Sutter & Werner Guth, 2002. "Bargaining outside the lab - a newspaper experiment of a three person-ultimatum game," Artefactual Field Experiments 00050, The Field Experiments Website.
  22. Glenn Harrison & John List, 2004. "Field experiments," Artefactual Field Experiments 00058, The Field Experiments Website.
  23. Hey, John D & Orme, Chris, 1994. "Investigating Generalizations of Expected Utility Theory Using Experimental Data," Econometrica, Econometric Society, vol. 62(6), pages 1291-1326, November.
  24. James J. Heckman, 1976. "The Common Structure of Statistical Models of Truncation, Sample Selection and Limited Dependent Variables and a Simple Estimator for Such Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, pages 475-492 National Bureau of Economic Research, Inc.
  25. Kahneman, Daniel & Tversky, Amos, 1979. "Prospect Theory: An Analysis of Decision under Risk," Econometrica, Econometric Society, vol. 47(2), pages 263-91, March.
  26. Lisa R. Anderson & Jennifer M. Mellor, 2008. "Are Risk Preferences Stable? Comparing an Experimental Measure with a Validated Survey-Based Measure," Working Papers 74, Department of Economics, College of William and Mary.
  27. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
  28. David Lucking-Reiley, 1999. "Using field experiments to test equivalence between auction formats: Magic on the internet," Framed Field Experiments 00183, The Field Experiments Website.
  29. Gaudecker, Hans-Martin von & Soest, Arthur van & Wengström, Erik, 2008. "Selection and mode effects in risk preference elicitation experiments," Papers 08-46, Sonderforschungsbreich 504.
  30. David M Kreps & Evan L Porteus, 1978. "Temporal Resolution of Uncertainty and Dynamic Choice Theory," Levine's Working Paper Archive 625018000000000009, David K. Levine.
  31. Elisabet Rutstrom & Glenn Harrison & Morten Lau & Steffen Andersen, 2004. "Preference heterogeneity in experiments: Comparing the field and lab," Artefactual Field Experiments 00004, The Field Experiments Website.
  32. Graham Loomes, 2005. "Modelling the Stochastic Component of Behaviour in Experiments: Some Issues for the Interpretation of Data," Experimental Economics, Springer;Economic Science Association, vol. 8(4), pages 301-323, December.
  33. Ernst Fehr & Urs Fischbacher & Bernhard von Rosenbladt & Jürgen Schupp & Gert G. Wagner, 2003. "A Nation-Wide Laboratory. Examining Trust and Trustworthiness by Integrating Behavioral Experiments into Representative Survey," CESifo Working Paper Series 866, CESifo Group Munich.
  34. Falk, Armin & Heckman, James J, 2010. "Lab Experiments are a Major Source of Knowledge in the Social Sciences," CEPR Discussion Papers 7620, C.E.P.R. Discussion Papers.
  35. Han Bleichrodt & Jose Luis Pinto & Peter P. Wakker, 2001. "Making Descriptive Use of Prospect Theory to Improve the Prescriptive Use of Expected Utility," Management Science, INFORMS, vol. 47(11), pages 1498-1514, November.
  36. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, 05.
  37. Elisabet Rutstrom & Glenn Harrison & Morten Lau, 2005. "Risk attitudes, randomization to treatment, and self-selection into experiments," Artefactual Field Experiments 00061, The Field Experiments Website.
  38. Harless, David W & Camerer, Colin F, 1994. "The Predictive Utility of Generalized Expected Utility Theories," Econometrica, Econometric Society, vol. 62(6), pages 1251-89, November.
  39. Chetan Dave & Catherine Eckel & Cathleen Johnson & Christian Rojas, 2010. "Eliciting risk preferences: When is simple better?," Journal of Risk and Uncertainty, Springer, vol. 41(3), pages 219-243, December.
  40. Donkers, Bas & Melenberg, Bertrand & Van Soest, Arthur, 2001. "Estimating Risk Attitudes Using Lotteries: A Large Sample Approach," Journal of Risk and Uncertainty, Springer, vol. 22(2), pages 165-95, March.
  41. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Publishing House "SINERGIA PRESS", vol. 31(3), pages 129-137.
  42. Steffen Andersen & Glenn W. Harrison & Morten Igel Lau & E. Elisabet Rutström, 2009. "Preference Heterogeneity in Experiments: Comparing the Field and Laboratory," Post-Print hal-00736951, HAL.
  43. Steffen Andersen & Glenn Harrison & Morten Lau & E. Rutström, 2009. "Elicitation using multiple price list formats," Experimental Economics, Springer;Economic Science Association, vol. 12(3), pages 365-366, September.
  44. Sarah Jacobson & Ragan Petrie, 2009. "Learning from mistakes: What do inconsistent choices over risk tell us?," Journal of Risk and Uncertainty, Springer, vol. 38(2), pages 143-158, April.
  45. Nicolas de Roos & Yianis Sarafidis, 2010. "Decision making under risk in Deal or No Deal," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(6), pages 987-1027.
  46. Hey, John D., 1995. "Experimental investigations of errors in decision making under risk," European Economic Review, Elsevier, vol. 39(3-4), pages 633-640, April.
  47. Heckman, James J, 1974. "Shadow Prices, Market Wages, and Labor Supply," Econometrica, Econometric Society, vol. 42(4), pages 679-94, July.
  48. Hans Binswanger, 1980. "Attitudes toward risk: Experimental measurement in rural india," Artefactual Field Experiments 00009, The Field Experiments Website.
  49. Pavlo Blavatskyy, 2009. "Betting on own knowledge: Experimental test of overconfidence," Journal of Risk and Uncertainty, Springer, vol. 38(1), pages 39-49, February.
  50. Ulrich Schmidt & Tibor Neugebauer, 2007. "Testing expected utility in the presence of errors," Economic Journal, Royal Economic Society, vol. 117(518), pages 470-485, 03.
  51. Tomomi Tanaka & Colin F. Camerer & Quang Nguyen, 2010. "Risk and Time Preferences: Linking Experimental and Household Survey Data from Vietnam," American Economic Review, American Economic Association, vol. 100(1), pages 557-71, March.
  52. Kobberling, Veronika & Wakker, Peter P., 2005. "An index of loss aversion," Journal of Economic Theory, Elsevier, vol. 122(1), pages 119-131, May.
  53. Steffen Huck & Wieland Müller, 2012. "Allais for all: Revisiting the paradox in a large representative sample," Journal of Risk and Uncertainty, Springer, vol. 44(3), pages 261-293, June.
  54. Chris Starmer, 2000. "Developments in Non-expected Utility Theory: The Hunt for a Descriptive Theory of Choice under Risk," Journal of Economic Literature, American Economic Association, vol. 38(2), pages 332-382, June.
  55. Keith Coble & Jayson Lusk, 2010. "At the nexus of risk and time preferences: An experimental investigation," Journal of Risk and Uncertainty, Springer, vol. 41(1), pages 67-79, August.
  56. repec:feb:framed:0074 is not listed on IDEAS
Full references (including those not matched with items on IDEAS)

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

When requesting a correction, please mention this item's handle: RePEc:xrs:sfbmaa:08-46. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Carsten Schmidt)

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.

This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.