IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v59y2013i3p613-640.html
   My bibliography  Save this article

Dynamic Experiments for Estimating Preferences: An Adaptive Method of Eliciting Time and Risk Parameters

Author

Listed:
  • Olivier Toubia

    (Columbia Business School, Columbia University, New York, New York 10027)

  • Eric Johnson

    (Columbia Business School, Columbia University, New York, New York 10027)

  • Theodoros Evgeniou

    (INSEAD, 77305 Fontainebleau, France)

  • Philippe Delquié

    (School of Business, The George Washington University, Washington, DC 20052)

Abstract

We present a method that dynamically designs elicitation questions for estimating risk and time preference parameters. Typically these parameters are elicited by presenting decision makers with a series of static choices between alternatives, gambles, or delayed payments. The proposed method dynamically (i.e., adaptively) designs such choices to optimize the information provided by each choice, while leveraging the distribution of the parameters across decision makers (heterogeneity) and capturing response error. We explore the convergence and the validity of our approach using simulations. The simulations suggest that the proposed method recovers true parameter values well under various circumstances. We then use an online experiment to compare our approach to a standard one used in the literature that requires comparable task completion time. We assess predictive accuracy in an out-of-sample task and completion time for both methods. For risk preferences, our results indicate that the proposed method predicts subjects' willingness to pay for a set of out-of-sample gambles significantly more accurately, while taking respondents about the same time to complete. For time preferences, both methods predict out-of-sample preferences equally well, while the proposed method takes significantly less completion time. For risk and time preferences, average completion time for our approach is approximately three minutes. Finally, we briefly review three applications that used the proposed methodology with various populations, and we discuss the potential benefits of the proposed methodology for research and practice. This paper was accepted by Teck Ho, decision analysis.

Suggested Citation

  • Olivier Toubia & Eric Johnson & Theodoros Evgeniou & Philippe Delquié, 2013. "Dynamic Experiments for Estimating Preferences: An Adaptive Method of Eliciting Time and Risk Parameters," Management Science, INFORMS, vol. 59(3), pages 613-640, June.
  • Handle: RePEc:inm:ormnsc:v:59:y:2013:i:3:p:613-640
    DOI: 10.1287/mnsc.1120.1570
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.1120.1570
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.1120.1570?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Matthew Rabin & Ted O'Donoghue, 1999. "Doing It Now or Later," American Economic Review, American Economic Association, vol. 89(1), pages 103-124, March.
    2. Stephan Meier & Charles Sprenger, 2010. "Present-Biased Preferences and Credit Card Borrowing," American Economic Journal: Applied Economics, American Economic Association, vol. 2(1), pages 193-210, January.
    3. Mohammed Abdellaoui & Han Bleichrodt & Olivier L’Haridon, 2008. "A tractable method to measure utility and loss aversion under prospect theory," Journal of Risk and Uncertainty, Springer, vol. 36(3), pages 245-266, June.
    4. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    5. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    6. Mohammed Abdellaoui & Han Bleichrodt & Corina Paraschiv, 2007. "Loss Aversion Under Prospect Theory: A Parameter-Free Measurement," Management Science, INFORMS, vol. 53(10), pages 1659-1674, October.
    7. Jianying Qiu & Eva-Maria Steiger, 2011. "Understanding the Two Components of Risk Attitudes: An Experimental Analysis," Management Science, INFORMS, vol. 57(1), pages 193-199, January.
    8. Kathryn Blackmond Laskey & Gregory W. Fischer, 1987. "Estimating Utility Functions in the Presence of Response Error," Management Science, INFORMS, vol. 33(8), pages 965-980, August.
    9. Peter E. Rossi & Greg M. Allenby, 2003. "Bayesian Statistics and Marketing," Marketing Science, INFORMS, vol. 22(3), pages 304-328, July.
    10. Daria Dzyabura & John R. Hauser, 2011. "Active Machine Learning for Consideration Heuristics," Marketing Science, INFORMS, vol. 30(5), pages 801-819, September.
    11. Starmer, Chris & Sugden, Robert, 1991. "Does the Random-Lottery Incentive System Elicit True Preferences? An Experimental Investigation," American Economic Review, American Economic Association, vol. 81(4), pages 971-978, September.
    12. Jonathan Levav & Mark Heitmann & Andreas Herrmann & Sheena S. Iyengar, 2010. "Order in Product Customization Decisions: Evidence from Field Experiments," Journal of Political Economy, University of Chicago Press, vol. 118(2), pages 274-299, April.
    13. Olivier Toubia & Duncan I. Simester & John R. Hauser & Ely Dahan, 2003. "Fast Polyhedral Adaptive Conjoint Estimation," Marketing Science, INFORMS, vol. 22(3), pages 273-303.
    14. Glenn W. Harrison & Morten I. Lau & Melonie B. Williams, 2002. "Estimating Individual Discount Rates in Denmark: A Field Experiment," American Economic Review, American Economic Association, vol. 92(5), pages 1606-1617, December.
    15. Peter Wakker & Daniel Deneffe, 1996. "Eliciting von Neumann-Morgenstern Utilities When Probabilities Are Distorted or Unknown," Management Science, INFORMS, vol. 42(8), pages 1131-1150, August.
    16. Richard H. Thaler, 2008. "Mental Accounting and Consumer Choice," Marketing Science, INFORMS, vol. 27(1), pages 15-25, 01-02.
    17. V. Srinivasan & Allan Shocker, 1973. "Estimating the weights for multiple attributes in a composite criterion using pairwise judgments," Psychometrika, Springer;The Psychometric Society, vol. 38(4), pages 473-493, December.
    18. Henry Stott, 2006. "Cumulative prospect theory's functional menagerie," Journal of Risk and Uncertainty, Springer, vol. 32(2), pages 101-130, March.
    19. Tomomi Tanaka & Colin F. Camerer & Quang Nguyen, 2010. "Risk and Time Preferences: Linking Experimental and Household Survey Data from Vietnam," American Economic Review, American Economic Association, vol. 100(1), pages 557-571, March.
    20. Elisabeth Deutskens & Ko de Ruyter & Martin Wetzels & Paul Oosterveld, 2004. "Response Rate and Response Quality of Internet-Based Surveys: An Experimental Study," Marketing Letters, Springer, vol. 15(1), pages 21-36, February.
    21. Nava Ashraf & Dean Karlan & Wesley Yin, 2006. "Tying Odysseus to the Mast: Evidence From a Commitment Savings Product in the Philippines," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(2), pages 635-672.
    22. E. S. Phelps & R. A. Pollak, 1968. "On Second-Best National Saving and Game-Equilibrium Growth," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 35(2), pages 185-199.
    23. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    24. Zauberman, Gal, 2003. "The Intertemporal Dynamics of Consumer Lock-In," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 30(3), pages 405-419, December.
    25. Theodoros Evgeniou & Massimiliano Pontil & Olivier Toubia, 2007. "A Convex Optimization Approach to Modeling Consumer Heterogeneity in Conjoint Estimation," Marketing Science, INFORMS, vol. 26(6), pages 805-818, 11-12.
    26. Manel Baucells & Franz H. Heukamp, 2012. "Probability and Time Trade-Off," Management Science, INFORMS, vol. 58(4), pages 831-842, April.
    27. Quang Nguyen & Colin Camerer & Tomomi Tanaka, 2010. "Risk and Time Preferences Linking Experimental and Household Data from Vietnam," Post-Print halshs-00547090, HAL.
    28. Adrian Bruhin & Helga Fehr-Duda & Thomas Epper, 2010. "Risk and Rationality: Uncovering Heterogeneity in Probability Distortion," Econometrica, Econometric Society, vol. 78(4), pages 1375-1412, July.
    29. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    30. George Wu & Richard Gonzalez, 1996. "Curvature of the Probability Weighting Function," Management Science, INFORMS, vol. 42(12), pages 1676-1690, December.
    31. Shane Frederick & George Loewenstein & Ted O'Donoghue, 2002. "Time Discounting and Time Preference: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 351-401, June.
    32. George-Marios Angeletos, 2001. "The Hyberbolic Consumption Model: Calibration, Simulation, and Empirical Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 15(3), pages 47-68, Summer.
    33. Jane E. J. Ebert & Drazen Prelec, 2007. "The Fragility of Time: Time-Insensitivity and Valuation of the Near and Far Future," Management Science, INFORMS, vol. 53(9), pages 1423-1438, September.
    34. Lowenstein, George & Prelec, Drazen, 1991. "Negative Time Preference," American Economic Review, American Economic Association, vol. 81(2), pages 347-352, May.
    35. Benhabib, Jess & Bisin, Alberto & Schotter, Andrew, 2010. "Present-bias, quasi-hyperbolic discounting, and fixed costs," Games and Economic Behavior, Elsevier, vol. 69(2), pages 205-223, July.
    36. repec:lmu:muenar:20868 is not listed on IDEAS
    37. Olivier Toubia & John Hauser & Rosanna Garcia, 2007. "Probabilistic Polyhedral Methods for Adaptive Choice-Based Conjoint Analysis: Theory and Application," Marketing Science, INFORMS, vol. 26(5), pages 596-610, 09-10.
    38. Nicholas Barberis & Ming Huang & Tano Santos, 2001. "Prospect Theory and Asset Prices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 116(1), pages 1-53.
    39. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 443-478.
    40. Peter Jarnebrant & Olivier Toubia & Eric Johnson, 2009. "The Silver Lining Effect: Formal Analysis and Experiments," Management Science, INFORMS, vol. 55(11), pages 1832-1841, November.
    41. Peter J. Lenk & Wayne S. DeSarbo & Paul E. Green & Martin R. Young, 1996. "Hierarchical Bayes Conjoint Analysis: Recovery of Partworth Heterogeneity from Reduced Experimental Designs," Marketing Science, INFORMS, vol. 15(2), pages 173-191.
    42. Harrison, Glenn W., 1986. "An experimental test for risk aversion," Economics Letters, Elsevier, vol. 21(1), pages 7-11.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohammed Abdellaoui & Han Bleichrodt & Olivier l’Haridon, 2013. "Sign-dependence in intertemporal choice," Journal of Risk and Uncertainty, Springer, vol. 47(3), pages 225-253, December.
    2. Kpegli, Yao Thibaut & Corgnet, Brice & Zylbersztejn, Adam, 2023. "All at once! A comprehensive and tractable semi-parametric method to elicit prospect theory components," Journal of Mathematical Economics, Elsevier, vol. 104(C).
    3. Stefano DellaVigna, 2009. "Psychology and Economics: Evidence from the Field," Journal of Economic Literature, American Economic Association, vol. 47(2), pages 315-372, June.
    4. Jakusch, Sven Thorsten & Meyer, Steffen & Hackethal, Andreas, 2019. "Taming models of prospect theory in the wild? Estimation of Vlcek and Hens (2011)," SAFE Working Paper Series 146, Leibniz Institute for Financial Research SAFE, revised 2019.
    5. Arthur E. Attema & Han Bleichrodt & Olivier L’Haridon & Patrick Peretti-Watel & Valérie Seror, 2018. "Discounting health and money: New evidence using a more robust method," Journal of Risk and Uncertainty, Springer, vol. 56(2), pages 117-140, April.
    6. Mark Schneider, 2016. "Dual Process Utility Theory: A Model of Decisions Under Risk and Over Time," Working Papers 16-23, Chapman University, Economic Science Institute.
    7. Lucy F. Ackert & Richard Deaves & Jennifer Miele & Quang Nguyen, 2020. "Are Time Preference and Risk Preference Associated with Cognitive Intelligence and Emotional Intelligence?," Journal of Behavioral Finance, Taylor & Francis Journals, vol. 21(2), pages 136-156, April.
    8. Eduard Marinov, 2017. "The 2017 Nobel Prize in Economics," Economic Thought journal, Bulgarian Academy of Sciences - Economic Research Institute, issue 6, pages 117-159.
    9. Committee, Nobel Prize, 2017. "Richard H. Thaler: Integrating Economics with Psychology," Nobel Prize in Economics documents 2017-1, Nobel Prize Committee.
    10. Thomas Epper & Helga Fehr-Duda, 2012. "The missing link: unifying risk taking and time discounting," ECON - Working Papers 096, Department of Economics - University of Zurich, revised Oct 2018.
    11. Jinrui Pan & Craig S. Webb & Horst Zank, 2019. "Delayed probabilistic risk attitude: a parametric approach," Theory and Decision, Springer, vol. 87(2), pages 201-232, September.
    12. Jakusch, Sven Thorsten, 2017. "On the applicability of maximum likelihood methods: From experimental to financial data," SAFE Working Paper Series 148, Leibniz Institute for Financial Research SAFE, revised 2017.
    13. Heutel, Garth, 2019. "Prospect theory and energy efficiency," Journal of Environmental Economics and Management, Elsevier, vol. 96(C), pages 236-254.
    14. Julia Ihli, Hanna & Chiputwa, Brian & Winter, Etti & Gassner, Anja, 2022. "Risk and time preferences for participating in forest landscape restoration: The case of coffee farmers in Uganda," World Development, Elsevier, vol. 150(C).
    15. Hammond, Peter J & Zank, Horst, 2013. "Rationality and Dynamic Consistency under Risk and Uncertainty," The Warwick Economics Research Paper Series (TWERPS) 1033, University of Warwick, Department of Economics.
    16. Dániel Horn & Hubert János Kiss, 2020. "Time preferences and their life outcome correlates: Evidence from a representative survey," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-26, July.
    17. Adam Booij & Bernard Praag & Gijs Kuilen, 2010. "A parametric analysis of prospect theory’s functionals for the general population," Theory and Decision, Springer, vol. 68(1), pages 115-148, February.
    18. Kemel, Emmanuel & Paraschiv, Corina, 2013. "Prospect Theory for joint time and money consequences in risk and ambiguity," Transportation Research Part B: Methodological, Elsevier, vol. 56(C), pages 81-95.
    19. Kairies-Schwarz, Nadja & Kokot, Johanna & Vomhof, Markus & Weßling, Jens, 2017. "Health insurance choice and risk preferences under cumulative prospect theory – an experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 137(C), pages 374-397.
    20. Sebastian Schweighofer-Kodritsch, 2015. "Time Preferences and Bargaining," STICERD - Theoretical Economics Paper Series /2015/568, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:59:y:2013:i:3:p:613-640. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.