A Choice Prediction Competition: Choices From Experience and From Description
Erev, Ert, and Roth organized three choice prediction competitions focused on three related choice tasks: one shot decisions from description (decisions under risk), one shot decisions from experience, and repeated decisions from experience. Each competition was based on two experimental datasets: An estimation dataset, and a competition dataset. The studies that generated the two datasets used the same methods and subject pool, and examined decision problems randomly selected from the same distribution. After collecting the experimental data to be used for estimation, the organizers posted them on the Web, together with their fit with several baseline models, and challenged other researchers to compete to predict the results of the second (competition) set of experimental sessions. Fourteen teams responded to the challenge: the last seven authors of this paper are members of the winning teams. The results highlight the robustness of the difference between decisions from description and decisions from experience. The best predictions of decisions from descriptions were obtained with a stochastic variant of prospect theory assuming that the sensitivity to the weighted values decreases with the distance between the cumulative payoff functions. The best predictions of decisions from experience were obtained with models that assume reliance on small samples. Merits and limitations of the competition method are discussed.
|Date of creation:||2009|
|Date of revision:|
|Publication status:||Published in Journal of Behavioral Decision Making|
|Contact details of provider:|| Postal: |
Web page: http://www.economics.harvard.edu/
More information through EDIRC
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Ido Erev & Alvin Roth & Robert Slonim & Greg Barron, 2007. "Learning and equilibrium as useful approximations: Accuracy of prediction on randomly selected constant sum games," Economic Theory, Springer, vol. 33(1), pages 29-51, October.
- Quiggin, John, 1991. "On the Optimal Design of Lotteries," Economica, London School of Economics and Political Science, vol. 58(229), pages 1-16, February.
- AlvinE. Roth, 2008.
"What Have We Learned from Market Design?,"
Royal Economic Society, vol. 118(527), pages 285-310, 03.
- Alvin E. Roth, 2009. "What Have We Learned from Market Design?," NBER Chapters, in: Innovation Policy and the Economy, Volume 9, pages 79-112 National Bureau of Economic Research, Inc.
- Alvin E. Roth, 2008. "What Have We Learned from Market Design?," Innovations: Technology, Governance, Globalization, MIT Press, vol. 3(1), pages 119-147, January.
- Alvin E. Roth, 2009. "What Have We Learned from Market Design?," Innovation Policy and the Economy, University of Chicago Press, vol. 9(1), pages 79 - 112.
- Amos Tversky & Daniel Kahneman, 1979.
"Prospect Theory: An Analysis of Decision under Risk,"
Levine's Working Paper Archive
7656, David K. Levine.
- Kahneman, Daniel & Tversky, Amos, 1979. "Prospect Theory: An Analysis of Decision under Risk," Econometrica, Econometric Society, vol. 47(2), pages 263-91, March.
- Hibon, Michele & Evgeniou, Theodoros, 2005. "To combine or not to combine: selecting among forecasts and their combinations," International Journal of Forecasting, Elsevier, vol. 21(1), pages 15-24.
- Tversky, Amos & Kahneman, Daniel, 1992. " Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- Selten, Reinhard, 1996.
"Axiomatic Characterization of the Quadratic Scoring Rule,"
Discussion Paper Serie B
390, University of Bonn, Germany.
- Reinhard Selten, 1998. "Axiomatic Characterization of the Quadratic Scoring Rule," Experimental Economics, Springer, vol. 1(1), pages 43-61, June.
- Richard P. Larrick & Jack B. Soll, 2006. "Erratum--Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(2), pages 309-310, February.
- Haruvy, Ernan & Erev, Ido & Sonsino, Doron, 2001. " The Medium Prizes Paradox: Evidence from a Simulated Casino," Journal of Risk and Uncertainty, Springer, vol. 22(3), pages 251-61, May.
- Richard P. Larrick & Jack B. Soll, 2006. "Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(1), pages 111-127, January.
- Erev, Ido & Bereby-Meyer, Yoella & Roth, Alvin E., 1999. "The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models," Journal of Economic Behavior & Organization, Elsevier, vol. 39(1), pages 111-128, May.
- Arifovic, Jasmina & McKelvey, Richard D. & Pevnitskaya, Svetlana, 2006. "An initial implementation of the Turing tournament to learning in repeated two-person games," Games and Economic Behavior, Elsevier, vol. 57(1), pages 93-122, October.
- Milton Friedman & L. J. Savage, 1948. "The Utility Analysis of Choices Involving Risk," Journal of Political Economy, University of Chicago Press, vol. 56, pages 279.
When requesting a correction, please mention this item's handle: RePEc:hrv:faseco:5343169. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Ben Steinberg)
If references are entirely missing, you can add them using this form.