A Choice Prediction Competition: Choices From Experience and From Description
AbstractErev, Ert, and Roth organized three choice prediction competitions focused on three related choice tasks: one shot decisions from description (decisions under risk), one shot decisions from experience, and repeated decisions from experience. Each competition was based on two experimental datasets: An estimation dataset, and a competition dataset. The studies that generated the two datasets used the same methods and subject pool, and examined decision problems randomly selected from the same distribution. After collecting the experimental data to be used for estimation, the organizers posted them on the Web, together with their fit with several baseline models, and challenged other researchers to compete to predict the results of the second (competition) set of experimental sessions. Fourteen teams responded to the challenge: the last seven authors of this paper are members of the winning teams. The results highlight the robustness of the difference between decisions from description and decisions from experience. The best predictions of decisions from descriptions were obtained with a stochastic variant of prospect theory assuming that the sensitivity to the weighted values decreases with the distance between the cumulative payoff functions. The best predictions of decisions from experience were obtained with models that assume reliance on small samples. Merits and limitations of the competition method are discussed.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Harvard University Department of Economics in its series Scholarly Articles with number 5343169.
Date of creation: 2009
Date of revision:
Publication status: Published in Journal of Behavioral Decision Making
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Milton Friedman & L. J. Savage, 1948. "The Utility Analysis of Choices Involving Risk," Journal of Political Economy, University of Chicago Press, vol. 56, pages 279.
- Richard P. Larrick & Jack B. Soll, 2006. "Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(1), pages 111-127, January.
- Quiggin, John, 1991. "On the Optimal Design of Lotteries," Economica, London School of Economics and Political Science, vol. 58(229), pages 1-16, February.
- Haruvy, Ernan & Erev, Ido & Sonsino, Doron, 2001. " The Medium Prizes Paradox: Evidence from a Simulated Casino," Journal of Risk and Uncertainty, Springer, vol. 22(3), pages 251-61, May.
- Arifovic, Jasmina & McKelvey, Richard D. & Pevnitskaya, Svetlana, 2006. "An initial implementation of the Turing tournament to learning in repeated two-person games," Games and Economic Behavior, Elsevier, vol. 57(1), pages 93-122, October.
- Reinhard Selten, 1998.
"Axiomatic Characterization of the Quadratic Scoring Rule,"
Springer, vol. 1(1), pages 43-61, June.
- Selten, Reinhard, 1996. "Axiomatic Characterization of the Quadratic Scoring Rule," Discussion Paper Serie B 390, University of Bonn, Germany.
- Richard P. Larrick & Jack B. Soll, 2006. "Erratum--Intuitions About Combining Opinions: Misappreciation of the Averaging Principle," Management Science, INFORMS, vol. 52(2), pages 309-310, February.
- Kahneman, Daniel & Tversky, Amos, 1979.
"Prospect Theory: An Analysis of Decision under Risk,"
Econometric Society, vol. 47(2), pages 263-91, March.
- Amos Tversky & Daniel Kahneman, 1979. "Prospect Theory: An Analysis of Decision under Risk," Levine's Working Paper Archive 7656, David K. Levine.
- Roth, Alvin, 2008.
"What Have We Learned from Market Design?,"
2579650, Harvard University Department of Economics.
- AlvinE. Roth, 2008. "What Have We Learned from Market Design?," Economic Journal, Royal Economic Society, vol. 118(527), pages 285-310, 03.
- Alvin E. Roth, 2009. "What Have We Learned from Market Design?," NBER Chapters, in: Innovation Policy and the Economy, Volume 9, pages 79-112 National Bureau of Economic Research, Inc.
- Alvin E. Roth, 2008. "What Have We Learned from Market Design?," Innovations: Technology, Governance, Globalization, MIT Press, vol. 3(1), pages 119-147, January.
- Alvin E. Roth, 2009. "What Have We Learned from Market Design?," Innovation Policy and the Economy, University of Chicago Press, vol. 9(1), pages 79 - 112.
- Tversky, Amos & Kahneman, Daniel, 1992. " Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
- Hibon, Michele & Evgeniou, Theodoros, 2005. "To combine or not to combine: selecting among forecasts and their combinations," International Journal of Forecasting, Elsevier, vol. 21(1), pages 15-24.
- Ido Erev & Alvin Roth & Robert Slonim & Greg Barron, 2007. "Learning and equilibrium as useful approximations: Accuracy of prediction on randomly selected constant sum games," Economic Theory, Springer, vol. 33(1), pages 29-51, October.
- Erev, Ido & Bereby-Meyer, Yoella & Roth, Alvin E., 1999. "The effect of adding a constant to all payoffs: experimental investigation, and implications for reinforcement learning models," Journal of Economic Behavior & Organization, Elsevier, vol. 39(1), pages 111-128, May.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Reinhard Engels).
If references are entirely missing, you can add them using this form.