IDEAS home Printed from https://ideas.repec.org/a/bla/ecorec/v96y2020i313p153-176.html
   My bibliography  Save this article

Prediction and Model Selection in Experiments

Author

Listed:
  • Zachary Breig

Abstract

This paper compares the predictive performance of several models of risk aversion and time preferences in experimental settings. Models are evaluated on the basis of out‐of‐sample prediction rather than in‐sample fit. For preferences over risk, with the exception of very small sample sizes, allowing the estimation procedure to select between constant relative risk aversion and constant absolute risk aversion improves prediction beyond that of a single model. Moreover, adding a behavioural parameter such as disappointment aversion improves prediction further. This contrasts with time preferences, where adding the present‐bias parameter worsens prediction for all sample sizes.

Suggested Citation

  • Zachary Breig, 2020. "Prediction and Model Selection in Experiments," The Economic Record, The Economic Society of Australia, vol. 96(313), pages 153-176, June.
  • Handle: RePEc:bla:ecorec:v:96:y:2020:i:313:p:153-176
    DOI: 10.1111/1475-4932.12533
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/1475-4932.12533
    Download Restriction: no

    File URL: https://libkey.io/10.1111/1475-4932.12533?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten I. & Rutström, E. Elisabet, 2014. "Discounting behavior: A reconsideration," European Economic Review, Elsevier, vol. 71(C), pages 15-33.
    2. Eddie Dekel & Barton L. Lipman, 2010. "How (Not) to Do Decision Theory," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 257-282, September.
    3. Marzilli Ericson, K. M. & White, J. M. & Laibson, David I. & Cohen, J. D., 2015. "Money Earlier or Later? Simple Heuristics Explain Intertemporal Choices Better Than Delay Discounting Does," Scholarly Articles 30367415, Harvard University Department of Economics.
    4. R. H. Strotz, 1955. "Myopia and Inconsistency in Dynamic Utility Maximization," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 23(3), pages 165-180.
    5. Ben Gillen & Erik Snowberg & Leeat Yariv, 2019. "Experimenting with Measurement Error: Techniques with Applications to the Caltech Cohort Study," Journal of Political Economy, University of Chicago Press, vol. 127(4), pages 1826-1863.
    6. Stephan Meier & Charles Sprenger, 2010. "Present-Biased Preferences and Credit Card Borrowing," American Economic Journal: Applied Economics, American Economic Association, vol. 2(1), pages 193-210, January.
    7. Steffen Andersen & Glenn W. Harrison & Morten I. Lau & E. Elisabet Rutström, 2008. "Eliciting Risk and Time Preferences," Econometrica, Econometric Society, vol. 76(3), pages 583-618, May.
    8. Paolo Crosetto & Antonio Filippin, 2016. "A theoretical and experimental appraisal of four risk elicitation methods," Experimental Economics, Springer;Economic Science Association, vol. 19(3), pages 613-641, September.
    9. Botond Kőszegi & Matthew Rabin, 2006. "A Model of Reference-Dependent Preferences," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 121(4), pages 1133-1165.
    10. John D. Hey & Chris Orme, 2018. "Investigating Generalizations Of Expected Utility Theory Using Experimental Data," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 3, pages 63-98, World Scientific Publishing Co. Pte. Ltd..
    11. James Andreoni & Charles Sprenger, 2012. "Estimating Time Preferences from Convex Budgets," American Economic Review, American Economic Association, vol. 102(7), pages 3333-3356, December.
    12. Yoram Halevy & Dotan Persitz & Lanny Zrill, 2018. "Parametric Recoverability of Preferences," Journal of Political Economy, University of Chicago Press, vol. 126(4), pages 1558-1593.
    13. Ned Augenblick & Muriel Niederle & Charles Sprenger, 2015. "Editor's Choice Working over Time: Dynamic Inconsistency in Real Effort Tasks," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 130(3), pages 1067-1115.
    14. Peysakhovich, Alexander & Naecker, Jeffrey, 2017. "Using methods from machine learning to evaluate behavioral models of choice under risk and ambiguity," Journal of Economic Behavior & Organization, Elsevier, vol. 133(C), pages 373-384.
    15. Quiggin, John, 1982. "A theory of anticipated utility," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 323-343, December.
    16. Stephen L. Cheung, 2020. "Eliciting utility curvature in time preference," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 493-525, June.
    17. Harless, David W & Camerer, Colin F, 1994. "The Predictive Utility of Generalized Expected Utility Theories," Econometrica, Econometric Society, vol. 62(6), pages 1251-1289, November.
    18. Ubfal, Diego, 2016. "How general are time preferences? Eliciting good-specific discount rates," Journal of Development Economics, Elsevier, vol. 118(C), pages 150-170.
    19. Stahl, Dale O., 2018. "Assessing the forecast performance of models of choice," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 73(C), pages 86-92.
    20. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    21. Gilboa,Itzhak, 2009. "Theory of Decision under Uncertainty," Cambridge Books, Cambridge University Press, number 9780521517324.
    22. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency, Heterogeneity, and Granularity of Individual Behavior under Uncertainty," Economics Working Papers 0076, Institute for Advanced Study, School of Social Science.
    23. Camerer, Colin F & Ho, Teck-Hua, 1994. "Violations of the Betweenness Axiom and Nonlinearity in Probability," Journal of Risk and Uncertainty, Springer, vol. 8(2), pages 167-196, March.
    24. Gul, Faruk, 1991. "A Theory of Disappointment Aversion," Econometrica, Econometric Society, vol. 59(3), pages 667-686, May.
    25. Keith M. Ericson & John Myles White & David Laibson & Jonathan D. Cohen, 2015. "Money Earlier or Later? Simple Heuristics Explain Intertemporal Choices Better than Delay Discounting," NBER Working Papers 20948, National Bureau of Economic Research, Inc.
    26. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    27. Shane Frederick & George Loewenstein & Ted O'Donoghue, 2002. "Time Discounting and Time Preference: A Critical Review," Journal of Economic Literature, American Economic Association, vol. 40(2), pages 351-401, June.
    28. Ned Augenblick & Matthew Rabin, 2019. "An Experiment on Time Preference and Misprediction in Unpleasant Tasks," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(3), pages 941-975.
    29. Abdellaoui, Mohammed & Kemel, Emmanuel & Panin, Amma & Vieider, Ferdinand M., 2019. "Measuring time and risk preferences in an integrated framework," Games and Economic Behavior, Elsevier, vol. 115(C), pages 459-469.
    30. Fisman, Raymond & Jakiela, Pamela & Kariv, Shachar, 2017. "Distributional preferences and political behavior," Journal of Public Economics, Elsevier, vol. 155(C), pages 1-10.
    31. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency and Heterogeneity of Individual Behavior under Uncertainty," American Economic Review, American Economic Association, vol. 97(5), pages 1921-1938, December.
    32. David Laibson, 1997. "Golden Eggs and Hyperbolic Discounting," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 112(2), pages 443-478.
    33. Graham Loomes & Ganna Pogrebna, 2014. "Measuring Individual Risk Attitudes when Preferences are Imprecise," Economic Journal, Royal Economic Society, vol. 0(576), pages 569-593, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stephen L. Cheung, 2020. "Eliciting utility curvature in time preference," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 493-525, June.
    2. Uttara Balakrishnan & Johannes Haushofer & Pamela Jakiela, 2020. "How soon is now? Evidence of present bias from convex time budget experiments," Experimental Economics, Springer;Economic Science Association, vol. 23(2), pages 294-321, June.
    3. Stephen L. Cheung & Agnieszka Tymula & Xueting Wang, 2022. "Present bias for monetary and dietary rewards," Experimental Economics, Springer;Economic Science Association, vol. 25(4), pages 1202-1233, September.
    4. Ali al-Nowaihi & Sanjit Dhami, 2018. "Foundations for Intertemporal Choice," CESifo Working Paper Series 6913, CESifo.
    5. Eileen Tipoe & Abi Adams & Ian Crawford, 2022. "Revealed preference analysis and bounded rationality [Consume now or later? Time inconsistency, collective choice and revealed preference]," Oxford Economic Papers, Oxford University Press, vol. 74(2), pages 313-332.
    6. Cheung, Stephen L. & Tymula, Agnieszka & Wang, Xueting, 2020. "Present Bias for Monetary and Dietary Rewards: Evidence from Chinese Teenagers," IZA Discussion Papers 13406, Institute of Labor Economics (IZA).
    7. Thomas Epper & Helga Fehr-Duda & Adrian Bruhin, 2011. "Viewing the future through a warped lens: Why uncertainty generates hyperbolic discounting," Journal of Risk and Uncertainty, Springer, vol. 43(3), pages 169-203, December.
    8. Andersen, Steffen & Harrison, Glenn W. & Lau, Morten Igel & Rutström, Elisabet E., 2010. "Behavioral econometrics for psychologists," Journal of Economic Psychology, Elsevier, vol. 31(4), pages 553-576, August.
    9. repec:cup:judgdm:v:16:y:2021:i:6:p:1324-1369 is not listed on IDEAS
    10. Friedman, Daniel & Habib, Sameh & James, Duncan & Crockett, Sean, 2018. "Varieties of risk elicitation," Discussion Papers, Research Professorship Market Design: Theory and Pragmatics SP II 2018-501, WZB Berlin Social Science Center.
    11. Belianin, A., 2017. "Face to Face to Human Being: Achievements and Challenges of Behavioral Economics," Journal of the New Economic Association, New Economic Association, vol. 34(2), pages 166-175.
    12. James Andreoni & Christina Gravert & Michael A. Kuhn & Silvia Saccardo & Yang Yang, 2018. "Arbitrage Or Narrow Bracketing? On Using Money to Measure Intertemporal Preferences," NBER Working Papers 25232, National Bureau of Economic Research, Inc.
    13. Chiara Pastore & Stefanie Schurer & Agnieszka Tymula & Nicholas Fuller & Ian Caterson, 2023. "Economic preferences and obesity: Evidence from a clinical lab‐in‐field study," Health Economics, John Wiley & Sons, Ltd., vol. 32(9), pages 2147-2167, September.
    14. Ali al-Nowaihi & Sanjit Dhami, 2021. "Preferences over Time and under Uncertainty: Theoretical Foundations," CESifo Working Paper Series 9215, CESifo.
    15. Pastore, Chiara & Schurer, Stefanie & Tymula, Agnieszka & Fuller, Nicholas & Caterson, Ian, 2020. "Economic Preferences and Obesity: Evidence from a Clinical Lab-in-Field Experiment," IZA Discussion Papers 13915, Institute of Labor Economics (IZA).
    16. Akin, Zafer & Yavas, Abdullah, 2023. "Elicited Time Preferences and Behavior in Long-Run Projects," MPRA Paper 117133, University Library of Munich, Germany.
    17. Bernedo Del Carpio, María & Alpizar, Francisco & Ferraro, Paul J., 2022. "Time and risk preferences of individuals, married couples and unrelated pairs," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 97(C).
    18. Sudeep Bhatia & Graham Loomes & Daniel Read, 2021. "Establishing the laws of preferential choice behavior," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 16(6), pages 1324-1369, November.
    19. Fredslund, Eskild Klausen & Mørkbak, Morten Raun & Gyrd-Hansen, Dorte, 2018. "Different domains – Different time preferences?," Social Science & Medicine, Elsevier, vol. 207(C), pages 97-105.
    20. Daniel R. Burghart, 2020. "The two faces of independence: betweenness and homotheticity," Theory and Decision, Springer, vol. 88(4), pages 567-593, May.
    21. Jindrich Matousek & Tomas Havranek & Zuzana Irsova, 2022. "Individual discount rates: a meta-analysis of experimental evidence," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 318-358, February.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:ecorec:v:96:y:2020:i:313:p:153-176. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/esausea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.