IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2007.09213.html
   My bibliography  Save this paper

How Flexible is that Functional Form? Quantifying the Restrictiveness of Theories

Author

Listed:
  • Drew Fudenberg
  • Wayne Gao
  • Annie Liang

Abstract

We propose a restrictiveness measure for economic models based on how well they fit synthetic data from a pre-defined class. This measure, together with a measure for how well the model fits real data, outlines a Pareto frontier, where models that rule out more regularities, yet capture the regularities that are present in real data, are preferred. To illustrate our approach, we evaluate the restrictiveness of popular models in two laboratory settings -- certainty equivalents and initial play -- and in one field setting -- takeup of microfinance in Indian villages. The restrictiveness measure reveals new insights about each of the models, including that some economic models with only a few parameters are very flexible.

Suggested Citation

  • Drew Fudenberg & Wayne Gao & Annie Liang, 2020. "How Flexible is that Functional Form? Quantifying the Restrictiveness of Theories," Papers 2007.09213, arXiv.org, revised Aug 2023.
  • Handle: RePEc:arx:papers:2007.09213
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2007.09213
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Stahl, Dale II & Wilson, Paul W., 1994. "Experimental evidence on players' models of other players," Journal of Economic Behavior & Organization, Elsevier, vol. 25(3), pages 309-327, December.
    2. Lattimore, Pamela K. & Baker, Joanna R. & Witte, Ann D., 1992. "The influence of probability on risky choice: A parametric examination," Journal of Economic Behavior & Organization, Elsevier, vol. 17(3), pages 377-400, May.
    3. Varian, Hal R, 1982. "The Nonparametric Approach to Demand Analysis," Econometrica, Econometric Society, vol. 50(4), pages 945-973, July.
    4. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    5. Matthew Polisson & John K.-H. Quah & Ludovic Renou, 2020. "Revealed Preferences over Risk and Uncertainty," American Economic Review, American Economic Association, vol. 110(6), pages 1782-1820, June.
    6. Erik Snowberg & Justin Wolfers, 2010. "Explaining the Favorite-Long Shot Bias: Is it Risk-Love or Misperceptions?," Journal of Political Economy, University of Chicago Press, vol. 118(4), pages 723-746, August.
    7. Costa-Gomes, Miguel & Crawford, Vincent P & Broseta, Bruno, 2001. "Cognition and Behavior in Normal-Form Games: An Experimental Study," Econometrica, Econometric Society, vol. 69(5), pages 1193-1235, September.
    8. Yaari, Menahem E, 1987. "The Dual Theory of Choice under Risk," Econometrica, Econometric Society, vol. 55(1), pages 95-115, January.
    9. Xiaohong Chen & Andres Santos, 2018. "Overidentification in Regular Models," Econometrica, Econometric Society, vol. 86(5), pages 1771-1817, September.
    10. Adrian Bruhin & Helga Fehr-Duda & Thomas Epper, 2010. "Risk and Rationality: Uncovering Heterogeneity in Probability Distortion," Econometrica, Econometric Society, vol. 78(4), pages 1375-1412, July.
    11. Selten, Reinhard, 1991. "Properties of a measure of predictive success," Mathematical Social Sciences, Elsevier, vol. 21(2), pages 153-167, April.
    12. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    13. Timothy K. M. Beatty & Ian A. Crawford, 2011. "How Demanding Is the Revealed Preference Approach to Demand?," American Economic Review, American Economic Association, vol. 101(6), pages 2782-2795, October.
    14. Pamela K. Lattimore & Joanna R. Baker & A. Dryden Witte, 1992. "The Influence Of Probability on Risky Choice: A parametric Examination," NBER Technical Working Papers 0081, National Bureau of Economic Research, Inc.
    15. Drew Fudenberg & Annie Liang, 2019. "Predicting and Understanding Initial Play," American Economic Review, American Economic Association, vol. 109(12), pages 4112-4141, December.
    16. Hausman, Jerry, 2015. "Specification tests in econometrics," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 38(2), pages 112-134.
    17. Basu, Pathikrit & Echenique, Federico, 2020. "On the falsifiability and learnability of decision theories," Theoretical Economics, Econometric Society, vol. 15(4), November.
    18. Peysakhovich, Alexander & Naecker, Jeffrey, 2017. "Using methods from machine learning to evaluate behavioral models of choice under risk and ambiguity," Journal of Economic Behavior & Organization, Elsevier, vol. 133(C), pages 373-384.
    19. Syngjoo Choi & Raymond Fisman & Douglas Gale & Shachar Kariv, 2007. "Consistency and Heterogeneity of Individual Behavior under Uncertainty," American Economic Review, American Economic Association, vol. 97(5), pages 1921-1938, December.
    20. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    21. Drew Fudenberg & Jon Kleinberg & Annie Liang & Sendhil Mullainathan, 2019. "Measuring the Completeness of Theories," Papers 1910.07022, arXiv.org.
    22. Quiggin, John, 1982. "A theory of anticipated utility," Journal of Economic Behavior & Organization, Elsevier, vol. 3(4), pages 323-343, December.
    23. Harless, David W & Camerer, Colin F, 1994. "The Predictive Utility of Generalized Expected Utility Theories," Econometrica, Econometric Society, vol. 62(6), pages 1251-1289, November.
    24. Hey, John D., 1998. "An application of Selten's measure of predictive success," Mathematical Social Sciences, Elsevier, vol. 35(1), pages 1-15, January.
    25. Nagel, Rosemarie, 1995. "Unraveling in Guessing Games: An Experimental Study," American Economic Review, American Economic Association, vol. 85(5), pages 1313-1326, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Levon Barseghyan & Francesca Molinari & Ted O'Donoghue & Joshua C. Teitelbaum, 2013. "The Nature of Risk Preferences: Evidence from Insurance Choices," American Economic Review, American Economic Association, vol. 103(6), pages 2499-2529, October.
    2. Eyal Baharad & Doron Kliger, 2013. "Market failure in light of non-expected utility," Theory and Decision, Springer, vol. 75(4), pages 599-619, October.
    3. Luís Santos-Pinto & Adrian Bruhin & José Mata & Thomas Åstebro, 2015. "Detecting heterogeneous risk attitudes with mixed gambles," Theory and Decision, Springer, vol. 79(4), pages 573-600, December.
    4. Jakusch, Sven Thorsten, 2017. "On the applicability of maximum likelihood methods: From experimental to financial data," SAFE Working Paper Series 148, Leibniz Institute for Financial Research SAFE, revised 2017.
    5. Thomas Epper & Helga Fehr-Duda & Adrian Bruhin, 2011. "Viewing the future through a warped lens: Why uncertainty generates hyperbolic discounting," Journal of Risk and Uncertainty, Springer, vol. 43(3), pages 169-203, December.
    6. Aluma Dembo & Shachar Kariv & Matthew Polisson & John Quah, 2021. "Ever since Allais," IFS Working Papers W21/15, Institute for Fiscal Studies.
    7. Kpegli, Yao Thibaut & Corgnet, Brice & Zylbersztejn, Adam, 2023. "All at once! A comprehensive and tractable semi-parametric method to elicit prospect theory components," Journal of Mathematical Economics, Elsevier, vol. 104(C).
    8. Gigi Foster & Paul Frijters & Markus Schaffner & Benno Torgler, 2013. "Expectation Formation in an Evolving Game of Uncertainty: Theory and New Experimental Evidence," CREMA Working Paper Series 2013-19, Center for Research in Economics, Management and the Arts (CREMA).
    9. Daniel R. Burghart, 2020. "The two faces of independence: betweenness and homotheticity," Theory and Decision, Springer, vol. 88(4), pages 567-593, May.
    10. Upravitelev, A., 2023. "Neoclassical roots of behavioral economics," Journal of the New Economic Association, New Economic Association, vol. 58(1), pages 110-140.
    11. Drew Fudenberg & Jon Kleinberg & Annie Liang & Sendhil Mullainathan, 2019. "Measuring the Completeness of Theories," Papers 1910.07022, arXiv.org.
    12. Foster, Gigi & Frijters, Paul & Schaffner, Markus & Torgler, Benno, 2018. "Expectation formation in an evolving game of uncertainty: New experimental evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 154(C), pages 379-405.
    13. Ariane Charpin, 2018. "Tests des modèles de décision en situation de risque. Le cas des parieurs hippiques en France," Revue économique, Presses de Sciences-Po, vol. 69(5), pages 779-803.
    14. Galarza, Francisco, 2009. "Choices under Risk in Rural Peru," MPRA Paper 17708, University Library of Munich, Germany.
    15. Jakusch, Sven Thorsten & Meyer, Steffen & Hackethal, Andreas, 2019. "Taming models of prospect theory in the wild? Estimation of Vlcek and Hens (2011)," SAFE Working Paper Series 146, Leibniz Institute for Financial Research SAFE, revised 2019.
    16. Levon Barseghyan & Francesca Molinari, 2023. "Risk Preference Types, Limited Consideration, and Welfare," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 41(4), pages 1011-1029, October.
    17. Stephen G Dimmock & Roy Kouwenberg & Olivia S Mitchell & Kim Peijnenburg, 2021. "Household Portfolio Underdiversification and Probability Weighting: Evidence from the Field," The Review of Financial Studies, Society for Financial Studies, vol. 34(9), pages 4524-4563.
    18. Fehr-Duda, Helga & Epper, Thomas & Bruhin, Adrian & Schubert, Renate, 2011. "Risk and rationality: The effects of mood and decision rules on probability weighting," Journal of Economic Behavior & Organization, Elsevier, vol. 78(1), pages 14-24.
    19. Peter Brooks & Simon Peters & Horst Zank, 2014. "Risk behavior for gain, loss, and mixed prospects," Theory and Decision, Springer, vol. 77(2), pages 153-182, August.
    20. Michael Kilka & Martin Weber, 2001. "What Determines the Shape of the Probability Weighting Function Under Uncertainty?," Management Science, INFORMS, vol. 47(12), pages 1712-1726, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2007.09213. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.