IDEAS home Printed from https://ideas.repec.org/a/aea/jeclit/v52y2014i3p820-50.html
   My bibliography  Save this article

The Limits of Inference with Theory: A Review of Wolpin (2013)

Author

Listed:
  • John Rust

Abstract

This essay reviews Kenneth I. Wolpin's (2013) monograph The Limits of Inference without Theory, which arose from lectures he presented at the Cowles Foundation in 2010 in honor of Tjalling Koopmans. While I readily agree with Wolpin's basic premise that empirical work that eschews the role of economic theory faces unnecessary self-imposed limits relative to empirical work that embraces and tries to test and improve economic theory, it is important to be aware that the use of economic theory is not a panacea. I point out that there are also serious limits to inference with theory: 1) there may be no truly "structural" (policy invariant) parameters, a key assumption underpinning the structural econometric approach that Wolpin and the Cowles Foundation have championed; 2) there is a curse of dimensionality that makes it very difficult for us to elucidate the detailed implications of economic theories, which is necessary to empirically implement and test these theories; 3) there is an identification problem that makes it impossible to decide between competing theories without imposing ad hoc auxiliary assumptions (such as parametric functional form assumptions); and 4) there is a problem of multiplicity and indeterminacy of equilibria that limits the predictive empirical content of many economic theories. I conclude that though these are very challenging problems, I agree with Wolpin and the Cowles Foundation that economists have far more to gain by trying to incorporate economic theory into empirical work and test and improve our theories than by rejecting theory and presuming that all interesting economic issues can be answered by well-designed controlled, randomized experiments and assuming that difficult questions of causality and evaluation of alternative hypothetical policies can be resolved by simply allowing the "data to speak for itself."

Suggested Citation

  • John Rust, 2014. "The Limits of Inference with Theory: A Review of Wolpin (2013)," Journal of Economic Literature, American Economic Association, vol. 52(3), pages 820-850, September.
  • Handle: RePEc:aea:jeclit:v:52:y:2014:i:3:p:820-50
    Note: DOI: 10.1257/jel.52.3.820
    as

    Download full text from publisher

    File URL: http://www.aeaweb.org/articles.php?doi=10.1257/jel.52.3.820
    Download Restriction: no

    File URL: http://www.aeaweb.org/jel/ds/5203/JEL.52.3.375_ds.zip
    Download Restriction: Access to full text is restricted to AEA members and institutional subscribers.

    References listed on IDEAS

    as
    1. D. COLANDER & al., 2010. "The Financial Crisis and the Systemic Failure of Academic Economics," VOPROSY ECONOMIKI, N.P. Redaktsiya zhurnala "Voprosy Economiki", vol. 6.
    2. Keane, Michael P., 2010. "Structural vs. atheoretic approaches to econometrics," Journal of Econometrics, Elsevier, vol. 156(1), pages 3-20, May.
    3. Schorfheide, Frank & Wolpin, Kenneth I., 2016. "To hold out or not to hold out," Research in Economics, Elsevier, vol. 70(2), pages 332-345.
    4. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    5. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009 is not listed on IDEAS
    6. James J. Heckman, 2010. "Building Bridges between Structural and Program Evaluation Approaches to Evaluating Policy," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 356-398, June.
    7. Angus Deaton, 2009. "Instruments of development: Randomization in the tropics, and the search for the elusive keys to economic development," Working Papers 1128, Princeton University, Woodrow Wilson School of Public and International Affairs, Center for Health and Wellbeing..
    8. Michael P. Keane & Kenneth I. Wolpin, 2010. "The Role Of Labor And Marriage Markets, Preference Heterogeneity, And The Welfare System In The Life Cycle Decisions Of Black, Hispanic, And White Women," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 51(3), pages 851-892, August.
    9. John Rust & Christopher Phelan, 1997. "How Social Security and Medicare Affect Retirement Behavior in a World of Incomplete Markets," Econometrica, Econometric Society, vol. 65(4), pages 781-832, July.
    10. Victor Aguirregabiria & Pedro Mira, 2013. "Identification of Games of Incomplete Information with Multiple Equilibria and Common Unobserved Heterogeneity," Working Papers tecipa-474, University of Toronto, Department of Economics.
    11. Sanjog Misra & Harikesh Nair, 2011. "A structural model of sales-force compensation dynamics: Estimation and field implementation," Quantitative Marketing and Economics (QME), Springer, vol. 9(3), pages 211-257, September.
    12. Morgan,Mary S., 1991. "The History of Econometric Ideas," Cambridge Books, Cambridge University Press, number 9780521424653, April.
    13. Gilboa, Itzhak & Samuelson, Larry & Schmeidler, David, 2013. "Dynamics of inductive inference in a unified framework," Journal of Economic Theory, Elsevier, vol. 148(4), pages 1399-1432.
    14. Matzkin, Rosa L, 1991. "Semiparametric Estimation of Monotone and Concave Utility Functions for Polychotomous Choice Models," Econometrica, Econometric Society, vol. 59(5), pages 1315-1327, September.
    15. Thierry Magnac & David Thesmar, 2002. "Identifying Dynamic Discrete Decision Processes," Econometrica, Econometric Society, vol. 70(2), pages 801-816, March.
    16. Guido W. Imbens, 2010. "Better LATE Than Nothing: Some Comments on Deaton (2009) and Heckman and Urzua (2009)," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 399-423, June.
    17. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    18. Manski, Charles F., 2013. "Public Policy in an Uncertain World: Analysis and Decisions," Economics Books, Harvard University Press, number 9780674066892, December.
    19. Heckman, J.J. & Hotz, V.J., 1988. "Choosing Among Alternative Nonexperimental Methods For Estimating The Impact Of Social Programs: The Case Of Manpower Training," University of Chicago - Economics Research Center 88-12, Chicago - Economics Research Center.
    20. Abhijit V. Banerjee & Esther Duflo, 2009. "The Experimental Approach to Development Economics," Annual Review of Economics, Annual Reviews, vol. 1(1), pages 151-178, May.
    21. John Rust, 1997. "Using Randomization to Break the Curse of Dimensionality," Econometrica, Econometric Society, vol. 65(3), pages 487-516, May.
    22. repec:pri:rpdevs:instruments_of_development is not listed on IDEAS
    23. Einhorn, Hillel J & Hogarth, Robin M, 1986. "Decision Making under Ambiguity," The Journal of Business, University of Chicago Press, vol. 59(4), pages 225-250, October.
    24. Peter C. B. Phillips, 2003. "Laws and Limits of Econometrics," Economic Journal, Royal Economic Society, vol. 113(486), pages 26-52, March.
    25. repec:pri:cheawb:deaton%20instruments%20of%20development%20keynes%20lecture%202009.pdf is not listed on IDEAS
    26. Fedor Iskhakov & John Rust & Bertel Schjerning, 2016. "Recursive Lexicographical Search: Finding All Markov Perfect Equilibria of Finite State Directional Dynamic Games," Review of Economic Studies, Oxford University Press, vol. 83(2), pages 658-703.
    27. J. Rust & J. F. Traub & H. Wozniakowski, 2002. "Is There a Curse of Dimensionality for Contraction Fixed Points in the Worst Case?," Econometrica, Econometric Society, vol. 70(1), pages 285-329, January.
    28. Hanming Fang & Alessandro Gavazza, 2011. "Dynamic Inefficiencies in an Employment-Based Health Insurance System: Theory and Evidence," American Economic Review, American Economic Association, vol. 101(7), pages 3047-3077, December.
    29. Kenneth I. Wolpin & Petra E. Todd, 2006. "Assessing the Impact of a School Subsidy Program in Mexico: Using a Social Experiment to Validate a Dynamic Behavioral Model of Child Schooling and Fertility," American Economic Review, American Economic Association, vol. 96(5), pages 1384-1417, December.
    30. Wolpin, Kenneth I., 2013. "The Limits of Inference without Theory," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262019086, January.
    31. Joseph E. Stiglitz, 2002. "Information and the Change in the Paradigm in Economics," American Economic Review, American Economic Association, vol. 92(3), pages 460-501, June.
    32. Heckman, James J, 1992. "Haavelmo and the Birth of Modern Econometrics: A Review of The History of Econometric Ideas," Journal of Economic Literature, American Economic Association, vol. 30(2), pages 876-886, June.
    33. Imbens, Guido W & Angrist, Joshua D, 1994. "Identification and Estimation of Local Average Treatment Effects," Econometrica, Econometric Society, vol. 62(2), pages 467-475, March.
    34. John Geweke, 2014. "Review Essay on Charles F. Manski's Public Policy in an Uncertain World: Analysis and Decisions," Journal of Economic Literature, American Economic Association, vol. 52(3), pages 799-804, September.
    35. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    36. Paul Frijters, 2013. "The Limits of Inference Without Theory , by Kenneth I. Wolpin ( MIT University Press , Cambridge, MA , 2013 ), pp. 192 ," The Economic Record, The Economic Society of Australia, vol. 89(286), pages 429-432, September.
    37. Rust, John, 2010. "Comments on: "Structural vs. atheoretic approaches to econometrics" by Michael Keane," Journal of Econometrics, Elsevier, vol. 156(1), pages 21-24, May.
    38. Aviv Nevo & Michael D. Whinston, 2010. "Taking the Dogma out of Econometrics: Structural Modeling and Credible Inference," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 69-82, Spring.
    39. repec:pri:rpdevs:instruments_of_development.pdf is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yew-Kwang Ng, 2016. "Are Unrealistic Assumptions/Simplifications Acceptable? Some Methodological Issues in Economics," Pacific Economic Review, Wiley Blackwell, vol. 21(2), pages 180-201, May.
    2. Drerup, Tilman & Enke, Benjamin & von Gaudecker, Hans-Martin, 2014. "Measurement Error in Subjective Expectation and the Empirical Content of Economic Models," MEA discussion paper series 201414, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.
    3. Kalouptsidi, Myrto & Scott, Paul & Souza-Rodrigues, Edouardo, 2015. "Identification of Counterfactuals and Payoffs in Dynamic Discrete Choice with an Application to Land Use," TSE Working Papers 15-596, Toulouse School of Economics (TSE).
    4. Breitmoser, Yves, 2018. "The Axiomatic Foundation of Logit," Rationality and Competition Discussion Paper Series 78, CRC TRR 190 Rationality and Competition.
    5. Breitmoser, Yves, 2017. "Discrete Choice with Presentation Effects," Rationality and Competition Discussion Paper Series 35, CRC TRR 190 Rationality and Competition.

    More about this item

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C18 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Methodolical Issues: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:aea:jeclit:v:52:y:2014:i:3:p:820-50. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Michael P. Albert). General contact details of provider: http://edirc.repec.org/data/aeaaaea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.