Advanced Search
MyIDEAS: Login

The Credibility Revolution in Empirical Economics: How Better Research Design Is Taking the Con out of Econometrics

Contents:

Author Info

  • Joshua D. Angrist
  • J�rn-Steffen Pischke

Abstract

Since Edward Leamer's memorable 1983 paper, "Let's Take the Con out of Econometrics," empirical microeconomics has experienced a credibility revolution. While Leamer's suggested remedy, sensitivity analysis, has played a role in this, we argue that the primary engine driving improvement has been a focus on the quality of empirical research designs. The advantages of a good research design are perhaps most easily apparent in research using random assignment. We begin with an overview of Leamer's 1983 critique and his proposed remedies. We then turn to the key factors we see contributing to improved empirical work, including the availability of more and better data, along with advances in theoretical econometric understanding, but especially the fact that research design has moved front and center in much of empirical micro. We offer a brief digression into macroeconomics and industrial organization, where progress -- by our lights -- is less dramatic, although there is work in both fields that we find encouraging. Finally, we discuss the view that the design pendulum has swung too far. Critics of design-driven studies argue that in pursuit of clean and credible research designs, researchers seek good answers instead of good questions. We briefly respond to this concern, which worries us little.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.aeaweb.org/articles.php?doi=10.1257/jep.24.2.3
Download Restriction: no

Bibliographic Info

Article provided by American Economic Association in its journal Journal of Economic Perspectives.

Volume (Year): 24 (2010)
Issue (Month): 2 (Spring)
Pages: 3-30

as in new window
Handle: RePEc:aea:jecper:v:24:y:2010:i:2:p:3-30

Note: DOI: 10.1257/jep.24.2.3
Contact details of provider:
Email:
Web page: http://www.aeaweb.org/jep/
More information through EDIRC

Order Information:
Web: http://www.aeaweb.org/subscribe.html

Related research

Keywords:

Other versions of this item:

Find related papers by JEL classification:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. David Y. Albouy, 2008. "The Colonial Origins of Comparative Development: An Investigation of the Settler Mortality Data," NBER Working Papers 14130, National Bureau of Economic Research, Inc.
  2. Crandall, Robert W. & Winston, Clifford, 2004. "Does Antitrust Policy Improve Consumer Welfare? Assessing the Evidence," Working paper 263, Regulation2point0.
  3. Stefano DellaVigna & M. Daniele Paserman, 2005. "Job Search and Impatience," Journal of Labor Economics, University of Chicago Press, vol. 23(3), pages 527-588, July.
  4. Raghuram G. Rajan, 2005. "Aid and Growth: What Does The Cross-Country Evidence Really Show?," Working Papers id:54, eSocialSciences.
  5. Isaac Ehrlich, 1996. "Crime, Punishment, and the Market for Offenses," Journal of Economic Perspectives, American Economic Association, vol. 10(1), pages 43-67, Winter.
  6. Joshua D. Angrist & Stacey H. Chen, 2009. "Long-Term Economic Consequences of Vietnam-Era Conscription: Schooling, Experience and Earnings," Royal Holloway, University of London: Discussion Papers in Economics 09/02, Department of Economics, Royal Holloway University of London.
  7. Summers, Anita A & Wolfe, Barbara L, 1977. "Do Schools Make a Difference?," American Economic Review, American Economic Association, vol. 67(4), pages 639-52, September.
  8. Orley Ashenfelter & Daniel Hosken & Matthew Weinberg, 2009. "Generating Evidence to Guide Merger Enforcement," CPI Journal, Competition Policy International, vol. 5.
  9. Miguel Urquiola & Eric A. Verhoogen, 2007. "Class size and sorting in market equilibrium: Theory and evidence," Discussion Papers 0607-14, Columbia University, Department of Economics.
  10. Jeffrey R Kling & Jeffrey B Liebman & Lawrence F Katz, 2007. "Experimental Analysis of Neighborhood Effects," Econometrica, Econometric Society, vol. 75(1), pages 83-119, 01.
  11. Eric A. Hanushek & John F. Kain & Steven G. Rivkin, 1998. "Teachers, Schools, and Academic Achievement," NBER Working Papers 6691, National Bureau of Economic Research, Inc.
  12. Dani Rodrik & Romain Wacziarg, 2005. "Do Democratic Transitions Produce Bad Economic Outcomes?," American Economic Review, American Economic Association, vol. 95(2), pages 50-55, May.
  13. McCrary, Justin, 2008. "Manipulation of the running variable in the regression discontinuity design: A density test," Journal of Econometrics, Elsevier, vol. 142(2), pages 698-714, February.
  14. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule To Estimate The Effect Of Class Size On Scholastic Achievement," The Quarterly Journal of Economics, MIT Press, vol. 114(2), pages 533-575, May.
  15. Nunn, Nathan, 2007. "The Long-Term Effects of Africa's Slave Trades," MPRA Paper 4134, University Library of Munich, Germany.
  16. Martin Feldstein & Charles Horioka, 1979. "Domestic Savings and International Capital Flows," NBER Working Papers 0310, National Bureau of Economic Research, Inc.
  17. Michael Conlin & Ted O'Donoghue & Timothy J. Vogelsang, 2007. "Projection Bias in Catalog Orders," American Economic Review, American Economic Association, vol. 97(4), pages 1217-1249, September.
  18. Donohue III, John J. & Wolfers, Justin, 2006. "Uses and Abuses of Empirical Evidence in the Death Penalty Debate," IZA Discussion Papers 1949, Institute for the Study of Labor (IZA).
  19. Stefano DellaVigna & Ulrike Malmendier, 2006. "Paying Not to Go to the Gym," American Economic Review, American Economic Association, vol. 96(3), pages 694-719, June.
  20. Olivier Deschênes & Michael Greenstone, 2007. "Climate Change, Mortality, and Adaptation: Evidence from Annual Fluctuations in Weather in the US," NBER Working Papers 13178, National Bureau of Economic Research, Inc.
  21. Dean S. Karlan & Jonathan Zinman, 2005. "Observing Unobservables: Identifying Information Asymmetries with a Consumer Credit Field Experiment," Working Papers 911, Economic Growth Center, Yale University.
  22. James J. Heckman & Sergio Urzua, 2009. "Comparing IV With Structural Models: What Simple IV Can and Cannot Identify," NBER Working Papers 14706, National Bureau of Economic Research, Inc.
  23. Ehrlich, Isaac & Brower, George D, 1987. "On the Issue of Causality in the Economic Model of Crime and Law Enforcement: Some Theoretical Considerations and Experimental Evidence," American Economic Review, American Economic Association, vol. 77(2), pages 99-106, May.
  24. Benjamin J. Keys & Tanmoy Mukherjee & Amit Seru & Vikrant Vig, 2010. "Did Securitization Lead to Lax Screening? Evidence from Subprime Loans," The Quarterly Journal of Economics, MIT Press, vol. 125(1), pages 307-362, February.
  25. Hoyt Bleakley, 2007. "Disease and Development: Evidence from Hookworm Eradication in the American South," The Quarterly Journal of Economics, MIT Press, vol. 122(1), pages 73-117, 02.
  26. Ernst Fehr & Lorenz Gotte, 2002. "Do workers work more if wages are high? Evidence from a randomized field experiment," Natural Field Experiments 00240, The Field Experiments Website.
  27. Borenstein, Severin, 1990. "Airline Mergers, Airport Dominance, and Market Power," American Economic Review, American Economic Association, vol. 80(2), pages 400-404, May.
  28. Manning, Willard G, et al, 1987. "Health Insurance and the Demand for Medical Care: Evidence from a Randomized Experiment," American Economic Review, American Economic Association, vol. 77(3), pages 251-77, June.
  29. Ehrlich, Isaac, 1977. "Capital Punishment and Deterrence: Some Further Thoughts and Additional Evidence," Journal of Political Economy, University of Chicago Press, vol. 85(4), pages 741-88, August.
  30. Ehrlich, Isaac & Liu, Zhiqiang, 1999. "Sensitivity Analyses of the Deterrence Hypothesis: Let's Keep the Econ in Econometrics," Journal of Law and Economics, University of Chicago Press, vol. 42(1), pages 455-87, April.
  31. Guido Imbens & Thomas Lemieux, 2007. "Regression Discontinuity Designs: A Guide to Practice," NBER Working Papers 13039, National Bureau of Economic Research, Inc.
  32. Ramey, Valerie A. & Shapiro, Matthew D., 1998. "Costly capital reallocation and the effects of government spending," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 48(1), pages 145-194, June.
  33. Isaac Ehrlich, 1973. "The Deterrent Effect of Capital Punishment: A Question of Life and Death," NBER Working Papers 0018, National Bureau of Economic Research, Inc.
  34. Gary Richardson & William Troost, 2009. "Monetary Intervention Mitigated Banking Panics during the Great Depression: Quasi-Experimental Evidence from a Federal Reserve District Border, 1929-1933," Journal of Political Economy, University of Chicago Press, vol. 117(6), pages 1031-1073, December.
  35. Gerald S. Oettinger, 1999. "An Empirical Analysis of the Daily Labor Supply of Stadium Vendors," Journal of Political Economy, University of Chicago Press, vol. 107(2), pages 360-392, April.
  36. Hanushek, Eric A, 1986. "The Economics of Schooling: Production and Efficiency in Public Schools," Journal of Economic Literature, American Economic Association, vol. 24(3), pages 1141-77, September.
  37. McAleer, Michael & Pagan, Adrian, 1985. "What Will Take the Con Out of Econometrics?," CEPR Discussion Papers 39, C.E.P.R. Discussion Papers.
  38. François R. Velde, 2009. "Chronicle of a Deflation Unforetold," Journal of Political Economy, University of Chicago Press, vol. 117(4), pages 591-634, 08.
  39. Joshua D. Angrist & Guido M. Kuersteiner, 2004. "Semiparametric Causality Tests Using the Policy Propensity Score," NBER Working Papers 10975, National Bureau of Economic Research, Inc.
  40. Aviv Nevo, 2000. "Mergers with Differentiated Products: The Case of the Ready-to-Eat Cereal Industry," RAND Journal of Economics, The RAND Corporation, vol. 31(3), pages 395-421, Autumn.
  41. Ehrlich, Isaac, 1977. "The Deterrent Effect of Capital Punishment: Reply," American Economic Review, American Economic Association, vol. 67(3), pages 452-58, June.
  42. Caroline M. Hoxby, 2000. "The Effects Of Class Size On Student Achievement: New Evidence From Population Variation," The Quarterly Journal of Economics, MIT Press, vol. 115(4), pages 1239-1285, November.
Full references (including those not matched with items on IDEAS)

Citations

Blog mentions

As found by EconAcademics.org, the blog aggregator for Economics research:
  1. O “núcleo” da inflação no Brasil.
    by ? in Análise Real on 2012-04-12 12:00:00
  2. Notes on books for Macroeconometrics
    by Gray in Pseudo-true News on 2013-04-08 15:49:43
  3. An incrementalist view of Impact Evaluation and knowledge
    by Jed Friedman in Development Impact on 2012-05-02 13:27:23
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:aea:jecper:v:24:y:2010:i:2:p:3-30

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Jane Voros) or (Michael P. Albert).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.