IDEAS home Printed from https://ideas.repec.org/p/nbr/nberwo/13026.html
   My bibliography  Save this paper

Replication in Economics

Author

Listed:
  • Daniel S. Hamermesh

Abstract

This examination of the role and potential for replication in economics points out the paucity of both pure replication -- checking on others' published papers using their data -- and scientific replication -- using data representing different populations in one's own work or in a Comment. Several controversies in empirical economics illustrate how and how not to behave when replicating others' work. The incentives for replication facing editors, authors and potential replicators are examined. Recognising these incentives, I advance proposals aimed at journal editors that will increase the supply of replication studies, and I propose a way of generating more scientific replication that will make empirical economic research more credible.

Suggested Citation

  • Daniel S. Hamermesh, 2007. "Replication in Economics," NBER Working Papers 13026, National Bureau of Economic Research, Inc.
    • Handle: RePEc:nbr:nberwo:13026
    Note: LS
    as

    Download full text from publisher

    File URL: http://www.nber.org/papers/w13026.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    2. Jere R. Behrman & Mark R. Rosenzweig, 2002. "Does Increasing Women's Schooling Raise the Schooling of the Next Generation?," American Economic Review, American Economic Association, vol. 92(1), pages 323-334, March.
    3. Alan B. Krueger & David Card, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Reply," American Economic Review, American Economic Association, vol. 90(5), pages 1397-1420, December.
    4. David Dollar & Craig Burnside, 2000. "Aid, Policies, and Growth," American Economic Review, American Economic Association, vol. 90(4), pages 847-868, September.
    5. William Wascher & David Neumark, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Comment," American Economic Review, American Economic Association, vol. 90(5), pages 1362-1396, December.
    6. Daniel S. Hamermesh & Peter Schmidt, 2003. "The Determinants of Econometric Society Fellows Elections," Econometrica, Econometric Society, vol. 71(1), pages 399-407, January.
    7. Jere R. Behrman & Mark R. Rosenzweig, 2005. "Does Increasing Women's Schooling Raise the Schooling of the Next Generation? Reply," American Economic Review, American Economic Association, vol. 95(5), pages 1745-1751, December.
    8. Daniel S. Hamermesh, 2002. "International Labor Economics," Journal of Labor Economics, University of Chicago Press, vol. 20(4), pages 709-732, October.
    9. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    10. De Long, J Bradford & Lang, Kevin, 1992. "Are All Economic Hypotheses False?," Journal of Political Economy, University of Chicago Press, vol. 100(6), pages 1257-1272, December.
    11. Caroline M. Hoxby, 2005. "Competition Among Public Schools: A Reply to Rothstein (2004)," NBER Working Papers 11216, National Bureau of Economic Research, Inc.
    12. Gregory Grossman & Richard Sakwa & Rachel Walker & Daniel Nelson & Mike Bowker & Jeffrey Checkel & Elizabeth Coughlan & Derek Aldcroft & David Mason & Kieran Williams & Jan Drewnowski & Andrei Kuznets, 1997. "Reviews," Europe-Asia Studies, Taylor & Francis Journals, vol. 49(5), pages 905-941.
    13. Caroline M. Hoxby, 2000. "Does Competition among Public Schools Benefit Students and Taxpayers?," American Economic Review, American Economic Association, vol. 90(5), pages 1209-1238, December.
    14. Feldstein, Martin S, 1982. "Social Security and Private Saving: Reply," Journal of Political Economy, University of Chicago Press, vol. 90(3), pages 630-642, June.
    15. Hamermesh, Daniel S., 1997. "Some thoughts on replications and reviews," Labour Economics, Elsevier, vol. 4(2), pages 107-109, June.
    16. Hamermesh, Daniel S & Biddle, Jeff E, 1994. "Beauty and the Labor Market," American Economic Review, American Economic Association, vol. 84(5), pages 1174-1194, December.
    17. Feldstein, Martin S, 1974. "Social Security, Induced Retirement, and Aggregate Capital Accumulation," Journal of Political Economy, University of Chicago Press, vol. 82(5), pages 905-926, Sept./Oct.
    18. Leimer, Dean R & Lesnoy, Selig D, 1982. "Social Security and Private Saving: New Time-Series Evidence," Journal of Political Economy, University of Chicago Press, vol. 90(3), pages 606-629, June.
    19. Kate L. Antonovics & Arthur S. Goldberger, 2005. "Does Increasing Women's Schooling Raise the Schooling of the Next Generation? Comment," American Economic Review, American Economic Association, vol. 95(5), pages 1738-1744, December.
    20. Jesse Rothstein, 2005. "Does Competition Among Public Schools Benefit Students and Taxpayers? A Comment on Hoxby (2000)," NBER Working Papers 11215, National Bureau of Economic Research, Inc.
    21. Jesse Rothstein, 2007. "Does Competition Among Public Schools Benefit Students and Taxpayers? Comment," American Economic Review, American Economic Association, vol. 97(5), pages 2026-2037, December.
    22. Craig Burnside & David Dollar, 2004. "Aid, Policies, and Growth: Reply," American Economic Review, American Economic Association, vol. 94(3), pages 781-784, June.
    23. Hunter, John E, 2001. "The Desperate Need for Replications," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 149-158, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(3), pages 715-733, August.
    2. Maren Duvendack & Richard Palmer-Jones, 2013. "Replication of quantitative work in development studies: Experiences and suggestions," Progress in Development Studies, , vol. 13(4), pages 307-322, October.
    3. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    4. Tito Boeri & Jan van Ours, 2013. "The Economics of Imperfect Labor Markets: Second Edition," Economics Books, Princeton University Press, edition 1, number 10142.
    5. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    6. Andrew C. Chang & Phillip Li, 2015. "Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say \"Usually Not\"," Finance and Economics Discussion Series 2015-83, Board of Governors of the Federal Reserve System (U.S.).
    7. Lemos Sara, 2005. "Political Variables as Instruments for the Minimum Wage," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 4(1), pages 1-31, December.
    8. Sara Lemos, 2004. "A Menu of Minimum Wage Variables for Evaluating Wages and Employment Effects: Evidence from Brazil," Discussion Papers in Economics 04/3, Division of Economics, School of Business, University of Leicester.
    9. B.D. McCullough & Kerry Anne McGeary & Teresa D. Harrison, 2008. "Do economics journal archives promote replicable research?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(4), pages 1406-1420, November.
    10. Hernández Alemán, Anastasia & León, Carmelo J., 2018. "La Réplica en el Análisis Económico Aplicado/Replication in Applied Economic Analysis," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 36, pages 317-332, Enero.
    11. Jonathan Gruber & Aaron Yelowitz, 1999. "Public Health Insurance and Private Savings," Journal of Political Economy, University of Chicago Press, vol. 107(6), pages 1249-1274, December.
    12. Amin, Vikesh & Lundborg, Petter & Rooth, Dan-Olof, 2015. "The intergenerational transmission of schooling: Are mothers really less important than fathers?," Economics of Education Review, Elsevier, vol. 47(C), pages 100-117.
    13. Derk Bienen, 2002. "Mindestlohnreformen in Südamerika – ökonomische Rechtfertigung und praktische Umsetzung," Ibero America Institute for Econ. Research (IAI) Discussion Papers 090, Ibero-America Institute for Economic Research.
    14. Mark B. Stewart, 2004. "The Impact of the Introduction of the U.K. Minimum Wage on the Employment Probabilities of Low-Wage Workers," Journal of the European Economic Association, MIT Press, vol. 2(1), pages 67-97, March.
    15. Annette N. Brown & Drew B. Cameron & Benjamin D. K. Wood, 2014. "Quality evidence for policymaking: I'll believe it when I see the replication," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(3), pages 215-235, September.
    16. Shirley, Peter, 2018. "The response of commuting patterns to cross-border policy differentials: Evidence from the American Community Survey," Regional Science and Urban Economics, Elsevier, vol. 73(C), pages 1-16.
    17. Goto, Hideaki, 2008. "Labor Market Competitiveness and Poverty," Working Papers 51159, Cornell University, Department of Applied Economics and Management.
    18. Franklin Mixon, 2002. "Social security trust fund flows and the welfare costs of rent seeking," Applied Economics, Taylor & Francis Journals, vol. 34(8), pages 975-979.
    19. William E. Even & David A. Macpherson, 2014. "The Effect of the Tipped Minimum Wage on Employees in the U.S. Restaurant Industry," Southern Economic Journal, John Wiley & Sons, vol. 80(3), pages 633-655, January.
    20. Tomas Kucera, 2020. "Are Employment Effects of Minimum Wage the Same Across the EU? A Meta-Regression Analysis," Working Papers IES 2020/2, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Jan 2020.

    More about this item

    JEL classification:

    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • C59 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Other

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:nbr:nberwo:13026. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/nberrus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.