IDEAS home Printed from https://ideas.repec.org/a/wly/canjec/v40y2007i3p715-733.html
   My bibliography  Save this article

Viewpoint: Replication in economics

Author

Listed:
  • Daniel S. Hamermesh

Abstract

. This examination of the role and potential for replication in economics points out the paucity of both pure replication – checking on others' published papers using their data – and scientific replication – using data representing different populations in one's own work or in a comment. Several controversies in empirical economics are used to illustrate how and how not to behave when replicating others' work. The incentives for replication are examined, and proposals aimed at journal editors and authors are advanced that might stimulate an activity that most economists applaud but few perform. L'examen du rôle potentiel de la réplication en science économique souligne la pauvretéà la fois de la réplication pure (la vérification des résultats des textes publiés en utilisant les données utilisées dans ces travaux) et de la réplication scientifique (l'utilisation de données tirées de populations différentes pour valider des résultats). Plusieurs controverses en économie empirique sont utilisées pour illustrer comment se comporter et ne pas se comporter dans la réplication des travaux d'autrui. Les incitations à faire de la réplication sont analysées, et certaines suggestions sont faites aux rédacteurs de revues et aux auteurs afin de stimuler une activité plus grande dans ce registre – que les économistes applaudissent mais que bien peu acceptent de pratiquer.

Suggested Citation

  • Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(3), pages 715-733, August.
    • Handle: RePEc:wly:canjec:v:40:y:2007:i:3:p:715-733
    DOI: 10.1111/j.1365-2966.2007.00428.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1365-2966.2007.00428.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1365-2966.2007.00428.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    2. Caroline M. Hoxby, 2000. "Does Competition among Public Schools Benefit Students and Taxpayers?," American Economic Review, American Economic Association, vol. 90(5), pages 1209-1238, December.
    3. Jere R. Behrman & Mark R. Rosenzweig, 2002. "Does Increasing Women's Schooling Raise the Schooling of the Next Generation?," American Economic Review, American Economic Association, vol. 92(1), pages 323-334, March.
    4. Steven D. Levitt & John A. List, 2007. "Viewpoint: On the generalizability of lab behaviour to the field," Canadian Journal of Economics, Canadian Economics Association, vol. 40(2), pages 347-370, May.
    5. Feldstein, Martin S, 1982. "Social Security and Private Saving: Reply," Journal of Political Economy, University of Chicago Press, vol. 90(3), pages 630-642, June.
    6. Alan B. Krueger & David Card, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Reply," American Economic Review, American Economic Association, vol. 90(5), pages 1397-1420, December.
    7. David Dollar & Craig Burnside, 2000. "Aid, Policies, and Growth," American Economic Review, American Economic Association, vol. 90(4), pages 847-868, September.
    8. Hamermesh, Daniel S., 1997. "Some thoughts on replications and reviews," Labour Economics, Elsevier, vol. 4(2), pages 107-109, June.
    9. William Wascher & David Neumark, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Comment," American Economic Review, American Economic Association, vol. 90(5), pages 1362-1396, December.
    10. De Long, J Bradford & Lang, Kevin, 1992. "Are All Economic Hypotheses False?," Journal of Political Economy, University of Chicago Press, vol. 100(6), pages 1257-1272, December.
    11. Hamermesh, Daniel S & Biddle, Jeff E, 1994. "Beauty and the Labor Market," American Economic Review, American Economic Association, vol. 84(5), pages 1174-1194, December.
    12. Feldstein, Martin S, 1974. "Social Security, Induced Retirement, and Aggregate Capital Accumulation," Journal of Political Economy, University of Chicago Press, vol. 82(5), pages 905-926, Sept./Oct.
    13. Jere R. Behrman & Mark R. Rosenzweig, 2005. "Does Increasing Women's Schooling Raise the Schooling of the Next Generation? Reply," American Economic Review, American Economic Association, vol. 95(5), pages 1745-1751, December.
    14. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    15. Leimer, Dean R & Lesnoy, Selig D, 1982. "Social Security and Private Saving: New Time-Series Evidence," Journal of Political Economy, University of Chicago Press, vol. 90(3), pages 606-629, June.
    16. Daniel S. Hamermesh, 2002. "International Labor Economics," Journal of Labor Economics, University of Chicago Press, vol. 20(4), pages 709-732, October.
    17. B. D. McCullough & H. D. Vinod, 2003. "Verifying the Solution from a Nonlinear Solver: A Case Study," American Economic Review, American Economic Association, vol. 93(3), pages 873-892, June.
    18. Kate L. Antonovics & Arthur S. Goldberger, 2005. "Does Increasing Women's Schooling Raise the Schooling of the Next Generation? Comment," American Economic Review, American Economic Association, vol. 95(5), pages 1738-1744, December.
    19. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    20. Martin Feldstein, 1982. "The Welfare Cost of Social Security's Impact on Private Saving," NBER Working Papers 0969, National Bureau of Economic Research, Inc.
    21. Jesse Rothstein, 2005. "Does Competition Among Public Schools Benefit Students and Taxpayers? A Comment on Hoxby (2000)," NBER Working Papers 11215, National Bureau of Economic Research, Inc.
    22. Caroline M. Hoxby, 2005. "Competition Among Public Schools: A Reply to Rothstein (2004)," NBER Working Papers 11216, National Bureau of Economic Research, Inc.
    23. William Easterly & Ross Levine & David Roodman, 2004. "Aid, Policies, and Growth: Comment," American Economic Review, American Economic Association, vol. 94(3), pages 774-780, June.
    24. Craig Burnside & David Dollar, 2004. "Aid, Policies, and Growth: Reply," American Economic Review, American Economic Association, vol. 94(3), pages 781-784, June.
    25. Hunter, John E, 2001. "The Desperate Need for Replications," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 28(1), pages 149-158, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hamermesh, Daniel S., 2007. "Replication in Economics," IZA Discussion Papers 2760, Institute of Labor Economics (IZA).
    2. Maren Duvendack & Richard Palmer-Jones, 2013. "Replication of quantitative work in development studies: Experiences and suggestions," Progress in Development Studies, , vol. 13(4), pages 307-322, October.
    3. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    4. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    5. B.D. McCullough & Kerry Anne McGeary & Teresa D. Harrison, 2008. "Do economics journal archives promote replicable research?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 41(4), pages 1406-1420, November.
    6. Andrew C. Chang & Phillip Li, 2015. "Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say \"Usually Not\"," Finance and Economics Discussion Series 2015-83, Board of Governors of the Federal Reserve System (U.S.).
    7. Hernández Alemán, Anastasia & León, Carmelo J., 2018. "La Réplica en el Análisis Económico Aplicado/Replication in Applied Economic Analysis," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 36, pages 317-332, Enero.
    8. Tito Boeri & Jan van Ours, 2013. "The Economics of Imperfect Labor Markets: Second Edition," Economics Books, Princeton University Press, edition 1, number 10142.
    9. Annette N. Brown & Drew B. Cameron & Benjamin D. K. Wood, 2014. "Quality evidence for policymaking: I'll believe it when I see the replication," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(3), pages 215-235, September.
    10. Lemos Sara, 2005. "Political Variables as Instruments for the Minimum Wage," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 4(1), pages 1-33, December.
    11. Franklin Mixon, 2002. "Social security trust fund flows and the welfare costs of rent seeking," Applied Economics, Taylor & Francis Journals, vol. 34(8), pages 975-979.
    12. Mark J. McCabe & Frank Mueller-Langer, 2019. "Does Data Disclosure Increase Citations? Empirical Evidence from a Natural Experiment in Leading Economics Journals," JRC Working Papers on Digital Economy 2019-02, Joint Research Centre.
    13. Sara Lemos, 2004. "A Menu of Minimum Wage Variables for Evaluating Wages and Employment Effects: Evidence from Brazil," Discussion Papers in Economics 04/3, Division of Economics, School of Business, University of Leicester.
    14. repec:dpr:wpaper:0905 is not listed on IDEAS
    15. Charles Yuji Horioka, 2014. "The Life and Work Of Martin Stuart (“Marty”) Feldstein," UP School of Economics Discussion Papers 201410, University of the Philippines School of Economics.
    16. Charles S. Wassell, Jr., 2018. "Social Security and saving: A time-series econometrics pedagogical example (with code)," The Journal of Economic Education, Taylor & Francis Journals, vol. 49(1), pages 103-114, January.
    17. Bissonnette, L. & van Soest, A.H.O., 2010. "Retirement Expectations, Preferences, and Decisions," Other publications TiSEM 45e93b08-cc1d-47c6-ba06-d, Tilburg University, School of Economics and Management.
    18. Martin Feldstein, 1985. "Should Social Security Be Means Tested?," NBER Working Papers 1775, National Bureau of Economic Research, Inc.
    19. Jonathan Gruber & Aaron Yelowitz, 1999. "Public Health Insurance and Private Savings," Journal of Political Economy, University of Chicago Press, vol. 107(6), pages 1249-1274, December.
    20. Amin, Vikesh & Lundborg, Petter & Rooth, Dan-Olof, 2015. "The intergenerational transmission of schooling: Are mothers really less important than fathers?," Economics of Education Review, Elsevier, vol. 47(C), pages 100-117.
    21. Juliana Yael Milovich, 2018. "Does Aid Reduce Poverty?," OPHI Working Papers ophiwp122.pdf, Queen Elizabeth House, University of Oxford.

    More about this item

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • C59 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:canjec:v:40:y:2007:i:3:p:715-733. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1111/(ISSN)1540-5982 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.