IDEAS home Printed from https://ideas.repec.org/a/cje/issued/v40y2007i3p715-733.html
   My bibliography  Save this article

Viewpoint: Replication in economics

Author

Listed:
  • Daniel S. Hamermesh

Abstract

This examination of the role and potential for replication in economics points out the paucity of both pure replication - checking on others' published papers using their data - and scientific replication - using data representing different populations in one's own work or in a comment. Several controversies in empirical economics are used to illustrate how and how not to behave when replicating others' work. The incentives for replication are examined, and proposals aimed at journal editors and authors are advanced that might stimulate an activity that most economists applaud but few perform.

Suggested Citation

  • Daniel S. Hamermesh, 2007. "Viewpoint: Replication in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 40(3), pages 715-733, August.
  • Handle: RePEc:cje:issued:v:40:y:2007:i:3:p:715-733
    as

    Download full text from publisher

    To our knowledge, this item is not available for download. To find whether it is available, there are three options:
    1. Check below whether another version of this item is available online.
    2. Check on the provider's web page whether it is in fact available.
    3. Perform a search for a similarly titled item that would be available.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Jere R. Behrman & Mark R. Rosenzweig, 2005. "Does Increasing Women's Schooling Raise the Schooling of the Next Generation? Reply," American Economic Review, American Economic Association, vol. 95(5), pages 1745-1751, December.
    2. Hamermesh, Daniel S & Biddle, Jeff E, 1994. "Beauty and the Labor Market," American Economic Review, American Economic Association, vol. 84(5), pages 1174-1194, December.
    3. Card, David & Krueger, Alan B, 1994. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania," American Economic Review, American Economic Association, vol. 84(4), pages 772-793, September.
    4. Leimer, Dean R & Lesnoy, Selig D, 1982. "Social Security and Private Saving: New Time-Series Evidence," Journal of Political Economy, University of Chicago Press, vol. 90(3), pages 606-629, June.
    5. Daniel S. Hamermesh, 2002. "International Labor Economics," Journal of Labor Economics, University of Chicago Press, vol. 20(4), pages 709-732, October.
    6. B. D. McCullough & H. D. Vinod, 2003. "Verifying the Solution from a Nonlinear Solver: A Case Study," American Economic Review, American Economic Association, vol. 93(3), pages 873-892, June.
    7. Caroline M. Hoxby, 2000. "Does Competition among Public Schools Benefit Students and Taxpayers?," American Economic Review, American Economic Association, vol. 90(5), pages 1209-1238, December.
    8. Kate L. Antonovics & Arthur S. Goldberger, 2005. "Does Increasing Women's Schooling Raise the Schooling of the Next Generation? Comment," American Economic Review, American Economic Association, vol. 95(5), pages 1738-1744, December.
    9. Jere R. Behrman & Mark R. Rosenzweig, 2002. "Does Increasing Women's Schooling Raise the Schooling of the Next Generation?," American Economic Review, American Economic Association, vol. 92(1), pages 323-334, March.
    10. Steven D. Levitt & John A. List, 2007. "Viewpoint: On the generalizability of lab behaviour to the field," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 40(2), pages 347-370, May.
    11. Glenn Ellison, 2002. "The Slowdown of the Economics Publishing Process," Journal of Political Economy, University of Chicago Press, vol. 110(5), pages 947-993, October.
    12. De Long, J Bradford & Lang, Kevin, 1992. "Are All Economic Hypotheses False?," Journal of Political Economy, University of Chicago Press, vol. 100(6), pages 1257-1272, December.
    13. Martin Feldstein, 1982. "The Welfare Cost of Social Security's Impact on Private Saving," NBER Working Papers 0969, National Bureau of Economic Research, Inc.
    14. Feldstein, Martin S, 1982. "Social Security and Private Saving: Reply," Journal of Political Economy, University of Chicago Press, vol. 90(3), pages 630-642, June.
    15. William Easterly & Ross Levine & David Roodman, 2004. "Aid, Policies, and Growth: Comment," American Economic Review, American Economic Association, vol. 94(3), pages 774-780, June.
    16. David Dollar & Craig Burnside, 2000. "Aid, Policies, and Growth," American Economic Review, American Economic Association, vol. 90(4), pages 847-868, September.
    17. Hamermesh, Daniel S., 1997. "Some thoughts on replications and reviews," Labour Economics, Elsevier, vol. 4(2), pages 107-109, June.
    18. William Wascher & David Neumark, 2000. "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania: Comment," American Economic Review, American Economic Association, vol. 90(5), pages 1362-1396, December.
    19. Feldstein, Martin S, 1974. "Social Security, Induced Retirement, and Aggregate Capital Accumulation," Journal of Political Economy, University of Chicago Press, vol. 82(5), pages 905-926, Sept./Oct.
    20. Hunter, John E, 2001. "The Desperate Need for Replications," Journal of Consumer Research, Oxford University Press, vol. 28(1), pages 149-158, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hamermesh, Daniel S., 2007. "Replication in Economics," IZA Discussion Papers 2760, Institute of Labor Economics (IZA).
    2. Garret Christensen & Edward Miguel, 2018. "Transparency, Reproducibility, and the Credibility of Economics Research," Journal of Economic Literature, American Economic Association, vol. 56(3), pages 920-980, September.
    3. Christensen, Garret & Miguel, Edward & Sturdy, Jennifer, 2017. "Transparency, Reproducibility, and the Credibility of Economics Research," MetaArXiv 9a3rw, Center for Open Science.
    4. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    5. Annette N. Brown & Drew B. Cameron & Benjamin D. K. Wood, 2014. "Quality evidence for policymaking: I'll believe it when I see the replication," Journal of Development Effectiveness, Taylor & Francis Journals, vol. 6(3), pages 215-235, September.
    6. Franklin Mixon, 2002. "Social security trust fund flows and the welfare costs of rent seeking," Applied Economics, Taylor & Francis Journals, vol. 34(8), pages 975-979.
    7. repec:dpr:wpaper:0905 is not listed on IDEAS
    8. Charles Yuji Horioka, 2014. "The Life and Work Of Martin Stuart (“Marty”) Feldstein," UP School of Economics Discussion Papers 201410, University of the Philippines School of Economics.
    9. Charles S. Wassell, Jr., 2018. "Social Security and saving: A time-series econometrics pedagogical example (with code)," The Journal of Economic Education, Taylor & Francis Journals, vol. 49(1), pages 103-114, January.
    10. Hernández Alemán, Anastasia & León, Carmelo J., 2018. "La Réplica en el Análisis Económico Aplicado/Replication in Applied Economic Analysis," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 36, pages 317-332, Enero.
    11. Bissonnette, L. & van Soest, A.H.O., 2010. "Retirement Expectations, Preferences, and Decisions," Other publications TiSEM 45e93b08-cc1d-47c6-ba06-d, Tilburg University, School of Economics and Management.
    12. Tito Boeri & Jan van Ours, 2013. "The Economics of Imperfect Labor Markets: Second Edition," Economics Books, Princeton University Press, edition 1, number 10142.
    13. Andrew C. Chang & Phillip Li, 2015. "Is Economics Research Replicable? Sixty Published Papers from Thirteen Journals Say \"Usually Not\"," Finance and Economics Discussion Series 2015-83, Board of Governors of the Federal Reserve System (U.S.).
    14. Martin Feldstein, 1985. "Should Social Security Be Means Tested?," NBER Working Papers 1775, National Bureau of Economic Research, Inc.
    15. Jonathan Gruber & Aaron Yelowitz, 1999. "Public Health Insurance and Private Savings," Journal of Political Economy, University of Chicago Press, vol. 107(6), pages 1249-1274, December.
    16. Amin, Vikesh & Lundborg, Petter & Rooth, Dan-Olof, 2015. "The intergenerational transmission of schooling: Are mothers really less important than fathers?," Economics of Education Review, Elsevier, vol. 47(C), pages 100-117.
    17. Lemos Sara, 2005. "Political Variables as Instruments for the Minimum Wage," The B.E. Journal of Economic Analysis & Policy, De Gruyter, vol. 4(1), pages 1-33, December.
    18. Ashraf, Nava & Karlan, Dean & Yin, Wesley, 2010. "Female Empowerment: Impact of a Commitment Savings Product in the Philippines," World Development, Elsevier, vol. 38(3), pages 333-344, March.
    19. Omar Al-Ubaydli & John List, 2013. "On the Generalizability of Experimental Results in Economics: With A Response To Camerer," Artefactual Field Experiments j0001, The Field Experiments Website.
    20. de Haan, Monique & Plug, Erik, 2006. "Estimates of the Effect of Parents’ Schooling on Children’s Schooling Using Censored and Uncensored Samples," IZA Discussion Papers 2416, Institute of Labor Economics (IZA).
    21. Mark J. McCabe & Frank Mueller-Langer, 2019. "Does Data Disclosure Increase Citations? Empirical Evidence from a Natural Experiment in Leading Economics Journals," JRC Working Papers on Digital Economy 2019-02, Joint Research Centre (Seville site).

    More about this item

    JEL classification:

    • B41 - Schools of Economic Thought and Methodology - - Economic Methodology - - - Economic Methodology
    • A14 - General Economics and Teaching - - General Economics - - - Sociology of Economics
    • C59 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cje:issued:v:40:y:2007:i:3:p:715-733. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/ceaaaea.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Prof. Werner Antweiler (email available below). General contact details of provider: https://edirc.repec.org/data/ceaaaea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.