IDEAS home Printed from https://ideas.repec.org/a/sae/amerec/v36y1992i1p29-34.html
   My bibliography  Save this article

The Publication Incidence of Replications and Critical Commentary in Economics

Author

Listed:
  • Raymond Hubbard
  • Daniel E. Vetter

Abstract

Replication is not common in the economics literature. No replications were found in a sampling of 1,698 papers from three major economics journals. Only 5.4 percent were replications with extensions, and they accounted for only four percent of journal space devoted to research reports. The replications with extensions generally produced results that conflicted with the original works. Of the 92 extensions published, 65.2 percent conflicted with the earlier results, and only 20 percent provided full confirmation.

Suggested Citation

  • Raymond Hubbard & Daniel E. Vetter, 1992. "The Publication Incidence of Replications and Critical Commentary in Economics," The American Economist, Sage Publications, vol. 36(1), pages 29-34, March.
    • Handle: RePEc:sae:amerec:v:36:y:1992:i:1:p:29-34
    DOI: 10.1177/056943459203600106
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/056943459203600106
    Download Restriction: no
    File URL: https://libkey.io/10.1177/056943459203600106?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    2. Feige, Edgar L, 1975. "The Consequences of Journal Editorial Policies and a Suggestion for Revision," Journal of Political Economy, University of Chicago Press, vol. 83(6), pages 1291-1295, December.
    3. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1986. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project," American Economic Review, American Economic Association, vol. 76(4), pages 587-603, September.
    4. Merrick, John J, Jr, 1988. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project: Comment," American Economic Review, American Economic Association, vol. 78(5), pages 1160-1161, December.
    5. David Laband & John Sophocleus, 1985. "Revealed preference for economics journals: Citations as dollar votes," Public Choice, Springer, vol. 46(3), pages 317-324, January.
    6. Dewald, William G & Thursby, Jerry G & Anderson, Richard G, 1988. "Replication in Empirical Economics: The Journal of Money, Credit and Banking Project: Reply," American Economic Review, American Economic Association, vol. 78(5), pages 1162-1163, December.
    7. Mayer, Thomas, 1980. "Economics as a Hard Science: Realistic Goal or Wishful Thinking?," Economic Inquiry, Western Economic Association International, vol. 18(2), pages 165-178, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Doucouliagos, Hristos & Paldam, Martin & Stanley, T.D., 2018. "Skating on thin evidence: Implications for public policy," European Journal of Political Economy, Elsevier, vol. 54(C), pages 16-25.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maren Duvendack & Richard W. Palmer-Jones & W. Robert Reed, 2015. "Replications in Economics: A Progress Report," Econ Journal Watch, Econ Journal Watch, vol. 12(2), pages 164–191-1, May.
    2. Raymond Hubbard & JS Armstrong, 2005. "Replications and Extensions in Marketing – Rarely Published But Quite Contrary," General Economics and Teaching 0502051, University Library of Munich, Germany.
    3. Hubbard, Raymond & Vetter, Daniel E., 1996. "An empirical comparison of published replication research in accounting, economics, finance, management, and marketing," Journal of Business Research, Elsevier, vol. 35(2), pages 153-164, February.
    4. Steven Caudill, 1990. "Econometrics in Theory and Practice," Eastern Economic Journal, Eastern Economic Association, vol. 16(3), pages 249-256, Jul-Sep.
    5. Grahame Thompson, 1993. "Causality in economics: Rhetorical ethic or positivist empiric?," Quality & Quantity: International Journal of Methodology, Springer, vol. 27(1), pages 47-71, February.
    6. Thomas Mayer, 2012. "Ziliak and McCloskey's Criticisms of Significance Tests: An Assessment," Econ Journal Watch, Econ Journal Watch, vol. 9(3), pages 256-297, September.
    7. Robison, Lindon J. & Colyer, Dale, 1994. "Reflections On Relevance Of Professional Journals," Journal of Agricultural and Applied Economics, Southern Agricultural Economics Association, vol. 26(1), pages 1-16, July.
    8. Pedro Cosme Costa Vieira, 2004. "Statistical variability of top ranking economics journals impact," Applied Economics Letters, Taylor & Francis Journals, vol. 11(15), pages 945-948.
    9. Leonard E. Burman & W. Robert Reed & James Alm, 2011. "A Call for Replication Studies," Public Finance Review, , vol. 39(1), pages 190-190, January.
    10. Wohlrabe, Klaus, 2016. "Taking the Temperature: A Meta-Ranking of Economics Journals," MPRA Paper 68933, University Library of Munich, Germany.
    11. Sandra Rousseau, 2008. "Journal evaluation by environmental and resource economists: A survey," Scientometrics, Springer;Akadémiai Kiadó, vol. 77(2), pages 223-233, November.
    12. R. Murray Lindsay, 1994. "Publication System Biases Associated with the Statistical Testing Paradigm," Contemporary Accounting Research, John Wiley & Sons, vol. 11(1), pages 33-57, June.
    13. Almudena Sevilla Sanz & Annalisa Cristini, 2011. "Do House Prices Affect Consumption? A Comparison Exercise," Economics Series Working Papers 589, University of Oxford, Department of Economics.
    14. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    15. Martin Macháček, 2004. "Komparace tematické struktury časopiseckých publikací českých a evropských ekonomů (1999 - 2002) [Comparison of the thematic structure of journal articles by czech and european economists]," Politická ekonomie, Prague University of Economics and Business, vol. 2004(1), pages 74-90.
    16. Petrick, Martin, 2004. "Can Econometric Analysis Make (Agricultural) Economics A Hard Science? Critical Remarks And Implications For Economic Methodology," IAMO Discussion Papers 14911, Institute of Agricultural Development in Transition Economies (IAMO).
    17. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    18. David Card, 2022. "Design-Based Research in Empirical Microeconomics," American Economic Review, American Economic Association, vol. 112(6), pages 1773-1781, June.
    19. Klos, Alexander & Rottke, Simon, 2013. "Saving and Consumption When Children Move Out," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79786, Verein für Socialpolitik / German Economic Association.
    20. Jean Heck & Peter Zaleski, 2006. "The most frequent contributors to the elite economics journals: Half century of contributions to the “Blue ribbon eight”," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 30(1), pages 1-37, March.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:amerec:v:36:y:1992:i:1:p:29-34. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: http://journals.sagepub.com/home/aex .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.