IDEAS home Printed from https://ideas.repec.org/p/feb/framed/00701.html
   My bibliography  Save this paper

A "Trojan Horse" in the peer-review process of fee-charging economic journals

Author

Listed:
  • Rocco Caferra
  • Roberto Dell'Anno
  • Andrea Morone

Abstract

This paper aims to unmask the inadequacy of the review process of a sample of fee-charging journals in economics. We submitted a bait-manuscript to 104 academic economic journals to test whether there is a difference in the peer-review process between Article Processing Charges (APC) journals and Traditional journals which do not require a publication fee. The submitted bait-article was based on completely made-up data, with evident errors in terms of methodology, literature, reporting of results, and quality of language. Nevertheless, about half of the APC journals fell in the trap. Their editors accepted the article in the journals and required to pay the publication fee. We conclude that the Traditional model has a more effective incentive-mechanism in selecting articles, based on quality standards. Otherwise, we confirm that the so-called "Predatory Journals" - i.e. academic journals which accept papers without a quality check - exploit the APC scheme to increase their profits. They are also able to enter whitelists (e.g. Scopus, COPE). Accordingly, poor-quality articles published on APC journals shed the lights on the weakness of methodologies based on a mechanical inclusion of academic journals in scientific database indexes, succeeding in being considered for bibliometric evaluations of research institutions or scholars' productivity.

Suggested Citation

  • Rocco Caferra & Roberto Dell'Anno & Andrea Morone, 2020. "A "Trojan Horse" in the peer-review process of fee-charging economic journals," Framed Field Experiments 00701, The Field Experiments Website.
  • Handle: RePEc:feb:framed:00701
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00701.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Johnson, Simon & Kaufmann, Daniel & McMillan, John & Woodruff, Christopher, 2000. "Why do firms hide? Bribes and unofficial activity after communism," Journal of Public Economics, Elsevier, vol. 76(3), pages 495-520, June.
    2. Engle, Robert & Granger, Clive, 2015. "Co-integration and error correction: Representation, estimation, and testing," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 39(3), pages 106-135.
    3. Pierre Perron & Serena Ng, 1996. "Useful Modifications to some Unit Root Tests with Dependent Errors and their Local Asymptotic Properties," Review of Economic Studies, Oxford University Press, vol. 63(3), pages 435-463.
    4. Hendrik P. van Dalen & Kène Henkens, 2012. "Intended and unintended consequences of a publish-or-perish culture: A worldwide survey," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(7), pages 1282-1293, July.
    5. Ruben Durante & Giovanna Labartino & Roberto Perotti, 2011. "Academic Dynasties: Decentralization and Familism in the Italian Academia," NBER Working Papers 17572, National Bureau of Economic Research, Inc.
    6. Serena Ng & Pierre Perron, 2001. "LAG Length Selection and the Construction of Unit Root Tests with Good Size and Power," Econometrica, Econometric Society, vol. 69(6), pages 1519-1554, November.
    7. Seidl, Christian & Schmidt, Ulrich & Grösche, Peter, 2005. "The Performance of Peer Review and a Beauty Contest of Referee Processes of Economics Journals/," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 23, pages 505-551, Diciembre.
    8. Wang, Qi & Waltman, Ludo, 2016. "Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus," Journal of Informetrics, Elsevier, vol. 10(2), pages 347-364.
    9. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    10. Daniele Fanelli & Vincent Larivière, 2016. "Researchers’ Individual Publication Rate Has Not Increased in a Century," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-12, March.
    11. Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
    12. Vincent Larivière & Yves Gingras, 2010. "The impact factor's Matthew Effect: A natural experiment in bibliometrics," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(2), pages 424-427, February.
    13. Loayza, Norman V., 1996. "The economics of the informal sector: a simple model and some empirical evidence from Latin America," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 45(1), pages 129-162, December.
    14. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, February.
    15. Zivot, Eric & Andrews, Donald W K, 2002. "Further Evidence on the Great Crash, the Oil-Price Shock, and the Unit-Root Hypothesis," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 25-44, January.
    16. Cimoli, Mario & Primi, Annalisa & Pugno, Maurizio, 2006. "A low-growth model: informality as a structural constraint," Revista CEPAL, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), April.
    17. Vincent Larivière & Yves Gingras, 2010. "The impact factor's Matthew Effect: A natural experiment in bibliometrics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(2), pages 424-427, February.
    18. Daniele Fanelli, 2010. "Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data," PLOS ONE, Public Library of Science, vol. 5(4), pages 1-7, April.
    19. Martijn Arns, 2014. "Open access is tiring out peer reviewers," Nature, Nature, vol. 515(7528), pages 467-467, November.
    20. MacKinnon, James G, 1996. "Numerical Distribution Functions for Unit Root and Cointegration Tests," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(6), pages 601-618, Nov.-Dec..
    21. Phillips, Peter C B & Ouliaris, S, 1990. "Asymptotic Properties of Residual Based Tests for Cointegration," Econometrica, Econometric Society, vol. 58(1), pages 165-193, January.
    22. Friedman, Eric & Johnson, Simon & Kaufmann, Daniel & Zoido-Lobaton, Pablo, 2000. "Dodging the grabbing hand: the determinants of unofficial activity in 69 countries," Journal of Public Economics, Elsevier, vol. 76(3), pages 459-493, June.
    23. Nelson, Charles R. & Plosser, Charles I., 1982. "Trends and random walks in macroeconmic time series : Some evidence and implications," Journal of Monetary Economics, Elsevier, vol. 10(2), pages 139-162.
    24. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    25. Piotr Sorokowski & Emanuel Kulczycki & Agnieszka Sorokowska & Katarzyna Pisanski, 2017. "Predatory journals recruit fake editor," Nature, Nature, vol. 543(7646), pages 481-483, March.
    26. Joshua S. Gans & George B. Shepherd, 1994. "How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 165-179, Winter.
    27. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giorgio Canarella & Rangan Gupta & Stephen M. Miller & Stephen K. Pollard, 2019. "Unemployment rate hysteresis and the great recession: exploring the metropolitan evidence," Empirical Economics, Springer, vol. 56(1), pages 61-79, January.
    2. Luis F. Martins & Paulo M. M. Rodrigues, 2022. "Tests for segmented cointegration: an application to US governments budgets," Empirical Economics, Springer, vol. 63(2), pages 567-600, August.
    3. D. Ventosa-Santaulària, 2009. "Spurious Regression," Journal of Probability and Statistics, Hindawi, vol. 2009, pages 1-27, August.
    4. Niels Haldrup & Robinson Kruse & Timo Teräsvirta & Rasmus T. Varneskov, 2013. "Unit roots, non-linearities and structural breaks," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 4, pages 61-94, Edward Elgar Publishing.
    5. Mohamed Maher & Yanzhi Zhao, 2022. "Do Political Instability and Military Expenditure Undermine Economic Growth in Egypt? Evidence from the ARDL Approach," Defence and Peace Economics, Taylor & Francis Journals, vol. 33(8), pages 956-979, November.
    6. Junaid Ashraf, 2023. "Does political risk undermine environment and economic development in Pakistan? Empirical evidence from China–Pakistan economic corridor," Economic Change and Restructuring, Springer, vol. 56(1), pages 581-608, February.
    7. Marco Morales, 2014. "Cointegration testing under structural change: reducing size distortions and improving power of residual based tests," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(2), pages 265-282, June.
    8. Yau, Hwey-Yun & Nieh, Chien-Chung, 2006. "Interrelationships among stock prices of Taiwan and Japan and NTD/Yen exchange rate," Journal of Asian Economics, Elsevier, vol. 17(3), pages 535-552, June.
    9. Christou, Christina & Gupta, Rangan & Nyakabawo, Wendy & Wohar, Mark E., 2018. "Do house prices hedge inflation in the US? A quantile cointegration approach," International Review of Economics & Finance, Elsevier, vol. 54(C), pages 15-26.
    10. Darne, Olivier & Diebolt, Claude, 2004. "Unit roots and infrequent large shocks: new international evidence on output," Journal of Monetary Economics, Elsevier, vol. 51(7), pages 1449-1465, October.
    11. Vicente German-Soto & Chapa Cantú, 2015. "Cointegration with structural changes between per capita product and income inequality in Mexico," Applied Economics, Taylor & Francis Journals, vol. 47(49), pages 5215-5228, October.
    12. Gaolu Zou & K. W. Chau, 2019. "Long- and Short-Run Effects of Fuel Prices on Freight Transportation Volumes in Shanghai," Sustainability, MDPI, vol. 11(18), pages 1-12, September.
    13. Bond, Derek & Harrison, Michael J & Hession, Niall & O’Brien, Edward J., 2006. "Some Empirical Observations on the Forward Exchange Rate Anomaly," Research Technical Papers 3/RT/06, Central Bank of Ireland.
    14. Bornmann, Lutz & Haunschild, Robin & Mutz, Rüdiger, 2020. "Should citations be field-normalized in evaluative bibliometrics? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 14(4).
    15. Mahalik, Mantu Kumar & Babu, M. Suresh & Loganathan, Nanthakumar & Shahbaz, Muhammad, 2017. "Does financial development intensify energy consumption in Saudi Arabia?," Renewable and Sustainable Energy Reviews, Elsevier, vol. 75(C), pages 1022-1034.
    16. Rapach, David E. & Weber, Christian E., 2004. "Are real interest rates really nonstationary? New evidence from tests with good size and power," Journal of Macroeconomics, Elsevier, vol. 26(3), pages 409-430, September.
    17. Peter C. B. Phillips & Zhijie Xiao, 1998. "A Primer on Unit Root Testing," Journal of Economic Surveys, Wiley Blackwell, vol. 12(5), pages 423-470, December.
    18. Pinar Evrim-Mandaci & Hakan Kahyaoglu & Efe Caglar Cagli, 2011. "Stock and bond market interactions with two regime shifts: evidence from Turkey," Applied Financial Economics, Taylor & Francis Journals, vol. 21(18), pages 1355-1368.
    19. Natalya KETENCİ & Ebru Tomris AYDOĞAN, 2019. "Determinants of Economic Growth in Turkey in the Presence of Structural Breaks," Sosyoekonomi Journal, Sosyoekonomi Society, issue 27(42).
    20. Jürgen Wolters & Uwe Hassler, 2006. "Unit root testing," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(1), pages 43-58, March.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • A10 - General Economics and Teaching - - General Economics - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:framed:00701. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.fieldexperiments.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: David Franks (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.