IDEAS home Printed from https://ideas.repec.org/p/feb/framed/00701.html
   My bibliography  Save this paper

A "Trojan Horse" in the peer-review process of fee-charging economic journals

Author

Listed:
  • Rocco Caferra
  • Roberto Dell'Anno
  • Andrea Morone

Abstract

This paper aims to unmask the inadequacy of the review process of a sample of fee-charging journals in economics. We submitted a bait-manuscript to 104 academic economic journals to test whether there is a difference in the peer-review process between Article Processing Charges (APC) journals and Traditional journals which do not require a publication fee. The submitted bait-article was based on completely made-up data, with evident errors in terms of methodology, literature, reporting of results, and quality of language. Nevertheless, about half of the APC journals fell in the trap. Their editors accepted the article in the journals and required to pay the publication fee. We conclude that the Traditional model has a more effective incentive-mechanism in selecting articles, based on quality standards. Otherwise, we confirm that the so-called "Predatory Journals" - i.e. academic journals which accept papers without a quality check - exploit the APC scheme to increase their profits. They are also able to enter whitelists (e.g. Scopus, COPE). Accordingly, poor-quality articles published on APC journals shed the lights on the weakness of methodologies based on a mechanical inclusion of academic journals in scientific database indexes, succeeding in being considered for bibliometric evaluations of research institutions or scholars' productivity.

Suggested Citation

  • Rocco Caferra & Roberto Dell'Anno & Andrea Morone, 2020. "A "Trojan Horse" in the peer-review process of fee-charging economic journals," Framed Field Experiments 00701, The Field Experiments Website.
  • Handle: RePEc:feb:framed:00701
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00701.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Simon Johnson & Daniel Kaufmann & John McMillan & Christopher Woodruff, 2007. "Why Do Firms Hide? Bribes and Unofficial Activity after Communism," Palgrave Macmillan Books, in: Erik Berglöf & Gérard Roland (ed.), The Economics of Transition, chapter 10, pages 335-359, Palgrave Macmillan.
    2. Robert Engle & Clive Granger, 2015. "Co-integration and error correction: Representation, estimation, and testing," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 39(3), pages 106-135.
    3. Pierre Perron & Serena Ng, 1996. "Useful Modifications to some Unit Root Tests with Dependent Errors and their Local Asymptotic Properties," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 63(3), pages 435-463.
    4. Hendrik P. van Dalen & Kène Henkens, 2012. "Intended and unintended consequences of a publish-or-perish culture: A worldwide survey," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(7), pages 1282-1293, July.
    5. Ruben Durante & Giovanna Labartino & Roberto Perotti, 2011. "Academic Dynasties: Decentralization and Familism in the Italian Academia," NBER Working Papers 17572, National Bureau of Economic Research, Inc.
    6. Serena Ng & Pierre Perron, 2001. "LAG Length Selection and the Construction of Unit Root Tests with Good Size and Power," Econometrica, Econometric Society, vol. 69(6), pages 1519-1554, November.
    7. Eric Friedman & Simon Johnson & Daniel Kaufmann & Pablo Zoido-Lobaton, 2007. "Dodging the Grabbing Hand: The Determinants of Unofficial Activity in 69 Countries," Palgrave Macmillan Books, in: Erik Berglöf & Gérard Roland (ed.), The Economics of Transition, chapter 9, pages 298-334, Palgrave Macmillan.
    8. Seidl, Christian & Schmidt, Ulrich & Grösche, Peter, 2005. "The Performance of Peer Review and a Beauty Contest of Referee Processes of Economics Journals/," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 23, pages 505-551, Diciembre.
    9. Wang, Qi & Waltman, Ludo, 2016. "Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus," Journal of Informetrics, Elsevier, vol. 10(2), pages 347-364.
    10. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    11. Daniele Fanelli & Vincent Larivière, 2016. "Researchers’ Individual Publication Rate Has Not Increased in a Century," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-12, March.
    12. Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
    13. Vincent Larivière & Yves Gingras, 2010. "The impact factor's Matthew Effect: A natural experiment in bibliometrics," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(2), pages 424-427, February.
    14. Loayza, Norman V., 1996. "The economics of the informal sector: a simple model and some empirical evidence from Latin America," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 45(1), pages 129-162, December.
    15. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    16. Zivot, Eric & Andrews, Donald W K, 2002. "Further Evidence on the Great Crash, the Oil-Price Shock, and the Unit-Root Hypothesis," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 25-44, January.
    17. MacKinnon, James G., 1995. "Numerical Distribution Functions for Unit Root and Cointegration Tests," Queen's Economics Department Working Papers 273322, Queen's University - Department of Economics.
    18. Cimoli, Mario & Primi, Annalisa & Pugno, Maurizio, 2006. "A low-growth model: informality as a structural constraint," Revista CEPAL, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), April.
    19. Vincent Larivière & Yves Gingras, 2010. "The impact factor's Matthew Effect: A natural experiment in bibliometrics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(2), pages 424-427, February.
    20. Daniele Fanelli, 2010. "Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data," PLOS ONE, Public Library of Science, vol. 5(4), pages 1-7, April.
    21. Martijn Arns, 2014. "Open access is tiring out peer reviewers," Nature, Nature, vol. 515(7528), pages 467-467, November.
    22. MacKinnon, James G, 1996. "Numerical Distribution Functions for Unit Root and Cointegration Tests," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(6), pages 601-618, Nov.-Dec..
    23. Phillips, Peter C B & Ouliaris, S, 1990. "Asymptotic Properties of Residual Based Tests for Cointegration," Econometrica, Econometric Society, vol. 58(1), pages 165-193, January.
    24. Nelson, Charles R. & Plosser, Charles I., 1982. "Trends and random walks in macroeconmic time series : Some evidence and implications," Journal of Monetary Economics, Elsevier, vol. 10(2), pages 139-162.
    25. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    26. Piotr Sorokowski & Emanuel Kulczycki & Agnieszka Sorokowska & Katarzyna Pisanski, 2017. "Predatory journals recruit fake editor," Nature, Nature, vol. 543(7646), pages 481-483, March.
    27. Joshua S. Gans & George B. Shepherd, 1994. "How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 165-179, Winter.
    28. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giorgio Canarella & Rangan Gupta & Stephen M. Miller & Stephen K. Pollard, 2019. "Unemployment rate hysteresis and the great recession: exploring the metropolitan evidence," Empirical Economics, Springer, vol. 56(1), pages 61-79, January.
    2. Yau, Hwey-Yun & Nieh, Chien-Chung, 2006. "Interrelationships among stock prices of Taiwan and Japan and NTD/Yen exchange rate," Journal of Asian Economics, Elsevier, vol. 17(3), pages 535-552, June.
    3. Chien-Chung Nieh & Hwey-Yun Yau & Ken Hung & Hong-Kou Ou & Shine Hung, 2013. "Cointegration and causal relationships among steel prices of Mainland China, Taiwan, and USA in the presence of multiple structural changes," Empirical Economics, Springer, vol. 44(2), pages 545-561, April.
    4. Niels Haldrup & Robinson Kruse & Timo Teräsvirta & Rasmus T. Varneskov, 2013. "Unit roots, non-linearities and structural breaks," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 4, pages 61-94, Edward Elgar Publishing.
    5. Gaolu Zou & K. W. Chau, 2019. "Long- and Short-Run Effects of Fuel Prices on Freight Transportation Volumes in Shanghai," Sustainability, MDPI, vol. 11(18), pages 1-12, September.
    6. Marta Gómez-Puig & Simón Sosvilla-Rivero, 2015. "“On the bi-directional causal relationship between public debt and economic growth in EMU countries”," IREA Working Papers 201512, University of Barcelona, Research Institute of Applied Economics, revised May 2015.
    7. Zou, Gao Lu, 2012. "The long-term relationships among China's energy consumption sources and adjustments to its renewable energy policy," Energy Policy, Elsevier, vol. 47(C), pages 456-467.
    8. Chor Foon Tang & Eu Chye Tan, 2012. "Electricity Consumption and Economic Growth in Portugal: Evidence from a Multivariate Framework Analysis," The Energy Journal, , vol. 33(4), pages 22-48, October.
    9. Abdurohman & Budy P. Resosudarmo, 2017. "The Behavior Of Fiscal Policy In Indonesia In Response To Economic Cycles," The Singapore Economic Review (SER), World Scientific Publishing Co. Pte. Ltd., vol. 62(02), pages 377-401, June.
    10. Bond, Derek & Harrison, Michael J & Hession, Niall & O’Brien, Edward J., 2006. "Some Empirical Observations on the Forward Exchange Rate Anomaly," Research Technical Papers 3/RT/06, Central Bank of Ireland.
    11. Christos Kollias & Stephanos Papadamou & Costas Siriopoulos, 2016. "Stock markets and effective exchange rates in European countries: threshold cointegration findings," Eurasian Economic Review, Springer;Eurasia Business and Economics Society, vol. 6(2), pages 215-274, August.
    12. Noriega Antonio E. & Ramos Francia Manuel & Rodríguez-Pérez Cid Alonso, 2015. "Money Demand Estimations in Mexico and of its Stability 1986-2010, as well as Some Examples of its Uses," Working Papers 2015-13, Banco de México.
    13. Luis F. Martins & Paulo M. M. Rodrigues, 2022. "Correction to: Tests for segmented cointegration: an application to US governments budgets," Empirical Economics, Springer, vol. 63(2), pages 601-601, August.
    14. Mohamed Maher & Yanzhi Zhao, 2022. "Do Political Instability and Military Expenditure Undermine Economic Growth in Egypt? Evidence from the ARDL Approach," Defence and Peace Economics, Taylor & Francis Journals, vol. 33(8), pages 956-979, November.
    15. D. Ventosa-Santaulària, 2009. "Spurious Regression," Journal of Probability and Statistics, Hindawi, vol. 2009, pages 1-27, August.
    16. Tang, Chor Foon, 2011. "Multivariate Granger Causality and the Dynamic Relationship between Health Care Spending, Income and Relative Price of Health Care in Malaysia," Hitotsubashi Journal of Economics, Hitotsubashi University, vol. 52(2), pages 199-214, December.
    17. Hanck, Christoph, 2007. "A meta analytic approach to testing for panel cointegration," Technical Reports 2007,02, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    18. Junaid Ashraf, 2023. "Does political risk undermine environment and economic development in Pakistan? Empirical evidence from China–Pakistan economic corridor," Economic Change and Restructuring, Springer, vol. 56(1), pages 581-608, February.
    19. Andreas Brunhart, 2013. "Der Klein(st)staat Liechtenstein und seine grossen Nachbarländer: Eine wachstums- und konjunkturanalytische Gegenüberstellung," Arbeitspapiere 44, Liechtenstein-Institut.
    20. Makin, Anthony J. & Rohde, Nicholas, 2012. "Has Australia's floating exchange rate regime been optimal?," Economic Modelling, Elsevier, vol. 29(4), pages 1338-1343.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • A10 - General Economics and Teaching - - General Economics - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:framed:00701. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Franco Daniel Albino (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.