IDEAS home Printed from https://ideas.repec.org/p/feb/framed/00701.html
   My bibliography  Save this paper

A "Trojan Horse" in the peer-review process of fee-charging economic journals

Author

Listed:
  • Rocco Caferra
  • Roberto Dell'Anno
  • Andrea Morone

Abstract

This paper aims to unmask the inadequacy of the review process of a sample of fee-charging journals in economics. We submitted a bait-manuscript to 104 academic economic journals to test whether there is a difference in the peer-review process between Article Processing Charges (APC) journals and Traditional journals which do not require a publication fee. The submitted bait-article was based on completely made-up data, with evident errors in terms of methodology, literature, reporting of results, and quality of language. Nevertheless, about half of the APC journals fell in the trap. Their editors accepted the article in the journals and required to pay the publication fee. We conclude that the Traditional model has a more effective incentive-mechanism in selecting articles, based on quality standards. Otherwise, we confirm that the so-called "Predatory Journals" - i.e. academic journals which accept papers without a quality check - exploit the APC scheme to increase their profits. They are also able to enter whitelists (e.g. Scopus, COPE). Accordingly, poor-quality articles published on APC journals shed the lights on the weakness of methodologies based on a mechanical inclusion of academic journals in scientific database indexes, succeeding in being considered for bibliometric evaluations of research institutions or scholars' productivity.

Suggested Citation

  • Rocco Caferra & Roberto Dell'Anno & Andrea Morone, 2020. "A "Trojan Horse" in the peer-review process of fee-charging economic journals," Framed Field Experiments 00701, The Field Experiments Website.
  • Handle: RePEc:feb:framed:00701
    as

    Download full text from publisher

    File URL: http://s3.amazonaws.com/fieldexperiments-papers2/papers/00701.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Johnson, Simon & Kaufmann, Daniel & McMillan, John & Woodruff, Christopher, 2000. "Why do firms hide? Bribes and unofficial activity after communism," Journal of Public Economics, Elsevier, vol. 76(3), pages 495-520, June.
    2. Seidl, Christian & Schmidt, Ulrich & Grösche, Peter, 2005. "The Performance of Peer Review and a Beauty Contest of Referee Processes of Economics Journals/," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 23, pages 505-551, Diciembre.
    3. Wang, Qi & Waltman, Ludo, 2016. "Large-scale analysis of the accuracy of the journal classification systems of Web of Science and Scopus," Journal of Informetrics, Elsevier, vol. 10(2), pages 347-364.
    4. Daniele Fanelli & Vincent Larivière, 2016. "Researchers’ Individual Publication Rate Has Not Increased in a Century," PLOS ONE, Public Library of Science, vol. 11(3), pages 1-12, March.
    5. Moed, H. F. & Burger, W. J. M. & Frankfort, J. G. & Van Raan, A. F. J., 1985. "The use of bibliometric data for the measurement of university research performance," Research Policy, Elsevier, vol. 14(3), pages 131-149, June.
    6. Zivot, Eric & Andrews, Donald W K, 2002. "Further Evidence on the Great Crash, the Oil-Price Shock, and the Unit-Root Hypothesis," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 25-44, January.
    7. Hendrik P. van Dalen & Kène Henkens, 2012. "Intended and unintended consequences of a publish‐or‐perish culture: A worldwide survey," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(7), pages 1282-1293, July.
    8. Vincent Larivière & Yves Gingras, 2010. "The impact factor's Matthew Effect: A natural experiment in bibliometrics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(2), pages 424-427, February.
    9. Joshua S. Gans & George B. Shepherd, 1994. "How Are the Mighty Fallen: Rejected Classic Articles by Leading Economists," Journal of Economic Perspectives, American Economic Association, vol. 8(1), pages 165-179, Winter.
    10. Engle, Robert & Granger, Clive, 2015. "Co-integration and error correction: Representation, estimation, and testing," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 39(3), pages 106-135.
    11. Pierre Perron & Serena Ng, 1996. "Useful Modifications to some Unit Root Tests with Dependent Errors and their Local Asymptotic Properties," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 63(3), pages 435-463.
    12. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    13. Vincent Larivière & Yves Gingras, 2010. "The impact factor's Matthew Effect: A natural experiment in bibliometrics," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(2), pages 424-427, February.
    14. Loayza, Norman V., 1996. "The economics of the informal sector: a simple model and some empirical evidence from Latin America," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 45(1), pages 129-162, December.
    15. MacKinnon, James G, 1996. "Numerical Distribution Functions for Unit Root and Cointegration Tests," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(6), pages 601-618, Nov.-Dec..
    16. Friedman, Eric & Johnson, Simon & Kaufmann, Daniel & Zoido-Lobaton, Pablo, 2000. "Dodging the grabbing hand: the determinants of unofficial activity in 69 countries," Journal of Public Economics, Elsevier, vol. 76(3), pages 459-493, June.
    17. Perotti, Roberto & Labartino, Giovanna, 2011. "Academic Dynasties: Decentralization and Familism in the Italian Academia," CEPR Discussion Papers 8645, C.E.P.R. Discussion Papers.
    18. Nelson, Charles R. & Plosser, Charles I., 1982. "Trends and random walks in macroeconmic time series : Some evidence and implications," Journal of Monetary Economics, Elsevier, vol. 10(2), pages 139-162.
    19. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    20. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    21. Cimoli, Mario & Primi, Annalisa & Pugno, Maurizio, 2006. "A low-growth model: informality as a structural constraint," Revista CEPAL, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL), April.
    22. Daniele Fanelli, 2010. "Do Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data," PLOS ONE, Public Library of Science, vol. 5(4), pages 1-7, April.
    23. Martijn Arns, 2014. "Open access is tiring out peer reviewers," Nature, Nature, vol. 515(7528), pages 467-467, November.
    24. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    25. Serena Ng & Pierre Perron, 2001. "LAG Length Selection and the Construction of Unit Root Tests with Good Size and Power," Econometrica, Econometric Society, vol. 69(6), pages 1519-1554, November.
    26. Phillips, Peter C B & Ouliaris, S, 1990. "Asymptotic Properties of Residual Based Tests for Cointegration," Econometrica, Econometric Society, vol. 58(1), pages 165-193, January.
    27. Piotr Sorokowski & Emanuel Kulczycki & Agnieszka Sorokowska & Katarzyna Pisanski, 2017. "Predatory journals recruit fake editor," Nature, Nature, vol. 543(7646), pages 481-483, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Niels Haldrup & Robinson Kruse & Timo Teräsvirta & Rasmus T. Varneskov, 2013. "Unit roots, non-linearities and structural breaks," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 4, pages 61-94, Edward Elgar Publishing.
    2. Giorgio Canarella & Rangan Gupta & Stephen M. Miller & Stephen K. Pollard, 2019. "Unemployment rate hysteresis and the great recession: exploring the metropolitan evidence," Empirical Economics, Springer, vol. 56(1), pages 61-79, January.
    3. Luis F. Martins & Paulo M. M. Rodrigues, 2022. "Tests for segmented cointegration: an application to US governments budgets," Empirical Economics, Springer, vol. 63(2), pages 567-600, August.
    4. Mohamed Maher & Yanzhi Zhao, 2022. "Do Political Instability and Military Expenditure Undermine Economic Growth in Egypt? Evidence from the ARDL Approach," Defence and Peace Economics, Taylor & Francis Journals, vol. 33(8), pages 956-979, November.
    5. D. Ventosa-Santaulària, 2009. "Spurious Regression," Journal of Probability and Statistics, Hindawi, vol. 2009, pages 1-27, August.
    6. Junaid Ashraf, 2023. "Does political risk undermine environment and economic development in Pakistan? Empirical evidence from China–Pakistan economic corridor," Economic Change and Restructuring, Springer, vol. 56(1), pages 581-608, February.
    7. Marco Morales, 2014. "Cointegration testing under structural change: reducing size distortions and improving power of residual based tests," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 23(2), pages 265-282, June.
    8. Yau, Hwey-Yun & Nieh, Chien-Chung, 2006. "Interrelationships among stock prices of Taiwan and Japan and NTD/Yen exchange rate," Journal of Asian Economics, Elsevier, vol. 17(3), pages 535-552, June.
    9. David Greasley & Les Oxley, 2010. "Cliometrics And Time Series Econometrics: Some Theory And Applications," Journal of Economic Surveys, Wiley Blackwell, vol. 24(5), pages 970-1042, December.
    10. Christou, Christina & Gupta, Rangan & Nyakabawo, Wendy & Wohar, Mark E., 2018. "Do house prices hedge inflation in the US? A quantile cointegration approach," International Review of Economics & Finance, Elsevier, vol. 54(C), pages 15-26.
    11. Darne, Olivier & Diebolt, Claude, 2004. "Unit roots and infrequent large shocks: new international evidence on output," Journal of Monetary Economics, Elsevier, vol. 51(7), pages 1449-1465, October.
    12. Chien-Chung Nieh & Hwey-Yun Yau & Ken Hung & Hong-Kou Ou & Shine Hung, 2013. "Cointegration and causal relationships among steel prices of Mainland China, Taiwan, and USA in the presence of multiple structural changes," Empirical Economics, Springer, vol. 44(2), pages 545-561, April.
    13. Olivier Darné & Amélie Charles, 2011. "Large shocks in U.S. macroeconomic time series: 1860-1988," Cliometrica, Journal of Historical Economics and Econometric History, Association Française de Cliométrie (AFC), vol. 5(1), pages 79-100, January.
    14. Antonio E. Noriega & Daniel Ventosa-Santaularia, 2012. "The effect of structural breaks on the Engle-Granger test for cointegration," Estudios Económicos, El Colegio de México, Centro de Estudios Económicos, vol. 27(1), pages 99-132.
    15. Vicente German-Soto & Chapa Cantú, 2015. "Cointegration with structural changes between per capita product and income inequality in Mexico," Applied Economics, Taylor & Francis Journals, vol. 47(49), pages 5215-5228, October.
    16. SBIA, Rashid & Al Rousan, Sahel, 2015. "Does Financial Development Induce Economic Growth in UAE? The Role of Foreign Direct Investment and Capitalization," MPRA Paper 64599, University Library of Munich, Germany.
    17. Gaolu Zou & K. W. Chau, 2019. "Long- and Short-Run Effects of Fuel Prices on Freight Transportation Volumes in Shanghai," Sustainability, MDPI, vol. 11(18), pages 1-12, September.
    18. Marta Gómez-Puig & Simón Sosvilla-Rivero, 2015. "“On the bi-directional causal relationship between public debt and economic growth in EMU countries”," IREA Working Papers 201512, University of Barcelona, Research Institute of Applied Economics, revised May 2015.
    19. Zou, Gao Lu, 2012. "The long-term relationships among China's energy consumption sources and adjustments to its renewable energy policy," Energy Policy, Elsevier, vol. 47(C), pages 456-467.
    20. Charles, Amélie & Darné, Olivier, 2012. "Trends and random walks in macroeconomic time series: A reappraisal," Journal of Macroeconomics, Elsevier, vol. 34(1), pages 167-180.

    More about this item

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • A10 - General Economics and Teaching - - General Economics - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:feb:framed:00701. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: David Franks (email available below). General contact details of provider: http://www.fieldexperiments.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.