IDEAS home Printed from https://ideas.repec.org/a/gam/jpubli/v12y2024i1p5-d1340860.html
   My bibliography  Save this article

Reducing the Matthew Effect on Journal Citations through an Inclusive Indexing Logic: The Brazilian Spell (Scientific Periodicals Electronic Library) Experience

Author

Listed:
  • Luciano Rossoni

    (Graduate Program in Administration, University of Brasilia, Brasilia 70910-900, Brazil)

  • Rodrigo Assunção Rosa

    (Postgraduation Program in Business Administration, Positivo University, Curitiba 81290-000, Brazil)

Abstract

The inclusion of scientific journals in prestigious indexers is often associated with higher citation rates; journals included in such indexers are significantly more acknowledged than those that are not included in them. This phenomenon refers to the Matthew effect on journal citations, according to which journals in exclusive rankings tend to be increasingly cited. This paper shows the opposite: that the inclusion of journals in local indexers ruled by inclusive logic reduces the Matthew effect on journal citations since it enables them to be equally exposed. Thus, we based our arguments on the comparison of 68 Brazilian journals before and after they were indexed in the Scientific Periodicals Electronic Library (Spell), which ranks journals in the Brazilian management field based on local citations. Citation impact indicators and iGini (a new individual inequality analysis measure) were used to show that the inclusion of journals in Spell has probably increased their impact factor and decreased their citation inequality rates. Using a difference-in-differences model with continuous treatment, the results indicated that the effect between ranking and inequality declined after journals were included in Spell. Additional robustness checks through event study models and interrupted time-series analysis for panel data point to a reduction in citation inequality but follow different trajectories for the 2- and 5-year impact. The results indicate that the indexer has reduced the Matthew effect on journal citations.

Suggested Citation

  • Luciano Rossoni & Rodrigo Assunção Rosa, 2024. "Reducing the Matthew Effect on Journal Citations through an Inclusive Indexing Logic: The Brazilian Spell (Scientific Periodicals Electronic Library) Experience," Publications, MDPI, vol. 12(1), pages 1-24, February.
    • Handle: RePEc:gam:jpubli:v:12:y:2024:i:1:p:5-:d:1340860
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2304-6775/12/1/5/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2304-6775/12/1/5/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Lidia Ceriani & Paolo Verme, 2015. "Individual Diversity and the Gini Decomposition," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 121(3), pages 637-646, April.
    2. Damian Clarke & Kathya Tapia-Schythe, 2021. "Implementing the panel event study," Stata Journal, StataCorp LP, vol. 21(4), pages 853-884, December.
    3. Simon Alder & Lin Shao & Fabrizio Zilibotti, 2016. "Economic reforms and industrial policy in a panel of Chinese cities," Journal of Economic Growth, Springer, vol. 21(4), pages 305-349, December.
    4. Marcelo S. Perlin & Takeyoshi Imasato & Denis Borenstein, 2018. "Is predatory publishing a real threat? Evidence from a large database study," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 255-273, July.
    5. Bodas Freitas, Isabel Maria & Marques, Rosane Argou & Silva, Evando Mirra de Paula e, 2013. "University–industry collaboration and innovation in emergent and mature industries in new industrialized countries," Research Policy, Elsevier, vol. 42(2), pages 443-453.
    6. Damian Clarke & Kathya Tapia-Schythe, 2021. "Implementing the panel event study," Stata Journal, StataCorp LLC, vol. 21(4), pages 853-884, December.
    7. Fabio Gomes Rocha & Rosimeri Ferraz Sabino & Alejandro C. Frery, 2020. "Analysis of the international impact of the Brazilian base “Qualis”-Education," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 1949-1963, December.
    8. Marshall Medoff, 2006. "Evidence of a Harvard and Chicago Matthew Effect," Journal of Economic Methodology, Taylor & Francis Journals, vol. 13(4), pages 485-506.
    9. Binder, John J, 1998. "The Event Study Methodology since 1969," Review of Quantitative Finance and Accounting, Springer, vol. 11(2), pages 111-137, September.
    10. Alcadipani, Rafael, 2017. "Periódicos brasileiros em Inglês: A mímica do publish or perish “global”," RAE - Revista de Administração de Empresas, FGV-EAESP Escola de Administração de Empresas de São Paulo (Brazil), vol. 57(4), August.
    11. Rogerio Meneghini & Rogerio Mugnaini & Abel L. Packer, 2006. "International versus national oriented Brazilian scientific journals. A scientometric analysis based on SciELO and JCR-ISI databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 69(3), pages 529-538, December.
    12. Daniel Hoechle, 2007. "Robust standard errors for panel regressions with cross-sectional dependence," Stata Journal, StataCorp LLC, vol. 7(3), pages 281-312, September.
    13. Ariel Linden, 2015. "Conducting interrupted time-series analysis for single- and multiple-group comparisons," Stata Journal, StataCorp LLC, vol. 15(2), pages 480-500, June.
    14. Philippe Mongeon & Adèle Paul-Hus, 2016. "The journal coverage of Web of Science and Scopus: a comparative analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 213-228, January.
    15. Francisco Collazo-Reyes, 2014. "Growth of the number of indexed journals of Latin America and the Caribbean: the effect on the impact of each country," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 197-209, January.
    16. Diana Hicks & Paul Wouters & Ludo Waltman & Sarah de Rijcke & Ismael Rafols, 2015. "Bibliometrics: The Leiden Manifesto for research metrics," Nature, Nature, vol. 520(7548), pages 429-431, April.
    17. William H. Starbuck, 2005. "How Much Better Are the Most-Prestigious Journals? The Statistics of Academic Publication," Organization Science, INFORMS, vol. 16(2), pages 180-200, April.
    18. Paula Leite & Rogério Mugnaini & Jacqueline Leta, 2011. "A new indicator for international visibility: exploring Brazilian scientific community," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(1), pages 311-319, July.
    19. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 871-906, January.
    20. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Correction to: Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 907-908, January.
    21. Jacqueline Leta & Hernan Chaimovich, 2002. "Recognition and international collaboration: the Brazilian case," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(3), pages 325-335, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Enrique Orduña-Malea & Núria Bautista-Puig, 2024. "Research assessment under debate: disentangling the interest around the DORA declaration on Twitter," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(1), pages 537-559, January.
    2. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    3. Fernando Morante-Carballo & Néstor Montalván-Burbano & Maribel Aguilar-Aguilar & Paúl Carrión-Mero, 2022. "A Bibliometric Analysis of the Scientific Research on Artisanal and Small-Scale Mining," IJERPH, MDPI, vol. 19(13), pages 1-29, July.
    4. Haddou, Samira, 2024. "Determinants of CDS in core and peripheral European countries: A comparative study during crisis and calm periods," The North American Journal of Economics and Finance, Elsevier, vol. 71(C).
    5. Ramón A. Feenstra & Emilio Delgado López-Cózar, 2022. "Philosophers’ appraisals of bibliometric indicators and their use in evaluation: from recognition to knee-jerk rejection," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 2085-2103, April.
    6. Mike Thelwall, 2021. "Alternative medicines worth researching? Citation analyses of acupuncture, chiropractic, homeopathy, and osteopathy 1996–2017," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8731-8747, October.
    7. Dušan Nikolić & Dragan Ivanović & Lidija Ivanović, 2024. "An open-source tool for merging data from multiple citation databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4573-4595, July.
    8. Gabriel Alves Vieira & Jacqueline Leta, 2024. "biblioverlap: an R package for document matching across bibliographic datasets," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(7), pages 4513-4527, July.
    9. Christopher Hansen & Holger Steinmetz & Jörn Block, 2022. "How to conduct a meta-analysis in eight steps: a practical guide," Management Review Quarterly, Springer, vol. 72(1), pages 1-19, February.
    10. Shirley Ainsworth & Jane M. Russell, 2018. "Has hosting on science direct improved the visibility of Latin American scholarly journals? A preliminary analysis of data quality," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(3), pages 1463-1484, June.
    11. Michael Gusenbauer, 2022. "Search where you will find most: Comparing the disciplinary coverage of 56 bibliographic databases," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2683-2745, May.
    12. Toluwase Asubiaro & Sodiq Onaolapo & David Mills, 2024. "Regional disparities in Web of Science and Scopus journal coverage," Scientometrics, Springer;Akadémiai Kiadó, vol. 129(3), pages 1469-1491, March.
    13. Kayvan Kousha & Mike Thelwall, 2024. "Factors associating with or predicting more cited or higher quality journal articles: An Annual Review of Information Science and Technology (ARIST) paper," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 75(3), pages 215-244, March.
    14. Nikolaos Efthimiou & Thomas Giotis & Athanasios Ragkos, 2025. "Applications for Non-Conventional Water Resources in the Mediterranean Basin: A Literature Review," Sustainability, MDPI, vol. 17(11), pages 1-30, May.
    15. Shir Aviv-Reuven & Ariel Rosenfeld, 2023. "A logical set theory approach to journal subject classification analysis: intra-system irregularities and inter-system discrepancies in Web of Science and Scopus," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(1), pages 157-175, January.
    16. Pingluo Xue & Chongyang Shen & Huaizhi Tang & Yunjia Liu & Yuanfang Huang, 2024. "Knowledge Atlas of Cultivated Land Quality Evaluation Based on Web of Science Since the 21st Century (2000–2023)," Land, MDPI, vol. 13(10), pages 1-15, October.
    17. Abdelkebir Sahid & Yassine Maleh & Karim Ouazzane, 2025. "Changing landscape of fake news research on social media: a bibliometric analysis," Quality & Quantity: International Journal of Methodology, Springer, vol. 59(2), pages 901-954, April.
    18. Huegel, Matthias, 2024. "University scientists’ multiple goals achievement: Social capital and its impact on research performance and research commercialization," Technovation, Elsevier, vol. 135(C).
    19. Adriane Cavalieri & João Reis & Marlene Amorim, 2021. "Circular Economy and Internet of Things: Mapping Science of Case Studies in Manufacturing Industry," Sustainability, MDPI, vol. 13(6), pages 1-32, March.
    20. Delgado-Quirós, Lorena & Ortega, José Luis, 2025. "Citation counts and inclusion of references in seven free-access scholarly databases: A comparative analysis," Journal of Informetrics, Elsevier, vol. 19(1).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jpubli:v:12:y:2024:i:1:p:5-:d:1340860. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.