IDEAS home Printed from https://ideas.repec.org/p/osf/osfxxx/dmsp9.html
   My bibliography  Save this paper

Scrambling for higher metrics in the Journal Impact Factor bubble period: a real-world problem in science management and its implications

Author

Listed:
  • Tran, Trung
  • Linh, Hoang Khanh
  • La, Viet-Phuong
  • Ho, Manh-Toan

    (Thanh Tay University Hanoi)

  • Vuong, Quan-Hoang

Abstract

Universities and funders in many countries have been using Journal Impact Factor (JIF) as an indicator for research and grant assessment despite its controversial nature as a statistical representation of scientific quality. This study investigates how the changes of JIF over the years can affect its role in research evaluation and science management by using JIF data from annual Journal Citation Reports (JCR) to illustrate the changes. The descriptive statistics find out an increase in the median JIF for the top 50 journals in the JCR, from 29.300 in 2017 to 33.162 in 2019. Moreover, on average, elite journal families have up to 27 journals in the top 50. In the group of journals with a JIF of lower than 1, the proportion has shrunk by 14.53% in the 2015–2019 period. The findings suggest a potential ‘JIF bubble period’ that science policymaker, university, public fund managers, and other stakeholders should pay more attention to JIF as a criterion for quality assessment to ensure more efficient science management.

Suggested Citation

  • Tran, Trung & Linh, Hoang Khanh & La, Viet-Phuong & Ho, Manh-Toan & Vuong, Quan-Hoang, 2020. "Scrambling for higher metrics in the Journal Impact Factor bubble period: a real-world problem in science management and its implications," OSF Preprints dmsp9, Center for Open Science.
    • Handle: RePEc:osf:osfxxx:dmsp9
    DOI: 10.31219/osf.io/dmsp9
    as

    Download full text from publisher

    File URL: https://osf.io/download/5e410b9ef1369e02e28adb28/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/dmsp9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lutz Bornmann, 2011. "Mimicry in science?," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(1), pages 173-177, January.
    2. Anke Snoek, 2019. "Why publishing should be a pleasure, not a pressure," Nature Human Behaviour, Nature, vol. 3(10), pages 1032-1032, October.
    3. Shibayama, Sotaro & Baba, Yasunori, 2015. "Impact-oriented science policies and scientific publication practices: The case of life sciences in Japan," Research Policy, Elsevier, vol. 44(4), pages 936-950.
    4. Maria Bordons & M. T. Fernández & Isabel Gómez, 2002. "Advantages and limitations in the use of impact factor measures for the assessment of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 53(2), pages 195-206, February.
    5. John Tregoning, 2018. "How will you judge me if not by impact factor?," Nature, Nature, vol. 558(7710), pages 345-345, June.
    6. Sornette, Didier & Cauwels, Peter, 2015. "Financial Bubbles: Mechanisms and Diagnostics," Review of Behavioral Economics, now publishers, vol. 2(3), pages 279-305, October.
    7. Quan-Hoang Vuong, 2019. "Breaking barriers in publishing demands a proactive attitude," Nature Human Behaviour, Nature, vol. 3(10), pages 1034-1034, October.
    8. Osterloh, Margit & Frey, Bruno S., 2020. "How to avoid borrowed plumes in academia," Research Policy, Elsevier, vol. 49(1).
    9. Mabiso, Athur & van Rheenen, Teunis & Ferguson, Jenna, 2013. "Organizational partnerships for food Policy research impact: A review of what works:," IFPRI discussion papers 1305, International Food Policy Research Institute (IFPRI).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. , Aisdl, 2020. "The rise of research on development economics in Vietnam: Analyses and implications for the public and policymakers from SSHPA 2008-2020 dataset," OSF Preprints 9nbyr, Center for Open Science.
    2. Salim Sazzed, 2021. "Association between the Rankings of Top Bioinformatics and Medical Informatics Journals and the Scholarly Reputations of Chief Editors," Publications, MDPI, vol. 9(3), pages 1-15, September.
    3. Ho, Manh-Toan, 2020. "The rise of research on development economics in Vietnam: Analyses and implications for the public and policymakers from SSHPA 2008-2020 dataset," Thesis Commons msy6e, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Francisco González-Sala & Julia Osca-Lluch & Julia Haba-Osca, 2019. "Are journal and author self-citations a visibility strategy?," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1345-1364, June.
    2. Fiorenzo Franceschini & Maurizio Galetto & Domenico Maisano & Luca Mastrogiacomo, 2012. "The success-index: an alternative approach to the h-index for evaluating an individual’s research output," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(3), pages 621-641, September.
    3. Riza Demirer & David Gabauer & Rangan Gupta & Joshua Nielsen, 2023. "Gold-to-Platinum Price Ratio and the Predictability of Bubbles in Financial Markets," Working Papers 202317, University of Pretoria, Department of Economics.
    4. Ghabban, Fahad & Selamat, Ali & Ibrahim, Roliana, 2018. "New model for encouraging academic staff in Saudi universities to use IT for knowledge sharing to improve scholarly publication performance," Technology in Society, Elsevier, vol. 55(C), pages 92-99.
    5. Nguyen, Minh-Hoang, 2021. "Lecture 1: Phân tích dữ liệu xã hội sử dụng BMF, MCMC và bayesvl với ngôn ngữ R," OSF Preprints s9rq7, Center for Open Science.
    6. Quan-Hoang Vuong & Thanh-Hang Pham & Trung Tran & Thu-Trang Vuong & Nguyen Manh Cuong & Nguyen Phuc Khanh Linh & Viet-Phuong La & Manh Toan Ho, 2020. "STEM education and outcomes in Vietnam: Views from the social gap and gender issues," Working Papers CEB 20-003, ULB -- Universite Libre de Bruxelles.
    7. Trung Tran & Thao-Phuong-Thi Trinh & Cuong-Minh Le & Linh-Khanh Hoang & Hiep-Hung Pham, 2020. "Research as a Base for Sustainable Development of Universities: Using the Delphi Method to Explore Factors Affecting International Publishing among Vietnamese Academic Staff," Sustainability, MDPI, vol. 12(8), pages 1-16, April.
    8. Li Lin & Didier Sornette, 2015. ""Speculative Influence Network" during financial bubbles: application to Chinese Stock Markets," Papers 1510.08162, arXiv.org.
    9. Tingcan Ma & Gui-Fang Wang & Ke Dong & Mukun Cao, 2012. "The Journal’s Integrated Impact Index: a new indicator for journal evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 649-658, February.
    10. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    11. Eduardo Araujo Oliveira & Roberto Peicots-Filho & Daniella Reis Martelli & Isabel Gomes Quirino & Maria Christina Lopes Oliveira & Mariana Guerra Duarte & Sergio Veloso Pinheiro & Enrico Antonio Colos, 2013. "Is there a correlation between journal impact factor and researchers’ performance? A study comprising the fields of clinical nephrology and neurosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(2), pages 149-160, November.
    12. Riza Demirer & Guilherme Demos & Rangan Gupta & Didier Sornette, 2019. "On the predictability of stock market bubbles: evidence from LPPLS confidence multi-scale indicators," Quantitative Finance, Taylor & Francis Journals, vol. 19(5), pages 843-858, May.
    13. Peter Andre & Armin Falk, 2021. "What’s Worth Knowing? Economists’ Opinions about Economics," ECONtribute Discussion Papers Series 102, University of Bonn and University of Cologne, Germany.
    14. Xinning Su & Sanhong Deng & Si Shen, 2014. "The design and application value of the Chinese Social Science Citation Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1567-1582, March.
    15. Thanos Fragkandreas, 2023. "Case study research on innovation systems: paradox, dialectical analysis and resolution," Working Papers 65, Birkbeck Centre for Innovation Management Research, revised 15 May 2023.
    16. Damien Besancenot & Abdelghani Maddi, 2019. "Should citations be weighted to assess the influence of an academic article?," Economics Bulletin, AccessEcon, vol. 435(1), pages 435-445.
    17. Narongrit Sombatsompop & T. Markpin & N. Premkamolnetr, 2004. "A modified method for calculating the Impact Factors of journals in ISI Journal Citation Reports: Polymer Science Category in 1997–2001," Scientometrics, Springer;Akadémiai Kiadó, vol. 60(2), pages 217-235, June.
    18. Nhan, Nguyen Thanh, 2021. "Healthcare expenses for poor households, how can large- scale poverty reduction programs help?," OSF Preprints 8m9ea, Center for Open Science.
    19. Ian Coelho de Souza Almeida & Rafael Galvão de Almeida & Lucas Resende de Carvalho, 2017. "Academic rankings and pluralism : the case of Brazil and the new version of Qualis," Textos para Discussão Cedeplar-UFMG 569, Cedeplar, Universidade Federal de Minas Gerais.
    20. Ho, Manh-Toan & Nguyen, Minh-Hoang, 2021. "The SSHPA Project," OSF Preprints ym3j5, Center for Open Science.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:osfxxx:dmsp9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://osf.io/preprints/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.