IDEAS home Printed from https://ideas.repec.org/a/oup/rseval/v31y2022i4p475-485..html
   My bibliography  Save this article

‘I want to be able to do what I know the tools will allow us to do’: Practicing evaluative bibliometrics through digital infrastructure

Author

Listed:
  • Anne K Krüger
  • Sabrina Petersohn

Abstract

The proliferation of quantitative research assessment has been accompanied by an increasing growth and diversification of digital infrastructure for evaluative bibliometrics. Since the beginning of the 2000s, insights into academic performance provided by a variety of new databases and devices significantly exceed the capacities of the former Science Citation Index and embedded metrics. Going beyond the research on the construction, uses, and consequences of bibliometric indicators, we therefore posit that a perspective on bibliometric infrastructure is crucial for understanding how evaluative bibliometrics is put into practice. Drawing on interviews with academic librarians on the increasing provision and implementation of bibliometric infrastructure in the years 2013 and 2014, we analyse how the entanglement of technology and its users shapes how evaluative bibliometrics is understood and practiced.

Suggested Citation

  • Anne K Krüger & Sabrina Petersohn, 2022. "‘I want to be able to do what I know the tools will allow us to do’: Practicing evaluative bibliometrics through digital infrastructure," Research Evaluation, Oxford University Press, vol. 31(4), pages 475-485.
    • Handle: RePEc:oup:rseval:v:31:y:2022:i:4:p:475-485.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/reseval/rvac009
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sarah Rijcke & Alexander Rushforth, 2015. "To intervene or not to intervene; is that the question? On the role of scientometrics in research evaluation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(9), pages 1954-1958, September.
    2. Torger Möller & Marion Schmidt & Stefan Hornbostel, 2016. "Assessing the effects of the German Excellence Initiative with bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2217-2239, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mohammed R. AlShareef & Ibrahim A. Alrammah & Nasser A. Alshoukani & Abdulaziz M. Almalik, 2023. "The impact of financial incentives on research production: Evidence from Saudi Arabia," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 3067-3089, May.
    2. Wu, Jiang & Ou, Guiyan & Liu, Xiaohui & Dong, Ke, 2022. "How does academic education background affect top researchers’ performance? Evidence from the field of artificial intelligence," Journal of Informetrics, Elsevier, vol. 16(2).
    3. Clemens Blümel & Stephan Gauch, 2021. "Introduction to special issue: quantitative studies of science in Germany," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9641-9647, December.
    4. Bonaccorsi, Andrea & Haddawy, Peter & Cicero, Tindaro & Hassan, Saeed-Ul, 2017. "The solitude of stars. An analysis of the distributed excellence model of European universities," Journal of Informetrics, Elsevier, vol. 11(2), pages 435-454.
    5. Nicolas Carayol & Emeric Henry & Marianne Lanoë, 2020. "Stimulating Peer Effects? Evidence from a Research Cluster Policy," Working Papers hal-03874261, HAL.
    6. Sabrina Petersohn & Thomas Heinze, 2018. "Professionalization of bibliometric research assessment. Insights from the history of the Leiden Centre for Science and Technology Studies (CWTS)," Science and Public Policy, Oxford University Press, vol. 45(4), pages 565-578.
    7. Shengbo Liu & Xiaoting Luo & Miaomiao Liu, 2023. "Was Chinese “Double-First Class” Construction Policy Influential? Analysis Using Propensity Score Matching," Sustainability, MDPI, vol. 15(8), pages 1-13, April.
    8. Carlo Galli & Stefano Guizzardi, 2021. "The Effect of Article Characteristics on Citation Number in a Diachronic Dataset of the Biomedical Literature on Chronic Inflammation: An Analysis by Ensemble Machines," Publications, MDPI, vol. 9(2), pages 1-11, April.
    9. Civera, Alice & Lehmann, Erik E. & Paleari, Stefano & Stockinger, Sarah A.E., 2020. "Higher education policy: Why hope for quality when rewarding quantity?," Research Policy, Elsevier, vol. 49(8).
    10. Antonin Bergeaud & Arthur Guillouzouic & Emeric Henry & Clement Malgouyres, 2022. "From public labs to private firms: magnitude and channels of R&D spillovers," POID Working Papers 041, Centre for Economic Performance, LSE.
    11. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    12. Isabel M. Habicht & Mark Lutter & Martin Schröder, 2021. "How human capital, universities of excellence, third party funding, mobility and gender explain productivity in German political science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9649-9675, December.
    13. Congbin Guo & Xiaowei Hao & Jiaqi Wu & Tizhen Hu, 2023. "The effect of national higher education initiatives on university rankings," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-9, December.
    14. Anne K. Krüger, 2020. "Quantification 2.0? Bibliometric Infrastructures in Academic Evaluation," Politics and Governance, Cogitatio Press, vol. 8(2), pages 58-67.
    15. Andersen, Jens Peter, 2017. "An empirical and theoretical critique of the Euclidean index," Journal of Informetrics, Elsevier, vol. 11(2), pages 455-465.
    16. Cantner, Uwe & Grashof, Nils & Grebel, Thomas & Zhang, Xijie, 2023. "When Excellence is not Excellent: The Impact of the Excellence Initiative on the Relative Productivity of German Universities," MPRA Paper 118139, University Library of Munich, Germany.
    17. Nataliya Matveeva & Anuška Ferligoj, 2020. "Scientific collaboration in Russian universities before and after the excellence initiative Project 5-100," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2383-2407, September.
    18. Matveeva, Nataliya & Sterligov, Ivan & Yudkevich, Maria, 2021. "The effect of Russian University Excellence Initiative on publications and collaboration patterns," Journal of Informetrics, Elsevier, vol. 15(1).
    19. Manoj Kumar Verma & Daud Khan & Mayank Yuvaraj, 2023. "Scientometric assessment of funded scientometrics and bibliometrics research (2011–2021)," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4305-4320, August.
    20. Bornmann, Lutz & Williams, Richard, 2017. "Can the journal impact factor be used as a criterion for the selection of junior researchers? A large-scale empirical study based on ResearcherID data," Journal of Informetrics, Elsevier, vol. 11(3), pages 788-799.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:rseval:v:31:y:2022:i:4:p:475-485.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/rev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.