IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v112y2017i3d10.1007_s11192-017-2453-4.html
   My bibliography  Save this article

Funding acknowledgments in the Web of Science: completeness and accuracy of collected data

Author

Listed:
  • Belén Álvarez-Bornstein

    (Spanish National Research Council (CSIC)
    Complutense University (UCM))

  • Fernanda Morillo

    (Spanish National Research Council (CSIC))

  • María Bordons

    (Spanish National Research Council (CSIC))

Abstract

The study of acknowledgments as a source of data on research funding is gaining ground in science, as exemplified by the present inclusion of this information in bibliographic databases such as Web of Science (WoS). The objective of this paper is to explore the completeness and accuracy of WoS in extracting and processing funding acknowledgment data. With this purpose, a random sample of articles published in eight thematic areas and selected from the scientific output of Spain in 2014 are analyzed. Funding information that appears in original articles is recorded by WoS in the “funding text” field, but is also extracted to the “funding agency” and “grant number” subfields. In the extraction process, some funding information was lost in 12% of the articles and the distribution of agencies and grant numbers by subfield was not always consistent. In addition, funding support is often incompletely reported by authors: in about half of the articles we studied, the country of origin of the funder or the grant number(s) were not mentioned. We propose and discuss the need to develop more detailed guidelines on how to acknowledge funding. More accurate documentation of funding sources in published articles would benefit researchers, funders and journals, and enhance the reliability and usefulness of studies on funding acknowledgments.

Suggested Citation

  • Belén Álvarez-Bornstein & Fernanda Morillo & María Bordons, 2017. "Funding acknowledgments in the Web of Science: completeness and accuracy of collected data," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1793-1812, September.
    • Handle: RePEc:spr:scient:v:112:y:2017:i:3:d:10.1007_s11192-017-2453-4
    DOI: 10.1007/s11192-017-2453-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2453-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-017-2453-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jue Wang & Philip Shapira, 2011. "Funding acknowledgement analysis: an enhanced tool to investigate research sponsorship impacts: the case of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 563-586, June.
    2. Nicola Grassano & Daniele Rotolo & Joshua Hutton & Frédérique Lang & Michael M. Hopkins, 2017. "Funding Data from Publication Acknowledgments: Coverage, Uses, and Limitations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(4), pages 999-1017, April.
    3. Françoise Salager-Meyer & María Ángeles Alcaraz-Ariza & Marianela Luzardo Briceño & Georges Jabbour, 2011. "Scholarly gratitude in five geographical contexts: a diachronic and cross-generic approach of the acknowledgment paratext in medical discourse (1950–2010)," Scientometrics, Springer;Akadémiai Kiadó, vol. 86(3), pages 763-784, March.
    4. Blaise Cronin & Gail McKenzie & Lourdes Rubio & Sherrill Weaver‐Wozniak, 1993. "Accounting for influence: Acknowledgments in contemporary sociology," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 44(7), pages 406-412, August.
    5. Elizabeth Koier & Edwin Horlings, 2015. "How accurately does output reflect the nature and design of transdisciplinary research programmes?," Research Evaluation, Oxford University Press, vol. 24(1), pages 37-50.
    6. Xianwen Wang & Di Liu & Kun Ding & Xinran Wang, 2012. "Science funding and research output: a study on 10 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 591-599, May.
    7. John Rigby, 2011. "Systematic grant and funding body acknowledgement data for publications: new dimensions and new controversies for research policy and evaluation," Research Evaluation, Oxford University Press, vol. 20(5), pages 365-375, December.
    8. Li Tang & Guangyuan Hu & Weishu Liu, 2017. "Funding acknowledgment analysis: Queries and caveats," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(3), pages 790-794, March.
    9. Rodrigo Costas & Thed N. Leeuwen, 2012. "Approaching the “reward triangle”: General analysis of the presence of funding acknowledgments and “peer interactive communication” in scientific publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(8), pages 1647-1661, August.
    10. Adèle Paul-Hus & Nadine Desrochers & Rodrigo Costas, 2016. "Characterization, description, and considerations for the use of funding acknowledgement data in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 167-182, July.
    11. John Rigby, 2013. "Looking for the impact of peer review: does count of funding acknowledgements really predict research impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 57-73, January.
    12. Radmila Lyubarova & Brandon K Itagaki & Michael W Itagaki, 2009. "The Impact of National Institutes of Health Funding on U.S. Cardiovascular Disease Research," PLOS ONE, Public Library of Science, vol. 4(7), pages 1-8, July.
    13. Dangzhi Zhao, 2010. "Characteristics and impact of grant-funded research: a case study of the library and information science field," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 293-306, August.
    14. Fernanda Morillo, 2016. "Public–private interactions reflected through the funding acknowledgements," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1193-1204, September.
    15. Adrián A. Díaz-Faes & María Bordons, 2014. "Acknowledgments in scientific publications: Presence in Spanish science and text patterns across disciplines," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(9), pages 1834-1849, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Daniele Rotolo & Michael Hopkins & Nicola Grassano, 2023. "Do funding sources complement or substitute? Examining the impact of cancer research publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 50-66, January.
    2. Fernanda Morillo & Belén Álvarez-Bornstein, 2018. "How to automatically identify major research sponsors selecting keywords from the WoS Funding Agency field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1755-1770, December.
    3. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    4. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    5. Magnus Eriksson & Annika Billhult & Tommy Billhult & Elena Pallari & Grant Lewison, 2020. "A new database of the references on international clinical practice guidelines: a facility for the evaluation of clinical research," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 1221-1235, February.
    6. Gianluca Fabiano & Andrea Marcellusi & Giampiero Favato, 2020. "Public–private contribution to biopharmaceutical discoveries: a bibliometric analysis of biomedical research in UK," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 153-168, July.
    7. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    8. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," SciencePo Working papers Main hal-03912647, HAL.
    9. Lin Zhang & Wenjing Zhao & Beibei Sun & Ying Huang & Wolfgang Glänzel, 2020. "How scientific research reacts to international public health emergencies: a global analysis of response patterns," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 747-773, July.
    10. Xiaoling Huang & Lei Wang & Weishu Liu, 2023. "Identification of national research output using Scopus/Web of Science Core Collection: a revisit and further investigation," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2337-2347, April.
    11. Álvarez-Bornstein, Belén & Bordons, María, 2021. "Is funding related to higher research impact? Exploring its relationship and the mediating role of collaboration in several disciplines," Journal of Informetrics, Elsevier, vol. 15(1).
    12. María Bordons & Borja González-Albo & Luz Moreno-Solano, 2023. "Improving our understanding of open access: how it relates to funding, internationality of research and scientific leadership," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4651-4676, August.
    13. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," Working Papers hal-03912647, HAL.
    14. Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
    15. Simone Belli & Joan Baltà, 2019. "Stocktaking scientific publication on bi-regional collaboration between Europe 28 and Latin America and the Caribbean," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(3), pages 1447-1480, December.
    16. Mu-Hsuan Huang & Mei-Jhen Huang, 2018. "An analysis of global research funding from subject field and funding agencies perspectives in the G9 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 833-847, May.
    17. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    18. Weishu Liu, 2020. "Accuracy of funding information in Scopus: a comparative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 803-811, July.
    19. Fernanda Morillo, 2019. "Collaboration and impact of research in different disciplines with international funding (from the EU and other foreign sources)," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 807-823, August.
    20. Pablo Sánchez-Núñez & Carlos de las Heras-Pedrosa & José Ignacio Peláez, 2020. "Opinion Mining and Sentiment Analysis in Marketing Communications: A Science Mapping Analysis in Web of Science (1998–2018)," Social Sciences, MDPI, vol. 9(3), pages 1-20, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    2. Nicola Grassano & Daniele Rotolo & Joshua Hutton & Frédérique Lang & Michael M. Hopkins, 2017. "Funding Data from Publication Acknowledgments: Coverage, Uses, and Limitations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(4), pages 999-1017, April.
    3. Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
    4. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.
    5. Gianluca Fabiano & Andrea Marcellusi & Giampiero Favato, 2020. "Public–private contribution to biopharmaceutical discoveries: a bibliometric analysis of biomedical research in UK," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 153-168, July.
    6. Ji-ping Gao & Cheng Su & Hai-yan Wang & Li-hua Zhai & Yun-tao Pan, 2019. "Research fund evaluation based on academic publication output analysis: the case of Chinese research fund evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 959-972, May.
    7. Fernanda Morillo, 2019. "Collaboration and impact of research in different disciplines with international funding (from the EU and other foreign sources)," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 807-823, August.
    8. Adèle Paul-Hus & Nadine Desrochers & Rodrigo Costas, 2016. "Characterization, description, and considerations for the use of funding acknowledgement data in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 167-182, July.
    9. Wen Lou & Jiangen He & Lingxin Zhang & Zhijie Zhu & Yongjun Zhu, 2023. "Support behind the scenes: the relationship between acknowledgement, coauthor, and citation in Nobel articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5767-5790, October.
    10. Alberto Baccini & Eugenio Petrovich, 2022. "Normative versus strategic accounts of acknowledgment data: The case of the top-five journals of economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 603-635, January.
    11. Lili Miao & Vincent Larivi`ere & Feifei Wang & Yong-Yeol Ahn & Cassidy R. Sugimoto, 2023. "Cooperation and interdependence in global science funding," Papers 2308.08630, arXiv.org, revised Feb 2024.
    12. Mu-Hsuan Huang & Mei-Jhen Huang, 2018. "An analysis of global research funding from subject field and funding agencies perspectives in the G9 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 833-847, May.
    13. Cristian Mejia & Yuya Kajikawa, 2018. "Using acknowledgement data to characterize funding organizations by the types of research sponsored: the case of robotics research," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 883-904, March.
    14. Fernanda Morillo & Belén Álvarez-Bornstein, 2018. "How to automatically identify major research sponsors selecting keywords from the WoS Funding Agency field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1755-1770, December.
    15. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    16. Li, Heyang & Wu, Meijun & Wang, Yougui & Zeng, An, 2022. "Bibliographic coupling networks reveal the advantage of diversification in scientific projects," Journal of Informetrics, Elsevier, vol. 16(3).
    17. Xin Xu & Alice M. Tan & Star X. Zhao, 2015. "Funding ratios in social science: the perspective of countries/territories level and comparison with natural sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 673-684, September.
    18. Star X. Zhao & Wen Lou & Alice M. Tan & Shuang Yu, 2018. "Do funded papers attract more usage?," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 153-168, April.
    19. Weishu Liu, 2020. "Accuracy of funding information in Scopus: a comparative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 803-811, July.
    20. Adèle Paul-Hus & Adrián A Díaz-Faes & Maxime Sainte-Marie & Nadine Desrochers & Rodrigo Costas & Vincent Larivière, 2017. "Beyond funding: Acknowledgement patterns in biomedical, natural and social sciences," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-14, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:112:y:2017:i:3:d:10.1007_s11192-017-2453-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.