IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v117y2018i3d10.1007_s11192-018-2947-8.html
   My bibliography  Save this article

How to automatically identify major research sponsors selecting keywords from the WoS Funding Agency field

Author

Listed:
  • Fernanda Morillo

    (Spanish National Research Council (CSIC))

  • Belén Álvarez-Bornstein

    (Spanish National Research Council (CSIC)
    Complutense University (UCM))

Abstract

In a context of increasingly limited resources, the demand for information from research funding bodies is growing. The exploitation of the funding acknowledgements collected in WoS publications can be useful for these sponsors, not only because it allows them to know the published results with their financial support, but also because it provides a framework to evaluate the efficiency of the different funding instruments. The present work adds to the knowledge of previous studies to offer a simple and efficient methodology that automatically identifies major sponsors, and their funded research, using keywords. To this end, articles with Spain in the address field and English in the language field are obtained (years 2010–2014), given that WoS only considers funding acknowledgements written in English. Subsequently, the Funding Agency field of these articles is treated, selecting funders’ variants that will serve as keywords in the Full-Text Search for the location of the research supported by major sponsors. In addition, a sample of reviewed documents is provided to evaluate the reliability of the proposed methodology, performing also some statistical tests. The results show a recall of 91.5% of the sample articles, with a precision of 99%. Notwithstanding, there are differences in the automatic identification of funders by institutional sector and/or area, being the Government sector the one with the highest precision and recall, and the area of Agriculture, Biology and Environment the one with the best degree of association between the automatic classification and the reviewed one. Finally, possible future developments are offered, paying special attention to increasing the automation of the standardisation of funders’ names.

Suggested Citation

  • Fernanda Morillo & Belén Álvarez-Bornstein, 2018. "How to automatically identify major research sponsors selecting keywords from the WoS Funding Agency field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1755-1770, December.
  • Handle: RePEc:spr:scient:v:117:y:2018:i:3:d:10.1007_s11192-018-2947-8
    DOI: 10.1007/s11192-018-2947-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-018-2947-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-018-2947-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jue Wang & Philip Shapira, 2011. "Funding acknowledgement analysis: an enhanced tool to investigate research sponsorship impacts: the case of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 563-586, June.
    2. Nicola Grassano & Daniele Rotolo & Joshua Hutton & Frédérique Lang & Michael M. Hopkins, 2017. "Funding Data from Publication Acknowledgments: Coverage, Uses, and Limitations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(4), pages 999-1017, April.
    3. Rodrigo Costas & Thed N. van Leeuwen, 2012. "Approaching the “reward triangle”: General analysis of the presence of funding acknowledgments and “peer interactive communication” in scientific publications," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(8), pages 1647-1661, August.
    4. John Rigby, 2011. "Systematic grant and funding body acknowledgement data for publications: new dimensions and new controversies for research policy and evaluation," Research Evaluation, Oxford University Press, vol. 20(5), pages 365-375, December.
    5. Pascal Cuxac & Jean-Charles Lamirel & Valerie Bonvallot, 2013. "Efficient supervised and semi-supervised approaches for affiliations disambiguation," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(1), pages 47-58, October.
    6. Grant Lewison & Richard Sullivan, 2015. "Conflicts of interest statements on biomedical papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(3), pages 2151-2159, March.
    7. Shuiqing Huang & Bo Yang & Sulan Yan & Ronald Rousseau, 2014. "Institution name disambiguation for research assessment," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(3), pages 823-838, June.
    8. Blaise Cronin & Debora Shaw & Kathryn La Barre, 2003. "A cast of thousands: Coauthorship and subauthorship collaboration in the 20th century as manifested in the scholarly journal literature of psychology and philosophy," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(9), pages 855-871, July.
    9. Rodrigo Costas & Thed N. Leeuwen, 2012. "Approaching the “reward triangle”: General analysis of the presence of funding acknowledgments and “peer interactive communication” in scientific publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(8), pages 1647-1661, August.
    10. Abdullah Gök & John Rigby & Philip Shapira, 2016. "The impact of research funding on scientific outputs: Evidence from six smaller European countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 715-730, March.
    11. Belén Álvarez-Bornstein & Fernanda Morillo & María Bordons, 2017. "Funding acknowledgments in the Web of Science: completeness and accuracy of collected data," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1793-1812, September.
    12. Fernanda Morillo & Ignacio Santabárbara & Javier Aparicio, 2013. "The automatic normalisation challenge: detailed addresses identification," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 953-966, June.
    13. Fernanda Morillo & Javier Aparicio & Borja González-Albo & Luz Moreno, 2013. "Towards the automation of address identification," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 207-224, January.
    14. Lepori, Benedetto, 2011. "Coordination modes in public funding systems," Research Policy, Elsevier, vol. 40(3), pages 355-367, April.
    15. Adrián A. Díaz-Faes & María Bordons, 2014. "Acknowledgments in scientific publications: Presence in Spanish science and text patterns across disciplines," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(9), pages 1834-1849, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fernanda Morillo, 2020. "Is open access publication useful for all research fields? Presence of funding, collaboration and impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 689-716, October.
    2. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    3. María Bordons & Borja González-Albo & Luz Moreno-Solano, 2023. "Improving our understanding of open access: how it relates to funding, internationality of research and scientific leadership," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4651-4676, August.
    4. Weishu Liu, 2020. "Accuracy of funding information in Scopus: a comparative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 803-811, July.
    5. Fernanda Morillo, 2019. "Collaboration and impact of research in different disciplines with international funding (from the EU and other foreign sources)," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 807-823, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicola Grassano & Daniele Rotolo & Joshua Hutton & Frédérique Lang & Michael M. Hopkins, 2017. "Funding Data from Publication Acknowledgments: Coverage, Uses, and Limitations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(4), pages 999-1017, April.
    2. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    3. Fernanda Morillo, 2019. "Collaboration and impact of research in different disciplines with international funding (from the EU and other foreign sources)," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 807-823, August.
    4. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    5. Adèle Paul-Hus & Nadine Desrochers & Rodrigo Costas, 2016. "Characterization, description, and considerations for the use of funding acknowledgement data in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 167-182, July.
    6. Gianluca Fabiano & Andrea Marcellusi & Giampiero Favato, 2020. "Public–private contribution to biopharmaceutical discoveries: a bibliometric analysis of biomedical research in UK," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 153-168, July.
    7. Ji-ping Gao & Cheng Su & Hai-yan Wang & Li-hua Zhai & Yun-tao Pan, 2019. "Research fund evaluation based on academic publication output analysis: the case of Chinese research fund evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 959-972, May.
    8. Belén Álvarez-Bornstein & Fernanda Morillo & María Bordons, 2017. "Funding acknowledgments in the Web of Science: completeness and accuracy of collected data," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1793-1812, September.
    9. Cristian Mejia & Yuya Kajikawa, 2018. "Using acknowledgement data to characterize funding organizations by the types of research sponsored: the case of robotics research," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 883-904, March.
    10. Fernanda Morillo, 2016. "Public–private interactions reflected through the funding acknowledgements," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1193-1204, September.
    11. Daniele Rotolo & Michael Hopkins & Nicola Grassano, 2023. "Do funding sources complement or substitute? Examining the impact of cancer research publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 50-66, January.
    12. Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
    13. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.
    14. Wen Lou & Jiangen He & Lingxin Zhang & Zhijie Zhu & Yongjun Zhu, 2023. "Support behind the scenes: the relationship between acknowledgement, coauthor, and citation in Nobel articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5767-5790, October.
    15. Xin Xu & Alice M. Tan & Star X. Zhao, 2015. "Funding ratios in social science: the perspective of countries/territories level and comparison with natural sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 673-684, September.
    16. Star X. Zhao & Wen Lou & Alice M. Tan & Shuang Yu, 2018. "Do funded papers attract more usage?," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 153-168, April.
    17. Weishu Liu, 2020. "Accuracy of funding information in Scopus: a comparative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 803-811, July.
    18. Alberto Baccini & Eugenio Petrovich, 2022. "Normative versus strategic accounts of acknowledgment data: The case of the top-five journals of economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 603-635, January.
    19. Mu-Hsuan Huang & Mei-Jhen Huang, 2018. "An analysis of global research funding from subject field and funding agencies perspectives in the G9 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 833-847, May.
    20. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," SciencePo Working papers Main hal-03912647, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:117:y:2018:i:3:d:10.1007_s11192-018-2947-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.