IDEAS home Printed from https://ideas.repec.org/p/sru/ssewps/2016-08.html
   My bibliography  Save this paper

Funding Data from Publication Acknowledgements: Coverage, Uses and Limitations

Author

Listed:
  • Nicola Grassano

    (SPRU - Science Policy Research Unit, University of Sussex, Brighton, United Kingdom)

  • Daniele Rotolo

    (SPRU - Science Policy Research Unit, University of Sussex, Brighton, United Kingdom)

  • Joshua Hutton

    (SPRU - Science Policy Research Unit, University of Sussex, Brighton, United Kingdom)

  • Frederique Lang

    (SPRU - Science Policy Research Unit, University of Sussex, Brighton, United Kingdom)

  • Michael M. Hopkins

    (SPRU - Science Policy Research Unit, University of Sussex, Brighton, United Kingdom)

Abstract

This article contributes to the development of methods for analysing research funding systems by exploring the robustness and comparability of emerging approaches to generate funding landscapes useful for policy making. We use a novel dataset of manually extracted and coded data on the funding acknowledgements of 7,510 publications representing UK cancer research in the year 2011 and compare these `reference data' with funding data provided by Web of Science (WoS) and MEDLINE/PubMed. Findings show high recall (about 93%) of WoS funding data. By contrast, MEDLINE/PubMed data retrieved less than half of the UK cancer publications acknowledging at least one funder. Conversely, both databases have high precision (+90%): i.e. few cases of publications with no acknowledgement to funders are identi ed as having funding data. Nonetheless, funders acknowledged in UK cancer publications were not correctly listed by MEDLINE/PubMed and WoS in about 75% and 32% of the cases, respectively. `Reference data' on the UK cancer research funding system are then used as a case-study to demonstrate the utility of funding data for strategic intelligence applications (e.g. mapping of funding landscape, comparison of funders' research portfolios).

Suggested Citation

  • Nicola Grassano & Daniele Rotolo & Joshua Hutton & Frederique Lang & Michael M. Hopkins, 2016. "Funding Data from Publication Acknowledgements: Coverage, Uses and Limitations," SPRU Working Paper Series 2016-08, SPRU - Science Policy Research Unit, University of Sussex Business School.
    • Handle: RePEc:sru:ssewps:2016-08
    as

    Download full text from publisher

    File URL: http://www.sussex.ac.uk/spru/swps2016-08
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Petersen, Alexander M. & Rotolo, Daniele & Leydesdorff, Loet, 2016. "A triple helix model of medical innovation: Supply, demand, and technological capabilities in terms of Medical Subject Headings," Research Policy, Elsevier, vol. 45(3), pages 666-681.
    2. Jue Wang & Philip Shapira, 2011. "Funding acknowledgement analysis: an enhanced tool to investigate research sponsorship impacts: the case of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 563-586, June.
    3. Daniele Rotolo & Ismael Rafols & Michael M. Hopkins & Loet Leydesdorff, 2017. "Strategic intelligence on emerging technologies: Scientometric overlay mapping," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(1), pages 214-233, January.
    4. Loet Leydesdorff & Daniele Rotolo & Ismael Rafols, 2012. "Bibliometric perspectives on medical innovation using the medical subject Headings of PubMed," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(11), pages 2239-2253, November.
    5. Ben Martin, 2016. "What is Happening to our Universities?," SPRU Working Paper Series 2016-03, SPRU - Science Policy Research Unit, University of Sussex Business School.
    6. Rodrigo Costas & Thed N. van Leeuwen, 2012. "Approaching the “reward triangle”: General analysis of the presence of funding acknowledgments and “peer interactive communication” in scientific publications," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(8), pages 1647-1661, August.
    7. Philip Shapira & Jue Wang, 2010. "Follow the money," Nature, Nature, vol. 468(7324), pages 627-628, December.
    8. Lucy Baker, 2016. "Technology Development in South Africa: The Case of Wind and Solar PV," SPRU Working Paper Series 2016-05, SPRU - Science Policy Research Unit, University of Sussex Business School.
    9. Marlie MacLean & Catherine Davies & Grant Lewison & Joe Anderson, 1998. "Evaluating the research activity and impact of funding agencies," Research Evaluation, Oxford University Press, vol. 7(1), pages 7-16, April.
    10. Xianwen Wang & Di Liu & Kun Ding & Xinran Wang, 2012. "Science funding and research output: a study on 10 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 591-599, May.
    11. Blaise Cronin & Sara Franks, 2006. "Trading cultures: Resource mobilization and service rendering in the life sciences as revealed in the journal article's paratext," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 57(14), pages 1909-1918, December.
    12. John Rigby, 2011. "Systematic grant and funding body acknowledgement data for publications: new dimensions and new controversies for research policy and evaluation," Research Evaluation, Oxford University Press, vol. 20(5), pages 365-375, December.
    13. Daniele Rotolo & Loet Leydesdorff, 2015. "Matching Medline/PubMed data with Web of Science: A routine in R language," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(10), pages 2155-2159, October.
    14. Blaise Cronin & Debora Shaw & Kathryn La Barre, 2003. "A cast of thousands: Coauthorship and subauthorship collaboration in the 20th century as manifested in the scholarly journal literature of psychology and philosophy," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(9), pages 855-871, July.
    15. Blaise Cronin & Debora Shaw & Kathryn La Barre, 2004. "Visible, less visible, and invisible work: Patterns of collaboration in 20th century chemistry," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 55(2), pages 160-168, January.
    16. Rodrigo Costas & Thed N. Leeuwen, 2012. "Approaching the “reward triangle”: General analysis of the presence of funding acknowledgments and “peer interactive communication” in scientific publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(8), pages 1647-1661, August.
    17. Abdullah Gök & John Rigby & Philip Shapira, 2016. "The impact of research funding on scientific outputs: Evidence from six smaller European countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 715-730, March.
    18. John Rigby, 2013. "Looking for the impact of peer review: does count of funding acknowledgements really predict research impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 57-73, January.
    19. Matthew L. Wallace & Ismael Rafols, 2015. "Research portfolios in science policy: moving from financial returns to societal benefits," SPRU Working Paper Series 2015-10, SPRU - Science Policy Research Unit, University of Sussex Business School.
    20. Linda Butler, 2001. "Revisiting bibliometric issues using new empirical data," Research Evaluation, Oxford University Press, vol. 10(1), pages 59-65, April.
    21. Dangzhi Zhao, 2010. "Characteristics and impact of grant-funded research: a case study of the library and information science field," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 293-306, August.
    22. Yuti Ariani Fatimah & Saurabh Arora, 2016. "Nonhumans in the Practice of Development: Material Agency and Friction in a Small-Scale Energy Program in Indonesia," SPRU Working Paper Series 2016-04, SPRU - Science Policy Research Unit, University of Sussex Business School.
    23. Matthew L. Wallace & Ismael Rafols, 2016. "Shaping the Agenda of a Grand Challenge: Institutional Mediation of Priorities in Avian Influenza Research," SPRU Working Paper Series 2016-02, SPRU - Science Policy Research Unit, University of Sussex Business School.
    24. Adrián A. Díaz-Faes & María Bordons, 2014. "Acknowledgments in scientific publications: Presence in Spanish science and text patterns across disciplines," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 65(9), pages 1834-1849, September.
    25. Ciarli, Tommaso & Valente, Marco, 2016. "The complex interactions between economic growth and market concentration in a model of structural change," Structural Change and Economic Dynamics, Elsevier, vol. 38(C), pages 38-54.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Adèle Paul-Hus & Nadine Desrochers & Rodrigo Costas, 2016. "Characterization, description, and considerations for the use of funding acknowledgement data in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 167-182, July.
    2. Belén Álvarez-Bornstein & Fernanda Morillo & María Bordons, 2017. "Funding acknowledgments in the Web of Science: completeness and accuracy of collected data," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1793-1812, September.
    3. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    4. Fernanda Morillo & Belén Álvarez-Bornstein, 2018. "How to automatically identify major research sponsors selecting keywords from the WoS Funding Agency field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1755-1770, December.
    5. Fernanda Morillo, 2019. "Collaboration and impact of research in different disciplines with international funding (from the EU and other foreign sources)," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 807-823, August.
    6. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.
    7. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    8. Ji-ping Gao & Cheng Su & Hai-yan Wang & Li-hua Zhai & Yun-tao Pan, 2019. "Research fund evaluation based on academic publication output analysis: the case of Chinese research fund evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 959-972, May.
    9. Xin Xu & Alice M. Tan & Star X. Zhao, 2015. "Funding ratios in social science: the perspective of countries/territories level and comparison with natural sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 673-684, September.
    10. Adèle Paul-Hus & Adrián A Díaz-Faes & Maxime Sainte-Marie & Nadine Desrochers & Rodrigo Costas & Vincent Larivière, 2017. "Beyond funding: Acknowledgement patterns in biomedical, natural and social sciences," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-14, October.
    11. Gianluca Fabiano & Andrea Marcellusi & Giampiero Favato, 2020. "Public–private contribution to biopharmaceutical discoveries: a bibliometric analysis of biomedical research in UK," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 153-168, July.
    12. Wen Lou & Jiangen He & Lingxin Zhang & Zhijie Zhu & Yongjun Zhu, 2023. "Support behind the scenes: the relationship between acknowledgement, coauthor, and citation in Nobel articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5767-5790, October.
    13. Katherine W. McCain, 2018. "Beyond Garfield’s Citation Index: an assessment of some issues in building a personal name Acknowledgments Index," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 605-631, February.
    14. Alberto Baccini & Eugenio Petrovich, 2022. "Normative versus strategic accounts of acknowledgment data: The case of the top-five journals of economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 603-635, January.
    15. Lili Miao & Vincent Larivi`ere & Feifei Wang & Yong-Yeol Ahn & Cassidy R. Sugimoto, 2023. "Cooperation and interdependence in global science funding," Papers 2308.08630, arXiv.org, revised Feb 2024.
    16. Mu-Hsuan Huang & Mei-Jhen Huang, 2018. "An analysis of global research funding from subject field and funding agencies perspectives in the G9 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 833-847, May.
    17. Mari Martiskainen, 2016. "The role of community leadership in the development of grassroots innovations," SPRU Working Paper Series 2016-10, SPRU - Science Policy Research Unit, University of Sussex Business School.
    18. Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
    19. Li, Heyang & Wu, Meijun & Wang, Yougui & Zeng, An, 2022. "Bibliographic coupling networks reveal the advantage of diversification in scientific projects," Journal of Informetrics, Elsevier, vol. 16(3).
    20. Álvarez-Bornstein, Belén & Bordons, María, 2021. "Is funding related to higher research impact? Exploring its relationship and the mediating role of collaboration in several disciplines," Journal of Informetrics, Elsevier, vol. 15(1).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sru:ssewps:2016-08. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: University of Sussex Business School Communications Team (email available below). General contact details of provider: https://edirc.repec.org/data/spessuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.