IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v115y2018i1d10.1007_s11192-017-2583-8.html
   My bibliography  Save this article

The funding factor: a cross-disciplinary examination of the association between research funding and citation impact

Author

Listed:
  • Erjia Yan

    (Drexel University)

  • Chaojiang Wu

    (Drexel University)

  • Min Song

    (Yonsei University)

Abstract

This paper intends to illuminate the relationship between science funding and citation impact in seven STEMM disciplines (science, technology, engineering, mathematics, and medicine). Using a regression model with Heckman bias correction, we find that funding has a positive, significant association with a paper’s citations in STEMM fields. Further analyses show that this association is magnified by the factors of multiple authorship and multiple institutions. For funded papers in STEM, multi-author and multi-institution papers tend to receive even more citations than single-authored and single-institution papers; however, funded papers in Medicine received less gain in citation impact when either factor is considered. Based on the finding that funding support has a stronger association with citation impact when it is treated as a binary variable than as a count variable, this paper recommends the allocation of funding to researchers without active funding support, instead of giving awards to those with multiple funding supports at hand.

Suggested Citation

  • Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
  • Handle: RePEc:spr:scient:v:115:y:2018:i:1:d:10.1007_s11192-017-2583-8
    DOI: 10.1007/s11192-017-2583-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-017-2583-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-017-2583-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Park, Hyunwoo & Lee, Jeongsik (Jay) & Kim, Byung-Cheol, 2015. "Project selection in NIH: A natural experiment from ARRA," Research Policy, Elsevier, vol. 44(6), pages 1145-1159.
    2. Lane, Julia I. & Owen-Smith, Jason & Rosen, Rebecca F. & Weinberg, Bruce A., 2015. "New linked data on research investments: Scientific workforce, productivity, and public value," Research Policy, Elsevier, vol. 44(9), pages 1659-1671.
    3. Rodrigo Costas & Thed N. Leeuwen, 2012. "Approaching the “reward triangle”: General analysis of the presence of funding acknowledgments and “peer interactive communication” in scientific publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(8), pages 1647-1661, August.
    4. Adèle Paul-Hus & Nadine Desrochers & Rodrigo Costas, 2016. "Characterization, description, and considerations for the use of funding acknowledgement data in Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(1), pages 167-182, July.
    5. Abdullah Gök & John Rigby & Philip Shapira, 2016. "The impact of research funding on scientific outputs: Evidence from six smaller European countries," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(3), pages 715-730, March.
    6. John Rigby, 2013. "Looking for the impact of peer review: does count of funding acknowledgements really predict research impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(1), pages 57-73, January.
    7. Leydesdorff, Loet & Wagner, Caroline, 2009. "Macro-level indicators of the relations between research funding and research output," Journal of Informetrics, Elsevier, vol. 3(4), pages 353-362.
    8. Jue Wang & Philip Shapira, 2011. "Funding acknowledgement analysis: an enhanced tool to investigate research sponsorship impacts: the case of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 563-586, June.
    9. James J. Heckman, 1976. "Introduction to "Annals of Economic and Social Measurement, Volume 5, number 4"," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 5, number 4, National Bureau of Economic Research, Inc.
    10. Nicola Grassano & Daniele Rotolo & Joshua Hutton & Frédérique Lang & Michael M. Hopkins, 2017. "Funding Data from Publication Acknowledgments: Coverage, Uses, and Limitations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(4), pages 999-1017, April.
    11. Vincent Larivière & Yves Gingras, 2010. "The impact factor's Matthew Effect: A natural experiment in bibliometrics," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(2), pages 424-427, February.
    12. Belén Álvarez-Bornstein & Fernanda Morillo & María Bordons, 2017. "Funding acknowledgments in the Web of Science: completeness and accuracy of collected data," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1793-1812, September.
    13. S. Trevis Certo & John R. Busenbark & Hyun‐soo Woo & Matthew Semadeni, 2016. "Sample selection bias and Heckman models in strategic management research," Strategic Management Journal, Wiley Blackwell, vol. 37(13), pages 2639-2657, December.
    14. Dangzhi Zhao, 2010. "Characteristics and impact of grant-funded research: a case study of the library and information science field," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 293-306, August.
    15. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    16. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    17. Franceschet, Massimo & Costantini, Antonio, 2010. "The effect of scholar collaboration on impact and quality of academic papers," Journal of Informetrics, Elsevier, vol. 4(4), pages 540-553.
    18. Mark A. Largent & Julia I. Lane, 2012. "STAR METRICS and the Science of Science Policy," Review of Policy Research, Policy Studies Organization, vol. 29(3), pages 431-438, May.
    19. Li Tang & Guangyuan Hu & Weishu Liu, 2017. "Funding acknowledgment analysis: Queries and caveats," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(3), pages 790-794, March.
    20. Yan, Erjia & Zhu, Yongjun, 2015. "Identifying entities from scientific publications: A comparison of vocabulary- and model-based methods," Journal of Informetrics, Elsevier, vol. 9(3), pages 455-465.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    2. Ping Zhou & Xiaojing Cai & Xiaozan Lyu, 0. "An in-depth analysis of government funding and international collaboration in scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 0, pages 1-17.
    3. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    4. Álvarez-Bornstein, Belén & Bordons, María, 2021. "Is funding related to higher research impact? Exploring its relationship and the mediating role of collaboration in several disciplines," Journal of Informetrics, Elsevier, vol. 15(1).
    5. Esma J. Doğramacı & Giampiero Rossi-Fedele, 2021. "Predictors of societal and professional impact of orthodontic research. A multivariate, scientometric approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 9223-9248, November.
    6. Mingyang Wang & Shijia Jiao & Kah-Hin Chai & Guangsheng Chen, 2019. "Building journal’s long-term impact: using indicators detected from the sustained active articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 261-283, October.
    7. Weishu Liu, 2020. "Accuracy of funding information in Scopus: a comparative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 803-811, July.
    8. Balázs Győrffy & Andrea Magda Nagy & Péter Herman & Ádám Török, 2018. "Factors influencing the scientific performance of Momentum grant holders: an evaluation of the first 117 research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 409-426, October.
    9. Li, Kai & Yan, Erjia, 2019. "Are NIH-funded publications fulfilling the proposed research? An examination of concept-matchedness between NIH research grants and their supported publications," Journal of Informetrics, Elsevier, vol. 13(1), pages 226-237.
    10. Saeed Roshani & Mohammad-Reza Bagherylooieh & Melika Mosleh & Mario Coccia, 2021. "What is the relationship between research funding and citation-based performance? A comparative analysis between critical disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7859-7874, September.
    11. Ping Zhou & Xiaojing Cai & Xiaozan Lyu, 2020. "An in-depth analysis of government funding and international collaboration in scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(2), pages 1331-1347, November.
    12. Fernanda Morillo, 2019. "Collaboration and impact of research in different disciplines with international funding (from the EU and other foreign sources)," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 807-823, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weishu Liu & Li Tang & Guangyuan Hu, 2020. "Funding information in Web of Science: an updated overview," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(3), pages 1509-1524, March.
    2. Ji-ping Gao & Cheng Su & Hai-yan Wang & Li-hua Zhai & Yun-tao Pan, 2019. "Research fund evaluation based on academic publication output analysis: the case of Chinese research fund evaluation," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 959-972, May.
    3. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    4. Belén Álvarez-Bornstein & Fernanda Morillo & María Bordons, 2017. "Funding acknowledgments in the Web of Science: completeness and accuracy of collected data," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(3), pages 1793-1812, September.
    5. Star X. Zhao & Wen Lou & Alice M. Tan & Shuang Yu, 2018. "Do funded papers attract more usage?," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 153-168, April.
    6. Weishu Liu, 2020. "Accuracy of funding information in Scopus: a comparative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 803-811, July.
    7. Mu-Hsuan Huang & Mei-Jhen Huang, 2018. "An analysis of global research funding from subject field and funding agencies perspectives in the G9 countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(2), pages 833-847, May.
    8. Cristian Mejia & Yuya Kajikawa, 2018. "Using acknowledgement data to characterize funding organizations by the types of research sponsored: the case of robotics research," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 883-904, March.
    9. Fernanda Morillo & Belén Álvarez-Bornstein, 2018. "How to automatically identify major research sponsors selecting keywords from the WoS Funding Agency field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1755-1770, December.
    10. Fernanda Morillo, 2019. "Collaboration and impact of research in different disciplines with international funding (from the EU and other foreign sources)," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 807-823, August.
    11. Gianluca Fabiano & Andrea Marcellusi & Giampiero Favato, 2020. "Public–private contribution to biopharmaceutical discoveries: a bibliometric analysis of biomedical research in UK," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 153-168, July.
    12. Álvarez-Bornstein, Belén & Bordons, María, 2021. "Is funding related to higher research impact? Exploring its relationship and the mediating role of collaboration in several disciplines," Journal of Informetrics, Elsevier, vol. 15(1).
    13. Fengqing Zhang & Erjia Yan & Xin Niu & Yongjun Zhu, 2018. "Joint modeling of the association between NIH funding and its three primary outcomes: patents, publications, and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 591-602, October.
    14. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    15. Saeed Roshani & Mohammad-Reza Bagherylooieh & Melika Mosleh & Mario Coccia, 2021. "What is the relationship between research funding and citation-based performance? A comparative analysis between critical disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7859-7874, September.
    16. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.
    17. Nicola Grassano & Daniele Rotolo & Joshua Hutton & Frédérique Lang & Michael M. Hopkins, 2017. "Funding Data from Publication Acknowledgments: Coverage, Uses, and Limitations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(4), pages 999-1017, April.
    18. Davide Vurchio & Anna Giunta, 2021. "The impact of the Italian Space Agency on scientific knowledge: Evidence from academic publications," Annals of Public and Cooperative Economics, Wiley Blackwell, vol. 92(3), pages 511-529, September.
    19. Renuka Sane & Susan Thomas, 2020. "From Participation To Repurchase: Low Income Households And Micro‐insurance," Journal of Risk & Insurance, The American Risk and Insurance Association, vol. 87(3), pages 783-814, September.
    20. Yuen Leng Chow & Isa E. Hafalir & Abdullah Yavas, 2015. "Auction versus Negotiated Sale: Evidence from Real Estate Sales," Real Estate Economics, American Real Estate and Urban Economics Association, vol. 43(2), pages 432-470, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:115:y:2018:i:1:d:10.1007_s11192-017-2583-8. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.springer.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.