IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v16y2022i4s175115772200102x.html
   My bibliography  Save this article

Does the author’s collaboration mode lead to papers’ different citation impacts? An empirical analysis based on propensity score matching

Author

Listed:
  • Fan, Lingxu
  • Guo, Lei
  • Wang, Xinhua
  • Xu, Liancheng
  • Liu, Fangai

Abstract

This study explores the impact of different collaboration modes on the cited frequency of publications. Though several studies have obtained some research results, most of them exploit association or regression-based methods, which may not lead to causal conclusions. To overcome the above challenges, we use the Propensity Score Matching (PSM) method to analyze and compare the citation frequencies resulting from four groups of collaboration models: international versus domestic, international multilateral versus international bilateral, domestic inter-organizational versus domestic intra-organizational, and domestic multi-author versus domestic single-author. More specifically, we conduct this analysis by exploring the publications with three computer science subfields from the Web of Science (WoS) database. The experimental results show that international collaboration, especially international multilateral collaboration, has a significant role in increasing the frequency of citations to scientific publications, showing that internationalization and collaboration are critical factors in the growth of the impact of the papers. Among national co-publications, collaborative publications within national organizations receive a higher citation impact. Multi-author collaborations significantly increase citation frequency compared to single-author publications. Our heterogeneity analysis across the different subfields of the computer science domain finds that the treatment effects for the three subfields differ modestly and mostly significant from the whole sample. Moreover, besides the implications for developing research policy and scientist collaboration, our study can capture the causal effect between author collaboration patterns and citation frequency to reveal their causal effects.

Suggested Citation

  • Fan, Lingxu & Guo, Lei & Wang, Xinhua & Xu, Liancheng & Liu, Fangai, 2022. "Does the author’s collaboration mode lead to papers’ different citation impacts? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 16(4).
  • Handle: RePEc:eee:infome:v:16:y:2022:i:4:s175115772200102x
    DOI: 10.1016/j.joi.2022.101350
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S175115772200102X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.joi.2022.101350?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sei‐Ching Joanna Sin, 2011. "International coauthorship and citation impact: A bibliometric study of six LIS journals, 1980–2008," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 62(9), pages 1770-1783, September.
    2. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    3. Bornmann, Lutz & Leydesdorff, Loet & Wang, Jian, 2014. "How to improve the prediction based on citation impact percentiles for years shortly after the publication date?," Journal of Informetrics, Elsevier, vol. 8(1), pages 175-180.
    4. Maria Benavent-Pérez & Juan Gorraiz & Christian Gumpenberger & Félix Moya-Anegón, 2012. "The different flavors of research collaboration: a case study of their influence on university excellence in four world regions," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(1), pages 41-58, October.
    5. Kwiek, Marek & Roszka, Wojciech, 2021. "Gender-based homophily in research: A large-scale study of man-woman collaboration," Journal of Informetrics, Elsevier, vol. 15(3).
    6. Yves Gingras & Mahdi Khelfaoui, 2018. "Assessing the effect of the United States’ “citation advantage” on other countries’ scientific impact as measured in the Web of Science (WoS) database," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 517-532, February.
    7. Nan Ma & Jiancheng Guan, 2005. "An exploratory study on collaboration profiles of Chinese publications in Molecular Biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(3), pages 343-355, December.
    8. Marco Caliendo & Sabine Kopeinig, 2008. "Some Practical Guidance For The Implementation Of Propensity Score Matching," Journal of Economic Surveys, Wiley Blackwell, vol. 22(1), pages 31-72, February.
    9. Vincent Larivière & Kaile Gong & Cassidy R. Sugimoto, 2018. "Citations strength begins at home," Nature, Nature, vol. 564(7735), pages 70-71, December.
    10. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    11. Vicente P. Guerrero Bote & Carlos Olmeda‐Gómez & Félix de Moya‐Anegón, 2013. "Quantifying the benefits of international scientific collaboration," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(2), pages 392-404, February.
    12. Peter M. Steiner & Thomas D. Cook & William R. Shadish, 2011. "On the Importance of Reliable Covariate Measurement in Selection Bias Adjustments Using Propensity Scores," Journal of Educational and Behavioral Statistics, , vol. 36(2), pages 213-236, April.
    13. Hanna-Mari Puuska & Reetta Muhonen & Yrjö Leino, 2014. "International and domestic co-publishing and their citation impact in different disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 823-839, February.
    14. Didegah, Fereshteh & Thelwall, Mike, 2013. "Which factors help authors produce the highest impact research? Collaboration, journal and document properties," Journal of Informetrics, Elsevier, vol. 7(4), pages 861-873.
    15. Tai‐Quan Peng & Jonathan J.H. Zhu, 2012. "Where you publish matters most: A multilevel analysis of factors affecting citations of internet studies," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(9), pages 1789-1803, September.
    16. Alberto Abadie & Guido W. Imbens, 2002. "Simple and Bias-Corrected Matching Estimators for Average Treatment Effects," NBER Technical Working Papers 0283, National Bureau of Economic Research, Inc.
    17. Bornmann, Lutz & Williams, Richard, 2013. "How to calculate the practical significance of citation impact differences? An empirical example from evaluative institutional bibliometrics using adjusted predictions and marginal effects," Journal of Informetrics, Elsevier, vol. 7(2), pages 562-574.
    18. Enrico di Bella & Luca Gandullia & Sara Preti, 2021. "Analysis of scientific collaboration network of Italian Institute of Technology," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(10), pages 8517-8539, October.
    19. Abbasi, Alireza & Altmann, Jörn & Hossain, Liaquat, 2011. "Identifying the effects of co-authorship networks on the performance of scholars: A correlation and regression analysis of performance measures and social network analysis measures," Journal of Informetrics, Elsevier, vol. 5(4), pages 594-607.
    20. Toluwase Asubiaro, 2019. "How collaboration type, publication place, funding and author’s role affect citations received by publications from Africa: A bibliometric study of LIS research from 1996 to 2015," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 1261-1287, September.
    21. Nataliya Matveeva & Anuška Ferligoj, 2020. "Scientific collaboration in Russian universities before and after the excellence initiative Project 5-100," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2383-2407, September.
    22. Chen, Shiji & Arsenault, Clément & Larivière, Vincent, 2015. "Are top-cited papers more interdisciplinary?," Journal of Informetrics, Elsevier, vol. 9(4), pages 1034-1046.
    23. Bryson, Alex & Dorsett, Richard & Purdon, Susan, 2002. "The use of propensity score matching in the evaluation of active labour market policies," LSE Research Online Documents on Economics 4993, London School of Economics and Political Science, LSE Library.
    24. Sei-Ching Joanna Sin, 2011. "International coauthorship and citation impact: A bibliometric study of six LIS journals, 1980–2008," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(9), pages 1770-1783, September.
    25. Vieira, E.S. & Gomes, J.A.N.F., 2010. "Citations to scientific articles: Its distribution and dependence on the article features," Journal of Informetrics, Elsevier, vol. 4(1), pages 1-13.
    26. Bárbara S. Lancho-Barrantes & Vicente P. Guerrero-Bote & Félix Moya-Anegón, 2013. "Citation increments between collaborating countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(3), pages 817-831, March.
    27. Maki Kato & Asao Ando, 2013. "The relationship between research performance and international collaboration in chemistry," Scientometrics, Springer;Akadémiai Kiadó, vol. 97(3), pages 535-553, December.
    28. Hongquan Shen & Juan Xie & Jiang Li & Ying Cheng, 2021. "The correlation between scientific collaboration and citation count at the paper level: a meta-analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3443-3470, April.
    29. Yan Wang & Yishan Wu & Yuntao Pan & Zheng Ma & Ronald Rousseau, 2005. "Scientific collaboration in China as reflected in co-authorship," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(2), pages 183-198, January.
    30. Fatemeh Rostami & Asghar Mohammadpoorasl & Mohammad Hajizadeh, 2014. "The effect of characteristics of title on citation rates of articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2007-2010, March.
    31. Maarten Wesel & Sally Wyatt & Jeroen Haaf, 2014. "What a difference a colon makes: how superficial factors influence subsequent citation," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1601-1615, March.
    32. Kim, Sangil & Park, Keon Chul, 2021. "Government funded R&D collaboration and it's impact on SME's business performance," Journal of Informetrics, Elsevier, vol. 15(3).
    33. Lutz Bornmann & Hans‐Dieter Daniel, 2007. "Multiple publication on a single research study: Does it pay? The influence of number of research articles on total citation counts in biomedicine," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 58(8), pages 1100-1107, June.
    34. Lorenzo Ductor, 2015. "Does Co-authorship Lead to Higher Academic Productivity?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 77(3), pages 385-407, June.
    35. Marian-Gabriel Hâncean & Matjaž Perc & Jürgen Lerner, 2021. "The coauthorship networks of the most productive European researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 201-224, January.
    36. Gerard Pasterkamp & Joris I. Rotmans & Dominique V. P. Kleijn & Cornelius Borst, 2007. "Citation frequency: A biased measure of research impact significantly influenced by the geographical origin of research articles," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(1), pages 153-165, January.
    37. Fereshteh Didegah & Mike Thelwall, 2013. "Determinants of research citation impact in nanoscience and nanotechnology," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(5), pages 1055-1064, May.
    38. Jonathan M. Levitt & Mike Thelwall, 2009. "The most highly cited Library and Information Science articles: Interdisciplinarity, first authors and citation patterns," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(1), pages 45-67, January.
    39. Peter Ingwersen & Birger Larsen, 2014. "Influence of a performance indicator on Danish research production and citation impact 2000–12," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1325-1344, November.
    40. Qianjin Zong & Yafen Xie & Jiechun Liang, 2020. "Does open peer review improve citation count? Evidence from a propensity score matching analysis of PeerJ," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 607-623, October.
    41. Radhamany Sooryamoorthy, 2009. "Do types of collaboration change citation? Collaboration and citation patterns of South African science publications," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(1), pages 177-193, October.
    42. Fereshteh Didegah & Mike Thelwall, 2013. "Determinants of research citation impact in nanoscience and nanotechnology," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(5), pages 1055-1064, May.
    43. Juan Gorraiz & Ralph Reimann & Christian Gumpenberger, 2012. "Key factors and considerations in the assessment of international collaboration: a case study for Austria and six countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(2), pages 417-433, May.
    44. Zhenyue Zhao & Xuelian Pan & Weina Hua, 2021. "Comparative analysis of the research productivity, publication quality, and collaboration patterns of top ranked library and information science schools in China and the United States," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 931-950, February.
    45. Shahadat Uddin & Liaquat Hossain & Alireza Abbasi & Kim Rasmussen, 2012. "Trend and efficiency analysis of co-authorship network," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 687-699, February.
    46. Tai-Quan Peng & Jonathan J.H. Zhu, 2012. "Where you publish matters most: A multilevel analysis of factors affecting citations of internet studies," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(9), pages 1789-1803, September.
    47. Vincent Larivière & Yves Gingras & Cassidy R. Sugimoto & Andrew Tsou, 2015. "Team size matters: Collaboration and scientific impact since 1900," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(7), pages 1323-1332, July.
    48. Ortega, José Luis, 2014. "Influence of co-authorship networks in the research impact: Ego network analyses from Microsoft Academic Search," Journal of Informetrics, Elsevier, vol. 8(3), pages 728-737.
    49. Candelaria Barrios & Esther Flores & M. Ángeles Martínez & Marta Ruiz-Martínez, 2019. "Is there convergence in international research collaboration? An exploration at the country level in the basic and applied science fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 631-659, August.
    50. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    51. Vanclay, Jerome K., 2013. "Factors affecting citation rates in environmental science," Journal of Informetrics, Elsevier, vol. 7(2), pages 265-271.
    52. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Iman Tahamtan & Askar Safipour Afshar & Khadijeh Ahamdzadeh, 2016. "Factors affecting number of citations: a comprehensive review of the literature," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1195-1225, June.
    2. Martorell Cunil, Onofre & Otero González, Luis & Durán Santomil, Pablo & Mulet Forteza, Carlos, 2023. "How to accomplish a highly cited paper in the tourism, leisure and hospitality field," Journal of Business Research, Elsevier, vol. 157(C).
    3. Bornmann, Lutz & Haunschild, Robin & Mutz, Rüdiger, 2020. "Should citations be field-normalized in evaluative bibliometrics? An empirical analysis based on propensity score matching," Journal of Informetrics, Elsevier, vol. 14(4).
    4. Elizabeth S. Vieira, 2023. "The influence of research collaboration on citation impact: the countries in the European Innovation Scoreboard," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3555-3579, June.
    5. Mingyang Wang & Zhenyu Wang & Guangsheng Chen, 2019. "Which can better predict the future success of articles? Bibliometric indices or alternative metrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1575-1595, June.
    6. Hongquan Shen & Juan Xie & Jiang Li & Ying Cheng, 2021. "The correlation between scientific collaboration and citation count at the paper level: a meta-analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3443-3470, April.
    7. Dehdarirad, Tahereh & Nasini, Stefano, 2017. "Research impact in co-authorship networks: a two-mode analysis," Journal of Informetrics, Elsevier, vol. 11(2), pages 371-388.
    8. Zhang, Mengya & Zhang, Gupeng & Liu, Yun & Zhai, Xiaorong & Han, Xinying, 2020. "Scientists’ genders and international academic collaboration: An empirical study of Chinese universities and research institutes," Journal of Informetrics, Elsevier, vol. 14(4).
    9. Amon, Julian & Hornik, Kurt, 2022. "Is it all bafflegab? – Linguistic and meta characteristics of research articles in prestigious economics journals," Journal of Informetrics, Elsevier, vol. 16(2).
    10. Didegah, Fereshteh & Thelwall, Mike, 2013. "Which factors help authors produce the highest impact research? Collaboration, journal and document properties," Journal of Informetrics, Elsevier, vol. 7(4), pages 861-873.
    11. Liu, Jialin & Chen, Hongkan & Liu, Zhibo & Bu, Yi & Gu, Weiye, 2022. "Non-linearity between referencing behavior and citation impact: A large-scale, discipline-level analysis," Journal of Informetrics, Elsevier, vol. 16(3).
    12. Chen, Shiji & Qiu, Junping & Arsenault, Clément & Larivière, Vincent, 2021. "Exploring the interdisciplinarity patterns of highly cited papers," Journal of Informetrics, Elsevier, vol. 15(1).
    13. Ruan, Xuanmin & Zhu, Yuanyang & Li, Jiang & Cheng, Ying, 2020. "Predicting the citation counts of individual papers via a BP neural network," Journal of Informetrics, Elsevier, vol. 14(3).
    14. Thelwall, Mike & Wilson, Paul, 2014. "Regression for citation data: An evaluation of different methods," Journal of Informetrics, Elsevier, vol. 8(4), pages 963-971.
    15. Shiji Chen & Yanhui Song & Fei Shu & Vincent Larivière, 2022. "Interdisciplinarity and impact: the effects of the citation time window," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2621-2642, May.
    16. Jonathan M. Levitt & Mike Thelwall, 2016. "Long term productivity and collaboration in information science," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1103-1117, September.
    17. Yezhu Wang & Yundong Xie & Dong Wang & Lu Guo & Rongting Zhou, 2022. "Do cover papers get better citations and usage counts? An analysis of 42 journals in cell biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(7), pages 3793-3813, July.
    18. Tahamtan, Iman & Bornmann, Lutz, 2018. "Core elements in the process of citing publications: Conceptual overview of the literature," Journal of Informetrics, Elsevier, vol. 12(1), pages 203-216.
    19. Danielle H. Lee, 2019. "Predictive power of conference-related factors on citation rates of conference papers," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 281-304, January.
    20. Juan Xie & Kaile Gong & Jiang Li & Qing Ke & Hyonchol Kang & Ying Cheng, 2019. "A probe into 66 factors which are possibly associated with the number of citations an article received," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1429-1454, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:16:y:2022:i:4:s175115772200102x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.