IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v108y2016i3d10.1007_s11192-016-2029-8.html
   My bibliography  Save this article

Using co-authorship and citation analysis to identify research groups: a new way to assess performance

Author

Listed:
  • Leonardo Reyes-Gonzalez

    (Medallia)

  • Claudia N. Gonzalez-Brambila

    (Instituto Tecnologico Autonomo de Mexico)

  • Francisco Veloso

    (Universidade Catolica Portuguesa)

Abstract

Considering that modern science is conducted primarily through a network of collaborators who organize themselves around key researchers, this research develops and tests a characterization and assessment method that recognizes the particular endogenous, or self-organizing characteristics of research groups. Instead of establishing an ad-hoc unit of analysis and assuming an unspecified network structure, the proposed method uses knowledge footprints, based on backward citations, to measure and compare the performance/productivity of research groups. The method is demonstrated by ranking research groups in Physics, Applied Physics/Condensed Matter/Materials Science and Optics in the leading institutions in Mexico, the results show that the understanding of the scientific performance of an institution changes with a more careful account for the unit of analysis used in the assessment. Moreover, evaluations at the group level provide more accurate assessments since they allow for appropriate comparisons within subfields of science. The proposed method could be used to better understand the self-organizing mechanisms of research groups and have better assessment of their performance.

Suggested Citation

  • Leonardo Reyes-Gonzalez & Claudia N. Gonzalez-Brambila & Francisco Veloso, 2016. "Using co-authorship and citation analysis to identify research groups: a new way to assess performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1171-1191, September.
  • Handle: RePEc:spr:scient:v:108:y:2016:i:3:d:10.1007_s11192-016-2029-8
    DOI: 10.1007/s11192-016-2029-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2029-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-016-2029-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Isabel Gómez & María Teresa Fernández & Jesús Sebastián, 1999. "Analysis of the structure of international scientific cooperation networks through bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 44(3), pages 441-457, March.
    2. Martin, Ben R. & Irvine, John, 1993. "Assessing basic research : Some partial indicators of scientific progress in radio astronomy," Research Policy, Elsevier, vol. 22(2), pages 106-106, April.
    3. Haiyang Lu & Yuqiang Feng, 2009. "A measure of authors’ centrality in co-authorship networks based on the distribution of collaborative relationships," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(2), pages 499-511, November.
    4. Wagner, Caroline S. & Leydesdorff, Loet, 2005. "Network structure, self-organization, and the growth of international collaboration in science," Research Policy, Elsevier, vol. 34(10), pages 1608-1618, December.
    5. Neal Coulter & Ira Monarch & Suresh Konda, 1998. "Software engineering as seen through its research literature: A study in co‐word analysis," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 49(13), pages 1206-1223.
    6. Anthony F J van Raan, 2000. "R&D evaluation at the beginning of the new century," Research Evaluation, Oxford University Press, vol. 9(2), pages 81-86, August.
    7. Katz, J. Sylvan & Martin, Ben R., 1997. "What is research collaboration?," Research Policy, Elsevier, vol. 26(1), pages 1-18, March.
    8. Jonathan Adams, 1998. "Benchmarking international research," Nature, Nature, vol. 396(6712), pages 615-618, December.
    9. Gonzalez-Brambila, Claudia N. & Veloso, Francisco M. & Krackhardt, David, 2013. "The impact of network embeddedness on research output," Research Policy, Elsevier, vol. 42(9), pages 1555-1567.
    10. Clara Calero & Renald Buter & Cecilia Cabello Valdés & Ed Noyons, 2006. "How to identify research groups using publication analysis: an example in the field of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 365-376, February.
    11. Gonzalez-Brambila, Claudia & Veloso, Francisco M., 2007. "The determinants of research output and impact: A study of Mexican researchers," Research Policy, Elsevier, vol. 36(7), pages 1035-1051, September.
    12. Jochen Gläser & Thomas H Spurling & Linda Butler, 2004. "Intraorganisational evaluation: are there ‘least evaluable units'?," Research Evaluation, Oxford University Press, vol. 13(1), pages 19-32, April.
    13. Antonio Perianes-Rodríguez & Carlos Olmeda-Gómez & Félix Moya-Anegón, 2010. "Detecting, identifying and visualizing research groups in co-authorship networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 307-319, February.
    14. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    15. David A. King, 2004. "The scientific impact of nations," Nature, Nature, vol. 430(6997), pages 311-316, July.
    16. Georghiou, Luke & Roessner, David, 2000. "Evaluating technology programs: tools and methods," Research Policy, Elsevier, vol. 29(4-5), pages 657-678, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yucheng Zhang & Zhiling Wang & Lin Xiao & Lijun Wang & Pei Huang, 2023. "Discovering the evolution of online reviews: A bibliometric review," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-22, December.
    2. Mora, Luca & Deakin, Mark & Reid, Alasdair, 2019. "Combining co-citation clustering and text-based analysis to reveal the main development paths of smart cities," Technological Forecasting and Social Change, Elsevier, vol. 142(C), pages 56-69.
    3. Benatti, Alexandre & de Arruda, Henrique Ferraz & Silva, Filipi Nascimento & Comin, César Henrique & da Fontoura Costa, Luciano, 2023. "On the stability of citation networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 610(C).
    4. Isabel Marques & João Leitão & Alba Carvalho & Dina Pereira, 2021. "Public Administration and Values Oriented to Sustainability: A Systematic Approach to the Literature," Sustainability, MDPI, vol. 13(5), pages 1-27, February.
    5. Quan-Hoang Vuong & Huyen Thanh T. Nguyen & Thanh-Hang Pham & Manh-Toan Ho & Minh-Hoang Nguyen, 2021. "Assessing the ideological homogeneity in entrepreneurial finance research by highly cited publications," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-11, December.
    6. Fernando J. Garrigos-Simon & M. Dolores Botella-Carrubi & Tomas F. Gonzalez-Cruz, 2018. "Social Capital, Human Capital, and Sustainability: A Bibliometric and Visualization Analysis," Sustainability, MDPI, vol. 10(12), pages 1-19, December.
    7. Huchang Liao & Ming Tang & Li Luo & Chunyang Li & Francisco Chiclana & Xiao-Jun Zeng, 2018. "A Bibliometric Analysis and Visualization of Medical Big Data Research," Sustainability, MDPI, vol. 10(1), pages 1-18, January.
    8. Nguyen, Minh-Hoang & Vuong, Quan-Hoang, 2020. "Evaluation of the Aichi Biodiversity Targets: The international collaboration trilemma in interdisciplinary research," SocArXiv 6yscw, Center for Open Science.
    9. Lee, O-Joun & Jeon, Hyeon-Ju & Jung, Jason J., 2021. "Learning multi-resolution representations of research patterns in bibliographic networks," Journal of Informetrics, Elsevier, vol. 15(1).
    10. Fernando J. Garrigos-Simon & Yeamduan Narangajavana-Kaosiri & Ismael Lengua-Lengua, 2018. "Tourism and Sustainability: A Bibliometric and Visualization Analysis," Sustainability, MDPI, vol. 10(6), pages 1-23, June.
    11. Saulo Cardoso Maia & Gideon Carvalho Benedicto & José Willer Prado & David Alastair Robb & Oscar Neto Almeida Bispo & Mozar José Brito, 2019. "Mapping the literature on credit unions: a bibliometric investigation grounded in Scopus and Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 929-960, September.
    12. Fernando Garrigós-Simón & Silvia Sanz-Blas & Yeamduan Narangajavana & Daniela Buzova, 2021. "The Nexus between Big Data and Sustainability: An Analysis of Current Trends and Developments," Sustainability, MDPI, vol. 13(12), pages 1, June.
    13. Leslier Valenzuela-Fernández & Manuel Escobar-Farfán, 2022. "Zero-Waste Management and Sustainable Consumption: A Comprehensive Bibliometric Mapping Analysis," Sustainability, MDPI, vol. 14(23), pages 1-24, December.
    14. Leonardo Reyes Gonzalez & Claudia N González Brambila & Francisco Veloso, 2018. "Birth of prominent scientists," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-23, March.
    15. Ana Lúcia Marôco & Fernanda Nogueira & Sónia P. Gonçalves & Isabel C. P. Marques, 2022. "Work-Family Interface in the Context of Social Responsibility: A Systematic Literature Review," Sustainability, MDPI, vol. 14(5), pages 1-23, March.
    16. Nguyen, Minh-Hoang & Pham, Thanh-Hang & Huyen, Nguyen Thanh Thanh & Ho, Manh-Toan & Vuong, Quan-Hoang, 2020. "Western ideological homogeneity in entrepreneurial finance research: Evidence from highly cited publications," OSF Preprints sk3e6, Center for Open Science.
    17. Daniela Maria Cretu & Felicia Morandau, 2020. "Initial Teacher Education for Inclusive Education: A Bibliometric Analysis of Educational Research," Sustainability, MDPI, vol. 12(12), pages 1-27, June.
    18. Fernando J. Garrigos-Simon & Yeamduan Narangajavana-Kaosiri & Yeamdao Narangajavana, 2019. "Quality in Tourism Literature: A Bibliometric Review," Sustainability, MDPI, vol. 11(14), pages 1-22, July.
    19. Zewen Hu & Angela Lin & Peter Willett, 2019. "Identification of research communities in cited and uncited publications using a co-authorship network," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 1-19, January.
    20. Daniela Aguirre-Guerrero & Roberto Bernal-Jaquez, 2023. "A Methodology for the Analysis of Collaboration Networks with Higher-Order Interactions," Mathematics, MDPI, vol. 11(10), pages 1-17, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Belkhouja, Mustapha & Fattoum, Senda & Yoon, Hyungseok (David), 2021. "Does greater diversification increase individual productivity? The moderating effect of attention allocation," Research Policy, Elsevier, vol. 50(6).
    2. Jo Royle & Louisa Coles & Dorothy Williams & Paul Evans, 2007. "Publishing in international journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 59-86, April.
    3. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2014. "Assessing national strengths and weaknesses in research fields," Journal of Informetrics, Elsevier, vol. 8(3), pages 766-775.
    4. Bar-Ilan, Judit, 2008. "Informetrics at the beginning of the 21st century—A review," Journal of Informetrics, Elsevier, vol. 2(1), pages 1-52.
    5. Maaike Verbree & Edwin Horlings & Peter Groenewegen & Inge Weijden & Peter Besselaar, 2015. "Organizational factors influencing scholarly performance: a multivariate study of biomedical research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 25-49, January.
    6. Guan, JianCheng & Zuo, KaiRui & Chen, KaiHua & Yam, Richard C.M., 2016. "Does country-level R&D efficiency benefit from the collaboration network structure?," Research Policy, Elsevier, vol. 45(4), pages 770-784.
    7. He, Zi-Lin & Geng, Xue-Song & Campbell-Hunt, Colin, 2009. "Research collaboration and research output: A longitudinal study of 65 biomedical scientists in a New Zealand university," Research Policy, Elsevier, vol. 38(2), pages 306-317, March.
    8. Chen, Kaihua & Zhang, Yi & Fu, Xiaolan, 2019. "International research collaboration: An emerging domain of innovation studies?," Research Policy, Elsevier, vol. 48(1), pages 149-168.
    9. Chin-Chang Tsai & Elizabeth A. Corley & Barry Bozeman, 2016. "Collaboration experiences across scientific disciplines and cohorts," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 505-529, August.
    10. Hird, Mackenzie D. & Pfotenhauer, Sebastian M., 2017. "How complex international partnerships shape domestic research clusters: Difference-in-difference network formation and research re-orientation in the MIT Portugal Program," Research Policy, Elsevier, vol. 46(3), pages 557-572.
    11. Brito, Ricardo & Rodríguez-Navarro, Alonso, 2018. "Research assessment by percentile-based double rank analysis," Journal of Informetrics, Elsevier, vol. 12(1), pages 315-329.
    12. Cédric Gossart & Müge Özman, 2009. "Co-authorship networks in social sciences: The case of Turkey," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 323-345, February.
    13. Zaida Chinchilla-Rodríguez & Cassidy R Sugimoto & Vincent Larivière, 2019. "Follow the leader: On the relationship between leadership and scholarly impact in international collaborations," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-18, June.
    14. Claudia N. Gonzalez Brambila & José I. Ponce & Silvia B. Gonzalez Brambila & Matias F. Milia, 2023. "Determining the Characteristics of Papers That Garner the Most Significant Impact: A Deep Dive into Mexican Engineering Publications," Publications, MDPI, vol. 11(4), pages 1-14, September.
    15. Guan, Jiancheng & Zhang, Jingjing & Yan, Yan, 2015. "The impact of multilevel networks on innovation," Research Policy, Elsevier, vol. 44(3), pages 545-559.
    16. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2020. "A novel methodology to assess the scientific standing of nations at field level," Journal of Informetrics, Elsevier, vol. 14(1).
    17. Qi Yu & Hongfang Shao & Zhiguang Duan, 2011. "Research groups of oncology co-authorship network in China," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(2), pages 553-567, November.
    18. Wang, Jian, 2016. "Knowledge creation in collaboration networks: Effects of tie configuration," Research Policy, Elsevier, vol. 45(1), pages 68-80.
    19. Guillermo Armando Ronda-Pupo & Carlos Díaz-Contreras & Guillermo Ronda-Velázquez & Jorge Carlos Ronda-Pupo, 2015. "The role of academic collaboration in the impact of Latin-American research on management," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1435-1454, February.
    20. Perianes-Rodríguez, Antonio & Chinchilla-Rodríguez, Zaida & Vargas-Quesada, Benjamín & Olmeda Gómez, Carlos & Moya-Anegón, Félix, 2009. "Synthetic hybrid indicators based on scientific collaboration to quantify and evaluate individual research results," Journal of Informetrics, Elsevier, vol. 3(2), pages 91-101.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:108:y:2016:i:3:d:10.1007_s11192-016-2029-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.