IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v108y2016i3d10.1007_s11192-016-2029-8.html
   My bibliography  Save this article

Using co-authorship and citation analysis to identify research groups: a new way to assess performance

Author

Listed:
  • Leonardo Reyes-Gonzalez

    (Medallia)

  • Claudia N. Gonzalez-Brambila

    () (Instituto Tecnologico Autonomo de Mexico)

  • Francisco Veloso

    (Universidade Catolica Portuguesa)

Abstract

Considering that modern science is conducted primarily through a network of collaborators who organize themselves around key researchers, this research develops and tests a characterization and assessment method that recognizes the particular endogenous, or self-organizing characteristics of research groups. Instead of establishing an ad-hoc unit of analysis and assuming an unspecified network structure, the proposed method uses knowledge footprints, based on backward citations, to measure and compare the performance/productivity of research groups. The method is demonstrated by ranking research groups in Physics, Applied Physics/Condensed Matter/Materials Science and Optics in the leading institutions in Mexico, the results show that the understanding of the scientific performance of an institution changes with a more careful account for the unit of analysis used in the assessment. Moreover, evaluations at the group level provide more accurate assessments since they allow for appropriate comparisons within subfields of science. The proposed method could be used to better understand the self-organizing mechanisms of research groups and have better assessment of their performance.

Suggested Citation

  • Leonardo Reyes-Gonzalez & Claudia N. Gonzalez-Brambila & Francisco Veloso, 2016. "Using co-authorship and citation analysis to identify research groups: a new way to assess performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1171-1191, September.
  • Handle: RePEc:spr:scient:v:108:y:2016:i:3:d:10.1007_s11192-016-2029-8
    DOI: 10.1007/s11192-016-2029-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2029-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gonzalez-Brambila, Claudia N. & Veloso, Francisco M. & Krackhardt, David, 2013. "The impact of network embeddedness on research output," Research Policy, Elsevier, vol. 42(9), pages 1555-1567.
    2. Gonzalez-Brambila, Claudia & Veloso, Francisco M., 2007. "The determinants of research output and impact: A study of Mexican researchers," Research Policy, Elsevier, vol. 36(7), pages 1035-1051, September.
    3. Martin, Ben R. & Irvine, John, 1993. "Assessing basic research : Some partial indicators of scientific progress in radio astronomy," Research Policy, Elsevier, vol. 22(2), pages 106-106, April.
    4. Jochen Gläser & Thomas H Spurling & Linda Butler, 2004. "Intraorganisational evaluation: are there ‘least evaluable units'?," Research Evaluation, Oxford University Press, vol. 13(1), pages 19-32, April.
    5. Wagner, Caroline S. & Leydesdorff, Loet, 2005. "Network structure, self-organization, and the growth of international collaboration in science," Research Policy, Elsevier, vol. 34(10), pages 1608-1618, December.
    6. Katz, J. Sylvan & Martin, Ben R., 1997. "What is research collaboration?," Research Policy, Elsevier, vol. 26(1), pages 1-18, March.
    7. Georghiou, Luke & Roessner, David, 2000. "Evaluating technology programs: tools and methods," Research Policy, Elsevier, vol. 29(4-5), pages 657-678, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mora, Luca & Deakin, Mark & Reid, Alasdair, 2019. "Combining co-citation clustering and text-based analysis to reveal the main development paths of smart cities," Technological Forecasting and Social Change, Elsevier, vol. 142(C), pages 56-69.
    2. Saulo Cardoso Maia & Gideon Carvalho Benedicto & José Willer Prado & David Alastair Robb & Oscar Neto Almeida Bispo & Mozar José Brito, 2019. "Mapping the literature on credit unions: a bibliometric investigation grounded in Scopus and Web of Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 929-960, September.
    3. Daniela Maria Cretu & Felicia Morandau, 2020. "Initial Teacher Education for Inclusive Education: A Bibliometric Analysis of Educational Research," Sustainability, MDPI, Open Access Journal, vol. 12(12), pages 1-27, June.
    4. Fernando J. Garrigos-Simon & Yeamduan Narangajavana-Kaosiri & Ismael Lengua-Lengua, 2018. "Tourism and Sustainability: A Bibliometric and Visualization Analysis," Sustainability, MDPI, Open Access Journal, vol. 10(6), pages 1-23, June.
    5. Nguyen, Minh-Hoang & Vuong, Quan-Hoang, 2020. "Evaluation of the Aichi Biodiversity Targets: The international collaboration trilemma in interdisciplinary research," OSF Preprints 84j76, Center for Open Science.
    6. Fernando J. Garrigos-Simon & M. Dolores Botella-Carrubi & Tomas F. Gonzalez-Cruz, 2018. "Social Capital, Human Capital, and Sustainability: A Bibliometric and Visualization Analysis," Sustainability, MDPI, Open Access Journal, vol. 10(12), pages 1-19, December.
    7. Fernando J. Garrigos-Simon & Yeamduan Narangajavana-Kaosiri & Yeamdao Narangajavana, 2019. "Quality in Tourism Literature: A Bibliometric Review," Sustainability, MDPI, Open Access Journal, vol. 11(14), pages 1-22, July.
    8. Huchang Liao & Ming Tang & Li Luo & Chunyang Li & Francisco Chiclana & Xiao-Jun Zeng, 2018. "A Bibliometric Analysis and Visualization of Medical Big Data Research," Sustainability, MDPI, Open Access Journal, vol. 10(1), pages 1-18, January.
    9. Leonardo Reyes Gonzalez & Claudia N González Brambila & Francisco Veloso, 2018. "Birth of prominent scientists," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-23, March.
    10. Zewen Hu & Angela Lin & Peter Willett, 2019. "Identification of research communities in cited and uncited publications using a co-authorship network," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 1-19, January.
    11. Nguyen, Minh-Hoang & Pham, Thanh-Hang & Huyen, Nguyen Thanh Thanh & Ho, Manh-Toan & Vuong, Quan-Hoang, 2020. "Western ideological homogeneity in entrepreneurial finance research: Evidence from highly cited publications," OSF Preprints sk3e6, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maaike Verbree & Edwin Horlings & Peter Groenewegen & Inge Weijden & Peter Besselaar, 2015. "Organizational factors influencing scholarly performance: a multivariate study of biomedical research groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(1), pages 25-49, January.
    2. He, Zi-Lin & Geng, Xue-Song & Campbell-Hunt, Colin, 2009. "Research collaboration and research output: A longitudinal study of 65 biomedical scientists in a New Zealand university," Research Policy, Elsevier, vol. 38(2), pages 306-317, March.
    3. Leonardo Reyes Gonzalez & Claudia N González Brambila & Francisco Veloso, 2018. "Birth of prominent scientists," PLOS ONE, Public Library of Science, vol. 13(3), pages 1-23, March.
    4. Hird, Mackenzie D. & Pfotenhauer, Sebastian M., 2017. "How complex international partnerships shape domestic research clusters: Difference-in-difference network formation and research re-orientation in the MIT Portugal Program," Research Policy, Elsevier, vol. 46(3), pages 557-572.
    5. Carillo, Maria Rosaria & Papagni, Erasmo & Sapio, Alessandro, 2013. "Do collaborations enhance the high-quality output of scientific institutions? Evidence from the Italian Research Assessment Exercise," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 47(C), pages 25-36.
    6. Hoekman & Frenken, 2013. "Proximity and Stratification in European Scientific Research Collaboration Networks: A Policy Perspective," Innovation Studies Utrecht (ISU) working paper series 13-04, Utrecht University, Department of Innovation Studies, revised Nov 2013.
    7. Laurent R. Bergé, 2017. "Network proximity in the geography of research collaboration," Papers in Regional Science, Wiley Blackwell, vol. 96(4), pages 785-815, November.
    8. Lemarchand, Guillermo A., 2012. "The long-term dynamics of co-authorship scientific networks: Iberoamerican countries (1973–2010)," Research Policy, Elsevier, vol. 41(2), pages 291-305.
    9. Seongkyoon Jeong & Jae Young Choi, 2012. "The taxonomy of research collaboration in science and technology: evidence from mechanical research through probabilistic clustering analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 719-735, June.
    10. Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Costa, 2012. "Identifying interdisciplinarity through the disciplinary classification of coauthors of scientific publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2206-2222, November.
    11. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    12. Svein Kyvik & Ingvild Reymert, 2017. "Research collaboration in groups and networks: differences across academic fields," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 951-967, November.
    13. Radhamany Sooryamoorthy, 2014. "Publication productivity and collaboration of researchers in South Africa: new empirical evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(1), pages 531-545, January.
    14. Lu, Xiao & McInerney, Paul-Brian, 2016. "Is it better to “Stand on Two Boats” or “Sit on the Chinese Lap”?: Examining the cultural contingency of network structures in the contemporary Chinese academic labor market," Research Policy, Elsevier, vol. 45(10), pages 2125-2137.
    15. Jo Royle & Louisa Coles & Dorothy Williams & Paul Evans, 2007. "Publishing in international journals," Scientometrics, Springer;Akadémiai Kiadó, vol. 71(1), pages 59-86, April.
    16. Wagner, Caroline S. & Whetsell, Travis A. & Mukherjee, Satyam, 2019. "International research collaboration: Novelty, conventionality, and atypicality in knowledge recombination," Research Policy, Elsevier, vol. 48(5), pages 1260-1270.
    17. Mary Frank Fox & Mary Lynn Realff & Diana Roldan Rueda & Jillian Morn, 2017. "International research collaboration among women engineers: frequency and perceived barriers, by regions," The Journal of Technology Transfer, Springer, vol. 42(6), pages 1292-1306, December.
    18. J. Sylvan Katz & Guillermo Armando Ronda-Pupo, 2019. "Cooperation, scale-invariance and complex innovation systems: a generalization," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(2), pages 1045-1065, November.
    19. Cantner, Uwe & Rake, Bastian, 2014. "International research networks in pharmaceuticals: Structure and dynamics," Research Policy, Elsevier, vol. 43(2), pages 333-348.
    20. Alireza Abbasi & Jorn Altmann, 2010. "On the Correlation between Research Performance and Social Network Analysis Measures Applied to Research Collaboration Networks," TEMEP Discussion Papers 201066, Seoul National University; Technology Management, Economics, and Policy Program (TEMEP), revised Oct 2010.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:108:y:2016:i:3:d:10.1007_s11192-016-2029-8. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Sonal Shukla) or (Springer Nature Abstracting and Indexing). General contact details of provider: http://www.springer.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.