IDEAS home Printed from https://ideas.repec.org/a/eee/infome/v5y2011i3p323-332.html
   My bibliography  Save this article

Multivariate approach to classify research institutes according to their outputs: The case of the CSIC's institutes

Author

Listed:
  • Ortega, José Luis
  • López-Romero, Elena
  • Fernández, Inés

Abstract

This paper attempts to build a classification model according to the research products created by those institutes and hence to design specific evaluation processes. Several scientific input/output indicators belonging to 109 research institutes from the Spanish National Research Council (CSIC) were selected. A multidimensional approach was proposed to resume these indicators in various components. A clustering analysis was used to classify the institutes according to their scores with those components (principal component analysis). Moreover, the validity of the a priori classification was tested and the most discriminant variables were detected (linear discriminant analysis). Results show that there are three types of institutes according to their research outputs: Humanistic, Scientific and Technological. It is argue that these differences oblige to design more precise assessment exercises which focus on the particular results of each type of institute. We conclude that this method permits to build more precise research assessment exercises which consider the varied nature of the scientific activity.

Suggested Citation

  • Ortega, José Luis & López-Romero, Elena & Fernández, Inés, 2011. "Multivariate approach to classify research institutes according to their outputs: The case of the CSIC's institutes," Journal of Informetrics, Elsevier, vol. 5(3), pages 323-332.
    • Handle: RePEc:eee:infome:v:5:y:2011:i:3:p:323-332
    DOI: 10.1016/j.joi.2011.01.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1751157711000058
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.joi.2011.01.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johan Bollen & Herbert Van de Sompel & Aric Hagberg & Ryan Chute, 2009. "A Principal Component Analysis of 39 Scientific Impact Measures," PLOS ONE, Public Library of Science, vol. 4(6), pages 1-11, June.
    2. Ramani, Shyama V., 2002. "Who is interested in biotech? R&D strategies, knowledge base and market sales of Indian biopharmaceutical firms," Research Policy, Elsevier, vol. 31(3), pages 381-398, March.
    3. Ying Cheng & Nian Cai Liu, 2006. "A first approach to the classification of the top 500 world universities by their disciplinary characteristics using scientometrics," Scientometrics, Springer;Akadémiai Kiadó, vol. 68(1), pages 135-150, July.
    4. Mario Coccia, 2005. "A scientometric model for the assessment of scientific research performance within public institutes," Scientometrics, Springer;Akadémiai Kiadó, vol. 65(3), pages 307-321, December.
    5. Katz, J. Sylvan, 1999. "The self-similar science system1," Research Policy, Elsevier, vol. 28(5), pages 501-517, June.
    6. Henry Kaiser, 1958. "The varimax criterion for analytic rotation in factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 23(3), pages 187-200, September.
    7. Anthony F. J. van Raan, 2005. "Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 133-143, January.
    8. Wolfgang Glänzel & András Schubert, 2003. "A new classification scheme of science fields and subfields designed for scientometric evaluation purposes," Scientometrics, Springer;Akadémiai Kiadó, vol. 56(3), pages 357-367, March.
    9. Feng Zhou & Huai-Cheng Guo & Yuh-Shan Ho & Chao-Zhong Wu, 2007. "Scientometric analysis of geostatistics using multivariate methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(3), pages 265-279, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cova, Tânia F.G.G. & Jarmelo, Susana & Formosinho, Sebastião J. & de Melo, J. Sérgio Seixas & Pais, Alberto A.C.C., 2015. "Unsupervised characterization of research institutions with task-force estimation," Journal of Informetrics, Elsevier, vol. 9(1), pages 59-68.
    2. Cena, Anna & Gagolewski, Marek & Mesiar, Radko, 2015. "Problems and challenges of information resources producers’ clustering," Journal of Informetrics, Elsevier, vol. 9(2), pages 273-284.
    3. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & Nicolas Robinson-García & Daniel Torres-Salinas, 2013. "Benchmarking research performance at the university level with information theoretic measures," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 435-452, April.
    4. Matthias Gnewuch & Klaus Wohlrabe, 2018. "Super-efficiency of education institutions: an application to economics departments," Education Economics, Taylor & Francis Journals, vol. 26(6), pages 610-623, November.
    5. Lee, Seonghee & Lee, Hakyeon, 2015. "Measuring and comparing the R&D performance of government research institutes: A bottom-up data envelopment analysis approach," Journal of Informetrics, Elsevier, vol. 9(4), pages 942-953.
    6. Seiler, Christian & Wohlrabe, Klaus, 2013. "Archetypal scientists," Journal of Informetrics, Elsevier, vol. 7(2), pages 345-356.
    7. Judith Czellar & Jacques Lanarès, 2013. "Quality of research: which underlying values?," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(3), pages 1003-1021, June.
    8. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    9. Gabriel-Alexandru Vîiu & Mihai Păunescu & Adrian Miroiu, 2016. "Research-driven classification and ranking in higher education: an empirical appraisal of a Romanian policy experience," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 785-805, May.
    10. Seiler, Christian & Wohlrabe, Klaus, 2012. "Ranking economists on the basis of many indicators: An alternative approach using RePEc data," Journal of Informetrics, Elsevier, vol. 6(3), pages 389-402.
    11. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nicolás Robinson-García & Clara Calero-Medina, 2014. "What do university rankings by fields rank? Exploring discrepancies between the organizational structure of universities and bibliometric classifications," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 1955-1970, March.
    2. José Luis Ortega & Isidro F. Aguillo, 2010. "Describing national science and technology systems through a multivariate approach: country participation in the 6th Framework Programmes," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 321-330, August.
    3. Javier Ruiz-Castillo, 2012. "The evaluation of citation distributions," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(1), pages 291-310, March.
    4. Hajar Sotudeh, 2012. "How sustainable a scientifically developing country could be in its specialties? The case of Iran’s publications in SCI in the 21st century compared to 1980s," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(1), pages 231-243, April.
    5. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    6. Michel Zitt, 2012. "The journal impact factor: angel, devil, or scapegoat? A comment on J.K. Vanclay’s article 2011," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(2), pages 485-503, August.
    7. Manuel Acosta & Daniel Coronado & Esther Ferrándiz & M. Dolores León & Pedro J. Moreno, 2017. "The geography of university scientific production in Europe: an exploration in the field of Food Science and Technology," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 215-240, July.
    8. Pei-Shan Chi & Wolfgang Glänzel, 2017. "An empirical investigation of the associations among usage, scientific collaboration and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 403-412, July.
    9. Pilar Valderrama & Evaristo Jiménez-Contreras & Manuel Escabias & Mariano J. Valderrama, 2022. "Introducing a bibliometric index based on factor analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 509-522, January.
    10. Zhao, Star X. & Rousseau, Ronald & Ye, Fred Y., 2011. "h-Degree as a basic measure in weighted networks," Journal of Informetrics, Elsevier, vol. 5(4), pages 668-677.
    11. Rabishankar Giri & Sabuj Kumar Chaudhuri, 2021. "Ranking journals through the lens of active visibility," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2189-2208, March.
    12. Bonhomme, Stphane & Robin, Jean-Marc, 2009. "Consistent noisy independent component analysis," Journal of Econometrics, Elsevier, vol. 149(1), pages 12-25, April.
    13. Domingo Docampo & Lawrence Cram, 2019. "Highly cited researchers: a moving target," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 1011-1025, March.
    14. Fernando Castelló-Sirvent & Pablo Pinazo-Dallenbach, 2021. "Corruption Shock in Mexico: fsQCA Analysis of Entrepreneurial Intention in University Students," Mathematics, MDPI, vol. 9(14), pages 1-31, July.
    15. Lin Zhang & Ronald Rousseau & Wolfgang Glänzel, 2016. "Diversity of references as an indicator of the interdisciplinarity of journals: Taking similarity between subject fields into account," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(5), pages 1257-1265, May.
    16. Matkovskyy, Roman, 2013. "To the Problem of Financial Safety Estimation: the Index of Financial Safety of Turkey," MPRA Paper 47673, University Library of Munich, Germany.
    17. Kaur, Jasleen & Radicchi, Filippo & Menczer, Filippo, 2013. "Universality of scholarly impact metrics," Journal of Informetrics, Elsevier, vol. 7(4), pages 924-932.
    18. Jha, Raghbendra & Murthy, K. V. Bhanu, 2003. "An inverse global environmental Kuznets curve," Journal of Comparative Economics, Elsevier, vol. 31(2), pages 352-368, June.
    19. Rodríguez-Fuentes, Carlos Javier & Hernández-López, Montserrat, 1997. "Análisis de diferencias estructurales interregionales determinantes en el impacto de la política monetaria," Estudios de Economia Aplicada, Estudios de Economia Aplicada, vol. 7, pages 141-157, Junio.
    20. Ivaldi, Enrico, 2013. "Proposal of a country risk index based on a factorial analysis - Una proposta di indice di rischio paese basato sull’analisi fattoriale: una applicazione ai paesi del sud del Mediterraneo e ai paesi d," Economia Internazionale / International Economics, Camera di Commercio Industria Artigianato Agricoltura di Genova, vol. 66(2), pages 231-249.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:infome:v:5:y:2011:i:3:p:323-332. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/joi .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.