IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v110y2017i1d10.1007_s11192-016-2166-0.html
   My bibliography  Save this article

Multiparametric characterization of scientometric performance profiles assisted by neural networks: a study of Mexican higher education institutions

Author

Listed:
  • Elio Atenógenes Villaseñor

    (Center of Research and Innovation in Information and Communication Technologies INFOTEC)

  • Ricardo Arencibia-Jorge

    (Empresa de Tecnologías de la Información)

  • Humberto Carrillo-Calvet

    (National Autonomous University of Mexico)

Abstract

Development of accurate systems to assess academic research performance is an essential topic in national science agendas around the world. Providing quantitative elements such as scientometric rankings and indicators have contributed to measure prestige and excellence of universities, but more sophisticated computational tools are seldom exploited. We compare the evolution of Mexican scientific production in Scopus and the Web of Science as well as Mexico’s scientific productivity in relation to the growth of the National Researchers System of Mexico is analyzed. As a main analysis tool we introduce an artificial intelligence procedure based on self-organizing neural networks. The neural network technique proves to be a worthy scientometric data mining and visualization tool which automatically carries out multiparametric scientometric characterizations of the production profiles of the 50 most productive Mexican Higher Education Institutions (in Scopus database). With this procedure we automatically identify and visually depict clusters of institutions that share similar bibliometric profiles in bidimensional maps. Four perspectives were represented in scientometric maps: productivity, impact, expected visibility and excellence. Since each cluster of institutions represents a bibliometric pattern of institutional performance, the neural network helps locate various bibliometric profiles of academic production, and the identification of groups of institutions which have similar patterns of performance. Also, scientometric maps allow for the identification of atypical behaviors (outliers) which are difficult to identify with classical tools, since they outstand not because of a disparate value in just one variable, but due to an uncommon combination of a set of indicators values.

Suggested Citation

  • Elio Atenógenes Villaseñor & Ricardo Arencibia-Jorge & Humberto Carrillo-Calvet, 2017. "Multiparametric characterization of scientometric performance profiles assisted by neural networks: a study of Mexican higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(1), pages 77-104, January.
    • Handle: RePEc:spr:scient:v:110:y:2017:i:1:d:10.1007_s11192-016-2166-0
    DOI: 10.1007/s11192-016-2166-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2166-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-2166-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Manuel Krauskopf & Erwin Krauskopf & Bernardita Méndez, 2007. "Low awareness of the link between science and innovation affects public policies in developing countries: The Chilean case," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(1), pages 93-103, July.
    2. Jerome K. Vanclay & Lutz Bornmann, 2012. "Metrics to evaluate research performance in academic institutions: a critique of ERA 2010 as applied in forestry and the indirect H2 index as a possible alternative," Scientometrics, Springer;Akadémiai Kiadó, vol. 91(3), pages 751-771, June.
    3. Egghe, L., 2012. "Averages of ratios compared to ratios of averages: Mathematical results," Journal of Informetrics, Elsevier, vol. 6(2), pages 307-317.
    4. Carlo Caputo & Jaime Requena & Domingo Vargas, 2012. "Life sciences research in Venezuela," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(3), pages 781-805, March.
    5. Sandra Miguel & Félix Moya-Anegón & Víctor Herrero-Solana, 2010. "The impact of the socio-economic crisis of 2001 on the scientific system of Argentina from the scientometric perspective," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 495-507, November.
    6. Omar Belkhodja & Réjean Landry, 2007. "“The Triple-Helix collaboration: Why do researchers collaborate with industry and the government? What are the factors that influence the perceived barriers?”," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(2), pages 301-332, February.
    7. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    8. Chris W. Belter, 2013. "A bibliometric analysis of NOAA’s Office of Ocean Exploration and Research," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(2), pages 629-644, May.
    9. Daniel Torres-Salinas & Jose G. Moreno-Torres & Emilio Delgado-López-Cózar & Francisco Herrera, 2011. "A methodology for Institution-Field ranking based on a bidimensional analysis: the IFQ 2 A index," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 771-786, September.
    10. Sandra Miguel & Zaida Chinchilla-Rodriguez & Félix de Moya-Anegón, 2011. "Open access and Scopus: A new approach to scientific visibility from the standpoint of access," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 62(6), pages 1130-1145, June.
    11. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    12. Ricardo Arencibia-Jorge & Felix Moya-Anegón, 2010. "Challenges in the study of Cuban scientific output," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(3), pages 723-737, June.
    13. repec:dau:papers:123456789/2947 is not listed on IDEAS
    14. Isidro F. Aguillo & Judit Bar-Ilan & Mark Levene & José Luis Ortega, 2010. "Comparing university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(1), pages 243-256, October.
    15. Giovanni Abramo & Tindaro Cicero & Ciriaco Andrea D’Angelo, 2013. "National peer-review research assessment exercises for the hard sciences can be a complete waste of money: the Italian case," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 311-324, April.
    16. O. Mryglod & R. Kenna & Yu. Holovatch & B. Berche, 2013. "Absolute and specific measures of research group excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 95(1), pages 115-127, April.
    17. Antonio J. Gómez-Núñez & Benjamín Vargas-Quesada & Félix Moya-Anegón & Wolfgang Glänzel, 2011. "Improving SCImago Journal & Country Rank (SJR) subject classification through reference analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 741-758, December.
    18. Benito Bonito, Mónica & Romera Ayllón, María Rosario, 2011. "Improving quality assessment of composite indicators in university rankings: a case study of French and German universities of excellence," DES - Working Papers. Statistics and Econometrics. WS ws112015, Universidad Carlos III de Madrid. Departamento de Estadística.
    19. André Frazão Helene & Pedro Leite Ribeiro, 2011. "Brazilian scientific production, financial support, established investigators and doctoral graduates," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(2), pages 677-686, November.
    20. Loet Leydesdorff & Martin Meyer, 2007. "The scientometrics of a Triple Helix of university-industry-government relations (Introduction to the topical issue)," Scientometrics, Springer;Akadémiai Kiadó, vol. 70(2), pages 207-222, February.
    21. F. Collazo-Reyes & M. E. Luna-Morales & J. M. Russell & M. A. Pérez-Angón, 2008. "Publication and citation patterns of Latin American & Caribbean journals in the SCI and SSCI from 1995 to 2004," Scientometrics, Springer;Akadémiai Kiadó, vol. 75(1), pages 145-161, April.
    22. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    23. M. Benito & R. Romera, 2011. "Improving quality assessment of composite indicators in university rankings: a case study of French and German universities of excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 153-176, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. María Elena Luna-Morales & Evelia Luna-Morales & Xochitl Flores-Vargas & Andrea Valencia-Martinez & Francisco Collazo-Reyes & Miguel Ángel Perez-Angon, 2022. "Reflections on the institutionalization process of scientific research in Latin America: the case of Cinvestav," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 661-681, January.
    2. Hamdi A. Al-Jamimi & Galal M. BinMakhashen & Lutz Bornmann, 2022. "Use of bibliometrics for research evaluation in emerging markets economies: a review and discussion of bibliometric indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(10), pages 5879-5930, October.
    3. Bárbara S. Lancho-Barrantes & Francisco J. Cantú-Ortiz, 2019. "Science in Mexico: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(2), pages 499-517, February.
    4. Lorena Parra-Rodríguez & Edward Reyes-Ramírez & José Luis Jiménez-Andrade & Humberto Carrillo-Calvet & Carmen García-Peña, 2022. "Self-Organizing Maps to Multidimensionally Characterize Physical Profiles in Older Adults," IJERPH, MDPI, vol. 19(19), pages 1-25, September.
    5. Barbara S. Lancho-Barrantes & Hector G. Ceballos-Cancino & Francisco J. Cantu-Ortiz, 2021. "Comparing the efficiency of countries to assimilate and apply research investment," Quality & Quantity: International Journal of Methodology, Springer, vol. 55(4), pages 1347-1369, August.
    6. Machado de CAMPOS, Silvia Regina & Henriques, Roberto & Yanaze, Mitsuru Higuchi, 2019. "Knowledge discovery through higher education census data," Technological Forecasting and Social Change, Elsevier, vol. 149(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. El Gibari, Samira & Gómez, Trinidad & Ruiz, Francisco, 2018. "Evaluating university performance using reference point based composite indicators," Journal of Informetrics, Elsevier, vol. 12(4), pages 1235-1250.
    2. J. A. García & Rosa Rodriguez-Sánchez & J. Fdez-Valdivia & Daniel Torres-Salinas & Francisco Herrera, 2012. "Ranking of research output of universities on the basis of the multidimensional prestige of influential fields: Spanish universities as a case of study," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 1081-1099, December.
    3. Milica Jovanovic & Veljko Jeremic & Gordana Savic & Milica Bulajic & Milan Martic, 2012. "How does the normalization of data affect the ARWU ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 319-327, November.
    4. Hiran H. Lathabai & Abhirup Nandy & Vivek Kumar Singh, 2021. "x-index: Identifying core competency and thematic research strengths of institutions using an NLP and network based ranking framework," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9557-9583, December.
    5. Enar Ruiz-Conde & Aurora Calderón-Martínez, 2014. "University institutional repositories: competitive environment and their role as communication media of scientific knowledge," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1283-1299, February.
    6. Veljko Jeremic & Milica Bulajic & Milan Martic & Zoran Radojicic, 2011. "A fresh approach to evaluating the academic ranking of world universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 587-596, June.
    7. Massucci, Francesco Alessandro & Docampo, Domingo, 2019. "Measuring the academic reputation through citation networks via PageRank," Journal of Informetrics, Elsevier, vol. 13(1), pages 185-201.
    8. Ludo Waltman & Clara Calero-Medina & Joost Kosten & Ed C.M. Noyons & Robert J.W. Tijssen & Nees Jan Eck & Thed N. Leeuwen & Anthony F.J. Raan & Martijn S. Visser & Paul Wouters, 2012. "The Leiden ranking 2011/2012: Data collection, indicators, and interpretation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(12), pages 2419-2432, December.
    9. Calabrese, Armando & Capece, Guendalina & Costa, Roberta & Di Pillo, Francesca & Giuffrida, Stefania, 2018. "A ‘power law’ based method to reduce size-related bias in indicators of knowledge performance: An application to university research assessment," Journal of Informetrics, Elsevier, vol. 12(4), pages 1263-1281.
    10. Berlemann, Michael & Haucap, Justus, 2015. "Which factors drive the decision to opt out of individual research rankings? An empirical study of academic resistance to change," Research Policy, Elsevier, vol. 44(5), pages 1108-1115.
    11. M. M. Segovia-González & I. Contreras, 2023. "A Composite Indicator to Compare the Performance of Male and Female Students in Educational Systems," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 165(1), pages 181-212, January.
    12. Daniel Torres-Salinas & Jose G. Moreno-Torres & Emilio Delgado-López-Cózar & Francisco Herrera, 2011. "A methodology for Institution-Field ranking based on a bidimensional analysis: the IFQ 2 A index," Scientometrics, Springer;Akadémiai Kiadó, vol. 88(3), pages 771-786, September.
    13. Antonio Fernández-Cano & Elvira Curiel-Marin & Manuel Torralbo-Rodríguez & Mónica Vallejo-Ruiz, 2018. "Questioning the Shanghai Ranking methodology as a tool for the evaluation of universities: an integrative review," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2069-2083, September.
    14. Sung-Shun Weng & Yang Liu & Yen-Ching Chuang, 2019. "Reform of Chinese Universities in the Context of Sustainable Development: Teacher Evaluation and Improvement Based on Hybrid Multiple Criteria Decision-Making Model," Sustainability, MDPI, vol. 11(19), pages 1-23, October.
    15. Alexandr Gedranovich & Mykhaylo Salnykov, 2012. "Productivity analysis of Belarusian higher education system," BEROC Working Paper Series 16, Belarusian Economic Research and Outreach Center (BEROC).
    16. Teja Koler-Povh & Primož Južnič & Goran Turk, 2014. "Impact of open access on citation of scholarly publications in the field of civil engineering," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1033-1045, February.
    17. Khatab Alqararah, 2023. "Assessing the robustness of composite indicators: the case of the Global Innovation Index," Journal of Innovation and Entrepreneurship, Springer, vol. 12(1), pages 1-22, December.
    18. Franceschini, Fiorenzo & Maisano, Domenico, 2011. "Structured evaluation of the scientific output of academic research groups by recent h-based indicators," Journal of Informetrics, Elsevier, vol. 5(1), pages 64-74.
    19. Zofio, Jose Luis & Aparicio, Juan & Barbero, Javier & Zabala-Iturriagagoitia, Jon Mikel, 2023. "The influence of bottlenecks on innovation systems performance: Put the slowest climber first," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    20. D. Docampo & D. Egret & L. Cram, 2015. "The effect of university mergers on the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(1), pages 175-191, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:110:y:2017:i:1:d:10.1007_s11192-016-2166-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.