IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v109y2016i3d10.1007_s11192-016-2073-4.html
   My bibliography  Save this article

On the use of databases about research performance: comments on Karlovčec and Mladenić (2015) and others using the SICRIS database

Author

Listed:
  • Romina Rodela

    (Södertörn University
    Wageningen University)

Abstract

The accuracy of interdisciplinarity measurements depends on how well the data is used for this purpose and whether it can meaningfully inform about work that crosses disciplinary domains. At present, there are no ad hoc databases compiling information only and exclusively about interdisciplinary research, and those interested in assessing it have to reach out to existing databases that have been compiled for other purposes. Karlovčec and Mladenić (Scientometrics 102:433–454, 2015) saw an opportunity in a national database that brings together information meant to be used for assessing the scientific performance of the Slovene academic community, which they used to obtain information that was then applied to measure interdisciplinarity. However, the context and purpose for which databases are produced have certain implications on their use. In their study, the authors overlooked the social and political context within which that specific database was created, is maintained and is used for (evaluation of research performance). This resulted in an incomplete interpretation of the results obtained and description of the current situation. This commentary addresses two aspects that warrant further consideration: one pertains to the limitations of the dataset itself and the measures used to debunk these, while the second pertains to the line of reasoning behind the integration and use of IDR measures in this study.

Suggested Citation

  • Romina Rodela, 2016. "On the use of databases about research performance: comments on Karlovčec and Mladenić (2015) and others using the SICRIS database," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2151-2157, December.
    • Handle: RePEc:spr:scient:v:109:y:2016:i:3:d:10.1007_s11192-016-2073-4
    DOI: 10.1007/s11192-016-2073-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2073-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-2073-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Luka Kronegger & Anuška Ferligoj & Patrick Doreian, 2011. "On the dynamics of national scientific systems," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(5), pages 989-1015, August.
    2. Wagner, Caroline S. & Roessner, J. David & Bobb, Kamau & Klein, Julie Thompson & Boyack, Kevin W. & Keyton, Joann & Rafols, Ismael & Börner, Katy, 2011. "Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature," Journal of Informetrics, Elsevier, vol. 5(1), pages 14-26.
    3. Hrvoje Matakovic & Mirjana Pejic Bach & Iva Radocaj Novak, 2013. "Scientific Productivity in Transition Countries: Trends and Obstacles," Interdisciplinary Description of Complex Systems - scientific journal, Croatian Interdisciplinary Society Provider Homepage: http://indecs.eu, vol. 11(2), pages 174-189.
    4. Primož Južnič & Stojan Pečlin & Matjaž Žaucer & Tilen Mandelj & Miro Pušnik & Franci Demšar, 2010. "Scientometric indicators: peer-review, bibliometric methods and conflict of interests," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(2), pages 429-441, November.
    5. Franc Mali, 2013. "Why an Unbiased External R&D Evaluation System is Important for the Progress of Social Sciences—the Case of a Small Social Science Community," Social Sciences, MDPI, vol. 2(4), pages 1-14, December.
    6. Luka Kronegger & Franc Mali & Anuška Ferligoj & Patrick Doreian, 2012. "Collaboration structures in Slovenian scientific communities," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 631-647, February.
    7. Patrick Doreian & Anuška Ferligoj & Luka Kronegger, 2011. "On the dynamics of national scientific systems: a reply," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(5), pages 1025-1029, August.
    8. Barbara Good & Niki Vermeulen & Brigitte Tiefenthaler & Erik Arnold, 2015. "Counting quality? The Czech performance-based research funding system," Research Evaluation, Oxford University Press, vol. 24(2), pages 91-105.
    9. Anuška Ferligoj & Luka Kronegger & Franc Mali & Tom A. B. Snijders & Patrick Doreian, 2015. "Scientific collaboration dynamics in a national scientific system," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 985-1012, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Šubelj, Lovro & Fiala, Dalibor & Ciglarič, Tadej & Kronegger, Luka, 2019. "Convexity in scientific collaboration networks," Journal of Informetrics, Elsevier, vol. 13(1), pages 10-31.
    2. Tošić, Aleksandar & Vičič, Jernej, 2021. "Use of Benford's law on academic publishing networks," Journal of Informetrics, Elsevier, vol. 15(3).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marjan Cugmas & Franc Mali & Aleš Žiberna, 2020. "Scientific collaboration of researchers and organizations: a two-level blockmodeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2471-2489, December.
    2. Hajdeja Iglič & Patrick Doreian & Luka Kronegger & Anuška Ferligoj, 2017. "With whom do researchers collaborate and why?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 153-174, July.
    3. Zaida Chinchilla-Rodríguez & Anuska Ferligoj & Sandra Miguel & Luka Kronegger & Félix Moya-Anegón, 2012. "Blockmodeling of co-authorship networks in library and information science in Argentina: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 699-717, December.
    4. Anuška Ferligoj & Luka Kronegger & Franc Mali & Tom A. B. Snijders & Patrick Doreian, 2015. "Scientific collaboration dynamics in a national scientific system," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(3), pages 985-1012, September.
    5. Marjan Cugmas & Anuška Ferligoj & Luka Kronegger, 2016. "The stability of co-authorship structures," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 163-186, January.
    6. Tomaz Bartol & Gordana Budimir & Doris Dekleva-Smrekar & Miro Pusnik & Primoz Juznic, 2014. "Assessment of research fields in Scopus and Web of Science in the view of national research evaluation in Slovenia," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(2), pages 1491-1504, February.
    7. Inoue, Masaaki & Pham, Thong & Shimodaira, Hidetoshi, 2020. "Joint estimation of non-parametric transitivity and preferential attachment functions in scientific co-authorship networks," Journal of Informetrics, Elsevier, vol. 14(3).
    8. Chin-Chang Tsai & Elizabeth A. Corley & Barry Bozeman, 2016. "Collaboration experiences across scientific disciplines and cohorts," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 505-529, August.
    9. Lepori, Benedetto & Barberio, Vitaliano & Seeber, Marco & Aguillo, Isidro, 2013. "Core–periphery structures in national higher education systems. A cross-country analysis using interlinking data," Journal of Informetrics, Elsevier, vol. 7(3), pages 622-634.
    10. Irene López-Navarro & Ana I. Moreno & Miguel Ángel Quintanilla & Jesús Rey-Rocha, 2015. "Why do I publish research articles in English instead of my own language? Differences in Spanish researchers’ motivations across scientific domains," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(3), pages 939-976, June.
    11. Katarina Rojko & Brankica Bratić & Borut Lužar, 2020. "The Bologna reform’s impacts on the scientific publication performance of Ph.D. graduates—the case of Slovenia," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 329-356, July.
    12. Rojko, Katarina & Lužar, Borut, 2022. "Scientific performance across research disciplines: Trends and differences in the case of Slovenia," Journal of Informetrics, Elsevier, vol. 16(2).
    13. Maria D’Esposito & Susanna Zaccarin, 2011. "Editorial: Applied and methodological issues in the analysis of network data," Quality & Quantity: International Journal of Methodology, Springer, vol. 45(5), pages 985-987, August.
    14. Letina, Srebrenka, 2016. "Network and actor attribute effects on the performance of researchers in two fields of social science in a small peripheral community," Journal of Informetrics, Elsevier, vol. 10(2), pages 571-595.
    15. Marjan Cugmas & Anuška Ferligoj & Aleš Žiberna, 2018. "Generating global network structures by triad types," PLOS ONE, Public Library of Science, vol. 13(5), pages 1-24, May.
    16. Franc Mali & Toni Pustovrh & Rok Platinovšek & Luka Kronegger & Anuška Ferligoj, 2017. "The effects of funding and co-authorship on research performance in a small scientific community," Science and Public Policy, Oxford University Press, vol. 44(4), pages 486-496.
    17. Aliakbar Akbaritabar & Vincent Antonio Traag & Alberto Caimo & Flaminio Squazzoni, 2020. "Italian sociologists: a community of disconnected groups," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2361-2382, September.
    18. Nataliya Matveeva & Anuška Ferligoj, 2020. "Scientific collaboration in Russian universities before and after the excellence initiative Project 5-100," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2383-2407, September.
    19. José Monteagudo-Fernández & Cosme J. Gómez-Carrasco & Álvaro Chaparro-Sainz, 2021. "Heritage Education and Research in Museums. Conceptual, Intellectual and Social Structure within a Knowledge Domain (2000–2019)," Sustainability, MDPI, vol. 13(12), pages 1-21, June.
    20. Susan Biancani & Daniel McFarland, 2013. "Social Networks Research in Higher Education," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 4, pages 85-126.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:109:y:2016:i:3:d:10.1007_s11192-016-2073-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.