IDEAS home Printed from https://ideas.repec.org/p/hal/journl/hal-00987714.html
   My bibliography  Save this paper

How to evaluate the degree of interdisciplinarity of an institution?

Author

Listed:
  • Lorenzo Cassi

    (CES - Centre d'économie de la Sorbonne - UP1 - Université Paris 1 Panthéon-Sorbonne - CNRS - Centre National de la Recherche Scientifique, OST - Observatoire des Sciences et des Techniques - HCERES - Haut Conseil de l'Évaluation de la Recherche et de l'Enseignement Supérieur)

  • Wilfriedo Mescheba

    (OST - Observatoire des Sciences et des Techniques - HCERES - Haut Conseil de l'Évaluation de la Recherche et de l'Enseignement Supérieur)

  • Elisabeth de Turckheim

    (OST - Observatoire des Sciences et des Techniques - HCERES - Haut Conseil de l'Évaluation de la Recherche et de l'Enseignement Supérieur, Délégation à l'évaluation - INRA - Institut National de la Recherche Agronomique)

Abstract

The Stirling index of the set of references of the corpus documents is widely used in the literature on interdisciplinary research and is defined as the integration score of the corpus under study. Such an indicator is relevant at the scale of a research institution, however, there is a gap between the integration scores of individual documents, and a global score computed on the whole set of references. The difference between the global index and the average of individual document indexes carries another relevant information about the corpus: it measures the diversity between the reference profiles of the corpus documents. It is, therefore, named between article index whereas the average of the individual article indexes is called within article index. The statistical properties of these two indexes as well as of the global index are derived from a general approximation method for distributions and lead to statistical tests which can be used to make meaningful comparisons between an institution indexes and benchmark values. The two dimensions of the global index provide a more acute information on the interdisciplinary practices of an institution researchers in a given research domain and is, therefore, likely to contribute to strategic and management issues.

Suggested Citation

  • Lorenzo Cassi & Wilfriedo Mescheba & Elisabeth de Turckheim, 2014. "How to evaluate the degree of interdisciplinarity of an institution?," Post-Print hal-00987714, HAL.
    • Handle: RePEc:hal:journl:hal-00987714
    DOI: 10.1007/s11192-014-1280-0
    Note: View the original document on HAL open archive server: https://paris1.hal.science/hal-00987714
    as

    Download full text from publisher

    File URL: https://paris1.hal.science/hal-00987714/document
    Download Restriction: no
    File URL: https://libkey.io/10.1007/s11192-014-1280-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    2. Alan L. Porter & Alex S. Cohen & J. David Roessner & Marty Perreault, 2007. "Measuring researcher interdisciplinarity," Scientometrics, Springer;Akadémiai Kiadó, vol. 72(1), pages 117-147, July.
    3. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    4. Andy Stirling, 2007. "A General Framework for Analysing Diversity in Science, Technology and Society," SPRU Working Paper Series 156, SPRU - Science Policy Research Unit, University of Sussex Business School.
    5. David Roessner & Alan L. Porter & Nancy J. Nersessian & Stephen Carley, 2013. "Validating indicators of interdisciplinarity: linking bibliometric measures to studies of engineering research labs," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 439-468, February.
    6. Jon Garner & Alan L. Porter & Maura Borrego & Elizabeth Tran & Rita Teutonico, 2013. "Facilitating social and natural science cross-disciplinarity: Assessing the human and social dynamics program," Research Evaluation, Oxford University Press, vol. 22(2), pages 134-144, February.
    7. Ismael Rafols & Martin Meyer, 2010. "Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 263-287, February.
    8. Loet Leydesdorff & Ismael Rafols & Chaomei Chen, 2013. "Interactive overlays of journals and the measurement of interdisciplinarity on the basis of aggregated journal–journal citations," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(12), pages 2573-2586, December.
    9. Loet Leydesdorff & Ismael Rafols, 2009. "A global map of science based on the ISI subject categories," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 60(2), pages 348-362, February.
    10. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    11. Alan L. Porter & Ismael Rafols, 2009. "Is science becoming more interdisciplinary? Measuring and mapping six research fields over time," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 719-745, December.
    12. Wagner, Caroline S. & Roessner, J. David & Bobb, Kamau & Klein, Julie Thompson & Boyack, Kevin W. & Keyton, Joann & Rafols, Ismael & Börner, Katy, 2011. "Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature," Journal of Informetrics, Elsevier, vol. 5(1), pages 14-26.
    13. Alan L Porter & David J Roessner & Anne E Heberger, 2008. "How interdisciplinary is a given body of research?," Research Evaluation, Oxford University Press, vol. 17(4), pages 273-282, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Loet Leydesdorff & Caroline S. Wagner & Lutz Bornmann, 2018. "Betweenness and diversity in journal citation networks as measures of interdisciplinarity—A tribute to Eugene Garfield," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 567-592, February.
    2. Jingwei Zheng & Ke Zhang & Boya Han & Jiayi Hou, 2023. "Research Interdisciplinarity and Citation Impact: A Network Analysis of Social Networking Sites Research," SAGE Open, , vol. 13(3), pages 21582440231, August.
    3. Cottafava, Dario & Ascione, Grazia Sveva & Corazza, Laura & Dhir, Amandeep, 2022. "Sustainable development goals research in higher education institutions: An interdisciplinarity assessment through an entropy-based indicator," Journal of Business Research, Elsevier, vol. 151(C), pages 138-155.
    4. Shengli Deng & Sudi Xia, 2020. "Mapping the interdisciplinarity in information behavior research: a quantitative study using diversity measure and co-occurrence analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 489-513, July.
    5. Erin Leahey & Sondra N. Barringer & Misty Ring-Ramirez, 2019. "Universities’ structural commitment to interdisciplinary research," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 891-919, March.
    6. Xuefeng Wang & Zhinan Wang & Ying Huang & Yun Chen & Yi Zhang & Huichao Ren & Rongrong Li & Jinhui Pang, 2017. "Measuring interdisciplinarity of a research system: detecting distinction between publication categories and citation categories," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 2023-2039, June.
    7. Sondra N. Barringer & Erin Leahey & Karina Salazar, 2020. "What Catalyzes Research Universities to Commit to Interdisciplinary Research?," Research in Higher Education, Springer;Association for Institutional Research, vol. 61(6), pages 679-705, September.
    8. Hoang-Son Pham & Bram Vancraeynest & Hanne Poelmans & Sadia Vancauwenbergh & Amr Ali-Eldin, 2023. "Identifying interdisciplinary research in research projects," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5521-5544, October.
    9. Koppman, Sharon & Leahey, Erin, 2019. "Who moves to the methodological edge? Factors that encourage scientists to use unconventional methods," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    10. Xiaolong Xue & Liang Wang & Rebecca J. Yang, 2018. "Exploring the science of resilience: critical review and bibliometric analysis," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 90(1), pages 477-510, January.
    11. Stephen F. Carley & Seokbeom Kwon & Alan L. Porter & Jan L. Youtie, 2019. "The relationship between forward and backward diversity in CORE datasets," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(3), pages 961-974, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alfonso Ávila-Robinson & Cristian Mejia & Shintaro Sengoku, 2021. "Are bibliometric measures consistent with scientists’ perceptions? The case of interdisciplinarity in research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7477-7502, September.
    2. Alexis-Michel Mugabushaka & Anthi Kyriakou & Theo Papazoglou, 2016. "Bibliometric indicators of interdisciplinarity: the potential of the Leinster–Cobbold diversity indices to study disciplinary diversity," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 593-607, May.
    3. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    4. Chen, Shiji & Qiu, Junping & Arsenault, Clément & Larivière, Vincent, 2021. "Exploring the interdisciplinarity patterns of highly cited papers," Journal of Informetrics, Elsevier, vol. 15(1).
    5. Lin Zhang & Beibei Sun & Zaida Chinchilla-Rodríguez & Lixin Chen & Ying Huang, 2018. "Interdisciplinarity and collaboration: on the relationship between disciplinary diversity in departmental affiliations and reference lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 271-291, October.
    6. Shunshun Shi & Wenyu Zhang & Shuai Zhang & Jie Chen, 2018. "Does prestige dimension influence the interdisciplinary performance of scientific entities in knowledge flow? Evidence from the e-government field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1237-1264, November.
    7. Shiji Chen & Yanhui Song & Fei Shu & Vincent Larivière, 2022. "Interdisciplinarity and impact: the effects of the citation time window," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2621-2642, May.
    8. Lina Xu & Steven Dellaportas & Jin Wang, 2022. "A study of interdisciplinary accounting research: analysing the diversity of cited references," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(2), pages 2131-2162, June.
    9. Sándor Soós & Zsófia Vida & András Schubert, 2018. "Long-term trends in the multidisciplinarity of some typical natural and social sciences, and its implications on the SSH versus STM distinction," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(3), pages 795-822, March.
    10. Ricardo Arencibia-Jorge & Rosa Lidia Vega-Almeida & José Luis Jiménez-Andrade & Humberto Carrillo-Calvet, 2022. "Evolutionary stages and multidisciplinary nature of artificial intelligence research," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5139-5158, September.
    11. Xuefeng Wang & Zhinan Wang & Ying Huang & Yun Chen & Yi Zhang & Huichao Ren & Rongrong Li & Jinhui Pang, 2017. "Measuring interdisciplinarity of a research system: detecting distinction between publication categories and citation categories," Scientometrics, Springer;Akadémiai Kiadó, vol. 111(3), pages 2023-2039, June.
    12. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.
    13. Stephen Carley & Alan L. Porter, 2012. "A forward diversity index," Scientometrics, Springer;Akadémiai Kiadó, vol. 90(2), pages 407-427, February.
    14. Andrea Bonaccorsi & Nicola Melluso & Francesco Alessandro Massucci, 2022. "Exploring the antecedents of interdisciplinarity at the European Research Council: a topic modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6961-6991, December.
    15. Wooseok Jang & Heeyeul Kwon & Yongtae Park & Hakyeon Lee, 2018. "Predicting the degree of interdisciplinarity in academic fields: the case of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 231-254, July.
    16. Loet Leydesdorff & Caroline S. Wagner & Lutz Bornmann, 2018. "Betweenness and diversity in journal citation networks as measures of interdisciplinarity—A tribute to Eugene Garfield," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 567-592, February.
    17. Hongyu Zhou & Raf Guns & Tim C. E. Engels, 2022. "Are social sciences becoming more interdisciplinary? Evidence from publications 1960–2014," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(9), pages 1201-1221, September.
    18. María del Carmen Calatrava Moreno & Thomas Auzinger & Hannes Werthner, 2016. "On the uncertainty of interdisciplinarity measurements due to incomplete bibliographic data," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(1), pages 213-232, April.
    19. David Roessner & Alan L. Porter & Nancy J. Nersessian & Stephen Carley, 2013. "Validating indicators of interdisciplinarity: linking bibliometric measures to studies of engineering research labs," Scientometrics, Springer;Akadémiai Kiadó, vol. 94(2), pages 439-468, February.
    20. Kavitha Karunan & Hiran H. Lathabai & Thara Prabhakaran, 2017. "Discovering interdisciplinary interactions between two research fields using citation networks," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 335-367, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hal:journl:hal-00987714. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CCSD (email available below). General contact details of provider: https://hal.archives-ouvertes.fr/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.