IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v50y2021i1s0048733320301475.html
   My bibliography  Save this article

Do synthesis centers synthesize? A semantic analysis of topical diversity in research

Author

Listed:
  • Hackett, Edward J.
  • Leahey, Erin
  • Parker, John N.
  • Rafols, Ismael
  • Hampton, Stephanie E.
  • Corte, Ugo
  • Chavarro, Diego
  • Drake, John M.
  • Penders, Bart
  • Sheble, Laura
  • Vermeulen, Niki
  • Vision, Todd J.

Abstract

Synthesis centers are a form of scientific organization that catalyzes and supports research that integrates diverse theories, methods and data across spatial or temporal scales to increase the generality, parsimony, applicability, or empirical soundness of scientific explanations. Synthesis working groups are a distinctive form of scientific collaboration that produce consequential, high-impact publications. But no one has asked if synthesis working groups synthesize: are their publications substantially more diverse than others, and if so, in what ways and with what effect? We investigate these questions by using Latent Dirichlet Analysis to compare the topical diversity of papers published by synthesis center collaborations with that of papers in a reference corpus. Topical diversity was operationalized and measured in several ways, both to reflect aggregate diversity and to emphasize particular aspects of diversity (such as variety, evenness, and balance). Synthesis center publications have greater topical variety and evenness, but less disparity, than do papers in the reference corpus. The influence of synthesis center origins on aspects of diversity is only partly mediated by the size and heterogeneity of collaborations: when taking into account the numbers of authors, distinct institutions, and references, synthesis center origins retain a significant direct effect on diversity measures. Controlling for the size and heterogeneity of collaborative groups, synthesis center origins and diversity measures significantly influence the visibility of publications, as indicated by citation measures. We conclude by suggesting social processes within collaborations that might account for the observed effects, by inviting further exploration of what this novel textual analysis approach might reveal about interdisciplinary research, and by offering some practical implications of our results.

Suggested Citation

  • Hackett, Edward J. & Leahey, Erin & Parker, John N. & Rafols, Ismael & Hampton, Stephanie E. & Corte, Ugo & Chavarro, Diego & Drake, John M. & Penders, Bart & Sheble, Laura & Vermeulen, Niki & Vision,, 2021. "Do synthesis centers synthesize? A semantic analysis of topical diversity in research," Research Policy, Elsevier, vol. 50(1).
  • Handle: RePEc:eee:respol:v:50:y:2021:i:1:s0048733320301475
    DOI: 10.1016/j.respol.2020.104069
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733320301475
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2020.104069?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    2. Alexis-Michel Mugabushaka & Anthi Kyriakou & Theo Papazoglou, 2016. "Bibliometric indicators of interdisciplinarity: the potential of the Leinster–Cobbold diversity indices to study disciplinary diversity," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 593-607, May.
    3. Vincent Larivière & Yves Gingras, 2010. "On the relationship between interdisciplinarity and scientific impact," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 61(1), pages 126-131, January.
    4. Andy Stirling, 2007. "A General Framework for Analysing Diversity in Science, Technology and Society," SPRU Working Paper Series 156, SPRU - Science Policy Research Unit, University of Sussex Business School.
    5. Sarah Kaplan & Keyvan Vakili, 2015. "The double-edged sword of recombination in breakthrough innovation," Strategic Management Journal, Wiley Blackwell, vol. 36(10), pages 1435-1457, October.
    6. Boardman, P. Craig & Corley, Elizabeth A., 2008. "University research centers and the composition of research collaborations," Research Policy, Elsevier, vol. 37(5), pages 900-913, June.
    7. Jian Wang & Bart Thijs & Wolfgang Glänzel, 2015. "Interdisciplinarity and Impact: Distinct Effects of Variety, Balance, and Disparity," PLOS ONE, Public Library of Science, vol. 10(5), pages 1-18, May.
    8. Kabo, Felichism W. & Cotton-Nessler, Natalie & Hwang, Yongha & Levenstein, Margaret C. & Owen-Smith, Jason, 2014. "Proximity effects on the dynamics and outcomes of scientific collaborations," Research Policy, Elsevier, vol. 43(9), pages 1469-1485.
    9. Ismael Rafols & Martin Meyer, 2010. "Diversity and network coherence as indicators of interdisciplinarity: case studies in bionanoscience," Scientometrics, Springer;Akadémiai Kiadó, vol. 82(2), pages 263-287, February.
    10. Jodi E. Basner & Katrina I. Theisz & Unni S. Jensen & C. David Jones & Ilya Ponomarev & Pawel Sulima & Karen Jo & Mariam Eljanne & Michael G. Espey & Jonathan Franca-Koh & Sean E. Hanlon & Nastaran Z., 2013. "Measuring the evolution and output of cross-disciplinary collaborations within the NCI Physical Sciences--Oncology Centers Network," Research Evaluation, Oxford University Press, vol. 22(5), pages 285-297, October.
    11. Giovanni Abramo & Ciriaco Andrea D’Angelo & Gianluca Murgia, 2014. "Variation in research collaboration patterns across academic ranks," Scientometrics, Springer;Akadémiai Kiadó, vol. 98(3), pages 2275-2294, March.
    12. Ethan Bernstein & Jesse Shore & David Lazer, 2018. "How intermittent breaks in interaction improve collective intelligence," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(35), pages 8734-8739, August.
    13. Alan L Porter & J David Roessner & Alex S Cohen & Marty Perreault, 2006. "Interdisciplinary research: meaning, metrics and nurture," Research Evaluation, Oxford University Press, vol. 15(3), pages 187-195, December.
    14. Magda Fontana & Martina Iori & Fabio Montobbio & Roberta Sinatra, 2018. "A bridge over troubled water: Interdisciplinarity, Novelty, and Impact," DISCE - Quaderni del Dipartimento di Politica Economica dipe0002, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    15. Alfredo Yegros-Yegros & Ismael Rafols & Pablo D’Este, 2015. "Does Interdisciplinary Research Lead to Higher Citation Impact? The Different Effect of Proximal and Distal Interdisciplinarity," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-21, August.
    16. Susan Biancani & Daniel A. McFarland & Linus Dahlander, 2014. "The Semiformal Organization," Organization Science, INFORMS, vol. 25(5), pages 1306-1324, October.
    17. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. van Loon, Austin, 2022. "Three Families of Automated Text Analysis," SocArXiv htnej, Center for Open Science.
    2. Zhao, Lu-Tao & Xing, Yue-Yue & Zhao, Qiu-Rong & Chen, Xue-Hui, 2023. "Dynamic impacts of online investor sentiment on international crude oil prices," Resources Policy, Elsevier, vol. 82(C).
    3. Fontana, Magda & Iori, Martina & Leone Sciabolazza, Valerio & Souza, Daniel, 2022. "The interdisciplinarity dilemma: Public versus private interests," Research Policy, Elsevier, vol. 51(7).
    4. Maria Bårdsen Hesjedal & Heidrun Åm, 2023. "Making sense of transdisciplinarity: Interpreting science policy in a biotechnology centre," Science and Public Policy, Oxford University Press, vol. 50(2), pages 219-229.
    5. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Shiji & Qiu, Junping & Arsenault, Clément & Larivière, Vincent, 2021. "Exploring the interdisciplinarity patterns of highly cited papers," Journal of Informetrics, Elsevier, vol. 15(1).
    2. Shiji Chen & Yanhui Song & Fei Shu & Vincent Larivière, 2022. "Interdisciplinarity and impact: the effects of the citation time window," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2621-2642, May.
    3. Wolfgang Glänzel & Koenraad Debackere, 2022. "Various aspects of interdisciplinarity in research and how to quantify and measure those," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(9), pages 5551-5569, September.
    4. Alfonso Ávila-Robinson & Cristian Mejia & Shintaro Sengoku, 2021. "Are bibliometric measures consistent with scientists’ perceptions? The case of interdisciplinarity in research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7477-7502, September.
    5. Erin Leahey & Sondra N. Barringer & Misty Ring-Ramirez, 2019. "Universities’ structural commitment to interdisciplinary research," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 891-919, March.
    6. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.
    7. Lina Xu & Steven Dellaportas & Jin Wang, 2022. "A study of interdisciplinary accounting research: analysing the diversity of cited references," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 62(2), pages 2131-2162, June.
    8. Hongyu Zhou & Raf Guns & Tim C. E. Engels, 2022. "Are social sciences becoming more interdisciplinary? Evidence from publications 1960–2014," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(9), pages 1201-1221, September.
    9. Chen, Shiji & Arsenault, Clément & Larivière, Vincent, 2015. "Are top-cited papers more interdisciplinary?," Journal of Informetrics, Elsevier, vol. 9(4), pages 1034-1046.
    10. Kwon, Seokbeom, 2022. "Interdisciplinary knowledge integration as a unique knowledge source for technology development and the role of funding allocation," Technological Forecasting and Social Change, Elsevier, vol. 181(C).
    11. Núria Bautista-Puig & Jorge Mañana-Rodríguez & Antonio Eleazar Serrano-López, 2021. "Role taxonomy of green and sustainable science and technology journals: exportation, importation, specialization and interdisciplinarity," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3871-3892, May.
    12. Fei Shu & Jesse David Dinneen & Shiji Chen, 2022. "Measuring the disparity among scientific disciplines using Library of Congress Subject Headings," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3613-3628, June.
    13. D’Este, Pablo & Robinson-García, Nicolás, 2023. "Interdisciplinary research and the societal visibility of science: The advantages of spanning multiple and distant scientific fields," Research Policy, Elsevier, vol. 52(2).
    14. Lin Zhang & Beibei Sun & Zaida Chinchilla-Rodríguez & Lixin Chen & Ying Huang, 2018. "Interdisciplinarity and collaboration: on the relationship between disciplinary diversity in departmental affiliations and reference lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 271-291, October.
    15. Seolmin Yang & So Young Kim, 2023. "Knowledge-integrated research is more disruptive when supported by homogeneous funding sources: a case of US federally funded research in biomedical and life sciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(6), pages 3257-3282, June.
    16. Magda Fontana & Martina Iori & Fabio Montobbio & Roberta Sinatra, 2018. "A bridge over troubled water: Interdisciplinarity, Novelty, and Impact," DISCE - Quaderni del Dipartimento di Politica Economica dipe0002, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    17. Wooseok Jang & Heeyeul Kwon & Yongtae Park & Hakyeon Lee, 2018. "Predicting the degree of interdisciplinarity in academic fields: the case of nanotechnology," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(1), pages 231-254, July.
    18. Lin Zhang & Ronald Rousseau & Wolfgang Glänzel, 2016. "Diversity of references as an indicator of the interdisciplinarity of journals: Taking similarity between subject fields into account," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(5), pages 1257-1265, May.
    19. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    20. Lina Xu & Steven Dellaportas & Zhiqiang Yang & Jin Wang, 2023. "More on the relationship between interdisciplinary accounting research and citation impact," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 63(4), pages 4779-4803, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:50:y:2021:i:1:s0048733320301475. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.