IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v47y2018i1p35-48.html
   My bibliography  Save this article

Gaining insight into interdisciplinary research and education programmes: A framework for evaluation

Author

Listed:
  • Carr, Gemma
  • Loucks, Daniel P.
  • Blöschl, Günter

Abstract

Greater understanding of how interdisciplinary research and education evolves is critical for identifying and implementing appropriate programme management strategies. In this paper a programme evaluation framework is presented. It is based on social learning processes (individual learning, interdisciplinary research practices, and interaction between researchers with different backgrounds); social capital outcomes (ability to interact, interpersonal connectivity, and shared understanding); and knowledge and human capital outcomes (new knowledge that integrates multiple research fields). The framework is illustrated on an established case study doctoral programme. Data are collected via mixed qualitative/quantitative methods to reveal several interesting findings about how interdisciplinary research evolves and can be supported. Firstly, different aspects of individual learning seem to contribute to a researcher's ability to interact with researchers from other research fields and work collaboratively. These include learning new material from different research fields, learning how to learn new material and learning how to integrate different material. Secondly, shared interdisciplinary research practices can be identified that may be common to other programmes and support interaction and shared understanding between different researchers. They include clarification and questioning, harnessing differences and setting defensible research boundaries. Thirdly, intensive interaction between researchers from different backgrounds support connectivity between the researchers, further enabling collaborative work. The case study data suggest that social learning processes and social capital outcomes precede new interdisciplinary research findings and are therefore a critical aspect to consider in interdisciplinary programme management.

Suggested Citation

  • Carr, Gemma & Loucks, Daniel P. & Blöschl, Günter, 2018. "Gaining insight into interdisciplinary research and education programmes: A framework for evaluation," Research Policy, Elsevier, vol. 47(1), pages 35-48.
    • Handle: RePEc:eee:respol:v:47:y:2018:i:1:p:35-48
    DOI: 10.1016/j.respol.2017.09.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733317301609
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2017.09.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nicolas Carayol & Thuc Uyen Nguyen Thi, 2005. "Why do academic scientists engage in interdisciplinary research?," Research Evaluation, Oxford University Press, vol. 14(1), pages 70-79, April.
    2. Irwin Feller, 2006. "Multiple actors, multiple settings, multiple criteria: issues in assessing interdisciplinary research," Research Evaluation, Oxford University Press, vol. 15(1), pages 5-15, April.
    3. Jha, Yamini & Welch, Eric W., 2010. "Relational mechanisms governing multifaceted collaborative behavior of academic scientists in six fields of science and engineering," Research Policy, Elsevier, vol. 39(9), pages 1174-1184, November.
    4. Silvia Gherardi & Davide Nicolini, 2002. "Learning In A Constellation of Interconnected Practices: Canon or Dissonance?," Journal of Management Studies, Wiley Blackwell, vol. 39(4), pages 419-436, June.
    5. Julie Thompson Klein, 2006. "Afterword: the emergent literature on interdisciplinary and transdisciplinary research evaluation," Research Evaluation, Oxford University Press, vol. 15(1), pages 75-80, April.
    6. Heinze, Thomas & Kuhlmann, Stefan, 2008. "Across institutional boundaries?: Research collaboration in German public sector nanoscience," Research Policy, Elsevier, vol. 37(5), pages 888-899, June.
    7. Millar, Morgan M., 2013. "Interdisciplinary research and the early career: The effect of interdisciplinary dissertation research on career placement and publication productivity of doctoral graduates in the sciences," Research Policy, Elsevier, vol. 42(5), pages 1152-1164.
    8. M. Muro & P. Jeffrey, 2008. "A critical review of the theory and application of social learning in participatory natural resource management processes," Journal of Environmental Planning and Management, Taylor & Francis Journals, vol. 51(3), pages 325-344.
    9. Amin, Ash & Roberts, Joanne, 2008. "Knowing in action: Beyond communities of practice," Research Policy, Elsevier, vol. 37(2), pages 353-369, March.
    10. Boardman, P. Craig & Corley, Elizabeth A., 2008. "University research centers and the composition of research collaborations," Research Policy, Elsevier, vol. 37(5), pages 900-913, June.
    11. Kabo, Felichism W. & Cotton-Nessler, Natalie & Hwang, Yongha & Levenstein, Margaret C. & Owen-Smith, Jason, 2014. "Proximity effects on the dynamics and outcomes of scientific collaborations," Research Policy, Elsevier, vol. 43(9), pages 1469-1485.
    12. Rhoten, Diana & Pfirman, Stephanie, 2007. "Women in interdisciplinary science: Exploring preferences and consequences," Research Policy, Elsevier, vol. 36(1), pages 56-75, February.
    13. van Rijnsoever, Frank J. & Hessels, Laurens K., 2011. "Factors associated with disciplinary and interdisciplinary research collaboration," Research Policy, Elsevier, vol. 40(3), pages 463-472, April.
    14. Corley, Elizabeth A. & Boardman, P. Craig & Bozeman, Barry, 2006. "Design and the management of multi-institutional research collaborations: Theoretical implications from two case studies," Research Policy, Elsevier, vol. 35(7), pages 975-993, September.
    15. Ponomariov, Branco L. & Boardman, P. Craig, 2010. "Influencing scientists' collaboration and productivity patterns through new institutions: University research centers and scientific and technical human capital," Research Policy, Elsevier, vol. 39(5), pages 613-624, June.
    16. Grit Laudel, 2002. "What do we measure by co-authorships?," Research Evaluation, Oxford University Press, vol. 11(1), pages 3-15, April.
    17. Katz, J. Sylvan & Martin, Ben R., 1997. "What is research collaboration?," Research Policy, Elsevier, vol. 26(1), pages 1-18, March.
    18. Wagner, Caroline S. & Roessner, J. David & Bobb, Kamau & Klein, Julie Thompson & Boyack, Kevin W. & Keyton, Joann & Rafols, Ismael & Börner, Katy, 2011. "Approaches to understanding and measuring interdisciplinary scientific research (IDR): A review of the literature," Journal of Informetrics, Elsevier, vol. 5(1), pages 14-26.
    19. Alan L Porter & J David Roessner & Alex S Cohen & Marty Perreault, 2006. "Interdisciplinary research: meaning, metrics and nurture," Research Evaluation, Oxford University Press, vol. 15(3), pages 187-195, December.
    20. Huutoniemi, Katri & Klein, Julie Thompson & Bruun, Henrik & Hukkinen, Janne, 2010. "Analyzing interdisciplinarity: Typology and indicators," Research Policy, Elsevier, vol. 39(1), pages 79-88, February.
    21. Siedlok, Frank & Hibbert, Paul & Sillince, John, 2015. "From practice to collaborative community in interdisciplinary research contexts," Research Policy, Elsevier, vol. 44(1), pages 96-107.
    22. Heinze, Thomas & Shapira, Philip & Rogers, Juan D. & Senker, Jacqueline M., 2009. "Organizational and institutional influences on creativity in scientific research," Research Policy, Elsevier, vol. 38(4), pages 610-623, May.
    23. Patton, Michael Quinn & Horton, Douglas, 2008. "Utilization-focused evaluation for agricultural innovation," ILAC Briefs 52533, Institutional Learning and Change (ILAC) Initiative.
    24. Cummings, Jonathon N. & Kiesler, Sara, 2007. "Coordination costs and project outcomes in multi-university collaborations," Research Policy, Elsevier, vol. 36(10), pages 1620-1634, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kevin M. Kniffin & Andrew S. Hanks & Xuechao Qian & Bo Wang & Bruce A. Weinberg, 2020. "Dissertators with Distantly Related Foci Face Divergent Near-Term Outcomes," NBER Working Papers 27825, National Bureau of Economic Research, Inc.
    2. Shunshun Shi & Wenyu Zhang & Shuai Zhang & Jie Chen, 2018. "Does prestige dimension influence the interdisciplinary performance of scientific entities in knowledge flow? Evidence from the e-government field," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(2), pages 1237-1264, November.
    3. Lazar Gitelman & Mikhail Kozhevnikov & Olga Ryzhuk, 2019. "Advance Management Education for Power-Engineering and Industry of the Future," Sustainability, MDPI, vol. 11(21), pages 1-23, October.
    4. Kenneth E. Wallen & Karen Filbee-Dexter & Jeremy B. Pittman & Stephen M. Posner & Steven M. Alexander & Chelsie L. Romulo & Drew E. Bennett & Elizabeth C. Clark & Stella J.M. Cousins & Bradford A. Dub, 2019. "Integrating team science into interdisciplinary graduate education: an exploration of the SESYNC Graduate Pursuit," Journal of Environmental Studies and Sciences, Springer;Association of Environmental Studies and Sciences, vol. 9(2), pages 218-233, June.
    5. Möhlmann, Mareike, 2021. "Unjustified trust beliefs: Trust conflation on sharing economy platforms," Research Policy, Elsevier, vol. 50(3).
    6. Dellaportas, Steven & Xu, Lina & Yang, Zhiqiang, 2022. "The level of cross-disciplinarity in cross-disciplinary accounting research: analysis and suggestions for improvement," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 85(C).
    7. Cheryl Mallen & Greg Dingle, 2021. "Organizing Sport for Climate Related Adaptations: Lessons from the Water and Forestry Industries," Sustainability, MDPI, vol. 13(18), pages 1-14, September.
    8. Marina Knickel & Karlheinz Knickel & Francesca Galli & Damian Maye & Johannes S. C. Wiskerke, 2019. "Towards a Reflexive Framework for Fostering Co—Learning and Improvement of Transdisciplinary Collaboration," Sustainability, MDPI, vol. 11(23), pages 1-22, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    2. Casey Helgeson & Robert E. Nicholas & Klaus Keller & Chris E. Forest & Nancy Tuana, 2022. "Attention to values helps shape convergence research," Climatic Change, Springer, vol. 170(1), pages 1-19, January.
    3. Marina Knickel & Karlheinz Knickel & Francesca Galli & Damian Maye & Johannes S. C. Wiskerke, 2019. "Towards a Reflexive Framework for Fostering Co—Learning and Improvement of Transdisciplinary Collaboration," Sustainability, MDPI, vol. 11(23), pages 1-22, November.
    4. Branco Ponomariov & Craig Boardman, 2016. "What is co-authorship?," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1939-1963, December.
    5. Qing Ke, 2023. "Interdisciplinary research and technological impact: evidence from biomedicine," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2035-2077, April.
    6. Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Costa, 2012. "Identifying interdisciplinarity through the disciplinary classification of coauthors of scientific publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(11), pages 2206-2222, November.
    7. van Rijnsoever, Frank J. & Hessels, Laurens K., 2011. "Factors associated with disciplinary and interdisciplinary research collaboration," Research Policy, Elsevier, vol. 40(3), pages 463-472, April.
    8. Gibson, Elizabeth & Daim, Tugrul U. & Dabic, Marina, 2019. "Evaluating university industry collaborative research centers," Technological Forecasting and Social Change, Elsevier, vol. 146(C), pages 181-202.
    9. Dellaportas, Steven & Xu, Lina & Yang, Zhiqiang, 2022. "The level of cross-disciplinarity in cross-disciplinary accounting research: analysis and suggestions for improvement," CRITICAL PERSPECTIVES ON ACCOUNTING, Elsevier, vol. 85(C).
    10. Jung, Jiwon & Bozeman, Barry & Gaughan, Monica, 2017. "Impact of research collaboration cosmopolitanism on job satisfaction," Research Policy, Elsevier, vol. 46(10), pages 1863-1872.
    11. Andrea Bonaccorsi & Nicola Melluso & Francesco Alessandro Massucci, 2022. "Exploring the antecedents of interdisciplinarity at the European Research Council: a topic modeling approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6961-6991, December.
    12. Erin Leahey & Sondra N. Barringer & Misty Ring-Ramirez, 2019. "Universities’ structural commitment to interdisciplinary research," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(3), pages 891-919, March.
    13. Hajdeja Iglič & Patrick Doreian & Luka Kronegger & Anuška Ferligoj, 2017. "With whom do researchers collaborate and why?," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 153-174, July.
    14. Meijun Liu & Sijie Yang & Yi Bu & Ning Zhang, 2023. "Female early-career scientists have conducted less interdisciplinary research in the past six decades: evidence from doctoral theses," Palgrave Communications, Palgrave Macmillan, vol. 10(1), pages 1-16, December.
    15. Solomon, Gregg E.A. & Youtie, Jan & Carley, Stephen & Porter, Alan L., 2019. "What people learn about how people learn: An analysis of citation behavior and the multidisciplinary flow of knowledge," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    16. Elizabeth A. Corley & Barry Bozeman & Xuefan Zhang & Chin-Chang Tsai, 2019. "The expanded scientific and technical human capital model: the addition of a cultural dimension," The Journal of Technology Transfer, Springer, vol. 44(3), pages 681-699, June.
    17. Jiang Wu & Miao Jin & Xiu-Hao Ding, 2015. "Diversity of individual research disciplines in scientific funding," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 669-686, May.
    18. Chin-Chang Tsai & Elizabeth A. Corley & Barry Bozeman, 2016. "Collaboration experiences across scientific disciplines and cohorts," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 505-529, August.
    19. Sabharwal, Meghna & Hu, Qian, 2013. "Participation in university-based research centers: Is it helping or hurting researchers?," Research Policy, Elsevier, vol. 42(6), pages 1301-1311.
    20. Lin Zhang & Beibei Sun & Zaida Chinchilla-Rodríguez & Lixin Chen & Ying Huang, 2018. "Interdisciplinarity and collaboration: on the relationship between disciplinary diversity in departmental affiliations and reference lists," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 271-291, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:47:y:2018:i:1:p:35-48. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.