IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v109y2016i3d10.1007_s11192-016-2121-0.html
   My bibliography  Save this article

Measuring efficiency of university-industry Ph.D. projects using best worst method

Author

Listed:
  • Negin Salimi

    (Delft University of Technology)

  • Jafar Rezaei

    (Delft University of Technology)

Abstract

A collaborative Ph.D. project, carried out by a doctoral candidate, is a type of collaboration between university and industry. Due to the importance of such projects, researchers have considered different ways to evaluate the success, with a focus on the outputs of these projects. However, what has been neglected is the other side of the coin—the inputs. The main aim of this study is to incorporate both the inputs and outputs of these projects into a more meaningful measure called efficiency. A ratio of the weighted sum of outputs over the weighted sum of inputs identifies the efficiency of a Ph.D. project. The weights of the inputs and outputs can be identified using a multi-criteria decision-making (MCDM) method. Data on inputs and outputs are collected from 51 Ph.D. candidates who graduated from Eindhoven University of Technology. The weights are identified using a new MCDM method called Best Worst Method (BWM). Because there may be differences in the opinion of Ph.D. candidates and supervisors on weighing the inputs and outputs, data for BWM are collected from both groups. It is interesting to see that there are differences in the level of efficiency from the two perspectives, because of the weight differences. Moreover, a comparison between the efficiency scores of these projects and their success scores reveals differences that may have significant implications. A sensitivity analysis divulges the most contributing inputs and outputs.

Suggested Citation

  • Negin Salimi & Jafar Rezaei, 2016. "Measuring efficiency of university-industry Ph.D. projects using best worst method," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1911-1938, December.
    • Handle: RePEc:spr:scient:v:109:y:2016:i:3:d:10.1007_s11192-016-2121-0
    DOI: 10.1007/s11192-016-2121-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-016-2121-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11192-016-2121-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    2. Mangematin, V., 2000. "PhD job market: professional trajectories and incentives during the PhD," Research Policy, Elsevier, vol. 29(6), pages 741-756, June.
    3. Thursby, Jerry G. & Kemp, Sukanya, 2002. "Growth and productive efficiency of university intellectual property licensing," Research Policy, Elsevier, vol. 31(1), pages 109-124, January.
    4. Roderik Ponds & Frank Van Oort & Koen Frenken, 2007. "The geographical and institutional proximity of research collaboration," Papers in Regional Science, Wiley Blackwell, vol. 86(3), pages 423-443, August.
    5. D'Este, P. & Patel, P., 2007. "University-industry linkages in the UK: What are the factors underlying the variety of interactions with industry?," Research Policy, Elsevier, vol. 36(9), pages 1295-1313, November.
    6. Olivier Bouba-Olga & Marie Ferru & Dominique Pépin, 2012. "Exploring spatial features of science-industry partnerships: A study on French data," Papers in Regional Science, Wiley Blackwell, vol. 91(2), pages 355-375, June.
    7. Meyer-Krahmer, Frieder & Schmoch, Ulrich, 1998. "Science-based technologies: university-industry interactions in four fields," Research Policy, Elsevier, vol. 27(8), pages 835-851, December.
    8. Noriko Hara & Paul Solomon & Seung‐Lye Kim & Diane H. Sonnenwald, 2003. "An emerging view of scientific collaboration: Scientists' perspectives on collaboration and factors that impact collaboration," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 54(10), pages 952-965, August.
    9. Bekkers, Rudi & Bodas Freitas, Isabel Maria, 2008. "Analysing knowledge transfer channels between universities and industry: To what degree do sectors also matter?," Research Policy, Elsevier, vol. 37(10), pages 1837-1853, December.
    10. Ponomariov, Branco L. & Boardman, P. Craig, 2010. "Influencing scientists' collaboration and productivity patterns through new institutions: University research centers and scientific and technical human capital," Research Policy, Elsevier, vol. 39(5), pages 613-624, June.
    11. Louis-Michel Lebeau & Marie-Claude Laframboise & Vincent Larivière & Yves Gingras, 2008. "The effect of university–industry collaboration on the scientific impact of publications: the Canadian case, 1980–2005," Research Evaluation, Oxford University Press, vol. 17(3), pages 227-232, September.
    12. Butcher, Juliette & Jeffrey, Paul, 2007. "A view from the coal face: UK research student perceptions of successful and unsuccessful collaborative projects," Research Policy, Elsevier, vol. 36(8), pages 1239-1250, October.
    13. Gulbrandsen, Magnus & Smeby, Jens-Christian, 2005. "Industry funding and university professors' research performance," Research Policy, Elsevier, vol. 34(6), pages 932-950, August.
    14. Negin Salimi & Rudi Bekkers & Koen Frenken, 2015. "Governance mode choice in collaborative Ph.D. projects," The Journal of Technology Transfer, Springer, vol. 40(5), pages 840-858, October.
    15. Albors, Jose G, 2002. "Networking and Technology Transfer in the Spanish Ceramic Tiles Cluster: Its Role in the Sector Competitiveness," The Journal of Technology Transfer, Springer, vol. 27(3), pages 263-273, June.
    16. Perkmann, Markus & Tartari, Valentina & McKelvey, Maureen & Autio, Erkko & Broström, Anders & D’Este, Pablo & Fini, Riccardo & Geuna, Aldo & Grimaldi, Rosa & Hughes, Alan & Krabel, Stefan & Kitson, Mi, 2013. "Academic engagement and commercialisation: A review of the literature on university–industry relations," Research Policy, Elsevier, vol. 42(2), pages 423-442.
    17. Jerry G. Thursby & Marie C. Thursby, 2002. "Who Is Selling the Ivory Tower? Sources of Growth in University Licensing," Management Science, INFORMS, vol. 48(1), pages 90-104, January.
    18. Keith Pavitt, 2003. "The Process of Innovation," SPRU Working Paper Series 89, SPRU - Science Policy Research Unit, University of Sussex Business School.
    19. Joaquín M Azagra-Caro & Gérard Carat & Dimitrios Pontikakis, 2010. "Inclining the columns to make the temple look straight: a first glance at monetary indicators on university-industry cooperation," Research Evaluation, Oxford University Press, vol. 19(2), pages 119-128, June.
    20. Rudi Bekkers & Bodas Freitas, 2008. "Analysing preferences for knowledge transfer channels between universities and industry: To what degree do sectors also matter?," Grenoble Ecole de Management (Post-Print) hal-01487467, HAL.
    21. Laura Cruz-Castro & Luis Sanz-Menéndez, 2005. "The employment of PhDs in firms: trajectories, mobility and innovation," Research Evaluation, Oxford University Press, vol. 14(1), pages 57-69, April.
    22. R. D. Banker & A. Charnes & W. W. Cooper, 1984. "Some Models for Estimating Technical and Scale Inefficiencies in Data Envelopment Analysis," Management Science, INFORMS, vol. 30(9), pages 1078-1092, September.
    23. Rezaei, Jafar, 2016. "Best-worst multi-criteria decision-making method: Some properties and a linear model," Omega, Elsevier, vol. 64(C), pages 126-130.
    24. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    25. Min-Wei Lin & Barry Bozeman, 2006. "Researchers’ Industry Experience and Productivity in University–Industry Research Centers: A “Scientific and Technical Human Capital” Explanation," The Journal of Technology Transfer, Springer, vol. 31(2), pages 269-290, March.
    26. Paula E. Stephan & Albert J. Sumell & Grant C. Black & James D. Adams, 2004. "Doctoral Education and Economic Development: The Flow of New Ph.D.s to Industry," Economic Development Quarterly, , vol. 18(2), pages 151-167, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gupta, Himanshu, 2018. "Evaluating service quality of airline industry using hybrid best worst method and VIKOR," Journal of Air Transport Management, Elsevier, vol. 68(C), pages 35-47.
    2. Gholamreza Haseli & Reza Sheikh & Jianqiang Wang & Hana Tomaskova & Erfan Babaee Tirkolaee, 2021. "A Novel Approach for Group Decision Making Based on the Best–Worst Method (G-BWM): Application to Supply Chain Management," Mathematics, MDPI, vol. 9(16), pages 1-20, August.
    3. Hamzeh Soltanali & Mehdi Khojastehpour & Siamak Kheybari, 2023. "Evaluating the critical success factors for maintenance management in agro-industries using multi-criteria decision-making techniques," Operations Management Research, Springer, vol. 16(2), pages 949-968, June.
    4. Geerten Van de Kaa & Daniel Scholten & Jafar Rezaei & Christine Milchram, 2017. "The Battle between Battery and Fuel Cell Powered Electric Vehicles: A BWM Approach," Energies, MDPI, vol. 10(11), pages 1-13, October.
    5. Govindan, Kannan & Shankar, K. Madan & Kannan, Devika, 2020. "Achieving sustainable development goals through identifying and analyzing barriers to industrial sharing economy: A framework development," International Journal of Production Economics, Elsevier, vol. 227(C).
    6. Negin Salimi, 2017. "Quality assessment of scientific outputs using the BWM," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 195-213, July.
    7. Peipei You & Sen Guo & Haoran Zhao & Huiru Zhao, 2017. "Operation Performance Evaluation of Power Grid Enterprise Using a Hybrid BWM-TOPSIS Method," Sustainability, MDPI, vol. 9(12), pages 1-15, December.
    8. João Lopes & João Lussuamo, 2021. "Barriers to University-Industry Cooperation in a Developing Region," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 12(3), pages 1019-1035, September.
    9. Salimi, Negin & Rezaei, Jafar, 2018. "Evaluating firms’ R&D performance using best worst method," Evaluation and Program Planning, Elsevier, vol. 66(C), pages 147-155.
    10. Željko Stević & Irena Đalić & Dragan Pamučar & Zdravko Nunić & Slavko Vesković & Marko Vasiljević & Ilija Tanackov, 2019. "A new hybrid model for quality assessment of scientific conferences based on Rough BWM and SERVQUAL," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(1), pages 1-30, April.
    11. Mi, Xiaomei & Tang, Ming & Liao, Huchang & Shen, Wenjing & Lev, Benjamin, 2019. "The state-of-the-art survey on integrations and applications of the best worst method in decision making: Why, what, what for and what's next?," Omega, Elsevier, vol. 87(C), pages 205-225.
    12. Bojan Ćudić & Peter Alešnik & David Hazemali, 2022. "Factors impacting university–industry collaboration in European countries," Journal of Innovation and Entrepreneurship, Springer, vol. 11(1), pages 1-24, December.
    13. Sarbast Moslem & Tiziana Campisi & Agnieszka Szmelter-Jarosz & Szabolcs Duleba & Kh Md Nahiduzzaman & Giovanni Tesoriere, 2020. "Best–Worst Method for Modelling Mobility Choice after COVID-19: Evidence from Italy," Sustainability, MDPI, vol. 12(17), pages 1-19, August.
    14. Mohammadi, Majid & Rezaei, Jafar, 2020. "Bayesian best-worst method: A probabilistic group decision making model," Omega, Elsevier, vol. 96(C).
    15. Shojaei, Payam & Seyed Haeri, Seyed Amin & Mohammadi, Sahar, 2018. "Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique," Journal of Air Transport Management, Elsevier, vol. 68(C), pages 4-13.
    16. Javid Nafari & Alireza Arab & Sina Ghaffari, 2017. "Through the Looking Glass: Analysis of Factors Influencing Iranian Student’s Study Abroad Motivations and Destination Choice," SAGE Open, , vol. 7(2), pages 21582440177, June.
    17. Driss El Kadiri Boutchich, 2020. "Factors with significant impact on efficiency of research laboratories: case of the public university," Quality & Quantity: International Journal of Methodology, Springer, vol. 54(4), pages 1317-1333, August.
    18. Qigan Shao & Sung-Shun Weng & James J.H. Liou & Huai-Wei Lo & Hongbo Jiang, 2019. "Developing A Sustainable Urban-Environmental Quality Evaluation System in China Based on A Hybrid Model," IJERPH, MDPI, vol. 16(8), pages 1-25, April.
    19. Shih-Chia Chang & Ming-Tsang Lu & Mei-Jen Chen & Li-Hua Huang, 2021. "Evaluating the Application of CSR in the High-Tech Industry during the COVID-19 Pandemic," Mathematics, MDPI, vol. 9(15), pages 1-16, July.
    20. Huseyin Kocak & Atalay Caglar & Gulin Zeynep Oztas, 2018. "Euclidean Best–Worst Method and Its Application," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(05), pages 1587-1605, September.
    21. Rezaei, Jafar & van Roekel, Wilco S. & Tavasszy, Lori, 2018. "Measuring the relative importance of the logistics performance index indicators using Best Worst Method," Transport Policy, Elsevier, vol. 68(C), pages 158-169.
    22. Ekaterina Albats & Irina Fiegenbaum & James A. Cunningham, 2018. "A micro level study of university industry collaborative lifecycle key performance indicators," The Journal of Technology Transfer, Springer, vol. 43(2), pages 389-431, April.
    23. Mališa Žižović & Dragan Pamučar & Goran Ćirović & Miodrag M. Žižović & Boža D. Miljković, 2020. "A Model for Determining Weight Coefficients by Forming a Non-Decreasing Series at Criteria Significance Levels (NDSL)," Mathematics, MDPI, vol. 8(5), pages 1-18, May.
    24. Badri Ahmadi, Hadi & Kusi-Sarpong, Simonov & Rezaei, Jafar, 2017. "Assessing the social sustainability of supply chains using Best Worst Method," Resources, Conservation & Recycling, Elsevier, vol. 126(C), pages 99-106.
    25. Shaopeng Zhang & Xiaohong Wang, 2022. "Effects of Local Government Behavior on University–Enterprise Knowledge Flow: Evidence from China," Sustainability, MDPI, vol. 14(18), pages 1-16, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuandi Wang & Ruifeng Hu & Weiping Li & Xiongfeng Pan, 2016. "Does teaching benefit from university–industry collaboration? Investigating the role of academic commercialization and engagement," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1037-1055, March.
    2. Andrea Bonaccorsi & Luca Secondi & Enza Setteducati & Alessio Ancaiani, 2014. "Participation and commitment in third-party research funding: evidence from Italian Universities," The Journal of Technology Transfer, Springer, vol. 39(2), pages 169-198, April.
    3. Perkmann, Markus & Tartari, Valentina & McKelvey, Maureen & Autio, Erkko & Broström, Anders & D’Este, Pablo & Fini, Riccardo & Geuna, Aldo & Grimaldi, Rosa & Hughes, Alan & Krabel, Stefan & Kitson, Mi, 2013. "Academic engagement and commercialisation: A review of the literature on university–industry relations," Research Policy, Elsevier, vol. 42(2), pages 423-442.
    4. Negin Salimi & Rudi Bekkers & Koen Frenken, 2013. "Governance and success of university-industry collaborations on the basis of Ph.D. projects: an explorative study," Working Papers 13-05, Eindhoven Center for Innovation Studies, revised Apr 2013.
    5. Yuandi Wang & Die Hu & Weiping Li & Yiwei Li & Qiang Li, 2015. "Collaboration strategies and effects on university research: evidence from Chinese universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 725-749, May.
    6. Quentin Plantec & Benjamin Cabanes & Pascal Le Masson & Benoit Weil, 2021. "Market-Pull Or Research Push? Effects Of Research Orientations On University-Industry Collaborative Ph.D. Projects' Performances," Post-Print halshs-03190142, HAL.
    7. Victoria Galan-Muros & Todd Davey, 2019. "The UBC ecosystem: putting together a comprehensive framework for university-business cooperation," The Journal of Technology Transfer, Springer, vol. 44(4), pages 1311-1346, August.
    8. Ankrah, Samuel & AL-Tabbaa, Omar, 2015. "Universities–industry collaboration: A systematic review," Scandinavian Journal of Management, Elsevier, vol. 31(3), pages 387-408.
    9. Nasirov, Shukhrat & Joshi, Amol M., 2023. "Minding the communications gap: How can universities signal the availability and value of their scientific knowledge to commercial organizations?," Research Policy, Elsevier, vol. 52(9).
    10. Iorio, Roberto & Labory, Sandrine & Rentocchini, Francesco, 2017. "The importance of pro-social behaviour for the breadth and depth of knowledge transfer activities: An analysis of Italian academic scientists," Research Policy, Elsevier, vol. 46(2), pages 497-509.
    11. Alice Bertoletti & Geraint Johnes, 2021. "Efficiency in university-industry collaboration: an analysis of UK higher education institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7679-7714, September.
    12. Alessandra Scandura & Simona Iammarino, 2022. "Academic engagement with industry: the role of research quality and experience," The Journal of Technology Transfer, Springer, vol. 47(4), pages 1000-1036, August.
    13. Christian Sandström & Karl Wennberg & Martin W. Wallin & Yulia Zherlygina, 2018. "Public policy for academic entrepreneurship initiatives: a review and critical discussion," The Journal of Technology Transfer, Springer, vol. 43(5), pages 1232-1256, October.
    14. Negin Salimi & Rudi Bekkers, 2014. "Does working with industry come at a price? A study of doctoral candidates’ performance in collaborative vs. non-collaborative PhD projects," Working Papers 14-09, Eindhoven Center for Innovation Studies, revised May 2014.
    15. Adegbile, Abiodun Samuel & Sarpong, David & Kolade, Oluwaseun, 2021. "Environments for Joint University-Industry Laboratories (JUIL): Micro-level dimensions and research implications," Technological Forecasting and Social Change, Elsevier, vol. 170(C).
    16. Roberto Iorio & Sandrine Labory & Francesco Rentocchini, 2014. "Academics’ Motivations and Depth and Breadth of Knowledge Transfer Activities," Working Papers 1401, c.MET-05 - Centro Interuniversitario di Economia Applicata alle Politiche per L'industria, lo Sviluppo locale e l'Internazionalizzazione.
    17. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2021. "The scholarly impact of private sector research: A multivariate analysis," Journal of Informetrics, Elsevier, vol. 15(3).
    18. Crespi, Gustavo & D'Este, Pablo & Fontana, Roberto & Geuna, Aldo, 2011. "The impact of academic patenting on university research and its transfer," Research Policy, Elsevier, vol. 40(1), pages 55-68, February.
    19. Véronique Schaeffer & Sıla Öcalan-Özel & Julien Pénin, 2020. "The complementarities between formal and informal channels of university–industry knowledge transfer: a longitudinal approach," The Journal of Technology Transfer, Springer, vol. 45(1), pages 31-55, February.
    20. Magnus Gulbrandsen & Taran Thune, 2017. "The effects of non-academic work experience on external interaction and research performance," The Journal of Technology Transfer, Springer, vol. 42(4), pages 795-813, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:109:y:2016:i:3:d:10.1007_s11192-016-2121-0. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.