IDEAS home Printed from https://ideas.repec.org/a/eee/soceps/v90y2023ics0038012123002550.html
   My bibliography  Save this article

Aggregating faculty members’ research effectiveness to the department or university level: Exact versus approximate solutions

Author

Listed:
  • Karagiannis, Giannis

Abstract

Using the Benefit-of-the-Doubt (BoD) model, we estimate research effectiveness at the university level based on the research effectiveness scores of its faculty members with three different set of aggregation weights: an exact and two approximates. Our empirical results for the university of Macedonia, Greece indicate that both set of approximate weights tend to overestimate considerably the research effectiveness at the university level as the faculty level research effectiveness scores are highly positively correlated with both set of the approximate aggregation weights.

Suggested Citation

  • Karagiannis, Giannis, 2023. "Aggregating faculty members’ research effectiveness to the department or university level: Exact versus approximate solutions," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    • Handle: RePEc:eee:soceps:v:90:y:2023:i:c:s0038012123002550
    DOI: 10.1016/j.seps.2023.101743
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0038012123002550
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.seps.2023.101743?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Leopold Simar & Paul Wilson, 2000. "A general methodology for bootstrapping in non-parametric frontier models," Journal of Applied Statistics, Taylor & Francis Journals, vol. 27(6), pages 779-802.
    2. Léopold Simar & Paul Wilson, 2000. "Statistical Inference in Nonparametric Frontier Models: The State of the Art," Journal of Productivity Analysis, Springer, vol. 13(1), pages 49-78, January.
    3. Färe, Rolf & Karagiannis, Giannis, 2014. "A postscript on aggregate Farrell efficiencies," European Journal of Operational Research, Elsevier, vol. 233(3), pages 784-786.
    4. Giannis Karagiannis, 2017. "On aggregate composite indicators," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(7), pages 741-746, July.
    5. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
    6. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2014. "How do you define and measure research productivity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1129-1144, November.
    7. Giovanni Abramo & Ciriaco Andrea D’Angelo & Tindaro Cicero, 2012. "What is the appropriate length of the publication period over which to assess research performance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 1005-1017, December.
    8. Fare, Rolf & Zelenyuk, Valentin, 2003. "On aggregate Farrell efficiencies," European Journal of Operational Research, Elsevier, vol. 146(3), pages 615-620, May.
    9. Panagiotis Ravanos & Giannis Karagiannis, 2021. "A VEA Benefit-of-the-Doubt Model for the HDI," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 155(1), pages 27-46, May.
    10. Olley, G Steven & Pakes, Ariel, 1996. "The Dynamics of Productivity in the Telecommunications Equipment Industry," Econometrica, Econometric Society, vol. 64(6), pages 1263-1297, November.
    11. Léopold Simar & Paul W. Wilson, 1998. "Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models," Management Science, INFORMS, vol. 44(1), pages 49-61, January.
    12. Chiang Kao & Hwei-Lan Pao, 2009. "An evaluation of research performance in management of 168 Taiwan universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 78(2), pages 261-277, February.
    13. Chiang Kao & Shiang-Tai Liu & Hwei-Lan Pao, 2012. "Assessing improvement in management research in Taiwan," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(1), pages 75-87, July.
    14. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.
    15. Kristof Witte & Lenka Hudrlikova, 2013. "What about excellence in teaching? A benevolent ranking of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 96(1), pages 337-364, July.
    16. Färe, Rolf & Karagiannis, Giannis, 2017. "The denominator rule for share-weighting aggregation," European Journal of Operational Research, Elsevier, vol. 260(3), pages 1175-1180.
    17. Pilar Murias & José Miguel & David Rodríguez, 2008. "A Composite Indicator for University Quality Assesment: The Case of Spanish Higher Education System," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 89(1), pages 129-146, October.
    18. Giannis Karagiannis, 2021. "DEA Models Without Inputs or Outputs: A Tour de Force," Springer Proceedings in Business and Economics, in: Christopher F. Parmeter & Robin C. Sickles (ed.), Advances in Efficiency and Productivity Analysis, pages 211-232, Springer.
    19. Giannis Karagiannis & Georgia Paschalidou, 2017. "Assessing research effectiveness: a comparison of alternative nonparametric models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 456-468, April.
    20. Caporaletti, L. E. & Dulá, J. H. & Womer, N. K., 1999. "Performance evaluation based on multiple attributes with nonparametric frontiers," Omega, Elsevier, vol. 27(6), pages 637-645, December.
    21. Emmanuel Thanassoulis & Kristof Witte & Jill Johnes & Geraint Johnes & Giannis Karagiannis & Conceição S. Portela, 2016. "Applications of Data Envelopment Analysis in Education," International Series in Operations Research & Management Science, in: Joe Zhu (ed.), Data Envelopment Analysis, chapter 0, pages 367-438, Springer.
    22. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    23. Giannis Karagiannis, 2015. "On structural and average technical efficiency," Journal of Productivity Analysis, Springer, vol. 43(3), pages 259-267, June.
    24. Tom Puyenbroeck, 2018. "On the Output Orientation of the Benefit-of-the-Doubt-Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(2), pages 415-431, September.
    25. Färe, Rolf & Karagiannis, Giannis, 2020. "On the denominator rule and a theorem by Janos Aczél," European Journal of Operational Research, Elsevier, vol. 282(1), pages 398-400.
    26. Peter Bogetoft & Lars Otto, 2011. "Benchmarking with DEA, SFA, and R," International Series in Operations Research and Management Science, Springer, number 978-1-4419-7961-2, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Giannis Karagiannis & Georgia Paschalidou, 2017. "Assessing research effectiveness: a comparison of alternative nonparametric models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 456-468, April.
    2. Färe, Rolf & Karagiannis, Giannis, 2022. "Aggregating Farrell efficiencies without value data: The case of hospitals," Socio-Economic Planning Sciences, Elsevier, vol. 84(C).
    3. Ali Homayoni & Reza Fallahnejad & Farhad Hosseinzadeh Lotfi, 2022. "Cross Malmquist Productivity Index in Data Envelopment Analysis," 4OR, Springer, vol. 20(4), pages 567-602, December.
    4. Karagiannis, Roxani & Karagiannis, Giannis, 2023. "Nonparametric estimates of price efficiency for the Greek infant milk market: Curing the curse of dimensionality with shannon entropy," Economic Modelling, Elsevier, vol. 121(C).
    5. Karagiannis, Roxani & Karagiannis, Giannis, 2018. "Intra- and inter-group composite indicators using the BoD model," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 44-51.
    6. Karagiannis, Giannis, 2023. "Decomposition and aggregation of tone efficiencies," Omega, Elsevier, vol. 119(C).
    7. Camanho, Ana S. & Stumbriene, Dovile & Barbosa, Flávia & Jakaitiene, Audrone, 2023. "The assessment of performance trends and convergence in education and training systems of European countries," European Journal of Operational Research, Elsevier, vol. 305(1), pages 356-372.
    8. Valentin Zelenyuk, 2023. "Productivity analysis: roots, foundations, trends and perspectives," Journal of Productivity Analysis, Springer, vol. 60(3), pages 229-247, December.
    9. Astrid Cullmann & Christian Hirschhausen, 2008. "Efficiency analysis of East European electricity distribution in transition: legacy of the past?," Journal of Productivity Analysis, Springer, vol. 29(2), pages 155-167, April.
    10. Mette Asmild & Jens Hougaard & Dorte Kronborg, 2013. "Do efficiency scores depend on input mix? A statistical test and empirical illustration," Annals of Operations Research, Springer, vol. 211(1), pages 37-48, December.
    11. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    12. Hosseinzadeh, Ahmad & Smyth, Russell & Valadkhani, Abbas & Le, Viet, 2016. "Analyzing the efficiency performance of major Australian mining companies using bootstrap data envelopment analysis," Economic Modelling, Elsevier, vol. 57(C), pages 26-35.
    13. Lena, Daniela & Pasurka, Carl A. & Cucculelli, Marco, 2022. "Environmental regulation and green productivity growth: Evidence from Italian manufacturing industries," Technological Forecasting and Social Change, Elsevier, vol. 184(C).
    14. Rolf Färe & Giannis Karagiannis, 2022. "Aggregation and decomposition of Farrell efficiencies," Operational Research, Springer, vol. 22(5), pages 5675-5683, November.
    15. Franz R. Hahn, 2007. "Determinants of Bank Efficiency in Europe. Assessing Bank Performance Across Markets," WIFO Studies, WIFO, number 31499.
    16. Isabel-María García-Sánchez & Luis Rodríguez-Domínguez & Javier Parra-Domínguez, 2013. "Yearly evolution of police efficiency in Spain and explanatory factors," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 21(1), pages 31-62, January.
    17. Gómez-Calvet, Roberto & Conesa, David & Gómez-Calvet, Ana Rosa & Tortosa-Ausina, Emili, 2014. "Energy efficiency in the European Union: What can be learned from the joint application of directional distance functions and slacks-based measures?," Applied Energy, Elsevier, vol. 132(C), pages 137-154.
    18. Essid, Hédi & Ouellette, Pierre & Vigeant, Stéphane, 2010. "Measuring efficiency of Tunisian schools in the presence of quasi-fixed inputs: A bootstrap data envelopment analysis approach," Economics of Education Review, Elsevier, vol. 29(4), pages 589-596, August.
    19. Barnabé Walheer, 2019. "Disaggregation for efficiency analysis," Journal of Productivity Analysis, Springer, vol. 51(2), pages 137-151, June.
    20. Nadia M. Guerrero & Juan Aparicio & Daniel Valero-Carreras, 2022. "Combining Data Envelopment Analysis and Machine Learning," Mathematics, MDPI, vol. 10(6), pages 1-22, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:soceps:v:90:y:2023:i:c:s0038012123002550. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/seps .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.