IDEAS home Printed from https://ideas.repec.org/p/ces/ifowps/_264.html
   My bibliography  Save this paper

How efficiently produce elite US universities highly cited papers? A case study based on input and output data

Author

Listed:
  • Klaus Wohlrabe
  • Felix de Moya Anegon
  • Lutz Bornmann

Abstract

While output and impact assessments were initially at the forefront of institutional research evaluations, efficiency measurements have become popular in recent years. Research efficiency is measured by indicators that relate research output to input. The additional consideration of research input in research evaluation is obvious, since the output should be related to the input. The present study is based on a comprehensive dataset with input- and output-data for 50 US universities. As input, we used the amount of budget, and as output the number of highly-cited papers. We employed Data Efficiency Analysis (DEA), Free Disposal Hull (FDH), and two more robust models: the order-m and order-α approach. The results of the DEA and FDH analysis show that Harvard University and Rice University can be called especially efficient compared to the other universities. While the strength of Harvard University lies in its high output of highly-cited papers, the strength of Rice University is its small input. In the order-α and order-m frameworks, Harvard University remains efficient, but Rice University becomes super-efficient. We produced university rankings based on adjusted efficiency scores (subsequent to regression analyses), in which single covariates (e.g. the disciplinary profile) are held constant.

Suggested Citation

  • Klaus Wohlrabe & Felix de Moya Anegon & Lutz Bornmann, 2018. "How efficiently produce elite US universities highly cited papers? A case study based on input and output data," ifo Working Paper Series 264, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
  • Handle: RePEc:ces:ifowps:_264
    as

    Download full text from publisher

    File URL: https://www.ifo.de/DocDL/wp-2018-264-wohlrabe-etal-us-universities-cited-papers.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Abramo, Giovanni & D’Angelo, Ciriaco Andrea, 2016. "A farewell to the MNCS and like size-independent indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 646-651.
    2. Andrew Worthington, 2001. "An Empirical Survey of Frontier Efficiency Measurement Techniques in Education," Education Economics, Taylor & Francis Journals, vol. 9(3), pages 245-268.
    3. Dominique Deprins & Léopold Simar & Henry Tulkens, 2006. "Measuring Labor-Efficiency in Post Offices," Springer Books, in: Parkash Chander & Jacques Drèze & C. Knox Lovell & Jack Mintz (ed.), Public goods, environmental externalities and fiscal competition, chapter 0, pages 285-309, Springer.
    4. Marvin A. Titus & Adriana Vamosiu & Kevin R. McClure, 2017. "Are Public Master’s Institutions Cost Efficient? A Stochastic Frontier and Spatial Analysis," Research in Higher Education, Springer;Association for Institutional Research, vol. 58(5), pages 469-496, August.
    5. Aragon, Y. & Daouia, A. & Thomas-Agnan, C., 2005. "Nonparametric Frontier Estimation: A Conditional Quantile-Based Approach," Econometric Theory, Cambridge University Press, vol. 21(2), pages 358-389, April.
    6. Bornmann, Lutz & Stefaner, Moritz & de Moya Anegón, Felix & Mutz, Rüdiger, 2014. "What is the effect of country-specific characteristics on the research performance of scientific institutions? Using multi-level statistical models to rank and map universities and research-focused in," Journal of Informetrics, Elsevier, vol. 8(3), pages 581-593.
    7. Maximilian Schwefer, 2018. "Sitting on a Volcano: Domestic Violence in Indonesia Following Two Volcano Eruptions," ifo Working Paper Series 263, ifo Institute - Leibniz Institute for Economic Research at the University of Munich.
    8. Lutz Bornmann & Felix Moya Anegón & Rüdiger Mutz, 2013. "Do universities or research institutions with a specific subject profile have an advantage or a disadvantage in institutional rankings?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(11), pages 2310-2316, November.
    9. Daraio, Cinzia & Bonaccorsi, Andrea & Simar, Léopold, 2015. "Rankings and university performance: A conditional multidimensional approach," European Journal of Operational Research, Elsevier, vol. 244(3), pages 918-930.
    10. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    11. Henk F. Moed & Gali Halevi, 2015. "Multidimensional assessment of scholarly research impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(10), pages 1988-2002, October.
    12. Christopher Bruffaerts & Bram De Rock & Catherine Dehon, 2013. "The Research Efficiency of US Universities: a Nonparametric Frontier Modelling Approach," Working Papers ECARES ECARES 2013-31, ULB -- Universite Libre de Bruxelles.
    13. Ulrich Schmoch, 2015. "The Informative Value of International University Rankings: Some Methodological Remarks," Springer Books, in: Isabell M. Welpe & Jutta Wollersheim & Stefanie Ringelhan & Margit Osterloh (ed.), Incentives and Performance, edition 127, pages 141-154, Springer.
    14. Bonaccorsi, Andrea & Daraio, Cinzia & Räty, Tarmo & Simar, Léopold, 2007. "Efficiency and University Size: Discipline-wise Evidence from European Universities," MPRA Paper 10265, University Library of Munich, Germany.
    15. Andrea Bonaccorsi & Cinzia Daraio & Léopold Simar, 2006. "Advanced indicators of productivity of universitiesAn application of robust nonparametric methods to Italian data," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(2), pages 389-410, February.
    16. K De Witte & N Rogge & L Cherchye & T Van Puyenbroeck, 2013. "Accounting for economies of scope in performance evaluations of university professors," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(11), pages 1595-1606, November.
    17. Giovanni Abramo & Ciriaco Andrea D’Angelo, 2014. "How do you define and measure research productivity?," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1129-1144, November.
    18. Lutz Bornmann & Felix de Moya Anegón & Rüdiger Mutz, 2013. "Do Universities or Research Institutions With a Specific Subject Profile Have an Advantage or a Disadvantage in Institutional Rankings? A Latent Class Analysis With Data From the SCImago Ranking," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(11), pages 2310-2316, November.
    19. G. Thomas Sav, 2012. "Stochastic Cost Inefficiency Estimates and Rankings of Public and Private Research and Doctoral Granting Universities," Journal of Knowledge Management, Economics and Information Technology, ScientificPapers.org, vol. 2(3), pages 1-13, June.
    20. Kaare Aagaard & Jesper W. Schneider, 2016. "Research funding and national academic performance: Examination of a Danish success story," Science and Public Policy, Oxford University Press, vol. 43(4), pages 518-531.
    21. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    22. Peter Bogetoft & Lars Otto, 2011. "Benchmarking with DEA, SFA, and R," International Series in Operations Research and Management Science, Springer, number 978-1-4419-7961-2, December.
    23. Susanne Warning, 2004. "Performance Differences in German Higher Education: Empirical Analysis of Strategic Groups," Review of Industrial Organization, Springer;The Industrial Organization Society, vol. 24(4), pages 393-408, June.
    24. Charnes, A. & Cooper, W. W. & Rhodes, E., 1979. "Measuring the efficiency of decision-making units," European Journal of Operational Research, Elsevier, vol. 3(4), pages 339-338, July.
    25. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    26. Giovanni Abramo & Ciriaco Andrea D’Angelo & Fabio Pugini, 2008. "The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(2), pages 225-244, August.
    27. Cohn, Elchanan & Rhine, Sherrie L W & Santos, Maria C, 1989. "Institutions of Higher Education as Multi-product Firms: Economies of Scale and Scope," The Review of Economics and Statistics, MIT Press, vol. 71(2), pages 284-290, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gnewuch, Matthias & Wohlrabe, Klaus, 2018. "Super-efficiency of education institutions: an application to economics departments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 26, pages 610-623.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Klaus Wohlrabe & Félix de Moya Anegon & Lutz Bornmann, 2019. "How Efficiently Do Elite US Universities Produce Highly Cited Papers?," Publications, MDPI, vol. 7(1), pages 1-15, January.
    2. Gnewuch, Matthias & Wohlrabe, Klaus, 2018. "Super-efficiency of education institutions: an application to economics departments," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 26, pages 610-623.
    3. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    4. Daraio, Cinzia & Simar, Léopold & Wilson, Paul W., 2021. "Quality as a latent heterogeneity factor in the efficiency of universities," Economic Modelling, Elsevier, vol. 99(C).
    5. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    6. Bornmann, Lutz & Gralka, Sabine & Anegón, Félix de Moya & Wohlrabe, Klaus, 2023. "Efficiency of universities and research-focused institutions worldwide: The introduction of a new input indicator reflecting institutional staff numbers," Journal of Informetrics, Elsevier, vol. 17(2).
    7. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    8. Joanna Wolszczak-Derlacz & Aleksandra Parteka, 2011. "Efficiency of European public higher education institutions: a two-stage multicountry approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 887-917, December.
    9. Klaus Wohlrabe & Elisabeth Friedrich, 2017. "The efficiency of economics departments reconsidered," Economics Bulletin, AccessEcon, vol. 37(3), pages 1602-1611.
    10. Calogero Guccio & Marco Ferdinando Martorana & Isidoro Mazza, 2016. "Efficiency assessment and convergence in teaching and research in Italian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1063-1094, June.
    11. Christopher Bruffaerts & Bram De Rock & Catherine Dehon, 2013. "The Research Efficiency of US Universities: a Nonparametric Frontier Modelling Approach," Working Papers ECARES ECARES 2013-31, ULB -- Universite Libre de Bruxelles.
    12. Herberholz, Lars & Wigger, Berthold U., 2021. "Efficiency of European universities: A comparison of peers," Research Policy, Elsevier, vol. 50(9).
    13. Ferreira, D.C. & Marques, R.C., 2019. "Do quality and access to hospital services impact on their technical efficiency?," Omega, Elsevier, vol. 86(C), pages 218-236.
    14. Gralka, Sabine, 2018. "Stochastic frontier analysis in higher education: A systematic review," CEPIE Working Papers 05/18, Technische Universität Dresden, Center of Public and International Economics (CEPIE).
    15. Barra, Cristian & Zotti, Roberto, 2014. "Handling negative data using Data Envelopment Analysis: a directional distance approach applied to higher education," MPRA Paper 55570, University Library of Munich, Germany.
    16. Mª Pilar García-Alcober & Emili Tortosa-Ausina & Diego Prior & Manuel Illueca, 2014. "Cost and revenue efficiency in Spanish banking: What distributions show," Working Papers 2014/12, Economics Department, Universitat Jaume I, Castellón (Spain).
    17. Diogo Cunha Ferreira & Rui Cunha Marques, 2020. "A step forward on order-α robust nonparametric method: inclusion of weight restrictions, convexity and non-variable returns to scale," Operational Research, Springer, vol. 20(2), pages 1011-1046, June.
    18. López-Torres, Laura & Nicolini, Rosella & Prior, Diego, 2017. "Does strategic interaction affect demand for school places? A conditional efficiency approach," Regional Science and Urban Economics, Elsevier, vol. 65(C), pages 89-103.
    19. Agasisti, Tommaso & Egorov, Aleksei & Serebrennikov, Pavel, 2023. "Universities’ efficiency and the socioeconomic characteristics of their environment — Evidence from an empirical analysis," Socio-Economic Planning Sciences, Elsevier, vol. 85(C).
    20. Emili Tortosa Ausina & Diego Prior & María Teresa Balaguer-Coll, 2006. "Decentralization And Effiency In Spanish Local Goverment," Working Papers. Serie EC 2006-02, Instituto Valenciano de Investigaciones Económicas, S.A. (Ivie).

    More about this item

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • D61 - Microeconomics - - Welfare Economics - - - Allocative Efficiency; Cost-Benefit Analysis

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ifowps:_264. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/ifooode.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.