IDEAS home Printed from https://ideas.repec.org/p/hig/wpaper/201-ec-2018.html
   My bibliography  Save this paper

The Russian Excellence Initiative For Higher Education: An Econometric Evaluation Of Short-Term Results

Author

Listed:
  • Tommaso Agasisti

    (Politecnico di Milano School of Managementcs)

  • Ekaterina Shibanova

    (National Research University Higher School of Economics)

  • Daria Platonova

    (National Research University Higher School of Economics)

  • Mikhail Lisyutkin

    (National Research University Higher School of Economics)

Abstract

This research studies the short-term effects of the Russian Excellence Initiative Project 5to100 on participating universities. To trace the effect, we develop a quasi-experimental econometric methodology. A control group of universities comparable to the Project 5to100 universities at the starting point of the program’s implementation was singled out using propensity score matching. Data envelopment analysis was conducted, and the Malmquist productivity index was calculated to trace how and why the efficiency of the “participants” and “non-participants” of the Project 5to100 has changed due to the project. We also investigate the direct impact of the policy on the research productivity of universities, using the average treatment effect, and difference-in-difference approaches. The final step consists of an explanatory analysis of the factors apart from the policy potentially affecting efficiency scores. We find statistically significant positive effects of the policy both on the productivity and on the efficiency of the participating universities.

Suggested Citation

  • Tommaso Agasisti & Ekaterina Shibanova & Daria Platonova & Mikhail Lisyutkin, 2018. "The Russian Excellence Initiative For Higher Education: An Econometric Evaluation Of Short-Term Results," HSE Working papers WP BRP 201/EC/2018, National Research University Higher School of Economics.
  • Handle: RePEc:hig:wpaper:201/ec/2018
    as

    Download full text from publisher

    File URL: https://wp.hse.ru/data/2018/10/25/1142226358/201EC2018.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Johnes, Jill & Yu, Li, 2008. "Measuring the research performance of Chinese higher education institutions using data envelopment analysis," China Economic Review, Elsevier, vol. 19(4), pages 679-696, December.
    2. Marco Slikker & Henk Norde & Stef Tijs, 2003. "Information Sharing Games," International Game Theory Review (IGTR), World Scientific Publishing Co. Pte. Ltd., vol. 5(01), pages 1-12.
    3. Копыток Витовт Константинович & Ратникова Татьяна Анатольевна, 2017. "Влияние Политики Инфляционного Таргетирования На Динамику Прямых Иностранных Инвестиций," Higher School of Economics Economic Journal Экономический журнал Высшей школы экономики, CyberLeninka;Федеральное государственное автономное образовательное учреждение высшего образования «Национальный исследовательский университет «Высшая школа экономики», vol. 21(1), pages 32-65.
    4. A. T. Flegg & D. O. Allen, 2007. "Does Expansion Cause Congestion? The Case of the Older British Universities, 1994-2004," Education Economics, Taylor & Francis Journals, vol. 15(1), pages 75-102.
    5. Avkiran, Necmi K., 2001. "Investigating technical and scale efficiencies of Australian Universities through data envelopment analysis," Socio-Economic Planning Sciences, Elsevier, vol. 35(1), pages 57-80, March.
    6. Philip G. Altbach & Jamil Salmi, 2011. "The Road to Academic Excellence : The Making of World-Class Research Universities [El camino hacia la excelencia académica : la constitución de universidades de investigación de rango mundial]," World Bank Publications - Books, The World Bank Group, number 2357, December.
    7. Martin Schlotter & Guido Schwerdt & Ludger Woessmann, 2011. "Econometric methods for causal evaluation of education policies and practices: a non-technical guide," Education Economics, Taylor & Francis Journals, vol. 19(2), pages 109-137.
    8. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    9. Jamil Salmi, 2009. "The Challenge of Establishing World-Class Universities," World Bank Publications - Books, The World Bank Group, number 2600, December.
    10. Abbott, M. & Doucouliagos, C., 2003. "The efficiency of Australian universities: a data envelopment analysis," Economics of Education Review, Elsevier, vol. 22(1), pages 89-97, February.
    11. Alexander D. Gromov, 2017. "The Efficiency of Russian Higher Education Institutions and its Determinants," HSE Working papers WP BRP 40/EDU/2017, National Research University Higher School of Economics.
    12. Andrew Worthington, 2001. "An Empirical Survey of Frontier Efficiency Measurement Techniques in Education," Education Economics, Taylor & Francis Journals, vol. 9(3), pages 245-268.
    13. Abankina, Irina & Aleskerov, Fuad & Belousova, Veronika & Gokhberg, Leonid & Kiselgof, Sofya & Petrushchenko, Vsevolod & Shvydun, Sergey & Zinkovsky, Kirill, 2016. "From equality to diversity: Classifying Russian universities in a performance oriented system," Technological Forecasting and Social Change, Elsevier, vol. 103(C), pages 228-239.
    14. Breu, Theodore M. & Raab, Raymond L., 1994. "Efficiency and perceived quality of the nation's "top 25" National Universities and National Liberal Arts Colleges: An application of data envelopment analysis to higher education," Socio-Economic Planning Sciences, Elsevier, vol. 28(1), pages 33-45.
    15. Yaisawarng, Suthathip & Ng, Ying Chu, 2014. "The impact of higher education reform on research performance of Chinese universities," China Economic Review, Elsevier, vol. 31(C), pages 94-105.
    16. Gawellek, Bastian & Sunder, Marco, 2016. "The German excellence initiative and efficiency change among universities, 2001-2011," Working Papers 142, University of Leipzig, Faculty of Economics and Management Science.
    17. Oleg Leshukov & Daria Platonova & Dmitry Semyonov, 2016. "The Efficiency of Regional Higher Education Systems and Competition in Russia," Economy of region, Centre for Economic Security, Institute of Economics of Ural Branch of Russian Academy of Sciences, vol. 1(2), pages 417-426.
    18. Torger Möller & Marion Schmidt & Stefan Hornbostel, 2016. "Assessing the effects of the German Excellence Initiative with bibliometric methods," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 2217-2239, December.
    19. NG, Ying Chu & LI, Sung-ko, 2009. "Efficiency and productivity growth in Chinese universities during the post-reform period," China Economic Review, Elsevier, vol. 20(2), pages 183-192, June.
    20. Oleg Poldin & Nataliya Matveeva & Ivan Sterligov & Mariya Yudkevich, 2017. "Publication Activities of Russian Universities: The Effects of Project 5-100," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 2, pages 5-100.
    21. Roger Carrington & Tim Coelli & D. S. Prasada Rao, 2005. "The Performance Of Australian Universities: Conceptual Issues And Preliminary Results," Economic Papers, The Economic Society of Australia, vol. 24(2), pages 145-163, June.
    22. Tamara Turko & Gennady Bakhturin & Vitaly Bagan & Stanislav Poloskov & Dmitry Gudym, 2016. "Influence of the program “5–top 100” on the publication activity of Russian universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 769-782, November.
    23. Zhang, Han & Patton, Donald & Kenney, Martin, 2013. "Building global-class universities: Assessing the impact of the 985 Project," Research Policy, Elsevier, vol. 42(3), pages 765-775.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Nataliya Matveeva & Anuška Ferligoj, 2020. "Scientific collaboration in Russian universities before and after the excellence initiative Project 5-100," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2383-2407, September.
    2. Matveeva, Nataliya & Sterligov, Ivan & Yudkevich, Maria, 2021. "The effect of Russian University Excellence Initiative on publications and collaboration patterns," Journal of Informetrics, Elsevier, vol. 15(1).
    3. Tommaso Agasisti & Aleksei Egorov & Margarita Maximova, 2020. "Do Merger Policies Increase University Efficiency? Evidence From A Fuzzy Regression Discontinuity Design," HSE Working papers WP BRP 226/EC/2020, National Research University Higher School of Economics.
    4. John V.C. Nye & Cheryl Litman & Maksym Bryukhanov & Sergiy Polyachenko, 2020. "The Universal Link between Higher Education and Pro-Market Values," HSE Working papers WP BRP 225/EC/2020, National Research University Higher School of Economics.
    5. Nataliya Matveeva & Ivan Sterligov & Maria Yudkevich, 2019. "The Russian University Excellence Initiative: Is It Really Excellence That Is Promoted?," HSE Working papers WP BRP 49/EDU/2019, National Research University Higher School of Economics.
    6. Katerina Guba & Mikhail Sokolov & Angelika Tsivinskaya, 2020. "Fictitious Efficiency: What the Russian Survey of Performance of Higher Education Institutions Actually Assessed," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 97-125.
    7. Губа К. С. & Соколов М. М. & Цивинская А. О., 2020. "Фиктивная Эффективность: Что На Самом Деле Оценивал Мониторинг Эффективности Образовательных Организаций," Вопросы образования // Educational Studies Moscow, National Research University Higher School of Economics, issue 1, pages 97-125.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yaisawarng, Suthathip & Ng, Ying Chu, 2014. "The impact of higher education reform on research performance of Chinese universities," China Economic Review, Elsevier, vol. 31(C), pages 94-105.
    2. Tommaso Agasisti & Guo-liang Yang & Yao-yao Song & Carolyn-Thi Thanh Dung Tran, 2021. "Evaluating the higher education productivity of Chinese and European “elite” universities using a meta-frontier approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(7), pages 5819-5853, July.
    3. Mehdi Rhaiem, 2017. "Measurement and determinants of academic research efficiency: a systematic review of the evidence," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 581-615, February.
    4. Lee, Boon L. & Worthington, Andrew C., 2016. "A network DEA quantity and quality-orientated production model: An application to Australian university research services," Omega, Elsevier, vol. 60(C), pages 26-33.
    5. Kristof De Witte & Laura López-Torres, 2017. "Efficiency in education: a review of literature and a way forward," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(4), pages 339-363, April.
    6. Tzeremes, Nickolaos & Halkos, George, 2010. "A DEA approach for measuring university departments’ efficiency," MPRA Paper 24029, University Library of Munich, Germany.
    7. Manuel Salas-Velasco, 2020. "Measuring and explaining the production efficiency of Spanish universities using a non-parametric approach and a bootstrapped-truncated regression," Scientometrics, Springer;Akadémiai Kiadó, vol. 122(2), pages 825-846, February.
    8. Nataliya Matveeva & Ivan Sterligov & Maria Yudkevich, 2019. "The Russian University Excellence Initiative: Is It Really Excellence That Is Promoted?," HSE Working papers WP BRP 49/EDU/2019, National Research University Higher School of Economics.
    9. Wang, Derek D., 2019. "Performance-based resource allocation for higher education institutions in China," Socio-Economic Planning Sciences, Elsevier, vol. 65(C), pages 66-75.
    10. Joanna Wolszczak-Derlacz & Aleksandra Parteka, 2011. "Efficiency of European public higher education institutions: a two-stage multicountry approach," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(3), pages 887-917, December.
    11. Ruiz, José L. & Segura, José V. & Sirvent, Inmaculada, 2015. "Benchmarking and target setting with expert preferences: An application to the evaluation of educational performance of Spanish universities," European Journal of Operational Research, Elsevier, vol. 242(2), pages 594-605.
    12. Y. c{C}inar, 2016. "Research and Teaching Efficiencies of Turkish Universities with Heterogeneity Considerations: Application of Multi-Activity DEA and DEA by Sequential Exclusion of Alternatives Methods," Papers 1701.07318, arXiv.org.
    13. Agasisti, Tommaso & Barra, Cristian & Zotti, Roberto, 2016. "Evaluating the efficiency of Italian public universities (2008–2011) in presence of (unobserved) heterogeneity," Socio-Economic Planning Sciences, Elsevier, vol. 55(C), pages 47-58.
    14. Calogero Guccio & Marco Ferdinando Martorana & Isidoro Mazza, 2016. "Efficiency assessment and convergence in teaching and research in Italian public universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(3), pages 1063-1094, June.
    15. Yang, Guo-liang & Fukuyama, Hirofumi & Song, Yao-yao, 2018. "Measuring the inefficiency of Chinese research universities based on a two-stage network DEA model," Journal of Informetrics, Elsevier, vol. 12(1), pages 10-30.
    16. Angel García Correas & Manuel Larran Jorge, 2010. "Análisis de diferentes medidas de la eficiencia investigadora y factores explicativos en las universidades públicas españolas," Investigaciones de Economía de la Educación volume 5, in: María Jesús Mancebón-Torrubia & Domingo P. Ximénez-de-Embún & José María Gómez-Sancho & Gregorio Gim (ed.), Investigaciones de Economía de la Educación 5, edition 1, volume 5, chapter 36, pages 703-732, Asociación de Economía de la Educación.
    17. Yang, Guoliang & Ahlgren, Per & Yang, Liying & Rousseau, Ronald & Ding, Jielan, 2016. "Using multi-level frontiers in DEA models to grade countries/territories," Journal of Informetrics, Elsevier, vol. 10(1), pages 238-253.
    18. Yolanda Fernández-Santos & Almudena Martínez-Campillo & José Miguel Fernández-Fernández, 2015. "Determinantes de la eficiencia en las universidades públicas españolas: un análisis DEA en dos etapas," Investigaciones de Economía de la Educación volume 10, in: Marta Rahona López & Jennifer Graves (ed.), Investigaciones de Economía de la Educación 10, edition 1, volume 10, chapter 25, pages 491-508, Asociación de Economía de la Educación.
    19. Nataliya Matveeva & Anuška Ferligoj, 2020. "Scientific collaboration in Russian universities before and after the excellence initiative Project 5-100," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(3), pages 2383-2407, September.
    20. Sunil Kumar Jauhar & Millie Pant & Richa Dutt, 2018. "Performance measurement of an Indian higher education institute: a sustainable educational supply chain management perspective," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 9(1), pages 180-193, February.

    More about this item

    Keywords

    efficiency in higher education; excellence initiative; management of universities; data envelopment analysis; Tobit regression; Malmquist index;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hig:wpaper:201/ec/2018. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Shamil Abdulaev or Shamil Abdulaev (email available below). General contact details of provider: https://edirc.repec.org/data/hsecoru.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.