IDEAS home Printed from https://ideas.repec.org/a/eee/chieco/v89y2025ics1043951x24002268.html
   My bibliography  Save this article

Publish or perish: Up-or-out rules and research performance of universities

Author

Listed:
  • Yang, Bingyan
  • Liu, Ruiming
  • Liu, Chuanbin
  • Shi, Yang

Abstract

Many organizations worldwide have adopted up-or-out rules, but little causal evidence is provided on their effectiveness. Using the introduction of the up-or-out rules in China Shenzhen University in 2016, we provide the first causal evidence of the impact of the rules on organizational performance using the synthetic control method. We find that up-or-out rules significantly boosted the quantity and quality of publications at Shenzhen University relative to the counterfactuals. Specifically, the WOS, SCI, SSCI, journal impact factor (JIF) weighted WOS, JIF weighted SCI, and JIF weighted SSCI publications had an annual average increase of 1695, 1409, 215, 9278, 9145, and 812, which implied a 3.5-fold, 4.1-fold, 10.9-fold, 9.3-fold, 9.2-fold, and 19.7-fold increase, respectively, relative to the average output per year before the reform (2006–2015). The result remains robust after a series of tests. The mechanism analysis revealed that the increase was driven by the up-or-out rules' ability to effectively motivate both newcomers and incumbents to enhance their publication efforts. Further analysis indicates that the rise in English publications did not come at the expense of Chinese publications or the quality of teaching.

Suggested Citation

  • Yang, Bingyan & Liu, Ruiming & Liu, Chuanbin & Shi, Yang, 2025. "Publish or perish: Up-or-out rules and research performance of universities," China Economic Review, Elsevier, vol. 89(C).
  • Handle: RePEc:eee:chieco:v:89:y:2025:i:c:s1043951x24002268
    DOI: 10.1016/j.chieco.2024.102337
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1043951X24002268
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chieco.2024.102337?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Park, Hyunwoo & Lee, Jeongsik (Jay) & Kim, Byung-Cheol, 2015. "Project selection in NIH: A natural experiment from ARRA," Research Policy, Elsevier, vol. 44(6), pages 1145-1159.
    2. Ufuk Akcigit & Douglas Hanley & Nicolas Serrano-Velarde, 2021. "Back to Basics: Basic Research Spillovers, Innovation Policy, and Growth," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(1), pages 1-43.
    3. Pierre Azoulay & Joshua S Graff Zivin & Danielle Li & Bhaven N Sampat, 2019. "Public R&D Investments and Private-sector Patenting: Evidence from NIH Funding Rules," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 86(1), pages 117-152.
    4. repec:clg:wpaper:2009-04 is not listed on IDEAS
    5. Marta De Philippis, 2021. "Multi-Task Agents and Incentives: The Case of Teaching and Research for University Professors," The Economic Journal, Royal Economic Society, vol. 131(636), pages 1643-1681.
    6. Dmitry Arkhangelsky & Susan Athey & David A. Hirshberg & Guido W. Imbens & Stefan Wager, 2021. "Synthetic Difference-in-Differences," American Economic Review, American Economic Association, vol. 111(12), pages 4088-4118, December.
    7. Jonathan Brogaard & Joseph Engelberg & Edward Van Wesep, 2018. "Do Economists Swing for the Fences after Tenure?," Journal of Economic Perspectives, American Economic Association, vol. 32(1), pages 179-194, Winter.
    8. Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010. "The governance and performance of universities: evidence from Europe and the US [Distance to frontier, selection, and economic growth]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 25(61), pages 7-59.
    9. Alberto Abadie & Javier Gardeazabal, 2003. "The Economic Costs of Conflict: A Case Study of the Basque Country," American Economic Review, American Economic Association, vol. 93(1), pages 113-132, March.
    10. Suman Ghosh & Michael Waldman, 2010. "Standard promotion practices versus up‐or‐out contracts," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 301-325, June.
    11. Robbiano, Simone, 2022. "The innovative impact of public research institutes: Evidence from Italy," Research Policy, Elsevier, vol. 51(10).
    12. Saul Lach & Mark Schankerman, 2008. "Incentives and invention in universities," RAND Journal of Economics, RAND Corporation, vol. 39(2), pages 403-433, June.
    13. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    14. Jan Zábojník & Dan Bernhardt, 2001. "Corporate Tournaments, Human Capital Acquisition, and the Firm Size—Wage Relation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 68(3), pages 693-716.
    15. James B. Rebitzer & Lowell J. Taylor, 2007. "When Knowledge Is an Asset: Explaining the Organizational Structure of Large Law Firms," Journal of Labor Economics, University of Chicago Press, vol. 25(2), pages 201-229.
    16. W. Bentley MacLeod & Miguel Urquiola, 2021. "Why Does the United States Have the Best Research Universities? Incentives, Resources, and Virtuous Circles," Journal of Economic Perspectives, American Economic Association, vol. 35(1), pages 185-206, Winter.
    17. Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, . "Higher aspirations- an agenda for reforming European universities," Bruegel Blueprints, Bruegel, number 1.
    18. Susan Athey & Guido W. Imbens, 2017. "The State of Applied Econometrics: Causality and Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 3-32, Spring.
    19. Li, Kathleen T. & Bell, David R., 2017. "Estimation of average treatment effects with panel data: Asymptotic theory and implementation," Journal of Econometrics, Elsevier, vol. 197(1), pages 65-75.
    20. Scott Stern, 2004. "Do Scientists Pay to Be Scientists?," Management Science, INFORMS, vol. 50(6), pages 835-853, June.
    21. Carmichael, H Lorne, 1988. "Incentives in Academics: Why Is There Tenure?," Journal of Political Economy, University of Chicago Press, vol. 96(3), pages 453-472, June.
    22. Glazer, Amihai, 2012. "Up-or-out policies when a worker imitates another," Journal of Economic Behavior & Organization, Elsevier, vol. 84(1), pages 432-438.
    23. Lorne Carmichael, 1983. "Firm-Specific Human Capital and Promotion Ladders," Bell Journal of Economics, The RAND Corporation, vol. 14(1), pages 251-258, Spring.
    24. Becker, William E, Jr, 1979. "Professorial Behavior Given a Stochastic Reward Structure," American Economic Review, American Economic Association, vol. 69(5), pages 1010-1017, December.
    25. Karen Kaplan, 2010. "Academia: The changing face of tenure," Nature, Nature, vol. 468(7320), pages 123-125, November.
    26. John McCormack & Carol Propper & Sarah Smith, 2014. "Herding Cats? Management and University Performance," Economic Journal, Royal Economic Society, vol. 124(578), pages 534-564, August.
    27. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
    28. Cheng Hsiao & Qiankun Zhou, 2019. "Panel parametric, semiparametric, and nonparametric construction of counterfactuals," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(4), pages 463-481, June.
    29. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    30. Dong, Xiaofang & Zheng, Siqi & Kahn, Matthew E., 2020. "The role of transportation speed in facilitating high skilled teamwork across cities," Journal of Urban Economics, Elsevier, vol. 115(C).
    31. Daniele Checchi & Gianni De Fraja & Stefano Verzillo, 2021. "Incentives and Careers in Academia: Theory and Empirical Analysis," The Review of Economics and Statistics, MIT Press, vol. 103(4), pages 786-802, October.
    32. O'Flaherty, Brendan & Siow, Aloysius, 1995. "Up-or-Out Rules in the Market for Lawyers," Journal of Labor Economics, University of Chicago Press, vol. 13(4), pages 709-735, October.
    33. Alberto Abadie & Alexis Diamond & Jens Hainmueller, 2015. "Comparative Politics and the Synthetic Control Method," American Journal of Political Science, John Wiley & Sons, vol. 59(2), pages 495-510, February.
    34. repec:bla:ecpoli:v:25:y:2010:i::p:7-59 is not listed on IDEAS
    35. Cheng Hsiao & H. Steve Ching & Shui Ki Wan, 2012. "A Panel Data Approach For Program Evaluation: Measuring The Benefits Of Political And Economic Integration Of Hong Kong With Mainland China," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 27(5), pages 705-740, August.
    36. Bonander, Carl & Jakobsson, Niklas & Podestà, Federico & Svensson, Mikael, 2016. "Universities as engines for regional growth? Using the synthetic control method to analyze the effects of research universities," Regional Science and Urban Economics, Elsevier, vol. 60(C), pages 198-207.
    37. repec:oup:ecpoli:v:25:y:2010:i::p:7-59 is not listed on IDEAS
    38. Canice Prendergast, 1993. "The Role of Promotion in Inducing Specific Human Capital Acquisition," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 108(2), pages 523-534.
    39. Waldman, Michael, 1990. "Up-or-Out Contracts: A Signaling Perspective," Journal of Labor Economics, University of Chicago Press, vol. 8(2), pages 230-250, April.
    40. A. Abigail Payne & Joanne Roberts, 2010. "Government Oversight of Public Universities: Are Centralized Performance Schemes Related to Increased Quantity or Quality?," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 207-212, February.
    41. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    42. Siow, Aloysius, 1998. "Tenure and Other Unusual Personnel Practices in Academia," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 14(1), pages 152-173, April.
    43. Alberto Abadie, 2021. "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects," Journal of Economic Literature, American Economic Association, vol. 59(2), pages 391-425, June.
    44. Bolli, Thomas & Olivares, Maria & Bonaccorsi, Andrea & Daraio, Cinzia & Aracil, Adela Garcia & Lepori, Benedetto, 2016. "The differential effects of competitive funding on the production frontier and the efficiency of universities," Economics of Education Review, Elsevier, vol. 52(C), pages 91-104.
    45. Geloso, Vincent & Pavlik, Jamie Bologna, 2021. "The Cuban revolution and infant mortality: A synthetic control approach," Explorations in Economic History, Elsevier, vol. 80(C).
    46. Zhang, Han & Patton, Donald & Kenney, Martin, 2013. "Building global-class universities: Assessing the impact of the 985 Project," Research Policy, Elsevier, vol. 42(3), pages 765-775.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cruz A. Echevarría & Serhat Hasancebi & Javier García-Enríquez, 2022. "Economic Effects of Macao’s Integration with Mainland China: A Causal Inference Study," Journal of Economic Integration, Center for Economic Integration, Sejong University, vol. 37(2), pages 179-215.
    2. Dennis Shen & Peng Ding & Jasjeet Sekhon & Bin Yu, 2022. "Same Root Different Leaves: Time Series and Cross-Sectional Methods in Panel Data," Papers 2207.14481, arXiv.org, revised Oct 2022.
    3. Michael Funke & Kadri Männasoo & Helery Tasane, 2023. "Regional Economic Impacts of the Øresund Cross-Border Fixed Link: Cui Bono?," CESifo Working Paper Series 10557, CESifo.
    4. Yi‐Ting Chen, 2020. "A distributional synthetic control method for policy evaluation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 505-525, August.
    5. Li, Xingyu & Shen, Yan & Zhou, Qiankun, 2024. "Confidence intervals of treatment effects in panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 240(1).
    6. David Gilchrist & Thomas Emery & Nuno Garoupa & Rok Spruk, 2023. "Synthetic Control Method: A tool for comparative case studies in economic history," Journal of Economic Surveys, Wiley Blackwell, vol. 37(2), pages 409-445, April.
    7. Fry, Joseph, 2024. "A method of moments approach to asymptotically unbiased Synthetic Controls," Journal of Econometrics, Elsevier, vol. 244(1).
    8. Ajab Khan & Ali Sina Önder & Sercan Özcan, 2023. "Does Performance-based Public Funding Pay off? UK’s Research Excellence Framework (REF) and Research Productivity," Working Papers in Economics & Finance 2023-08, University of Portsmouth, Portsmouth Business School, Economics and Finance Subject Group.
    9. Zhentao Shi & Jin Xi & Haitian Xie, 2025. "A Synthetic Business Cycle Approach to Counterfactual Analysis with Nonstationary Macroeconomic Data," Papers 2505.22388, arXiv.org.
    10. Pekka Malo & Juha Eskelinen & Xun Zhou & Timo Kuosmanen, 2024. "Computing Synthetic Controls Using Bilevel Optimization," Computational Economics, Springer;Society for Computational Economics, vol. 64(2), pages 1113-1136, August.
    11. Stefano, Roberta di & Mellace, Giovanni, 2020. "The inclusive synthetic control method," Discussion Papers on Economics 14/2020, University of Southern Denmark, Department of Economics.
    12. Roy Cerqueti & Raffaella Coppier & Alessandro Girardi & Marco Ventura, 2022. "The sooner the better: lives saved by the lockdown during the COVID-19 outbreak. The case of Italy," The Econometrics Journal, Royal Economic Society, vol. 25(1), pages 46-70.
    13. Aleksandar Kešeljević & Rok Spruk, 2024. "Estimating the effects of Syrian civil war," Empirical Economics, Springer, vol. 66(2), pages 671-703, February.
    14. Suman Ghosh & Michael Waldman, 2010. "Standard promotion practices versus up‐or‐out contracts," RAND Journal of Economics, RAND Corporation, vol. 41(2), pages 301-325, June.
    15. Bruno Ferman & Cristine Pinto, 2021. "Synthetic controls with imperfect pretreatment fit," Quantitative Economics, Econometric Society, vol. 12(4), pages 1197-1221, November.
    16. Ko, Dong Gyun, 2025. "Did the American Rescue Plan cause inflation? A synthetic control approach," Economic Modelling, Elsevier, vol. 143(C).
    17. Campos, Nauro F. & Coricelli, Fabrizio & Franceschi, Emanuele, 2022. "Institutional integration and productivity growth: Evidence from the 1995 enlargement of the European Union," European Economic Review, Elsevier, vol. 142(C).
    18. McCloud, Nadine, 2022. "Does domestic investment respond to inflation targeting? A synthetic control investigation," International Economics, Elsevier, vol. 169(C), pages 98-134.
    19. Saleem, Adil & Zahid, R.M. Ammar & Sági, Judit, 2025. "Differential impact of adopting Islamic banking: A quasi-experimental approach," Research in International Business and Finance, Elsevier, vol. 76(C).
    20. Mohammad Reza Farzanegan, 2023. "Years of life lost to revolution and war in Iran," Review of Development Economics, Wiley Blackwell, vol. 27(4), pages 2061-2103, November.

    More about this item

    Keywords

    Up-or-out rules; Research performance; Synthetic control method; University;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • J44 - Labor and Demographic Economics - - Particular Labor Markets - - - Professional Labor Markets and Occupations
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chieco:v:89:y:2025:i:c:s1043951x24002268. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/chieco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.