IDEAS home Printed from https://ideas.repec.org/a/eee/wdevel/v169y2023ics0305750x23001122.html
   My bibliography  Save this article

What makes a program good? Evidence from short-cycle higher education programs in five developing countries

Author

Listed:
  • Dinarte-Diaz, Lelys
  • Ferreyra, Maria Marta
  • Urzua, Sergio
  • Bassi, Marina

Abstract

Short-cycle higher education programs (SCPs) can play a central role in skill development and higher education expansion, yet their quality varies greatly within and among countries. In this paper, we explore the relationship between programs’ practices and inputs (quality determinants) and student academic and labor market outcomes. We design and conduct a novel survey to collect program-level information on quality determinants and average outcomes for Brazil, Colombia, Dominican Republic, Ecuador, and Peru. Categories of quality determinants include training and curriculum, infrastructure, faculty, link with productive sector, costs and funding, and practices on student admission and institutional governance. We also gather administrative student-level data on higher education and formal employment for SCP students in Brazil and Ecuador and match it to survey data. Using machine learning methods, we select the quality determinants that predict outcomes at the program and student levels. We show that specific quality determinants may favor academic and labor market outcomes. Two practices predict improvements in all labor market outcomes in Brazil and Ecuador—teaching numerical competencies and providing job market information—and one practice—teaching numerical competencies—additionally predicts improvements in labor market outcomes for all survey countries. Since quality determinants account for 20–40 percent of the explained variation in student-level outcomes, quality determinants might have a role shrinking program quality gaps. These findings have implications for the design and replication of high-quality SCPs, their regulation, and the development of information systems.

Suggested Citation

  • Dinarte-Diaz, Lelys & Ferreyra, Maria Marta & Urzua, Sergio & Bassi, Marina, 2023. "What makes a program good? Evidence from short-cycle higher education programs in five developing countries," World Development, Elsevier, vol. 169(C).
  • Handle: RePEc:eee:wdevel:v:169:y:2023:i:c:s0305750x23001122
    DOI: 10.1016/j.worlddev.2023.106294
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305750X23001122
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.worlddev.2023.106294?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nicholas Bloom & Mirko Draca & John Van Reenen, 2016. "Trade Induced Technical Change? The Impact of Chinese Imports on Innovation, IT and Productivity," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(1), pages 87-117.
    2. Nicholas Bloom & Renata Lemos & Raffaella Sadun & John Van Reenen, 2020. "Healthy Business? Managerial Education and Management in Health Care," The Review of Economics and Statistics, MIT Press, vol. 102(3), pages 506-517, July.
    3. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "High-Dimensional Methods and Inference on Structural and Treatment Effects," Journal of Economic Perspectives, American Economic Association, vol. 28(2), pages 29-50, Spring.
    4. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    5. Jorge Rodríguez & Sergio Urzúa & Loreto Reyes, 2016. "Heterogeneous Economic Returns to Post-Secondary Degrees: Evidence from Chile," Journal of Human Resources, University of Wisconsin Press, vol. 51(2), pages 416-460.
    6. Nicholas Bloom & Renata Lemos & Raffaella Sadun & John Van Reenen, 2015. "Does Management Matter in schools?," Economic Journal, Royal Economic Society, vol. 0(584), pages 647-674, May.
    7. Stephanie Riegg Cellini & Hernando Grueso, 2021. "Student Learning in Online College Programs," NBER Working Papers 28552, National Bureau of Economic Research, Inc.
    8. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Kato, Kengo, 2015. "Some new asymptotic theory for least squares series: Pointwise and uniform results," Journal of Econometrics, Elsevier, vol. 186(2), pages 345-366.
    9. Jack Mountjoy, 2022. "Community Colleges and Upward Mobility," American Economic Review, American Economic Association, vol. 112(8), pages 2580-2630, August.
    10. David J. Deming & Michael Lovenheim & Richard Patterson, 2018. "The Competitive Effects of Online Education," NBER Chapters, in: Productivity in Higher Education, pages 259-290, National Bureau of Economic Research, Inc.
    11. Ann Huff Stevens & Michal Kurlaender & Michel Grosz, 2019. "Career Technical Education and Labor Market Outcomes: Evidence from California Community Colleges," Journal of Human Resources, University of Wisconsin Press, vol. 54(4), pages 986-1036.
    12. Lovenheim, Michael F. & Smith, Jonathan, 2022. "Returns to Different Postsecondary Investments: Institution Type, Academic Programs, and Credentials," IZA Discussion Papers 15535, Institute of Labor Economics (IZA).
    13. Scott E. Carrell & Michal Kurlaender, 2016. "Estimating the Productivity of Community Colleges in Paving the Road to Four-Year Success," NBER Working Papers 22904, National Bureau of Economic Research, Inc.
    14. Christopher Jepsen & Kenneth Troske & Paul Coomes, 2014. "The Labor-Market Returns to Community College Degrees, Diplomas, and Certificates," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 95-121.
    15. David Figlio & Mark Rush & Lu Yin, 2013. "Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning," Journal of Labor Economics, University of Chicago Press, vol. 31(4), pages 763-784.
    16. Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010. "The governance and performance of universities: evidence from Europe and the US [Distance to frontier, selection, and economic growth]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 25(61), pages 7-59.
    17. Barrera-Osorio, Felipe & Bayona-Rodríguez, Hernando, 2019. "Signaling or better human capital: Evidence from Colombia," Economics of Education Review, Elsevier, vol. 70(C), pages 20-34.
    18. World Bank, 2019. "World Development Report 2019 [Rapport sur le développement dans le monde 2019]," World Bank Publications - Books, The World Bank Group, number 30435.
    19. Stephanie Riegg Cellini & Nicholas Turner, 2019. "Gainfully Employed?: Assessing the Employment and Earnings of For-Profit College Students Using Administrative Data," Journal of Human Resources, University of Wisconsin Press, vol. 54(2), pages 342-370.
    20. Eric P. Bettinger & Lindsay Fox & Susanna Loeb & Eric S. Taylor, 2017. "Virtual Classrooms: How Online College Courses Affect Student Success," American Economic Review, American Economic Association, vol. 107(9), pages 2855-2875, September.
    21. John McCormack & Carol Propper & Sarah Smith, 2014. "Herding Cats? Management and University Performance," Economic Journal, Royal Economic Society, vol. 124(578), pages 534-564, August.
    22. Jonathan Smith & Kevin Stange, 2016. "A New Measure of College Quality to Study the Effects of College Sector and Peers on Degree Attainment," Education Finance and Policy, MIT Press, vol. 11(4), pages 369-403, Fall.
    23. Gaofeng Yi, 2018. "Impact of internship quality on entrepreneurial intentions among graduating engineering students of research universities in China," International Entrepreneurship and Management Journal, Springer, vol. 14(4), pages 1071-1087, December.
    24. Michel Grosz, 2020. "The Returns to a Large Community College Program: Evidence from Admissions Lotteries," American Economic Journal: Economic Policy, American Economic Association, vol. 12(1), pages 226-253, February.
    25. Melguizo, Tatiana & Sanchez, Fabio & Velasco, Tatiana, 2016. "Credit for Low-Income Students and Access to and Academic Performance in Higher Education in Colombia: A Regression Discontinuity Approach," World Development, Elsevier, vol. 80(C), pages 61-77.
    26. John M. Krieg & Steven E. Henson, 2016. "The Educational Impact of Online Learning: How Do University Students Perform in Subsequent Courses?," Education Finance and Policy, MIT Press, vol. 11(4), pages 426-448, Fall.
    27. Liu, Vivian Y.T. & Belfield, Clive R. & Trimble, Madeline J., 2015. "The medium-term labor market returns to community college awards: Evidence from North Carolina," Economics of Education Review, Elsevier, vol. 44(C), pages 42-55.
    28. Kevin Stange, 2012. "Ability Sorting and the Importance of College Quality to Student Achievement: Evidence from Community Colleges," Education Finance and Policy, MIT Press, vol. 7(1), pages 74-105, January.
    29. P. Wesley Routon & Jay K. Walker, 2019. "College internships, tenure gaps, and student outcomes: a multiple-treatment matching approach," Education Economics, Taylor & Francis Journals, vol. 27(4), pages 383-400, July.
    30. Thomas J. Kane & Angela Boatman & Whitney Kozakowski & Christopher Bennett & Rachel Hitch & Dana Weisenfeld, 2021. "Is College Remediation a Barrier or a Boost? Evidence from the Tennessee SAILS Program," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(3), pages 883-913, June.
    31. Filmer,Deon P. & Nahata,Vatsal & Sabarwal,Shwetlena, 2021. "Preparation, Practice, and Beliefs : A Machine Learning Approach to Understanding Teacher Effectiveness," Policy Research Working Paper Series 9847, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marina Bassi & Lelys Dinarte-Diaz & Maria Marta Ferreyra & Sergio Urzua, 2023. "What Makes a Program Good? Evidence from Short-Cycle Higher Education Programs in Five Developing Countries," CESifo Working Paper Series 10255, CESifo.
    2. Dinarte Diaz,Lelys Ileana & Ferreyra,Maria Marta & Urzua,Sergio & Bassi,Marina, 2021. "What Makes a Program Good ? Evidence from Short-Cycle Higher Education Programs in LatinAmerica and the Caribbean," Policy Research Working Paper Series 9722, The World Bank.
    3. Juan Esteban Carranza & María Marta Ferreyra & Ana Maria Gazmuri, 2023. "The Dynamic Market for Short-Cycle Higher Education Programs," Borradores de Economia 1265, Banco de la Republica de Colombia.
    4. Lelys Dinarte-Diaz & Maria Marta Ferreyra & Tatiana Melguizo & Angelica Sanchez, 2023. "The Contribution of Short-Cycle Programs to Student Outcomes: Evidence from Colombia," CESifo Working Paper Series 10262, CESifo.
    5. Ferreyra,Maria Marta & Franco Hernandez,Andrea & Melguizo,Tatiana & Sanchez Diaz,Angelica Maria, 2020. "Estimating the Contribution of Short-Cycle Programs to Student Outcomes in Colombia," Policy Research Working Paper Series 9424, The World Bank.
    6. Celeste K. Carruthers & Christopher Jepsen, 2020. "Vocational Education: An International Perspective," CESifo Working Paper Series 8718, CESifo.
    7. Christopher Jepsen & Peter Mueser & Kenneth Troske & Kyung-Seong Jeon, 2023. "Estimates of Earnings Returns by Field of Study for For-Profit Schools and Community Colleges," CESifo Working Paper Series 10754, CESifo.
    8. Andrew Foote & Michel Grosz, 2020. "The Effect of Local Labor Market Downturns on Postsecondary Enrollment and Program Choice," Education Finance and Policy, MIT Press, vol. 15(4), pages 593-622, Fall.
    9. Esteban M. Aucejo & Claudia Hupkau & Jenifer Ruiz-Valenzuela, 2020. "Where versus What: College Value-Added and Returns to Field of Study in Further Education," CVER Research Papers 030, Centre for Vocational Education Research.
    10. Michel Grosz & Michal Kurlaender & Ann Stevens, 2022. "Capacity and Flexibility in Community College CTE Programs: Program Offerings and Student Success," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(1), pages 140-188, February.
    11. Kameshwari Shankar & Punit Arora & Maria Christina Binz-Scharf, 2023. "Evidence on Online Higher Education: The Promise of COVID-19 Pandemic Data," Management and Labour Studies, XLRI Jamshedpur, School of Business Management & Human Resources, vol. 48(2), pages 242-249, May.
    12. Mario BENASSI & Matteo LANDONI & Francesco RENTOCCHINI, 2017. "University Management Practices and Academic Spin-offs," Departmental Working Papers 2017-11, Department of Economics, Management and Quantitative Methods at Università degli Studi di Milano.
    13. Baum, Sandy & Holzer, Harry J. & Luetmer, Grace, 2021. "Should the Federal Government Fund Short-Term Postsecondary Certificate Programs?," IZA Discussion Papers 14109, Institute of Labor Economics (IZA).
    14. Luis Armona & Rajashri Chakrabarti & Michael F. Lovenheim, 2018. "How Does For-profit College Attendance Affect Student Loans, Defaults and Labor Market Outcomes?," NBER Working Papers 25042, National Bureau of Economic Research, Inc.
    15. Susan Dynarski & Brian Jacob & Daniel Kreisman, 2018. "How important are fixed effects and time trends in estimating returns to schooling? Evidence from a replication of Jacobson, Lalonde, and Sullivan, 2005," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(7), pages 1098-1108, November.
    16. Dave E. Marcotte, 2019. "The Returns to Education at Community Colleges: New Evidence from the Education Longitudinal Survey," Education Finance and Policy, MIT Press, vol. 14(4), pages 523-547, Fall.
    17. Christopher Jepsen & Peter Mueser & Kenneth Troske & Kyung-Seong Jeon, 2021. "The Benefits of Alternatives to Conventional College: Comparing the Labor-Market Returns to For-Profit Schools and Community Colleges," CESifo Working Paper Series 9272, CESifo.
    18. Armona, Luis & Chakrabarti, Rajashri & Lovenheim, Michael F., 2022. "Student debt and default: The role of for-profit colleges," Journal of Financial Economics, Elsevier, vol. 144(1), pages 67-92.
    19. Daniel Kreisman & Jonathan Smith & Bondi Arifin, 2023. "Labor Market Signaling and the Value of College: Evidence from Resumes and the Truth," Journal of Human Resources, University of Wisconsin Press, vol. 58(6), pages 1820-1849.
    20. Hardt, David & Nagler, Markus & Rincke, Johannes, 2022. "Can peer mentoring improve online teaching effectiveness? An RCT during the COVID-19 pandemic," Labour Economics, Elsevier, vol. 78(C).

    More about this item

    Keywords

    Higher education; Short-cycle degrees; Quality;
    All these keywords.

    JEL classification:

    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:wdevel:v:169:y:2023:i:c:s0305750x23001122. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/worlddev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.