IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_10255.html
   My bibliography  Save this paper

What Makes a Program Good? Evidence from Short-Cycle Higher Education Programs in Five Developing Countries

Author

Listed:
  • Marina Bassi
  • Lelys Dinarte-Diaz
  • Maria Marta Ferreyra
  • Sergio Urzua

Abstract

Short-cycle higher education programs (SCPs) can play a central role in skill development and higher education expansion, yet their quality varies greatly within and among countries. In this paper we explore the relationship between programs’ practices and inputs (quality determinants) and student academic and labor market outcomes. We design and conduct a novel survey to collect program-level information on quality determinants and average outcomes for Brazil, Colombia, Dominican Republic, Ecuador, and Peru. Categories of quality determinants include training and curriculum, infrastructure, faculty, link with productive sector, costs and funding, and practices on student admission and institutional governance. We also collect administrative, student-level data on higher education and formal employment for SCP students in Brazil and Ecuador and match it to survey data. Using machine learning methods, we select the quality determinants that predict outcomes at the program and student levels. Estimates indicate that some quality determinants may favor academic and labor market outcomes while others may hinder them. Two practices predict improvements in all labor market outcomes in Brazil and Ecuador—teaching numerical competencies and providing job market information—and one practice—teaching numerical competencies—additionally predicts improvements in labor market outcomes for all survey countries. Since quality determinants account for 20-40 percent of the explained variation in student-level outcomes, quality determinants might have a role shrinking program quality gaps. Findings have implications for the design and replication of high-quality SCPs, their regulation, and the development of information systems.

Suggested Citation

  • Marina Bassi & Lelys Dinarte-Diaz & Maria Marta Ferreyra & Sergio Urzua, 2023. "What Makes a Program Good? Evidence from Short-Cycle Higher Education Programs in Five Developing Countries," CESifo Working Paper Series 10255, CESifo.
  • Handle: RePEc:ces:ceswps:_10255
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp10255.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nicholas Bloom & Mirko Draca & John Van Reenen, 2016. "Trade Induced Technical Change? The Impact of Chinese Imports on Innovation, IT and Productivity," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 83(1), pages 87-117.
    2. Eric P. Bettinger & Bridget Terry Long, 2009. "Addressing the Needs of Underprepared Students in Higher Education: Does College Remediation Work?," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    3. Sacerdote, Bruce, 2011. "Peer Effects in Education: How Might They Work, How Big Are They and How Much Do We Know Thus Far?," Handbook of the Economics of Education, in: Erik Hanushek & Stephen Machin & Ludger Woessmann (ed.), Handbook of the Economics of Education, edition 1, volume 3, chapter 4, pages 249-277, Elsevier.
    4. Kutscher, Macarena & Nath, Shanjukta & Urzúa, Sergio, 2023. "Centralized admission systems and school segregation: Evidence from a national reform," Journal of Public Economics, Elsevier, vol. 221(C).
    5. Jorge Rodríguez & Sergio Urzúa & Loreto Reyes, 2016. "Heterogeneous Economic Returns to Post-Secondary Degrees: Evidence from Chile," Journal of Human Resources, University of Wisconsin Press, vol. 51(2), pages 416-460.
    6. Nicholas Bloom & Renata Lemos & Raffaella Sadun & John Van Reenen, 2015. "Does Management Matter in schools?," Economic Journal, Royal Economic Society, vol. 0(584), pages 647-674, May.
    7. Andrews, Rodney & Li, Jing & Lovenheim, Michael F., 2014. "Heterogeneous paths through college: Detailed patterns and relationships with graduation and earnings," Economics of Education Review, Elsevier, vol. 42(C), pages 93-108.
    8. Stephanie Riegg Cellini & Hernando Grueso, 2021. "Student Learning in Online College Programs," NBER Working Papers 28552, National Bureau of Economic Research, Inc.
    9. Caroline M. Hoxby & Kevin Stange, 2019. "Productivity in Higher Education," NBER Books, National Bureau of Economic Research, Inc, number hoxb-2, May.
    10. Scott E. Carrell & Marianne E. Page & James E. West, 2010. "Sex and Science: How Professor Gender Perpetuates the Gender Gap," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(3), pages 1101-1144.
    11. Sarah R. Cohodes & Joshua S. Goodman, 2014. "Merit Aid, College Quality, and College Completion: Massachusetts' Adams Scholarship as an In-Kind Subsidy," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 251-285, October.
    12. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Kato, Kengo, 2015. "Some new asymptotic theory for least squares series: Pointwise and uniform results," Journal of Econometrics, Elsevier, vol. 186(2), pages 345-366.
    13. Chin, Aimee & Daysal, N. Meltem & Imberman, Scott A., 2013. "Impact of bilingual education programs on limited English proficient students and their peers: Regression discontinuity evidence from Texas," Journal of Public Economics, Elsevier, vol. 107(C), pages 63-78.
    14. David J. Deming & Michael Lovenheim & Richard Patterson, 2018. "The Competitive Effects of Online Education," NBER Chapters, in: Productivity in Higher Education, pages 259-290, National Bureau of Economic Research, Inc.
    15. Ann Huff Stevens & Michal Kurlaender & Michel Grosz, 2019. "Career Technical Education and Labor Market Outcomes: Evidence from California Community Colleges," Journal of Human Resources, University of Wisconsin Press, vol. 54(4), pages 986-1036.
    16. Eric P. Bettinger & Bridget Terry Long, 2005. "Do Faculty Serve as Role Models? The Impact of Instructor Gender on Female Students," American Economic Review, American Economic Association, vol. 95(2), pages 152-157, May.
    17. Judith Scott-Clayton, 2011. "On Money and Motivation: A Quasi-Experimental Analysis of Financial Incentives for College Achievement," Journal of Human Resources, University of Wisconsin Press, vol. 46(3), pages 614-646.
    18. P. Teixeira & V. Rocha & R. Biscaia & M. F. Cardoso, 2013. "Competition and diversification in public and private higher education," Applied Economics, Taylor & Francis Journals, vol. 45(35), pages 4949-4958, December.
    19. Lisa Barrow & Lashawn Richburg-Hayes & Cecilia Elena Rouse & Thomas Brock, 2014. "Paying for Performance: The Education Impacts of a Community College Scholarship Program for Low-Income Adults," Journal of Labor Economics, University of Chicago Press, vol. 32(3), pages 563-599.
    20. Lovenheim, Michael F. & Smith, Jonathan, 2022. "Returns to Different Postsecondary Investments: Institution Type, Academic Programs, and Credentials," IZA Discussion Papers 15535, Institute of Labor Economics (IZA).
    21. Scott E. Carrell & Michal Kurlaender, 2016. "Estimating the Productivity of Community Colleges in Paving the Road to Four-Year Success," NBER Working Papers 22904, National Bureau of Economic Research, Inc.
    22. Hoxby, Caroline M. & Stange, Kevin (ed.), 2019. "Productivity in Higher Education," National Bureau of Economic Research Books, University of Chicago Press, edition 1, number 9780226574585, December.
    23. Christopher Jepsen & Kenneth Troske & Paul Coomes, 2014. "The Labor-Market Returns to Community College Degrees, Diplomas, and Certificates," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 95-121.
    24. David Figlio & Mark Rush & Lu Yin, 2013. "Is It Live or Is It Internet? Experimental Estimates of the Effects of Online Instruction on Student Learning," Journal of Labor Economics, University of Chicago Press, vol. 31(4), pages 763-784.
    25. Philippe Aghion & Mathias Dewatripont & Caroline Hoxby & Andreu Mas-Colell & André Sapir, 2010. "The governance and performance of universities: evidence from Europe and the US [Distance to frontier, selection, and economic growth]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 25(61), pages 7-59.
    26. Barrera-Osorio, Felipe & Bayona-Rodríguez, Hernando, 2019. "Signaling or better human capital: Evidence from Colombia," Economics of Education Review, Elsevier, vol. 70(C), pages 20-34.
    27. Benjamin L. Castleman & Bridget Terry Long, 2016. "Looking beyond Enrollment: The Causal Effect of Need-Based Grants on College Access, Persistence, and Graduation," Journal of Labor Economics, University of Chicago Press, vol. 34(4), pages 1023-1073.
    28. Will Dobbie & Roland G. Fryer Jr., 2013. "Getting beneath the Veil of Effective Schools: Evidence from New York City," American Economic Journal: Applied Economics, American Economic Association, vol. 5(4), pages 28-60, October.
    29. Stephanie Riegg Cellini & Nicholas Turner, 2019. "Gainfully Employed?: Assessing the Employment and Earnings of For-Profit College Students Using Administrative Data," Journal of Human Resources, University of Wisconsin Press, vol. 54(2), pages 342-370.
    30. Eric P. Bettinger & Lindsay Fox & Susanna Loeb & Eric S. Taylor, 2017. "Virtual Classrooms: How Online College Courses Affect Student Success," American Economic Review, American Economic Association, vol. 107(9), pages 2855-2875, September.
    31. John McCormack & Carol Propper & Sarah Smith, 2014. "Herding Cats? Management and University Performance," Economic Journal, Royal Economic Society, vol. 124(578), pages 534-564, August.
    32. Luis Armona & Rajashri Chakrabarti & Michael F. Lovenheim, 2018. "How Does For-profit College Attendance Affect Student Loans, Defaults and Labor Market Outcomes?," NBER Working Papers 25042, National Bureau of Economic Research, Inc.
    33. Jonathan Smith & Kevin Stange, 2016. "A New Measure of College Quality to Study the Effects of College Sector and Peers on Degree Attainment," Education Finance and Policy, MIT Press, vol. 11(4), pages 369-403, Fall.
    34. Paco Martorell & Brian McCall & Isaac McFarlin, 2014. "Do Public Tuition Subsidies Promote College Enrollment? Evidence From Community College Taxing Districts In Texas," Working Papers 14-32, Center for Economic Studies, U.S. Census Bureau.
    35. Gaofeng Yi, 2018. "Impact of internship quality on entrepreneurial intentions among graduating engineering students of research universities in China," International Entrepreneurship and Management Journal, Springer, vol. 14(4), pages 1071-1087, December.
    36. Michel Grosz, 2020. "The Returns to a Large Community College Program: Evidence from Admissions Lotteries," American Economic Journal: Economic Policy, American Economic Association, vol. 12(1), pages 226-253, February.
    37. Melguizo, Tatiana & Sanchez, Fabio & Velasco, Tatiana, 2016. "Credit for Low-Income Students and Access to and Academic Performance in Higher Education in Colombia: A Regression Discontinuity Approach," World Development, Elsevier, vol. 80(C), pages 61-77.
    38. Jeffrey T. Denning, 2017. "College on the Cheap: Consequences of Community College Tuition Reductions," American Economic Journal: Economic Policy, American Economic Association, vol. 9(2), pages 155-188, May.
    39. Liu, Vivian Y.T. & Belfield, Clive R. & Trimble, Madeline J., 2015. "The medium-term labor market returns to community college awards: Evidence from North Carolina," Economics of Education Review, Elsevier, vol. 44(C), pages 42-55.
    40. Kevin Stange, 2012. "Ability Sorting and the Importance of College Quality to Student Achievement: Evidence from Community Colleges," Education Finance and Policy, MIT Press, vol. 7(1), pages 74-105, January.
    41. Wiederspan, Mark, 2016. "Denying loan access: The student-level consequences when community colleges opt out of the Stafford loan program," Economics of Education Review, Elsevier, vol. 51(C), pages 79-96.
    42. P. Wesley Routon & Jay K. Walker, 2019. "College internships, tenure gaps, and student outcomes: a multiple-treatment matching approach," Education Economics, Taylor & Francis Journals, vol. 27(4), pages 383-400, July.
    43. Erica Field, 2009. "Educational Debt Burden and Career Choice: Evidence from a Financial Aid Experiment at NYU Law School," American Economic Journal: Applied Economics, American Economic Association, vol. 1(1), pages 1-21, January.
    44. Thomas J. Kane & Angela Boatman & Whitney Kozakowski & Christopher Bennett & Rachel Hitch & Dana Weisenfeld, 2021. "Is College Remediation a Barrier or a Boost? Evidence from the Tennessee SAILS Program," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 40(3), pages 883-913, June.
    45. Filmer,Deon P. & Nahata,Vatsal & Sabarwal,Shwetlena, 2021. "Preparation, Practice, and Beliefs : A Machine Learning Approach to Understanding Teacher Effectiveness," Policy Research Working Paper Series 9847, The World Bank.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dinarte Diaz,Lelys Ileana & Ferreyra,Maria Marta & Urzua,Sergio & Bassi,Marina, 2021. "What Makes a Program Good ? Evidence from Short-Cycle Higher Education Programs in LatinAmerica and the Caribbean," Policy Research Working Paper Series 9722, The World Bank.
    2. Dinarte-Diaz, Lelys & Ferreyra, Maria Marta & Urzua, Sergio & Bassi, Marina, 2023. "What makes a program good? Evidence from short-cycle higher education programs in five developing countries," World Development, Elsevier, vol. 169(C).
    3. Lelys Dinarte-Diaz & Maria Marta Ferreyra & Tatiana Melguizo & Angelica Sanchez, 2023. "The Contribution of Short-Cycle Programs to Student Outcomes: Evidence from Colombia," CESifo Working Paper Series 10262, CESifo.
    4. Ferreyra,Maria Marta & Franco Hernandez,Andrea & Melguizo,Tatiana & Sanchez Diaz,Angelica Maria, 2020. "Estimating the Contribution of Short-Cycle Programs to Student Outcomes in Colombia," Policy Research Working Paper Series 9424, The World Bank.
    5. Celeste K. Carruthers & Christopher Jepsen, 2020. "Vocational Education: An International Perspective," CESifo Working Paper Series 8718, CESifo.
    6. Aguirre, Josefa, 2021. "Long-term effects of grants and loans for vocational education," Journal of Public Economics, Elsevier, vol. 204(C).
    7. Page, Lindsay C. & Scott-Clayton, Judith, 2016. "Improving college access in the United States: Barriers and policy responses," Economics of Education Review, Elsevier, vol. 51(C), pages 4-22.
    8. Andrew Foote & Michel Grosz, 2020. "The Effect of Local Labor Market Downturns on Postsecondary Enrollment and Program Choice," Education Finance and Policy, MIT Press, vol. 15(4), pages 593-622, Fall.
    9. Benjamin M. Marx & Lesley J. Turner, 2019. "Student Loan Nudges: Experimental Evidence on Borrowing and Educational Attainment," American Economic Journal: Economic Policy, American Economic Association, vol. 11(2), pages 108-141, May.
    10. Juan Esteban Carranza & María Marta Ferreyra & Ana Maria Gazmuri, 2023. "The Dynamic Market for Short-Cycle Higher Education Programs," Borradores de Economia 1265, Banco de la Republica de Colombia.
    11. Christopher Jepsen & Peter Mueser & Kenneth Troske & Kyung-Seong Jeon, 2023. "Estimates of Earnings Returns by Field of Study for For-Profit Schools and Community Colleges," CESifo Working Paper Series 10754, CESifo.
    12. Lindsay C. Page & Judith Scott-Clayton, 2015. "Improving College Access in the United States: Barriers and Policy Responses," NBER Working Papers 21781, National Bureau of Economic Research, Inc.
    13. Rajashri Chakrabarti & Nicole Gorton & Michael F. Lovenheim, 2020. "State Investment in Higher Education: Effects on Human Capital Formation, Student Debt, and Long-Term Financial Outcomes of Students," CESifo Working Paper Series 8592, CESifo.
    14. Lauren Schudde & Judith Scott-Clayton, 2016. "Pell Grants as Performance-Based Scholarships? An Examination of Satisfactory Academic Progress Requirements in the Nation’s Largest Need-Based Aid Program," Research in Higher Education, Springer;Association for Institutional Research, vol. 57(8), pages 943-967, December.
    15. Jeffrey T. Denning & Todd R. Jones, 2021. "Maxed Out?: The Effect of Larger Student Loan Limits on Borrowing and Education Outcomes," Journal of Human Resources, University of Wisconsin Press, vol. 56(4), pages 1113-1140.
    16. Christopher Erwin & Melissa Binder & Cynthia Miller & Kate Krause, 2020. "Performance-based aid, enhanced advising, and the income gap in college graduation: Evidence from a randomized controlled trial," Working Papers 2020-06, Auckland University of Technology, Department of Economics.
    17. Michel Grosz & Michal Kurlaender & Ann Stevens, 2022. "Capacity and Flexibility in Community College CTE Programs: Program Offerings and Student Success," Research in Higher Education, Springer;Association for Institutional Research, vol. 63(1), pages 140-188, February.
    18. Jack Mountjoy & Brent Hickman, 2020. "The Returns to College(s): Estimating Value-Added and Match Effects in Higher Education," Working Papers 2020-08, Becker Friedman Institute for Research In Economics.
    19. Joshua Angrist & Philip Oreopoulos & Tyler Williams, 2014. "When Opportunity Knocks, Who Answers?: New Evidence on College Achievement Awards," Journal of Human Resources, University of Wisconsin Press, vol. 49(3), pages 572-610.
    20. Welch, Jilleah G., 2014. "HOPE for community college students: The impact of merit aid on persistence, graduation, and earnings," Economics of Education Review, Elsevier, vol. 43(C), pages 1-20.

    More about this item

    Keywords

    higher education; short-cycle degrees; quality;
    All these keywords.

    JEL classification:

    • I22 - Health, Education, and Welfare - - Education - - - Educational Finance; Financial Aid
    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education
    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_10255. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.