IDEAS home Printed from https://ideas.repec.org/a/eee/deveco/v169y2024ics0304387824000348.html

Is online job training for all? Experimental evidence on the effects of a Coursera program in Costa Rica

Author

Listed:
  • Novella, Rafael
  • Rosas-Shady, David
  • Freund, Richard

Abstract

Massive open online courses (MOOCs) are frequently viewed as a tool for democratizing education and job training. However, their effectiveness is largely untested. We report on the first randomized evaluation of a job training program offering cost-free access to curated, short Coursera MOOCs and certificates. We find low course completion rates (10%), with males and wealthier individuals more likely to complete a course. Personalized reminders did not increase treatment take-up over a simple, standardized email reminder. Treatment has no significant effect on labour market outcomes roughly two years after the program. However, we find marginally significant evidence that treatment increases post-secondary education enrolment by 11%. Evidence on mechanisms suggests that this may be operating partially through the program motivating individuals who lacked sufficient skills to pursue further specialization.

Suggested Citation

  • Novella, Rafael & Rosas-Shady, David & Freund, Richard, 2024. "Is online job training for all? Experimental evidence on the effects of a Coursera program in Costa Rica," Journal of Development Economics, Elsevier, vol. 169(C).
    • Handle: RePEc:eee:deveco:v:169:y:2024:i:c:s0304387824000348
    DOI: 10.1016/j.jdeveco.2024.103285
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304387824000348
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jdeveco.2024.103285?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. David McKenzie, 2017. "How Effective Are Active Labor Market Policies in Developing Countries? A Critical Review of Recent Evidence," The World Bank Research Observer, World Bank, vol. 32(2), pages 127-154.
    2. Kast, Felipe & Meier, Stephan & Pomeranz, Dina, 2018. "Saving more in groups: Field experimental evidence from Chile," Journal of Development Economics, Elsevier, vol. 133(C), pages 275-294.
    3. repec:hal:pseose:halshs-00840901 is not listed on IDEAS
    4. David K. Evans & Fei Yuan, 2020. "How Big Are Effect Sizes in International Education Studies?," Working Papers 545, Center for Global Development, revised 01 Apr 2022.
    5. Girum Abebe & A Stefano Caria & Marcel Fafchamps & Paolo Falco & Simon Franklin & Simon Quinn, 2021. "Anonymity or Distance? Job Search and Labour Market Exclusion in a Growing African City [Endogenous Stratification in Randomized Experiments]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 88(3), pages 1279-1310.
    6. Patterson, Richard W., 2018. "Can behavioral tools improve online student outcomes? Experimental evidence from a massive open online course," Journal of Economic Behavior & Organization, Elsevier, vol. 153(C), pages 293-321.
    7. Heissel, Jennifer, 2016. "The relative benefits of live versus online delivery: Evidence from virtual algebra I in North Carolina," Economics of Education Review, Elsevier, vol. 53(C), pages 99-115.
    8. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    9. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2013. "Do Labor Market Policies have Displacement Effects? Evidence from a Clustered Randomized Experiment," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(2), pages 531-580.
    10. David S. Lee, 2009. "Training, Wages, and Sample Selection: Estimating Sharp Bounds on Treatment Effects," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 76(3), pages 1071-1102.
    11. Wyatt Brooks & Kevin Donovan & Terence R. Johnson, 2018. "Mentors or Teachers? Microenterprise Training in Kenya," American Economic Journal: Applied Economics, American Economic Association, vol. 10(4), pages 196-221, October.
    12. Das, Narayan, 2021. "Training the disadvantaged youth and labor market outcomes: Evidence from Bangladesh," Journal of Development Economics, Elsevier, vol. 149(C).
    13. Dean Karlan & Margaret McConnell & Sendhil Mullainathan & Jonathan Zinman, 2016. "Getting to the Top of Mind: How Reminders Increase Saving," Management Science, INFORMS, vol. 62(12), pages 3393-3411, December.
    14. Jeffrey R. Kling & Jeffrey B. Liebman, 2004. "Experimental Analysis of Neighborhood Effects on Youth," Working Papers 1, Princeton University, Department of Economics, Industrial Relations Section..
    15. Eliana Carranza & Robert Garlick & Kate Orkin & Neil Rankin, 2022. "Job Search and Hiring with Limited Information about Workseekers' Skills," American Economic Review, American Economic Association, vol. 112(11), pages 3547-3583, November.
    16. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    17. Bruno Crépon & Florencia Devoto & Esther Duflo & William Parienté, 2015. "Estimating the Impact of Microcredit on Those Who Take It Up: Evidence from a Randomized Experiment in Morocco," American Economic Journal: Applied Economics, American Economic Association, vol. 7(1), pages 123-150, January.
    18. Abhijit V. Banerjee & Esther Duflo, 2014. "(Dis)organization and Success in an Economics MOOC," American Economic Review, American Economic Association, vol. 104(5), pages 514-518, May.
    19. Cilliers, Jacobus & Fleisch, Brahm & Kotze, Janeli & Mohohlwane, Nompumelelo & Taylor, Stephen & Thulare, Tsegofatso, 2022. "Can virtual replace in-person coaching? Experimental evidence on teacher professional development and student learning," Journal of Development Economics, Elsevier, vol. 155(C).
    20. Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004. "Evaluating the Employment Impact of a Mandatory Job Search Program," Journal of the European Economic Association, MIT Press, vol. 2(4), pages 569-606, June.
    21. Ximena Cadena & Antoinette Schoar, 2011. "Remembering to Pay? Reminders vs. Financial Incentives for Loan Payments," NBER Working Papers 17020, National Bureau of Economic Research, Inc.
    22. Rafael Novella & Graciana Rucci & Claudia Vazquez & David S. Kaplan, 2018. "Training Vouchers and Labour Market Outcomes in Chile," LABOUR, CEIS, vol. 32(2), pages 243-260, June.
    23. Avitabile, Ciro & de Hoyos, Rafael, 2018. "The heterogeneous effect of information on student performance: Evidence from a randomized control trial in Mexico," Journal of Development Economics, Elsevier, vol. 135(C), pages 318-348.
    24. UN Women, 2015. "Progress of the World’s Women 2015-2016: Transforming Economies, Realizing Rights," Working Papers id:7688, eSocialSciences.
    25. Emily Breza & Arun G. Chandrasekhar, 2019. "Social Networks, Reputation, and Commitment: Evidence From a Savings Monitors Experiment," Econometrica, Econometric Society, vol. 87(1), pages 175-216, January.
    26. Daron Acemoglu & David Laibson & John A. List, 2014. "Equalizing Superstars: The Internet and the Democratization of Education," American Economic Review, American Economic Association, vol. 104(5), pages 523-527, May.
    27. De Paola, Maria & Gioia, Francesca & Scoppa, Vincenzo, 2023. "Online teaching, procrastination and student achievement," Economics of Education Review, Elsevier, vol. 94(C).
    28. Imbens,Guido W. & Rubin,Donald B., 2015. "Causal Inference for Statistics, Social, and Biomedical Sciences," Cambridge Books, Cambridge University Press, number 9780521885881, January.
    29. Laurel Wheeler & Robert Garlick & Eric Johnson & Patrick Shaw & Marissa Gargano, 2022. "LinkedIn(to) Job Opportunities: Experimental Evidence from Job Readiness Training," American Economic Journal: Applied Economics, American Economic Association, vol. 14(2), pages 101-125, April.
    30. Bacher-Hicks, Andrew & Goodman, Joshua & Mulhern, Christine, 2021. "Inequality in household adaptation to schooling shocks: Covid-induced online learning engagement in real time," Journal of Public Economics, Elsevier, vol. 193(C).
    31. Robert Jensen, 2010. "The (Perceived) Returns to Education and the Demand for Schooling," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 515-548.
    32. repec:pri:indrel:dsp01m613mx58m is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fazio, Maria Victoria & Freund, Richard & Novella, Rafael, 2025. "Do entrepreneurial skills unlock opportunities for online freelancing? Experimental evidence from El Salvador," Journal of Development Economics, Elsevier, vol. 172(C).
    2. Witte, Marc J. & Roth, Johanna & Hardy, Morgan & Meyer, Christian Johannes, 2025. "Reaching Marginalized Job Seekers Through Public Employment Services: Experimental Evidence from Ethiopia," IZA Discussion Papers 18005, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Armand, Alex & Carneiro, Pedro & Tagliati, Federico & Xia, Yiming, 2026. "Can subsidized employment tackle long-term unemployment? Experimental evidence from North Macedonia," Journal of Development Economics, Elsevier, vol. 178(C).
    2. Fazio, Maria Victoria & Freund, Richard & Novella, Rafael, 2025. "Do entrepreneurial skills unlock opportunities for online freelancing? Experimental evidence from El Salvador," Journal of Development Economics, Elsevier, vol. 172(C).
    3. Gong, Jie & Liu, Tracy Xiao & Tang, Jie, 2021. "How monetary incentives improve outcomes in MOOCs: Evidence from a field experiment," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 905-921.
    4. Laurel Wheeler & Robert Garlick & Eric Johnson & Patrick Shaw & Marissa Gargano, 2022. "LinkedIn(to) Job Opportunities: Experimental Evidence from Job Readiness Training," American Economic Journal: Applied Economics, American Economic Association, vol. 14(2), pages 101-125, April.
    5. Crepon,Bruno Jacques Jean Philippe & Premand,Patrick, 2018. "Creating new positions ? direct and indirect effects of a subsidized apprenticeship program," Policy Research Working Paper Series 8561, The World Bank.
    6. Livia Alfonsi & Oriana Bandiera & Vittorio Bassi & Robin Burgess & Imran Rasul & Munshi Sulaiman & Anna Vitali, 2020. "Tackling Youth Unemployment: Evidence From a Labor Market Experiment in Uganda," Econometrica, Econometric Society, vol. 88(6), pages 2369-2414, November.
    7. Banerjee, Abhijit V. & Chiplunkar, Gaurav, 2024. "How important are matching frictions in the labor market? Experimental & non-experimental evidence from a large Indian firm," Journal of Development Economics, Elsevier, vol. 171(C).
    8. Brynde Kreft, 2025. "Information, skills and job search," CSAE Working Paper Series 2025-09, Centre for the Study of African Economies, University of Oxford.
    9. Chowdhury, Shyamal & Hasan, Syed & Sharma, Uttam, 2024. "The Role of Trainee Selection in the Effectiveness of Vocational Training: Evidence from a Randomized Controlled Trial in Nepal," IZA Discussion Papers 16705, Institute of Labor Economics (IZA).
    10. Bernd Beber & Tabea Lakemann & Regina Schnars & Jann Lay, 2025. "Employment Effects of Skills Trainings in Sub-Saharan Africa: A Systematic Review of Recent Randomized Controlled Trials," De Economist, Springer, vol. 173(1), pages 87-120, March.
    11. Denis Fougère & Nicolas Jacquemet, 2019. "Causal Inference and Impact Evaluation," Economie et Statistique / Economics and Statistics, Institut National de la Statistique et des Etudes Economiques (INSEE), issue 510-511-5, pages 181-200.
    12. Maria Laura Alzúa & Soyolmaa Batbekh & Altantsetseg Batchuluun & Bayarmaa Dalkhjav & José Galdo, 2021. "Demand-Driven Youth Training Programs: Experimental Evidence from Mongolia," The World Bank Economic Review, World Bank, vol. 35(3), pages 720-744.
    13. Andrea Kiss & Robert Garlick & Kate Orkin & Luke Hensel, 2023. "Jobseekers’ Beliefs about Comparative Advantage and (Mis)Directed Search," Upjohn Working Papers 23-388, W.E. Upjohn Institute for Employment Research.
    14. Islam, Asadul & Lee, Wang-Sheng & Triyana, Margaret & Xia, Xing, 2023. "Improving Health and Safety in the Informal Sector: Evidence from a Randomized Trial in Bangladesh," IZA Discussion Papers 16150, Institute of Labor Economics (IZA).
    15. Yuehao Bai, 2022. "Optimality of Matched-Pair Designs in Randomized Controlled Trials," Papers 2206.07845, arXiv.org.
    16. Fred Mawunyo Dzanku & Robert Osei & Isaac Osei‐Akoto, 2021. "The impact of mobile phone voice message reminders on agricultural outcomes in Mali," Agricultural Economics, International Association of Agricultural Economists, vol. 52(5), pages 789-806, September.
    17. Altmann, Steffen & Falk, Armin & Jäger, Simon & Zimmermann, Florian, 2018. "Learning about job search: A field experiment with job seekers in Germany," Journal of Public Economics, Elsevier, vol. 164(C), pages 33-49.
    18. Beber, Bernd & Dworschak, Regina & Lakemann, Tabea & Lay, Jann & Priebe, Jan, 2021. "Skills Development and Training Interventions in Africa: Findings, Challenges, and Opportunities," RWI Projektberichte, RWI - Leibniz-Institut für Wirtschaftsforschung, number 247426.
    19. Lombardi, Stefano & Skans, Oskar Nordström & Vikström, Johan, 2018. "Targeted wage subsidies and firm performance," Labour Economics, Elsevier, vol. 53(C), pages 33-45.
    20. M. Antonella Mancino & Leonardo Fabio Morales & Diego F. Salazar, 2023. "Signaling Worker Quality in a Developing Country: Lessons from a Certification Program," Borradores de Economia 1259, Banco de la Republica de Colombia.

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • J24 - Labor and Demographic Economics - - Demand and Supply of Labor - - - Human Capital; Skills; Occupational Choice; Labor Productivity
    • J01 - Labor and Demographic Economics - - General - - - Labor Economics: General
    • J62 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Job, Occupational and Intergenerational Mobility; Promotion
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:deveco:v:169:y:2024:i:c:s0304387824000348. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/devec .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.