IDEAS home Printed from https://ideas.repec.org/a/eee/labeco/v67y2020ics0927537120301111.html
   My bibliography  Save this article

Evaluation of education and training impacts for the unemployed: Challenges of new data

Author

Listed:
  • Cerqua, Augusto
  • Urwin, Peter
  • Thomson, Dave
  • Bibby, David

Abstract

This study utilises an exceptionally rich English administrative dataset, to estimate employment impacts from training voluntarily initiated by unemployed individuals. A Coarsened Exact Matching approach is adopted, in a dynamic evaluation framework, to estimate impacts up to 5 years from training start. We identify economically and statistically significant impacts, estimated separately for (i) all training starters, (ii) the partially, and (iii) fully treated. Investigation of possible endogenous selection into partial/full treatment, using distance to training provider as an instrumental variable, suggests inclusion of extensive employment and learning histories in a matching framework, justifies invocation of the conditional independence assumption for comparisons of full/partial treatment. The partially treated secure a return that is, on average, 2 percentage points lower than full treatment. Thus, an `intention to treat' approach would not alter conclusions on the efficacy of training; but using the partially treated to estimate counterfactual outcomes risks understating returns.

Suggested Citation

  • Cerqua, Augusto & Urwin, Peter & Thomson, Dave & Bibby, David, 2020. "Evaluation of education and training impacts for the unemployed: Challenges of new data," Labour Economics, Elsevier, vol. 67(C).
  • Handle: RePEc:eee:labeco:v:67:y:2020:i:c:s0927537120301111
    DOI: 10.1016/j.labeco.2020.101907
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0927537120301111
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.labeco.2020.101907?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gerard J. van den Berg & Antoine Bozio & Mónica Costa Dias, 2020. "Policy discontinuity and duration outcomes," Quantitative Economics, Econometric Society, vol. 11(3), pages 871-916, July.
    2. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    3. Patrick Arni & Rafael Lalive & Jan C. Van Ours, 2013. "How Effective Are Unemployment Benefit Sanctions? Looking Beyond Unemployment Exit," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(7), pages 1153-1178, November.
    4. Bernd Fitzenberger & Aderonke Osikominu & Robert Völter, 2008. "Get Training or Wait? Long-Run Employment Effects of Training Programs for the Unemployed in West Germany," Annals of Economics and Statistics, GENES, issue 91-92, pages 321-355.
    5. Cornelissen, Thomas & Dustmann, Christian & Raute, Anna & Schönberg, Uta, 2016. "From LATE to MTE: Alternative methods for the evaluation of policy interventions," Labour Economics, Elsevier, vol. 41(C), pages 47-60.
    6. Pedro Carneiro & James J. Heckman & Edward J. Vytlacil, 2011. "Estimating Marginal Returns to Education," American Economic Review, American Economic Association, vol. 101(6), pages 2754-2781, October.
    7. Christopher Jepsen & Kenneth Troske & Paul Coomes, 2014. "The Labor-Market Returns to Community College Degrees, Diplomas, and Certificates," Journal of Labor Economics, University of Chicago Press, vol. 32(1), pages 95-121.
    8. Kluve, Jochen, 2010. "The effectiveness of European active labor market programs," Labour Economics, Elsevier, vol. 17(6), pages 904-918, December.
    9. David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labour Market Policy Evaluations: A Meta-Analysis," Economic Journal, Royal Economic Society, vol. 120(548), pages 452-477, November.
    10. Dorsett, Richard, 2006. "The new deal for young people: effect on the labour market status of young men," Labour Economics, Elsevier, vol. 13(3), pages 405-422, June.
    11. Fredriksson, Peter & Johansson, Per, 2008. "Dynamic Treatment Assignment," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 435-445.
    12. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    13. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    14. Kluve, Jochen & Rinne, Ulf & Uhlendorff, Arne & Zhao, Zhong, 2013. "The impact of training duration on employment outcomes: Evidence from LATE estimates," Economics Letters, Elsevier, vol. 120(3), pages 487-490.
    15. Matthew Blackwell & Stefano Iacus & Gary King & Giuseppe Porro, 2009. "cem: Coarsened exact matching in Stata," Stata Journal, StataCorp LP, vol. 9(4), pages 524-546, December.
    16. Dolton, Peter & Smith, Jeffrey A., 2011. "The Impact of the UK New Deal for Lone Parents on Benefit Receipt," IZA Discussion Papers 5491, Institute of Labor Economics (IZA).
    17. Lechner Michael & Miquel Ruth & Wunsch Conny, 2007. "The Curse and Blessing of Training the Unemployed in a Changing Economy: The Case of East Germany After Unification," German Economic Review, De Gruyter, vol. 8(4), pages 468-509, December.
    18. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    19. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2011. "Multivariate Matching Methods That Are Monotonic Imbalance Bounding," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 345-361.
    20. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    21. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    22. Christopher R. Walters, 2018. "The Demand for Effective Charter Schools," Journal of Political Economy, University of Chicago Press, vol. 126(6), pages 2179-2223.
    23. James Heckman & Neil Hohmann & Jeffrey Smith & Michael Khoo, 2000. "Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment," The Quarterly Journal of Economics, Oxford University Press, vol. 115(2), pages 651-694.
    24. Matt Dickson, 2013. "The Causal Effect of Education on Wages Revisited," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(4), pages 477-498, August.
    25. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    26. Chung Choe & Alfonso Flores-Lagunes & Sang-Jun Lee, 2015. "Do dropouts with longer training exposure benefit from training programs? Korean evidence employing methods for continuous treatments," Empirical Economics, Springer, vol. 48(2), pages 849-881, March.
    27. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    28. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    29. Michael Lechner & Ruth Miquel & Conny Wunsch, 2007. "The Curse and Blessing of Training the Unemployed in a Changing Economy: The Case of East Germany After Unification," German Economic Review, Verein für Socialpolitik, vol. 8(4), pages 468-509, November.
    30. Conny Wunsch, 2016. "How to minimize lock-in effects of programs for unemployed workers," IZA World of Labor, Institute of Labor Economics (IZA), pages 288-288, September.
    31. Burt S. Barnow & Jeffrey Smith, 2015. "Employment and Training Programs," NBER Chapters, in: Economics of Means-Tested Transfer Programs in the United States, Volume 2, pages 127-234, National Bureau of Economic Research, Inc.
    32. Heckman, James J & Smith, Jeffrey A, 1999. "The Pre-programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies," Economic Journal, Royal Economic Society, vol. 109(457), pages 313-348, July.
    33. Spiess, C. Katharina & Wrohlich, Katharina, 2010. "Does distance determine who attends a university in Germany?," Economics of Education Review, Elsevier, vol. 29(3), pages 470-479, June.
    34. Stephen V. Cameron & Christopher Taber, 2004. "Estimation of Educational Borrowing Constraints Using Returns to Schooling," Journal of Political Economy, University of Chicago Press, vol. 112(1), pages 132-182, February.
    35. Iacus, Stefano & King, Gary & Porro, Giuseppe, 2009. "cem: Software for Coarsened Exact Matching," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 30(i09).
    36. Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004. "Evaluating the Employment Impact of a Mandatory Job Search Program," Journal of the European Economic Association, MIT Press, vol. 2(4), pages 569-606, June.
    37. McCall, B. & Smith, J. & Wunsch, C., 2016. "Government-Sponsored Vocational Education for Adults," Handbook of the Economics of Education,, Elsevier.
    38. James Heckman & Jeffrey Smith & Christopher Taber, 1998. "Accounting For Dropouts In Evaluations Of Social Programs," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 1-14, February.
    39. Stephen H. Bell & Larry l. Orr & John D. Blomquist & Glen G. Cain, 1995. "Program Applicants as a Comparison Group in Evaluating Training Programs: Theory and a Test," Books from Upjohn Press, W.E. Upjohn Institute for Employment Research, number pacg, November.
    40. Jere R. Behrman & Yingmei Cheng & Petra E. Todd, 2004. "Evaluating Preschool Programs When Length of Exposure to the Program Varies: A Nonparametric Approach," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 108-132, February.
    41. Bernhard Boockmann & Stephan L. Thomsen & Thomas Walter, 2014. "Intensifying the use of benefit sanctions: an effective tool to increase employment?," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 3(1), pages 1-19, December.
    42. Marc Frenette, 2004. "Access to College and University: Does Distance to School Matter?," Canadian Public Policy, University of Toronto Press, vol. 30(4), pages 427-443, December.
    43. Richard Blundell & Lorraine Dearden & Barbara Sianesi, 2005. "Evaluating the effect of education on earnings: models, methods and results from the National Child Development Survey," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(3), pages 473-512, July.
    44. Sianesi, Barbara, 2008. "Differential effects of active labour market programs for the unemployed," Labour Economics, Elsevier, vol. 15(3), pages 370-399, June.
    45. Iacus, Stefano M. & King, Gary & Porro, Giuseppe, 2012. "Causal Inference without Balance Checking: Coarsened Exact Matching," Political Analysis, Cambridge University Press, vol. 20(1), pages 1-24, January.
    46. Robert G. Fay, 1996. "Enhancing the Effectiveness of Active Labour Market Policies: Evidence from Programme Evaluations in OECD Countries," OECD Labour Market and Social Policy Occasional Papers 18, OECD Publishing.
    47. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2014. "Unobservable, but Unimportant? The Influence of Personality Traits (and Other Usually Unobserved Variables) for the Evaluation of Labor Market Policies," IZA Discussion Papers 8337, Institute of Labor Economics (IZA).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Karlsson, Linn, 2021. "Never too late? Returning to university after completing secondary education as adults," Umeå Economic Studies 1002, Umeå University, Department of Economics.
    2. Rainer Eppel & Ulrike Huemer & Helmut Mahringer & Lukas Schmoigl, 2024. "Active Labour Market Policies: What Works for the Long-term Unemployed?," WIFO Working Papers 671, WIFO.
    3. Rainer Eppel & Ulrike Huemer & Helmut Mahringer & Lukas Schmoigl, 2022. "Welcher Kurs wirkt für wen?. Effektivität der Qualifizierungsförderungen des Arbeitsmarktservice Österreich," WIFO Monatsberichte (monthly reports), WIFO, vol. 95(11), pages 757-767, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    2. Mörk, Eva & Ottosson, Lillit & Vikman, Ulrika, 2021. "To work or not to work? Effects of temporary public employment on future employment and benefits," Working Paper Series 2021:12, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    3. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    4. Fitzenberger, Bernd & Furdas, Marina & Sajons, Christoph, 2016. "End-of-year spending and the long-run employment effects of training programs for the unemployed," Freiburg Discussion Papers on Constitutional Economics 16/08, Walter Eucken Institut e.V..
    5. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    6. Hagen, Tobias, 2016. "Econometric Evaluation of a Placement Coaching Program for Recipients of Disability Insurance Benefits in Switzerland," VfS Annual Conference 2016 (Augsburg): Demographic Change 145736, Verein für Socialpolitik / German Economic Association.
    7. Leduc, Elisabeth & Tojerow, Ilan, 2020. "Subsidizing Domestic Services as a Tool to Fight Unemployment: Effectiveness and Hidden Costs," IZA Discussion Papers 13544, Institute of Labor Economics (IZA).
    8. Hagen, Tobias, 2016. "Econometric evaluation of a placement coaching program for recipients of disability insurance benefits in Switzerland," Working Paper Series 10, Frankfurt University of Applied Sciences, Faculty of Business and Law.
    9. Thomas Kruppe & Julia Lang, 2018. "Labour market effects of retraining for the unemployed: the role of occupations," Applied Economics, Taylor & Francis Journals, vol. 50(14), pages 1578-1600, March.
    10. Dauth, Christine & Lang, Julia, 2017. "Should the unemployed care for the elderly? : The effect of subsidized occupational and further training in elderly care," IAB-Discussion Paper 201713, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    11. Lang, Julia & Dauth, Christine, 2017. "Should the unemployed care for the elderly? The effect of subsidized occupational and further training in geriatric care," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168130, Verein für Socialpolitik / German Economic Association.
    12. Blázquez, Maite & Herrarte, Ainhoa & Sáez, Felipe, 2019. "Training and job search assistance programmes in Spain: The case of long-term unemployed," Journal of Policy Modeling, Elsevier, vol. 41(2), pages 316-335.
    13. Tobias Brändle & Lukas Fervers, 2021. "Give it Another Try: What are the Effects of a Job Creation Scheme Especially Designed for Hard-to-Place Workers?," Journal of Labor Research, Springer, vol. 42(3), pages 382-417, December.
    14. Cockx, Bart & Lechner, Michael & Bollens, Joost, 2023. "Priority to unemployed immigrants? A causal machine learning evaluation of training in Belgium," Labour Economics, Elsevier, vol. 80(C).
    15. Marco Caliendo & Ricarda Schmidl, 2016. "Youth unemployment and active labor market policies in Europe," IZA Journal of Labor Policy, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 5(1), pages 1-30, December.
    16. Marloes Lammers & Lucy Kok, 2021. "Are active labor market policies (cost-)effective in the long run? Evidence from the Netherlands," Empirical Economics, Springer, vol. 60(4), pages 1719-1746, April.
    17. Marco Caliendo & Robert Mahlstedt & Gerard J. van den Berg & Johan Vikström, 2023. "Side effects of labor market policies," Scandinavian Journal of Economics, Wiley Blackwell, vol. 125(2), pages 339-375, April.
    18. Madoń, Karol & Magda, Iga & Palczyńska, Marta & Smoter, Mateusz, 2021. "What Works for Whom? Youth Labour Market Policy in Poland," IZA Discussion Papers 14793, Institute of Labor Economics (IZA).
    19. Daniel Goller & Tamara Harrer & Michael Lechner & Joachim Wolff, 2021. "Active labour market policies for the long-term unemployed: New evidence from causal machine learning," Papers 2106.10141, arXiv.org, revised May 2023.
    20. Sandra Cavaco & Denis Fougère & Julien Pouget, 2013. "Estimating the effect of a retraining program on the re-employment rate of displaced workers," Empirical Economics, Springer, vol. 44(1), pages 261-287, February.

    More about this item

    Keywords

    Active labour market programme; Full and partial treatment; Endogenous selection;
    All these keywords.

    JEL classification:

    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I26 - Health, Education, and Welfare - - Education - - - Returns to Education
    • I38 - Health, Education, and Welfare - - Welfare, Well-Being, and Poverty - - - Government Programs; Provision and Effects of Welfare Programs
    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:labeco:v:67:y:2020:i:c:s0927537120301111. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/labeco .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.