Advanced Search
MyIDEAS: Login to save this paper or follow this series

The effectiveness of public sponsored training revisited: The importance of data and methodological choices

Contents:

Author Info

  • Martin Biewen
  • Bernd Fitzenberger
  • Aderonke Osikominu
  • Marie Paul

Abstract

As the first, substantive contribution, this paper revisits the effectiveness of two widely used public sponsored training programs, the first one focusing on intensive occupational training and the second one on short-term activation and job entry. We use an exceptionally rich administrative data set for Germany to estimate their employment and earnings effects in the early 2000s. We employ a stratified propensity score matching approach to address dynamic selection into heterogeneous programs. As a second, methodological contribution, we carefully assess to what extent various aspects of our empirical strategy such as conditioning flexibly on employment and benefit histories, the availability of rich personal information, handling of later program participations, and further methodological and specification choices affect estimation results. Our results imply pronounced negative lock-in effects in the short run in general and positive medium-run effects on employment and earnings when job-seekers enroll after having been unemployed for some time. We find that data and specification issues can have a large effect on impact estimates.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://www.econ.uzh.ch/static/wp/econwp091.pdf
Download Restriction: no

Bibliographic Info

Paper provided by Department of Economics - University of Zurich in its series ECON - Working Papers with number 091.

as in new window
Length:
Date of creation: Sep 2012
Date of revision:
Handle: RePEc:zur:econwp:091

Contact details of provider:
Postal: Blümlisalpstrasse 10, CH-8006 Zürich
Phone: +41-1-634 22 05
Fax: +41-1-634 49 07
Email:
Web page: http://www.econ.uzh.ch/
More information through EDIRC

Related research

Keywords: Public sponsored training; dynamic treatment effects; multiple treatments; kernel matching; administrative data;

Other versions of this item:

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Michael Lechner, 2002. "Program Heterogeneity And Propensity Score Matching: An Application To The Evaluation Of Active Labor Market Policies," The Review of Economics and Statistics, MIT Press, vol. 84(2), pages 205-220, May.
  2. Lechner, Michael & Miquel, Ruth & Wunsch, Conny, 2005. "The curse and blessing of training the unemployed in a changing economy : the case of East Germany after unification," IAB Discussion Paper 200514, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
  3. Norm Park & Bob Power & W. Craig Riddell & Ging Wong, 1996. "An Assessment of the Impact of Government-Sponsored Training," Canadian Journal of Economics, Canadian Economics Association, vol. 29(s1), pages 93-98, April.
  4. Lechner, Michael & Wiehler, Stephan, 2007. "Kids or Courses? Gender Differences in the Effects of Active Labour Market Policies," CEPR Discussion Papers 6267, C.E.P.R. Discussion Papers.
  5. Speckesser, Stefan & Fitzenberger, Bernd & Bergemann, Annette, 2004. "Evaluating the Dynamic Employment Effects of Training Programs in East Germany Using Conditional Difference-in-Differences," ZEW Discussion Papers 04-41, ZEW - Zentrum für Europäische Wirtschaftsforschung / Center for European Economic Research.
  6. V. Joseph Hotz & Guido W. Imbens & Jacob A. Klerman, 2006. "Evaluating the Differential Effects of Alternative Welfare-to-Work Training Components: A Re-Analysis of the California GAIN Program," NBER Working Papers 11939, National Bureau of Economic Research, Inc.
  7. Stéphane Carcillo & David Grubb, 2006. "From Inactivity to Work: The Role of Active Labour Market Policies," OECD Social, Employment and Migration Working Papers 36, OECD Publishing.
  8. Fredriksson, Peter & Johansson, Per, 2008. "Dynamic Treatment Assignment," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 435-445.
  9. Card, David & Kluve, Jochen & Weber, Andrea, 2009. "Active Labor Market Policy Evaluations: A Meta-Analysis," IZA Discussion Papers 4002, Institute for the Study of Labor (IZA).
  10. Michael Lechner & Conny Wunsch, 2009. "Active labour market policy in East Germany," The Economics of Transition, The European Bank for Reconstruction and Development, vol. 17(4), pages 661-702, October.
  11. Bruno Crépon & Marc Ferracci & Grégory Jolivet & Gerard J. van den Berg, 2008. "“Active Labor Market Policy Effects in a Dynamic Setting”," Working Papers 2008-25, Centre de Recherche en Economie et Statistique.
  12. Völter, Robert & Osikominu, Aderonke & Fitzenberger, Bernd, 2007. "Get Training or Wait? Long-Run Employment Effects of Training Programs for the Unemployed in West Germany," ZEW Discussion Papers 06-39 [rev.], ZEW - Zentrum für Europäische Wirtschaftsforschung / Center for European Economic Research.
  13. Gerard J. van den Berg & Bas van der Klaauw, 2006. "Counseling And Monitoring Of Unemployed Workers: Theory And Evidence From A Controlled Social Experiment," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(3), pages 895-936, 08.
  14. Conny Wunsch & Michael Lechner, 2008. "What Did All the Money Do? On the General Ineffectiveness of Recent West German Labour Market Programmes," Kyklos, Wiley Blackwell, vol. 61(1), pages 134-174, 02.
  15. Biewen, Martin & Fitzenberger, Bernd & Osikominu, Aderonke & Waller, Marie, 2007. "Which Program for Whom? Evidence on the Comparative Effectiveness of Public Sponsored Training Programs in Germany," IZA Discussion Papers 2885, Institute for the Study of Labor (IZA).
  16. Richard Blundell & Monica Costa Dias & Costas Meghir & John Van Reenen, 2004. "Evaluating the Employment Impact of a Mandatory Job Search Program," Journal of the European Economic Association, MIT Press, vol. 2(4), pages 569-606, 06.
  17. Fitzenberger, Bernd & Speckesser, Stefan, 2005. "Employment Effects of the Provision of Specific Professional Skills and Techniques in Germany," ZEW Discussion Papers 05-77, ZEW - Zentrum für Europäische Wirtschaftsforschung / Center for European Economic Research.
  18. Frolich, Markus, 2008. "Statistical Treatment Choice: An Application to Active Labor Market Programs," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 547-558, June.
  19. Peter Dolton & Donal O'Neill, 2002. "The Long-Run Effects of Unemployment Monitoring and Work-Search Programs: Experimental Evidence from the United Kingdom," Journal of Labor Economics, University of Chicago Press, vol. 20(2), pages 381-403, Part.
  20. Heinrich, Carolyn J. & Mueser, Peter R. & Troske, Kenneth & Jeon, Kyung-Seong & Kahvecioglu, Daver C., 2009. "New Estimates of Public Employment and Training Program Net Impacts: A Nonexperimental Evaluation of the Workforce Investment Act Program," IZA Discussion Papers 4569, Institute for the Study of Labor (IZA).
  21. Markus Frölich, 2004. "Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 77-90, February.
  22. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
  23. Aderonke Osikominu, 2013. "Quick Job Entry or Long-Term Human Capital Development? The Dynamic Effects of Alternative Training Schemes," Review of Economic Studies, Oxford University Press, vol. 80(1), pages 313-342.
  24. Dyke, Andrew & Heinrich, Carolyn J. & Mueser, Peter R. & Troske, Kenneth, 2005. "The Effects of Welfare-to-Work Program Activities on Labor Market Outcomes," IZA Discussion Papers 1520, Institute for the Study of Labor (IZA).
  25. Bruno Crépon & Esther Duflo & Marc Gurgand & Roland Rathelot & Philippe Zamora, 2012. "Do Labor Market Policies Have Displacement Effects? Evidence from a Clustered Randomized Experiment," NBER Working Papers 18597, National Bureau of Economic Research, Inc.
  26. Bernd Fitzenberger & Aderonke Osikominu & Robert Völter, 2006. "Imputation Rules to Improve the Education Variable in the IAB Employment Subsample," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 126(3), pages 405-436.
  27. Laura Larsson, 2003. "Evaluation of Swedish Youth Labor Market Programs," Journal of Human Resources, University of Wisconsin Press, vol. 38(4).
  28. Bruno Crépon & Muriel Dejemeppe & Marc Gurgand, 2005. "Counseling the unemployed: does it lower unemployment duration and recurrence?," PSE Working Papers halshs-00590769, HAL.
  29. David Card & Daniel Sullivan, 1987. "Measuring the Effect of Subsidized Training Programs on Movements In andOut of Employment," NBER Working Papers 2173, National Bureau of Economic Research, Inc.
  30. Peter Jacobebbinghaus & Stefan Seth, 2007. "European Data Watch: The German Integrated Employment Biographies Sample IEBS," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 127(2), pages 335-342.
  31. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
  32. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
  33. Hujer, Reinhard & Thomsen, Stephan L. & Zeiss, Christopher, 2006. "The effects of short-term training measures on the individual unemployment duration in West Germany," ZEW Discussion Papers 06-65, ZEW - Zentrum für Europäische Wirtschaftsforschung / Center for European Economic Research.
  34. Weber, Andrea & Hofer, Helmut, 2004. "Employment Effects of Early Interventions on Job Search Programs," IZA Discussion Papers 1076, Institute for the Study of Labor (IZA).
  35. Peter R. Mueser & Kenneth Troske & Alexey Gorislavsky, 2003. "Using State Administrative Data to Measure Program Performance," Working Papers 0309, Department of Economics, University of Missouri.
  36. Abadie, Alberto & Imbens, Guido W., 2011. "Bias-Corrected Matching Estimators for Average Treatment Effects," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 1-11.
  37. Annette BERGEMANN & Gerard J. VAN DEN BERG, 2008. "Active Labor Market Policy Effects for Women in Europe – A Survey," Annales d'Economie et de Statistique, ENSAE, issue 91-92, pages 385-408.
  38. Martin, John P. & Grubb, David, 2001. "What works and for whom: a review of OECD countries' experiences with active labour market policies," Working Paper Series 2001:14, IFAU - Institute for Evaluation of Labour Market and Education Policy.
  39. Wang-Sheng Lee, 2013. "Propensity score matching and variations on the balancing test," Empirical Economics, Springer, vol. 44(1), pages 47-80, February.
  40. Galdo, Jose C. & Smith, Jeffrey A. & Black, Dan A., 2007. "Bandwidth Selection and the Estimation of Treatment Effects with Unbalanced Data," IZA Discussion Papers 3095, Institute for the Study of Labor (IZA).
  41. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, 01.
  42. James J. Heckman, 1989. "Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: The Case of Manpower Training," NBER Working Papers 2861, National Bureau of Economic Research, Inc.
  43. Marie Waller, 2008. "On the Importance of Correcting Reported End Dates of Labor Market Programs," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 128(2), pages 213-236.
  44. Dorsett, Richard, 2006. "The new deal for young people: effect on the labour market status of young men," Labour Economics, Elsevier, vol. 13(3), pages 405-422, June.
  45. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2010. "How to Control for Many Covariates? Reliable Estimators Based on the Propensity Score," IZA Discussion Papers 5268, Institute for the Study of Labor (IZA).
  46. Jochen Kluve & Christoph M. Schmidt, 2002. "Can training and employment subsidies combat European unemployment?," Economic Policy, CEPR & CES & MSH, vol. 17(35), pages 409-448, October.
  47. Heckman, James J & Ichimura, Hidehiko & Todd, Petra E, 1997. "Matching as an Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Wiley Blackwell, vol. 64(4), pages 605-54, October.
  48. Fitzenberger, Bernd & Völter, Robert, 2007. "Long-run effects of training programs for the unemployed in East Germany," ZEW Discussion Papers 07-009, ZEW - Zentrum für Europäische Wirtschaftsforschung / Center for European Economic Research.
  49. Heckman, James J & Smith, Jeffrey A, 1999. "The Pre-programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies," Economic Journal, Royal Economic Society, vol. 109(457), pages 313-48, July.
  50. Lechner, Michael, 1999. "Earnings and Employment Effects of Continuous Off-the-Job Training in East Germany after Unification," Journal of Business & Economic Statistics, American Statistical Association, vol. 17(1), pages 74-90, January.
  51. de Luna, Xavier & Johansson, Per, 2009. "Non-Parametric Inference for the Effect of a Treatment on Survival Times with Application in the Health and Social Sciences," IZA Discussion Papers 3966, Institute for the Study of Labor (IZA).
  52. Burt S. Barnow, 1987. "The Impact of CETA Programs on Earnings: A Review of the Literature," Journal of Human Resources, University of Wisconsin Press, vol. 22(2), pages 157-193.
  53. Jespersen, Svend T. & Munch, Jakob R. & Skipper, Lars, 2008. "Costs and benefits of Danish active labour market programmes," Labour Economics, Elsevier, vol. 15(5), pages 859-884, October.
  54. Jan Boone & Jan Ours, 2009. "Bringing Unemployed Back to Work: Effective Active Labor Market Policies," De Economist, Springer, vol. 157(3), pages 293-313, September.
  55. Inés Hardoy, 2005. "Impact of Multiple Labour Market Programmes on Multiple Outcomes: The Case of Norwegian Youth Programmes ," LABOUR, CEIS, vol. 19(3), pages 425-467, 09.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Moczall, Andreas, 2013. "Subsidies for substitutes? : New evidence on deadweight loss and substitution effects of a wage subsidy for hard-to-place job-seekers," IAB Discussion Paper 201305, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:zur:econwp:091. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Marita Kieser).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.