IDEAS home Printed from https://ideas.repec.org/p/usg/econwp/201421.html
   My bibliography  Save this paper

Assignment Mechanisms, Selection Criteria, and the Effectiveness of Training Programs

Author

Listed:
  • Doerr, Annabelle
  • Strittmatter, Anthony

Abstract

Many studies investigate the effectiveness of active labour market programmes for the unemployed, but there is little evidence regarding effectiveness of the assignment mechanism of such programmes. We exploit a large-scale reform of the allocation of vocational training programmes for unemployed individuals in Germany. We analyse the effectiveness of vocational training under two different assignment mechanisms. The pre-reform direct assignment mechanism is characterised by strong influence of caseworkers who can directly assign the unemployed to training courses. Under the post-reform voucher assignment mechanism unemployed have more freedom to choose among different courses and training providers. Simultaneously with the assignment mechanism the selection criteria for potential training participants is changed. We employ a multiple treatment framework to identify the different effects of interest. Furthermore, we use a formal mediation analysis to isolate the direct effect of the voucher assignment mechanism. We find that an assignment through vouchers reduces the returns to vocational training over the short term. These negative effects fade out in the long run. The new selection rule appears to be poorly constructed and to reduce the effectiveness of training.

Suggested Citation

  • Doerr, Annabelle & Strittmatter, Anthony, 2014. "Assignment Mechanisms, Selection Criteria, and the Effectiveness of Training Programs," Economics Working Paper Series 1421, University of St. Gallen, School of Economics and Political Science, revised May 2017.
  • Handle: RePEc:usg:econwp:2014:21
    as

    Download full text from publisher

    File URL: http://ux-tauri.unisg.ch/RePEc/usg/econwp/EWP-1421.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Barnow, Burt S., 2009. "Vouchers in U.S. vocational training programs : an overview of what we have learned," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 42(1), pages 71-84.
    2. Bell, Stephen H. & Orr, Larry L., 2002. "Screening (and creaming?) applicants to job training programs: the AFDC homemaker-home health aide demonstrations," Labour Economics, Elsevier, vol. 9(2), pages 279-301, April.
    3. David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labour Market Policy Evaluations: A Meta-Analysis," Economic Journal, Royal Economic Society, vol. 120(548), pages 452-477, November.
    4. Jaap H. Abbring & Gerard J. Berg & Jan C. Ours, 2005. "The Effect of Unemployment Insurance Sanctions on the Transition Rate from Unemployment to Employment," Economic Journal, Royal Economic Society, vol. 115(505), pages 602-630, July.
    5. Oscar Mitnik, 2008. "How do Training Programs Assign Participants to Training? Characterizing the Assignment Rules of Government Agencies for Welfare-to-Work Programs in California," Working Papers 0907, University of Miami, Department of Economics.
    6. DiNardo, John & Fortin, Nicole M & Lemieux, Thomas, 1996. "Labor Market Institutions and the Distribution of Wages, 1973-1992: A Semiparametric Approach," Econometrica, Econometric Society, vol. 64(5), pages 1001-1044, September.
    7. Kai-Uwe Müller & Viktor Steiner, 2008. "Imposed Benefit Sanctions and the Unemployment-to-Employment Transition: The German Experience," Discussion Papers of DIW Berlin 792, DIW Berlin, German Institute for Economic Research.
    8. Gerard J. van den Berg & Bas van der Klaauw & Jan C. van Ours, 2004. "Punitive Sanctions and the Transition Rate from Welfare to Work," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 211-241, January.
    9. Kluve, Jochen & Schneider, Hilmar & Uhlendorff, Arne & Zhao, Zhong, 2007. "Evaluating Continuous Training Programs Using the Generalized Propensity Score," IZA Discussion Papers 3255, Institute of Labor Economics (IZA).
    10. Bernd Fitzenberger & Aderonke Osikominu & Robert Völter, 2008. "Get Training or Wait? Long-Run Employment Effects of Training Programs for the Unemployed in West Germany," Annals of Economics and Statistics, GENES, issue 91-92, pages 321-355.
    11. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    12. Gesine Stephan & André Pahnke, 2011. "The Relative Effectiveness Of Selected Active Labor Market Programs: An Empirical Investigation For Germany," Manchester School, University of Manchester, vol. 79(6), pages 1262-1293, December.
    13. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    14. James Heckman, 2011. "Policies to foster human capital," Voprosy obrazovaniya / Educational Studies Moscow, National Research University Higher School of Economics, issue 3, pages 73-137.
    15. Rafael Lalive & Jan C. van Ours & Josef Zweimüller, 2005. "The Effect Of Benefit Sanctions On The Duration Of Unemployment," Journal of the European Economic Association, MIT Press, vol. 3(6), pages 1386-1417, December.
    16. Keisuke Hirano & Guido W. Imbens & Geert Ridder, 2003. "Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score," Econometrica, Econometric Society, vol. 71(4), pages 1161-1189, July.
    17. Lechner, Michael & Smith, Jeffrey, 2007. "What is the value added by caseworkers?," Labour Economics, Elsevier, vol. 14(2), pages 135-151, April.
    18. Ulf Rinne & Marc Schneider & Arne Uhlendorff, 2011. "Do the skilled and prime-aged unemployed benefit more from training? Effect heterogeneity of public training programmes in Germany," Applied Economics, Taylor & Francis Journals, vol. 43(25), pages 3465-3494.
    19. Fortin, Nicole & Lemieux, Thomas & Firpo, Sergio, 2011. "Decomposition Methods in Economics," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 4, chapter 1, pages 1-102, Elsevier.
    20. Stefanie Behncke & Markus Frölich & Michael Lechner, 2010. "Unemployed and their caseworkers: should they be friends or foes?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 173(1), pages 67-92, January.
    21. Conny Wunsch & Michael Lechner, 2008. "What Did All the Money Do? On the General Ineffectiveness of Recent West German Labour Market Programmes," Kyklos, Wiley Blackwell, vol. 61(1), pages 134-174, February.
    22. Graversen, Brian Krogh & van Ours, Jan C., 2008. "How to help unemployed find jobs quickly: Experimental evidence from a mandatory activation program," Journal of Public Economics, Elsevier, vol. 92(10-11), pages 2020-2035, October.
    23. Reinhard Hujer & Stephan Thomsen & Christopher Zeiss, 2006. "The effects of vocational training programmes on the duration of unemployment in Eastern Germany," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 90(2), pages 299-321, June.
    24. Lechner Michael & Miquel Ruth & Wunsch Conny, 2007. "The Curse and Blessing of Training the Unemployed in a Changing Economy: The Case of East Germany After Unification," German Economic Review, De Gruyter, vol. 8(4), pages 468-509, December.
    25. Bryan S. Graham & Cristine Campos de Xavier Pinto & Daniel Egel, 2016. "Efficient Estimation of Data Combination Models by the Method of Auxiliary-to-Study Tilting (AST)," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(2), pages 288-301, April.
    26. Michael Lechner & Anthony Strittmatter, 2019. "Practical procedures to deal with common support problems in matching estimation," Econometric Reviews, Taylor & Francis Journals, vol. 38(2), pages 193-207, February.
    27. Fredriksson, Peter & Johansson, Per, 2008. "Dynamic Treatment Assignment," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 435-445.
    28. Paul, Marie & Dörr, Annabelle & Fitzenberger, Bernd & Kruppe, Thomas & Strittmatter, Anthony, 2013. "The Award of a Training Voucher and Labor Market Outcomes," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79918, Verein für Socialpolitik / German Economic Association.
    29. Carlos A. Flores & Alfonso Flores-Lagunes & Arturo Gonzalez & Todd C. Neumann, 2012. "Estimating the Effects of Length of Exposure to Instruction in a Training Program: The Case of Job Corps," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 153-171, February.
    30. Fitzenberger, Bernd & Osikominu, Aderonke & Paul, Marie, 2010. "The Heterogeneous Effects of Training Incidence and Duration on Labor Market Transitions," IZA Discussion Papers 5269, Institute of Labor Economics (IZA).
    31. Biewen, Martin & Fitzenberger, Bernd & Osikominu, Aderonke & Waller, Marie, 2007. "Which Program for Whom? Evidence on the Comparative Effectiveness of Public Sponsored Training Programs in Germany," IZA Discussion Papers 2885, Institute of Labor Economics (IZA).
    32. James J. Heckman & Carolyn Heinrich & Jeffrey Smith, 2002. "The Performance of Performance Standards," Journal of Human Resources, University of Wisconsin Press, vol. 37(4), pages 778-811.
    33. Mark C. Berger & Dan Black & Jeffrey Smith, 2000. "Evaluating Profiling as a Means of Allocating Government Services," University of Western Ontario, Departmental Research Report Series 200018, University of Western Ontario, Department of Economics.
    34. Fitzenberger, Bernd & Volter, Robert, 2007. "Long-run effects of training programs for the unemployed in East Germany," Labour Economics, Elsevier, vol. 14(4), pages 730-755, August.
    35. Müller, Kai-Uwe & Steiner, Viktor, 2008. "Imposed Benefit Sanctions and the Unemployment-to-Employment Transition: The German Experience," IZA Discussion Papers 3483, Institute of Labor Economics (IZA).
    36. Dehejia, Rajeev H., 2005. "Program evaluation as a decision problem," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 141-173.
    37. Barnow, Burt S., 2009. "Vouchers in U.S. vocational training programs : an overview of what we have learned," Zeitschrift für ArbeitsmarktForschung - Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 42(1), pages 71-84.
    38. Robert E. Prasch & Falguni A. Sheth, 2000. "What Is Wrong with Education Vouchers?," Journal of Economic Issues, Taylor & Francis Journals, vol. 34(2), pages 509-515, June.
    39. Heinrich, Carolyn J. & Mueser, Peter R. & Troske, Kenneth & Jeon, Kyung-Seong & Kahvecioglu, Daver C., 2009. "New Estimates of Public Employment and Training Program Net Impacts: A Nonexperimental Evaluation of the Workforce Investment Act Program," IZA Discussion Papers 4569, Institute of Labor Economics (IZA).
    40. Randall W. Eberts & Christopher J. O'Leary & Stephen A. Wandner (ed.), 2002. "Targeting Employment Services," Books from Upjohn Press, W.E. Upjohn Institute for Employment Research, number tes, December.
    41. Ulf Rinne & Arne Uhlendorff & Zhong Zhao, 2013. "Vouchers and caseworkers in training programs for the unemployed," Empirical Economics, Springer, vol. 45(3), pages 1089-1127, December.
    42. repec:bla:germec:v:8:y:2007:i::p:468-509 is not listed on IDEAS
    43. Jochen Kluve & Hilmar Schneider & Arne Uhlendorff & Zhong Zhao, 2012. "Evaluating continuous training programmes by using the generalized propensity score," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 587-617, April.
    44. repec:adr:anecst:y:2008:i:91-92:p:15 is not listed on IDEAS
    45. Jochen Kluve & Hilmar Schneider & Arne Uhlendorff & Zhong Zhao, 2012. "Evaluating continuous training programmes by using the generalized propensity score," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(2), pages 587-617, April.
    46. Dan A. Black & Jeffrey A. Smith & Mark C. Berger & Brett J. Noel, 2003. "Is the Threat of Reemployment Services More Effective Than the Services Themselves? Evidence from Random Assignment in the UI System," American Economic Review, American Economic Association, vol. 93(4), pages 1313-1327, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Martin Huber & Michael Lechner & Anthony Strittmatter, 2018. "Direct and indirect effects of training vouchers for the unemployed," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 181(2), pages 441-463, February.
    2. Massimiliano Bratti & Corinna Ghirelli & Enkelejda Havari & Giulia Santangelo, 2022. "Vocational training for unemployed youth in Latvia," Journal of Population Economics, Springer;European Society for Population Economics, vol. 35(2), pages 677-717, April.
    3. Anthony Strittmatter, 2016. "What effect do vocational training vouchers have on the unemployed?," IZA World of Labor, Institute of Labor Economics (IZA), pages 316-316, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ulf Rinne & Arne Uhlendorff & Zhong Zhao, 2013. "Vouchers and caseworkers in training programs for the unemployed," Empirical Economics, Springer, vol. 45(3), pages 1089-1127, December.
    2. Paul, Marie & Dörr, Annabelle & Fitzenberger, Bernd & Kruppe, Thomas & Strittmatter, Anthony, 2013. "The Award of a Training Voucher and Labor Market Outcomes," VfS Annual Conference 2013 (Duesseldorf): Competition Policy and Regulation in a Global Economic Order 79918, Verein für Socialpolitik / German Economic Association.
    3. Kelly, Elish & McGuinness, Seamus & O'Connell, Philip J., 2011. "What Can Active Labour Market Policies Do?," Papers EC1, Economic and Social Research Institute (ESRI).
    4. Annabelle Doerr & Bernd Fitzenberger & Thomas Kruppe & Marie Paul & Anthony Strittmatter, 2017. "Employment and Earnings Effects of Awarding Training Vouchers in Germany," ILR Review, Cornell University, ILR School, vol. 70(3), pages 767-812, May.
    5. Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2022. "Heterogeneous Employment Effects of Job Search Programs: A Machine Learning Approach," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 597-636.
    6. Gerd Heyer & Susanne Koch & Gesine Stephan & Joachim Wolff, 2012. "Evaluation der aktiven Arbeitsmarktpolitik: Ein Sachstandsbericht für die Instrumentenreform 2011 [Evaluation of active labor market programs: a summary of recent results for the German program ref," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 45(1), pages 41-62, March.
    7. Heyer, Gerd & Koch, Susanne & Stephan, Gesine & Wolff, Joachim, 2012. "Evaluation der aktiven Arbeitsmarktpolitik: Ein Sachstandsbericht für die Instrumentenreform 2011 (Evaluation of active labor market programs : a summary of recent results for the German program refor," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 45(1), pages 41-62.
    8. Stephan, Gesine & Pahnke, André, 2008. "The Relative Effectiveness of Selected Active Labour Market Programmes and the Common Support Problem," IZA Discussion Papers 3767, Institute of Labor Economics (IZA).
    9. Thomas Kruppe & Julia Lang, 2018. "Labour market effects of retraining for the unemployed: the role of occupations," Applied Economics, Taylor & Francis Journals, vol. 50(14), pages 1578-1600, March.
    10. Sarah Bernhard & Thomas Kruppe, 2012. "Effectiveness of Further Vocational Training in Germany – Empirical Findings for Persons Receiving Means-tested Unemployment Benefits," Schmollers Jahrbuch : Journal of Applied Social Science Studies / Zeitschrift für Wirtschafts- und Sozialwissenschaften, Duncker & Humblot, Berlin, vol. 132(4), pages 501-526.
    11. Seamus McGuinness & Philip J. O'Connell & Elish Kelly, 2014. "The Impact of Training Programme Type and Duration on the Employment Chances of the Unemployed in Ireland," The Economic and Social Review, Economic and Social Studies, vol. 45(3), pages 425-450.
    12. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    13. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    14. McGuinness, Seamus & O'Connell, Philip J. & Kelly, Elish & Walsh, John R., 2011. "Activation in Ireland: An Evaluation of the National Employment Action Plan," Research Series, Economic and Social Research Institute (ESRI), number RS20.
    15. Huber, Martin & Lechner, Michael & Wunsch, Conny, 2013. "The performance of estimators based on the propensity score," Journal of Econometrics, Elsevier, vol. 175(1), pages 1-21.
    16. Chung Choe & Alfonso Flores-Lagunes & Sang-Jun Lee, 2015. "Do dropouts with longer training exposure benefit from training programs? Korean evidence employing methods for continuous treatments," Empirical Economics, Springer, vol. 48(2), pages 849-881, March.
    17. Lechner, Michael & Smith, Jeffrey, 2007. "What is the value added by caseworkers?," Labour Economics, Elsevier, vol. 14(2), pages 135-151, April.
    18. Stefanie Behncke & Markus Frölich & Michael Lechner, 2009. "Targeting Labour Market Programmes - Results from a Randomized Experiment," Swiss Journal of Economics and Statistics (SJES), Swiss Society of Economics and Statistics (SSES), vol. 145(III), pages 221-268, September.
    19. Singer, Christine & Toomet, Ott-Siim, 2013. "On government-subsidized training programs for older workers," IAB-Discussion Paper 201321, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    20. Tito Boeri & Jan van Ours, 2013. "The Economics of Imperfect Labor Markets: Second Edition," Economics Books, Princeton University Press, edition 1, number 10142.

    More about this item

    Keywords

    Active Labor Market Policies; Treatment Effects Evaluation; Administrative Data; Voucher;
    All these keywords.

    JEL classification:

    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy
    • H43 - Public Economics - - Publicly Provided Goods - - - Project Evaluation; Social Discount Rate
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:usg:econwp:2014:21. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/vwasgch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.