IDEAS home Printed from https://ideas.repec.org/p/jku/nrnwps/2009_02.html
   My bibliography  Save this paper

Active Labor Market Policy Evaluations: A Meta-analysis

Author

Abstract

This paper presents a meta-analysis of recent microeconometric evaluations of active labor market policies. Our sample consists of 199 program estimates drawn from 97 studies conducted between 1995 and 2007. In about one-half of these cases we have both a short-term impact estimate (for a one-year post-program horizon) and a medium-term estimate (two-year horizon). We characterize the program estimates according to the type and duration of the program, the characteristics of the participants, and the evaluation methodology. Heterogeneity in all three dimensions affects the likelihood that an impact estimate is significantly positive, significantly negative, or statistically insignificant. Comparing program types, subsidized public sector employment programs have the least favorable impact estimates. Job search assistance programs have relatively favorable short-run impacts, whereas classroom and on-the-job training programs tend to show better outcomes in the medium-run than the short-run. Programs for youths are less likely to yield positive impacts than untargeted programs, but there are no large or systematic differences by gender. Methodologically, we find that the outcome variable used to measure program effectiveness matters. Evaluations based on registered unemployment durations are more likely to show favorable short-term impacts. Controlling for the outcome measure, and the type of program and participants, we find that experimental and non-experimental studies have similar fractions of significant negative and significant positive impact estimates, suggesting that the research designs used in recent non-experimental evaluations are unbiased.

Suggested Citation

  • David E. Card & Jochen Kluve & Andrea Weber, 2009. "Active Labor Market Policy Evaluations: A Meta-analysis," NRN working papers 2009-02, The Austrian Center for Labor Economics and the Analysis of the Welfare State, Johannes Kepler University Linz, Austria.
  • Handle: RePEc:jku:nrnwps:2009_02
    as

    Download full text from publisher

    File URL: http://www.labornrn.at/wp/wp0902.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    2. Michael Lechner & Conny Wunsch, 2006. "Active Labour Market Policy in East Germany: Waiting for the Economy to Take Off," University of St. Gallen Department of Economics working paper series 2006 2006-24, Department of Economics, University of St. Gallen.
    3. David Card & Raj Chetty & Andrea Weber, 2007. "The Spike at Benefit Exhaustion: Leaving the Unemployment System or Starting a New Job?," American Economic Review, American Economic Association, vol. 97(2), pages 113-118, May.
    4. V. Joseph Hotz & Guido W. Imbens & Jacob A. Klerman, 2006. "Evaluating the Differential Effects of Alternative Welfare-to-Work Training Components: A Reanalysis of the California GAIN Program," Journal of Labor Economics, University of Chicago Press, vol. 24(3), pages 521-566, July.
    5. Ashenfelter, Orley C, 1978. "Estimating the Effect of Training Programs on Earnings," The Review of Economics and Statistics, MIT Press, vol. 60(1), pages 47-57, February.
    6. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    7. Kluve, Jochen, 2010. "The effectiveness of European active labor market programs," Labour Economics, Elsevier, vol. 17(6), pages 904-918, December.
    8. Annette Bergemann & Gerard J. Van Den Berg, 2008. "Active Labor Market Policy Effects for Women in Europe - A Survey," Annals of Economics and Statistics, GENES, issue 91-92, pages 385-408.
    9. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    10. Biewen, Martin & Fitzenberger, Bernd & Osikominu, Aderonke & Waller, Marie, 2007. "Which Program for Whom? Evidence on the Comparative Effectiveness of Public Sponsored Training Programs in Germany," IZA Discussion Papers 2885, Institute of Labor Economics (IZA).
    11. Heckman, James J. & Lalonde, Robert J. & Smith, Jeffrey A., 1999. "The economics and econometrics of active labor market programs," Handbook of Labor Economics, in: O. Ashenfelter & D. Card (ed.), Handbook of Labor Economics, edition 1, volume 3, chapter 31, pages 1865-2097, Elsevier.
    12. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    13. Ashenfelter, Orley & Card, David, 1985. "Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs," The Review of Economics and Statistics, MIT Press, vol. 67(4), pages 648-660, November.
    14. James Heckman & Hidehiko Ichimura & Jeffrey Smith & Petra Todd, 1998. "Characterizing Selection Bias Using Experimental Data," Econometrica, Econometric Society, vol. 66(5), pages 1017-1098, September.
    15. Richardson, Katarina & van den Berg, Gerard J., 2002. "The effect of vocational employment training on the individual transition rate from unemployment to work," Working Paper Series 2002:8, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    16. Ashenfelter, Orley, 1987. "The case for evaluating training programs with randomized trials," Economics of Education Review, Elsevier, vol. 6(4), pages 333-338, August.
    17. Jespersen, Svend T. & Munch, Jakob R. & Skipper, Lars, 2008. "Costs and benefits of Danish active labour market programmes," Labour Economics, Elsevier, vol. 15(5), pages 859-884, October.
    18. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," Review of Economic Studies, Oxford University Press, vol. 65(2), pages 261-294.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    2. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    3. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    4. Gueorgui Kambourov & Iourii Manovskii & Miana Plesca, 2020. "Occupational mobility and the returns to training," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(1), pages 174-211, February.
    5. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    6. David Card & Jochen Kluve & Andrea Weber, 2009. "Active Labor Market Policy Evaluations – A Meta-analysis," Ruhr Economic Papers 0086, Rheinisch-Westfälisches Institut für Wirtschaftsforschung, Ruhr-Universität Bochum, Universität Dortmund, Universität Duisburg-Essen.
    7. David Card & Jochen Kluve & Andrea Weber, 2018. "What Works? A Meta Analysis of Recent Active Labor Market Program Evaluations," Journal of the European Economic Association, European Economic Association, vol. 16(3), pages 894-931.
    8. repec:zbw:rwirep:0086 is not listed on IDEAS
    9. Dettmann, E. & Becker, C. & Schmeißer, C., 2011. "Distance functions for matching in small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(5), pages 1942-1960, May.
    10. Cho,Yoonyoung & Kalomba, Davie & Mobarak,Ahmed Mushfiq & Orozco Olvera,Victor Hugo & Cho,Yoonyoung & Kalomba, Davie & Mobarak,Ahmed Mushfiq & Orozco Olvera,Victor Hugo, 2013. "Gender differences in the effects of vocational training : constraints on women and drop-out behavior," Policy Research Working Paper Series 6545, The World Bank.
    11. Richard Blundell & Monica Costa Dias, 2009. "Alternative Approaches to Evaluation in Empirical Microeconomics," Journal of Human Resources, University of Wisconsin Press, vol. 44(3).
    12. Biewen, Martin & Fitzenberger, Bernd & Osikominu, Aderonke & Waller, Marie, 2007. "Which Program for Whom? Evidence on the Comparative Effectiveness of Public Sponsored Training Programs in Germany," ZEW Discussion Papers 07-042, ZEW - Leibniz Centre for European Economic Research.
    13. Thomas Kruppe & Julia Lang, 2018. "Labour market effects of retraining for the unemployed: the role of occupations," Applied Economics, Taylor & Francis Journals, vol. 50(14), pages 1578-1600, March.
    14. Jones A.M & Rice N, 2009. "Econometric Evaluation of Health Policies," Health, Econometrics and Data Group (HEDG) Working Papers 09/09, HEDG, c/o Department of Economics, University of York.
    15. Centeno, Luis & Centeno, Mário & Novo, Álvaro A., 2009. "Evaluating job-search programs for old and young individuals: Heterogeneous impact on unemployment duration," Labour Economics, Elsevier, vol. 16(1), pages 12-25, January.
    16. Chabé-Ferret, Sylvain, 2015. "Analysis of the bias of Matching and Difference-in-Difference under alternative earnings and selection processes," Journal of Econometrics, Elsevier, vol. 185(1), pages 110-123.
    17. Rainer Eppel & Helmut Mahringer, 2012. "Do wage subsidies work in boosting economic inclusion? Evidence on e," EcoMod2012 4065, EcoMod.
    18. Hämäläinen, Kari & Ollikainen, Virve, 2004. "Differential Effects of Active Labour Market Programmes in the Early Stages of Young People's Unemployment," Research Reports 115, VATT Institute for Economic Research.
    19. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    20. Carlos A. Flores & Oscar A. Mitnik, 2009. "Evaluating Nonexperimental Estimators for Multiple Treatments: Evidence from Experimental Data," Working Papers 2010-10, University of Miami, Department of Economics.
    21. Maitra, Pushkar & Mani, Subha, 2017. "Learning and earning: Evidence from a randomized evaluation in India," Labour Economics, Elsevier, vol. 45(C), pages 116-130.

    More about this item

    JEL classification:

    • H53 - Public Economics - - National Government Expenditures and Related Policies - - - Government Expenditures and Welfare Programs
    • J08 - Labor and Demographic Economics - - General - - - Labor Economics Policies

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jku:nrnwps:2009_02. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (René Böheim). General contact details of provider: https://edirc.repec.org/data/aclawat.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.