IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp10531.html
   My bibliography  Save this paper

Comparing Econometric Methods to Empirically Evaluate Job-Search Assistance

Author

Listed:
  • Muller, Paul

    () (University of Gothenburg)

  • van der Klaauw, Bas

    () (Vrije Universiteit Amsterdam)

  • Heyma, Arjan

    () (SEO Economic Research)

Abstract

We test whether different empirical methods give different results when evaluating job-search assistance programs. Budgetary problems at the Dutch unemployment insurance (UI) administration in March 2010, caused a sharp drop in the availability of these programs. Using administrative data provided by the UI administration, we evaluate the effect of the program using (1) the policy discontinuity as a quasi-experiment, (2) conventional matching methods, and (3) the timing-of-events model. All three methods use the same data to consider the same program in the same setting, and also yield similar results. The program reduces job finding during the first six months after enrollment. At longer durations, the quasi-experimental estimates are not significantly different from zero, while the non-experimental methods show a small negative effect.

Suggested Citation

  • Muller, Paul & van der Klaauw, Bas & Heyma, Arjan, 2017. "Comparing Econometric Methods to Empirically Evaluate Job-Search Assistance," IZA Discussion Papers 10531, Institute for the Study of Labor (IZA).
  • Handle: RePEc:iza:izadps:dp10531
    as

    Download full text from publisher

    File URL: http://ftp.iza.org/dp10531.pdf
    Download Restriction: no

    Other versions of this item:

    References listed on IDEAS

    as
    1. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    2. Gerard J. van den Berg & Bas van der Klaauw, 2006. "Counseling And Monitoring Of Unemployed Workers: Theory And Evidence From A Controlled Social Experiment," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(3), pages 895-936, August.
    3. repec:hal:journl:halshs-01067926 is not listed on IDEAS
    4. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    5. Luc Behaghel & Bruno Cr?pon & Marc Gurgand, 2014. "Private and Public Provision of Counseling to Job Seekers: Evidence from a Large Controlled Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 142-174, October.
    6. David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labour Market Policy Evaluations: A Meta-Analysis," Economic Journal, Royal Economic Society, vol. 120(548), pages 452-477, November.
    7. Gerard Van Den Berg & Antoine Bozio & Monica Costa Dias, 2013. "Policy discontinuity and duration outcomes," IFS Working Papers W13/27, Institute for Fiscal Studies.
    8. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    9. Jaap H. Abbring & Gerard J. Berg & Jan C. Ours, 2005. "The Effect of Unemployment Insurance Sanctions on the Transition Rate from Unemployment to Employment," Economic Journal, Royal Economic Society, vol. 115(505), pages 602-630, July.
    10. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    11. Gerard J. van den Berg & Bas van der Klaauw & Jan C. van Ours, 2004. "Punitive Sanctions and the Transition Rate from Welfare to Work," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 211-241, January.
    12. Peter Dolton & Donal O'Neill, 2002. "The Long-Run Effects of Unemployment Monitoring and Work-Search Programs: Experimental Evidence from the United Kingdom," Journal of Labor Economics, University of Chicago Press, vol. 20(2), pages 381-403, Part.
    13. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, August.
    14. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    15. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6b, January.
    16. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    17. Michael Lechner & Conny Wunsch, 2009. "Are Training Programs More Effective When Unemployment Is High?," Journal of Labor Economics, University of Chicago Press, vol. 27(4), pages 653-692, October.
    18. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    19. Rafael Lalive & Jan C. van Ours & Josef Zweimüller, 2005. "The Effect Of Benefit Sanctions On The Duration Of Unemployment," Journal of the European Economic Association, MIT Press, vol. 3(6), pages 1386-1417, December.
    20. Kluve, Jochen, 2010. "The effectiveness of European active labor market programs," Labour Economics, Elsevier, vol. 17(6), pages 904-918, December.
    21. Busso, Matias & DiNardo, John & McCrary, Justin, 2009. "New Evidence on the Finite Sample Properties of Propensity Score Matching and Reweighting Estimators," IZA Discussion Papers 3998, Institute for the Study of Labor (IZA).
    22. repec:adr:anecst:y:2012:i:107-108:p:7 is not listed on IDEAS
    23. Graversen, Brian Krogh & van Ours, Jan C., 2008. "How to help unemployed find jobs quickly: Experimental evidence from a mandatory activation program," Journal of Public Economics, Elsevier, vol. 92(10-11), pages 2020-2035, October.
    24. Abbring, Jaap H & van den Berg, Gerard J, 2005. "Social experiments and intrumental variables with duration outcomes," Working Paper Series 2005:11, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    25. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    26. Abadie, Alberto & Imbens, Guido W., 2011. "Bias-Corrected Matching Estimators for Average Treatment Effects," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 1-11.
    27. Cockx, Bart & Dejemeppe, Muriel, 2012. "Monitoring job search effort: An evaluation based on a regression discontinuity design," Labour Economics, Elsevier, vol. 19(5), pages 729-737.
    28. David Card & Pablo Ibarrarán & Ferdinando Regalia & David Rosas-Shady & Yuri Soares, 2011. "The Labor Market Impacts of Youth Training in the Dominican Republic," Journal of Labor Economics, University of Chicago Press, vol. 29(2), pages 267-300.
    29. Guido W. Imbens, 2015. "Matching Methods in Practice: Three Examples," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 373-419.
    30. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    31. De Groot, Nynke & van der Klaauw, Bas, 2014. "The Effects of Reducing the Entitlement Period to Unemployment Insurance Benefits," IZA Discussion Papers 8336, Institute for the Study of Labor (IZA).
    32. Bruno Crépon & Marc Ferracci & Denis Fougere, 2012. "Training the Unemployed in France: How Does it Affect Unemployment Duration and Recurrence?," Annals of Economics and Statistics, GENES, issue 107-108, pages 175-199.
    33. repec:adr:anecst:y:2012:i:107-108 is not listed on IDEAS
    34. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6a, January.
    35. Card, David & Sullivan, Daniel G, 1988. "Measuring the Effect of Subsidized Training Programs on Movements in and out of Employment," Econometrica, Econometric Society, vol. 56(3), pages 497-530, May.
    36. Kastoryano, Stephen & van der Klaauw, Bas, 2011. "Dynamic Evaluation of Job Search Assistance," IZA Discussion Papers 5424, Institute for the Study of Labor (IZA).
    37. Bas Van der Klaauw & Jan C. Van Ours, 2013. "Carrot And Stick: How Re‐Employment Bonuses And Benefit Sanctions Affect Exit Rates From Welfare," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 275-296, March.
    38. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, September.
    39. Rafael Lalive & JanC. vanOurs & Josef Zweimüller, 2008. "The Impact of Active Labour Market Programmes on The Duration of Unemployment in Switzerland," Economic Journal, Royal Economic Society, vol. 118(525), pages 235-257, January.
    Full references (including those not matched with items on IDEAS)

    More about this item

    Keywords

    empirical policy evaluation; job-search assistance; unemployment duration;

    JEL classification:

    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C31 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models; Quantile Regressions; Social Interaction Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp10531. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Fallak). General contact details of provider: http://www.iza.org .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.