IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Comparing Econometric Methods to Empirically Evaluate Job-Search Assistance

Listed author(s):
  • Muller, Paul

    ()

    (University of Gothenburg)

  • van der Klaauw, Bas

    ()

    (Vrije Universiteit Amsterdam)

  • Heyma, Arjan

    ()

    (SEO Economic Research)

Registered author(s):

    We test whether different empirical methods give different results when evaluating job-search assistance programs. Budgetary problems at the Dutch unemployment insurance (UI) administration in March 2010, caused a sharp drop in the availability of these programs. Using administrative data provided by the UI administration, we evaluate the effect of the program using (1) the policy discontinuity as a quasi-experiment, (2) conventional matching methods, and (3) the timing-of-events model. All three methods use the same data to consider the same program in the same setting, and also yield similar results. The program reduces job finding during the first six months after enrollment. At longer durations, the quasi-experimental estimates are not significantly different from zero, while the non-experimental methods show a small negative effect.

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

    File URL: http://ftp.iza.org/dp10531.pdf
    Download Restriction: no

    Paper provided by Institute for the Study of Labor (IZA) in its series IZA Discussion Papers with number 10531.

    as
    in new window

    Length: 58 pages
    Date of creation: Jan 2017
    Handle: RePEc:iza:izadps:dp10531
    Contact details of provider: Postal:
    IZA, P.O. Box 7240, D-53072 Bonn, Germany

    Phone: +49 228 3894 223
    Fax: +49 228 3894 180
    Web page: http://www.iza.org

    Order Information: Postal: IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany
    Email:


    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

    as
    in new window


    1. Gerard J. van den Berg & Bas van der Klaauw, 2006. "Counseling And Monitoring Of Unemployed Workers: Theory And Evidence From A Controlled Social Experiment," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(3), pages 895-936, 08.
    2. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    3. repec:hal:journl:halshs-01067926 is not listed on IDEAS
    4. Luc Behaghel & Bruno Cr?pon & Marc Gurgand, 2014. "Private and Public Provision of Counseling to Job Seekers: Evidence from a Large Controlled Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 142-174, October.
    5. David Card & Jochen Kluve & Andrea Weber, 2010. "Active Labour Market Policy Evaluations: A Meta-Analysis," Economic Journal, Royal Economic Society, vol. 120(548), pages 452-477, November.
    6. Gerard Van Den Berg & Antoine Bozio & Monica Costa Dias, 2013. "Policy discontinuity and duration outcomes," IFS Working Papers W13/27, Institute for Fiscal Studies.
    7. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    8. Jaap H. Abbring & Gerard J. Berg & Jan C. Ours, 2005. "The Effect of Unemployment Insurance Sanctions on the Transition Rate from Unemployment to Employment," Economic Journal, Royal Economic Society, vol. 115(505), pages 602-630, 07.
    9. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    10. Gerard J. van den Berg & Bas van der Klaauw & Jan C. van Ours, 2004. "Punitive Sanctions and the Transition Rate from Welfare to Work," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 211-241, January.
    11. Peter Dolton & Donal O'Neill, 2002. "The Long-Run Effects of Unemployment Monitoring and Work-Search Programs: Experimental Evidence from the United Kingdom," Journal of Labor Economics, University of Chicago Press, vol. 20(2), pages 381-403, Part.
    12. Michael Lechner & Ruth Miquel & Conny Wunsch, 2011. "Long‐Run Effects Of Public Sector Sponsored Training In West Germany," Journal of the European Economic Association, European Economic Association, vol. 9(4), pages 742-784, 08.
    13. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2014. "The Effectiveness of Public-Sponsored Training Revisited: The Importance of Data and Methodological Choices," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 837-897.
    14. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6b.
    15. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    16. Michael Lechner & Conny Wunsch, 2009. "Are Training Programs More Effective When Unemployment Is High?," Journal of Labor Economics, University of Chicago Press, vol. 27(4), pages 653-692, October.
    17. Peter R. Mueser & Kenneth R. Troske & Alexey Gorislavsky, 2007. "Using State Administrative Data to Measure Program Performance," The Review of Economics and Statistics, MIT Press, vol. 89(4), pages 761-783, November.
    18. Rafael Lalive & Jan C. van Ours & Josef Zweimüller, 2005. "The Effect Of Benefit Sanctions On The Duration Of Unemployment," Journal of the European Economic Association, MIT Press, vol. 3(6), pages 1386-1417, December.
    19. Kluve, Jochen, 2010. "The effectiveness of European active labor market programs," Labour Economics, Elsevier, vol. 17(6), pages 904-918, December.
    20. Busso, Matias & DiNardo, John & McCrary, Justin, 2009. "New Evidence on the Finite Sample Properties of Propensity Score Matching and Reweighting Estimators," IZA Discussion Papers 3998, Institute for the Study of Labor (IZA).
    21. repec:adr:anecst:y:2012:i:107-108:p:7 is not listed on IDEAS
    22. Graversen, Brian Krogh & van Ours, Jan C., 2008. "How to help unemployed find jobs quickly: Experimental evidence from a mandatory activation program," Journal of Public Economics, Elsevier, vol. 92(10-11), pages 2020-2035, October.
    23. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    24. Abbring, Jaap H & van den Berg, Gerard J, 2005. "Social experiments and intrumental variables with duration outcomes," Working Paper Series 2005:11, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    25. Abadie, Alberto & Imbens, Guido W., 2011. "Bias-Corrected Matching Estimators for Average Treatment Effects," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 1-11.
    26. Cockx, Bart & Dejemeppe, Muriel, 2012. "Monitoring job search effort: An evaluation based on a regression discontinuity design," Labour Economics, Elsevier, vol. 19(5), pages 729-737.
    27. David Card & Pablo Ibarrarán & Ferdinando Regalia & David Rosas-Shady & Yuri Soares, 2011. "The Labor Market Impacts of Youth Training in the Dominican Republic," Journal of Labor Economics, University of Chicago Press, vol. 29(2), pages 267-300.
    28. Guido W. Imbens, 2015. "Matching Methods in Practice: Three Examples," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 373-419.
    29. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    30. De Groot, Nynke & van der Klaauw, Bas, 2014. "The Effects of Reducing the Entitlement Period to Unemployment Insurance Benefits," IZA Discussion Papers 8336, Institute for the Study of Labor (IZA).
    31. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    32. Bruno Crépon & Marc Ferracci & Denis Fougere, 2012. "Training the Unemployed in France: How Does it Affect Unemployment Duration and Recurrence?," Annals of Economics and Statistics, GENES, issue 107-108, pages 175-199.
    33. repec:adr:anecst:y:2012:i:107-108 is not listed on IDEAS
    34. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6a.
    35. Card, David & Sullivan, Daniel G, 1988. "Measuring the Effect of Subsidized Training Programs on Movements in and out of Employment," Econometrica, Econometric Society, vol. 56(3), pages 497-530, May.
    36. Kastoryano, Stephen & van der Klaauw, Bas, 2011. "Dynamic Evaluation of Job Search Assistance," IZA Discussion Papers 5424, Institute for the Study of Labor (IZA).
    37. Bas Van der Klaauw & Jan C. Van Ours, 2013. "Carrot And Stick: How Re‐Employment Bonuses And Benefit Sanctions Affect Exit Rates From Welfare," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 275-296, 03.
    38. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, 09.
    39. Rafael Lalive & JanC. vanOurs & Josef Zweimüller, 2008. "The Impact of Active Labour Market Programmes on The Duration of Unemployment in Switzerland," Economic Journal, Royal Economic Society, vol. 118(525), pages 235-257, 01.
    Full references (including those not matched with items on IDEAS)

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp10531. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Fallak)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.