IDEAS home Printed from https://ideas.repec.org/
MyIDEAS: Log in (now much improved!) to save this paper

Comparing Econometric Methods to Empirically Evaluate Job-Search Assistance

Listed author(s):
  • Muller, Paul

    ()

    (University of Gothenburg)

  • van der Klaauw, Bas

    ()

    (Vrije Universiteit Amsterdam)

  • Heyma, Arjan

    ()

    (SEO Economic Research)

Registered author(s):

    We test whether different empirical methods give different results when evaluating job-search assistance programs. Budgetary problems at the Dutch unemployment insurance (UI) administration in March 2010, caused a sharp drop in the availability of these programs. Using administrative data provided by the UI administration, we evaluate the effect of the program using (1) the policy discontinuity as a quasi-experiment, (2) conventional matching methods, and (3) the timing-of-events model. All three methods use the same data to consider the same program in the same setting, and also yield similar results. The program reduces job finding during the first six months after enrollment. At longer durations, the quasi-experimental estimates are not significantly different from zero, while the non-experimental methods show a small negative effect.

    If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

    File URL: http://ftp.iza.org/dp10531.pdf
    Download Restriction: no

    Paper provided by Institute for the Study of Labor (IZA) in its series IZA Discussion Papers with number 10531.

    as
    in new window

    Length: 58 pages
    Date of creation: Jan 2017
    Handle: RePEc:iza:izadps:dp10531
    Contact details of provider: Postal:
    IZA, P.O. Box 7240, D-53072 Bonn, Germany

    Phone: +49 228 3894 223
    Fax: +49 228 3894 180
    Web page: http://www.iza.org

    Order Information: Postal: IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany
    Email:


    References listed on IDEAS
    Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

    as
    in new window


    1. van den Berg, Gerard J & van der Klaauw, Bas, 2001. "Counselling and Monitoring of Unemployed Workers: Theory and Evidence from a Controlled Social Experiment," CEPR Discussion Papers 2986, C.E.P.R. Discussion Papers.
    2. Behaghel, Luc & Crépon, Bruno & Gurgand, Marc, 2012. "Private and Public Provision of Counseling to Job-Seekers: Evidence from a Large Controlled Experiment," IZA Discussion Papers 6518, Institute for the Study of Labor (IZA).
    3. Peter R. Mueser & Kenneth Troske & Alexey Gorislavsky, 2003. "Using State Administrative Data to Measure Program Performance," Working Papers 0309, Department of Economics, University of Missouri.
    4. Michael Lechner & Conny Wunsch, 2006. "Are Training Programs More Effective When Unemployment Is High?," University of St. Gallen Department of Economics working paper series 2006 2006-23, Department of Economics, University of St. Gallen.
    5. Rafael Lalive & Jan C. van Ours & Josef Zweim�ller, "undated". "The Effect of Benefit Sanctions on the Duration of Unemployment," IEW - Working Papers 110, Institute for Empirical Research in Economics - University of Zurich.
    6. Gerard J. van den Berg & Bas van der Klaauw & Jan C. van Ours, 1998. "Punitive Sanctions and the Transition Rate from Welfare to Work," Tinbergen Institute Discussion Papers 98-076/3, Tinbergen Institute.
    7. Jaap Abbring & Gerard Van Den Berg, 2005. "Social experiments and instrumental variables with duration outcomes," IFS Working Papers W05/19, Institute for Fiscal Studies.
    8. Kastoryano, Stephen & van der Klaauw, Bas, 2011. "Dynamic Evaluation of Job Search Assistance," IZA Discussion Papers 5424, Institute for the Study of Labor (IZA).
    9. repec:adr:anecst:y:2012:i:107-108 is not listed on IDEAS
    10. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6b, January.
    11. James J. Heckman & Hidehiko Ichimura & Petra E. Todd, 1997. "Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme," Review of Economic Studies, Oxford University Press, vol. 64(4), pages 605-654.
    12. Alberto Abadie & Guido W. Imbens, 2011. "Bias-Corrected Matching Estimators for Average Treatment Effects," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 1-11, January.
    13. David Card & Daniel Sullivan, 1987. "Measuring the Effect of Subsidized Training Programs on Movements In andOut of Employment," NBER Working Papers 2173, National Bureau of Economic Research, Inc.
    14. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    15. repec:adr:anecst:y:2012:i:107-108:p:7 is not listed on IDEAS
    16. Lechner, Michael & Miquel, Ruth & Wunsch, Conny, 2005. "Long-run effects of public sector sponsored training in West Germany," IAB Discussion Paper 200503, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    17. Bas Van der Klaauw & Jan C. Van Ours, 2013. "Carrot And Stick: How Re‐Employment Bonuses And Benefit Sanctions Affect Exit Rates From Welfare," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(2), pages 275-296, 03.
    18. Guido M. Imbens & Jeffrey M. Wooldridge, 2008. "Recent Developments in the Econometrics of Program Evaluation," NBER Working Papers 14251, National Bureau of Economic Research, Inc.
    19. Kluve, Jochen, 2010. "The effectiveness of European active labor market programs," Labour Economics, Elsevier, vol. 17(6), pages 904-918, December.
    20. Guido W. Imbens, 2015. "Matching Methods in Practice: Three Examples," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 373-419.
    21. Martin Biewen & Bernd Fitzenberger & Aderonke Osikominu & Marie Paul, 2012. "The effectiveness of public sponsored training revisited: The importance of data and methodological choices," ECON - Working Papers 091, Department of Economics - University of Zurich.
    22. Card, David Edward & Kluve, Jochen & Weber, Andrea Maria, 2009. "Active Labor Market Policy Evaluations – A Meta-analysis," Ruhr Economic Papers 86, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    23. De Groot, Nynke & van der Klaauw, Bas, 2014. "The Effects of Reducing the Entitlement Period to Unemployment Insurance Benefits," IZA Discussion Papers 8336, Institute for the Study of Labor (IZA).
    24. A. Smith, Jeffrey & E. Todd, Petra, 2005. "Does matching overcome LaLonde's critique of nonexperimental estimators?," Journal of Econometrics, Elsevier, vol. 125(1-2), pages 305-353.
    25. Graversen, Brian Krogh & van Ours, Jan C., 2008. "How to help unemployed find jobs quickly: Experimental evidence from a mandatory activation program," Journal of Public Economics, Elsevier, vol. 92(10-11), pages 2020-2035, October.
    26. Gerfin, Michael & Lechner, Michael, 2000. "Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," IZA Discussion Papers 154, Institute for the Study of Labor (IZA).
    27. Bruno Crépon & Marc Ferracci & Denis Fougere, 2012. "Training the Unemployed in France: How Does it Affect Unemployment Duration and Recurrence?," Annals of Economics and Statistics, GENES, issue 107-108, pages 175-199.
    28. Peter Dolton & Donal O'Neill, 2002. "The Long-Run Effects of Unemployment Monitoring and Work-Search Programs: Experimental Evidence from the United Kingdom," Journal of Labor Economics, University of Chicago Press, vol. 20(2), pages 381-403, Part.
    29. Cockx, Bart & Dejemeppe, Muriel, 2012. "Monitoring job search effort: An evaluation based on a regression discontinuity design," Labour Economics, Elsevier, vol. 19(5), pages 729-737.
    30. David Card & Pablo Ibarrarán & Ferdinando Regalia & David Rosas-Shady & Yuri Soares, 2011. "The Labor Market Impacts of Youth Training in the Dominican Republic," Journal of Labor Economics, University of Chicago Press, vol. 29(2), pages 267-300.
    31. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    32. van den Berg, Gerard J. & Bozio, Antoine & Costa Dias, Mónica, 2015. "Policy discontinuity and duration outcomes," Working Paper Series 2015:10, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    33. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    34. Busso, Matias & DiNardo, John & McCrary, Justin, 2009. "New Evidence on the Finite Sample Properties of Propensity Score Matching and Reweighting Estimators," IZA Discussion Papers 3998, Institute for the Study of Labor (IZA).
    35. Rafael Lalive & JanC. vanOurs & Josef Zweimüller, 2008. "The Impact of Active Labour Market Programmes on The Duration of Unemployment in Switzerland," Economic Journal, Royal Economic Society, vol. 118(525), pages 235-257, 01.
    36. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, 09.
    37. repec:hal:journl:halshs-01067926 is not listed on IDEAS
    38. Jaap H. Abbring & Gerard J. Berg & Jan C. Ours, 2005. "The Effect of Unemployment Insurance Sanctions on the Transition Rate from Unemployment to Employment," Economic Journal, Royal Economic Society, vol. 115(505), pages 602-630, 07.
    39. J.J. Heckman & E.E. Leamer (ed.), 2007. "Handbook of Econometrics," Handbook of Econometrics, Elsevier, edition 1, volume 6, number 6a, January.
    Full references (including those not matched with items on IDEAS)

    This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

    When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp10531. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Fallak)

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If references are entirely missing, you can add them using this form.

    If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    This information is provided to you by IDEAS at the Research Division of the Federal Reserve Bank of St. Louis using RePEc data.