IDEAS home Printed from https://ideas.repec.org/a/wly/japmet/v37y2022i2p227-241.html
   My bibliography  Save this article

Dynamic evaluation of job search assistance

Author

Listed:
  • Stephen Kastoryano
  • Bas van der Klaauw

Abstract

This paper evaluates a job search assistance program for unemployed teachers where the assignment to the program is dynamic. We discuss the methodology of estimating dynamic treatment effects and identification conditions. In the empirical analysis, we use administrative data from a unique institutional environment in which we observe all variables determining assignment to the job search assistance program. This allows us to compare results from a dynamic discrete‐time evaluation model and a continuous‐time duration model. All approaches show that participation in the job search assistance program reduces exit rates from unemployment, in particular when starting the program early during the spell of unemployment. The discrete‐time approach makes less strict parametric assumptions, but the results are sensitive to the choice of control group and the unit of time.

Suggested Citation

  • Stephen Kastoryano & Bas van der Klaauw, 2022. "Dynamic evaluation of job search assistance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 227-241, March.
  • Handle: RePEc:wly:japmet:v:37:y:2022:i:2:p:227-241
    DOI: 10.1002/jae.2866
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/jae.2866
    Download Restriction: no

    File URL: https://libkey.io/10.1002/jae.2866?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. de Groot, Nynke & van der Klaauw, Bas, 2019. "The effects of reducing the entitlement period to unemployment insurance benefits," Labour Economics, Elsevier, vol. 57(C), pages 195-208.
    2. Gerard J. van den Berg & Bas van der Klaauw, 2006. "Counseling And Monitoring Of Unemployed Workers: Theory And Evidence From A Controlled Social Experiment," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 47(3), pages 895-936, August.
    3. Luc Behaghel & Bruno Cr?pon & Marc Gurgand, 2014. "Private and Public Provision of Counseling to Job Seekers: Evidence from a Large Controlled Experiment," American Economic Journal: Applied Economics, American Economic Association, vol. 6(4), pages 142-174, October.
    4. Gerard J. van den Berg & Bas van der Klaauw & Jan C. van Ours, 2004. "Punitive Sanctions and the Transition Rate from Welfare to Work," Journal of Labor Economics, University of Chicago Press, vol. 22(1), pages 211-241, January.
    5. Heckman, James J. & Navarro, Salvador, 2007. "Dynamic discrete choice and dynamic treatment effects," Journal of Econometrics, Elsevier, vol. 136(2), pages 341-396, February.
    6. Michael Gerfin & Michael Lechner, 2002. "A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland," Economic Journal, Royal Economic Society, vol. 112(482), pages 854-893, October.
    7. Michael Lechner & Conny Wunsch, 2009. "Are Training Programs More Effective When Unemployment Is High?," Journal of Labor Economics, University of Chicago Press, vol. 27(4), pages 653-692, October.
    8. Bruno Crépon & Marc Ferracci & Gregory Jolivet & Gerard J. van den Berg, 2018. "Information shocks and the empirical evaluation of training programs during unemployment spells," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 33(4), pages 594-616, June.
    9. Fredriksson, Peter & Johansson, Per, 2008. "Dynamic Treatment Assignment," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 435-445.
    10. Paul Muller & Bas van der Klaauw & Arjan Heyma, 2020. "Comparing econometric methods to empirically evaluate activation programs for job seekers," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 526-547, August.
    11. Barbara Sianesi, 2004. "An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 133-155, February.
    12. Michael Lechner & Ruth Miquel, 2010. "Identification of the effects of dynamic treatments by sequential conditional independence assumptions," Empirical Economics, Springer, vol. 39(1), pages 111-137, August.
    13. Abbring, Jaap H., 2003. "Dynamic Econometric Program Evaluation," IZA Discussion Papers 804, Institute of Labor Economics (IZA).
    14. Curtis Eberwein & John C. Ham & Robert J. Lalonde, 1997. "The Impact of Being Offered and Receiving Classroom Training on the Employment Histories of Disadvantaged Women: Evidence from Experimental Data," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 655-682.
    15. Abbring, Jaap H. & Heckman, James J., 2007. "Econometric Evaluation of Social Programs, Part III: Distributional Treatment Effects, Dynamic Treatment Effects, Dynamic Discrete Choice, and General Equilibrium Policy Evaluation," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 72, Elsevier.
    16. Stephen Kastoryano & Bas van der Klaauw, 2022. "Dynamic evaluation of job search assistance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 227-241, March.
    17. Moffitt, Robert, 1985. "Unemployment insurance and the distribution of unemployment spells," Journal of Econometrics, Elsevier, vol. 28(1), pages 85-101, April.
    18. Lechner, Michael, 2009. "Sequential Causal Models for the Evaluation of Labor Market Programs," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 71-83.
    19. Lawrence F. Katz & Bruce D. Meyer, 1990. "Unemployment Insurance, Recall Expectations, and Unemployment Outcomes," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 105(4), pages 973-1002.
    20. Guido W. Imbens & Jeffrey M. Wooldridge, 2009. "Recent Developments in the Econometrics of Program Evaluation," Journal of Economic Literature, American Economic Association, vol. 47(1), pages 5-86, March.
    21. Jaap H. Abbring & Gerard J. van den Berg, 2003. "The Nonparametric Identification of Treatment Effects in Duration Models," Econometrica, Econometric Society, vol. 71(5), pages 1491-1517, September.
    22. Rafael Lalive & Jan C. Van Ours & Josef Zweimüller, 2008. "The Impact of Active Labour Market Programmes on The Duration of Unemployment in Switzerland," Economic Journal, Royal Economic Society, vol. 118(525), pages 235-257, January.
    23. Dan A. Black & Jeffrey A. Smith & Mark C. Berger & Brett J. Noel, 2003. "Is the Threat of Reemployment Services More Effective Than the Services Themselves? Evidence from Random Assignment in the UI System," American Economic Review, American Economic Association, vol. 93(4), pages 1313-1327, September.
    24. LaLonde, Robert J, 1986. "Evaluating the Econometric Evaluations of Training Programs with Experimental Data," American Economic Review, American Economic Association, vol. 76(4), pages 604-620, September.
    25. Ham, John C & LaLonde, Robert J, 1996. "The Effect of Sample Selection and Initial Conditions in Duration Models: Evidence from Experimental Data on Training," Econometrica, Econometric Society, vol. 64(1), pages 175-205, January.
    26. Judith Lok & Richard Gill & Aad Van Der Vaart & James Robins, 2004. "Estimating the causal effect of a time‐varying treatment on time‐to‐event using structural nested failure time models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 58(3), pages 271-295, August.
    27. Chris Elbers & Geert Ridder, 1982. "True and Spurious Duration Dependence: The Identifiability of the Proportional Hazard Model," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 49(3), pages 403-409.
    28. Vikström, Johan, 2017. "Dynamic treatment assignment and evaluation of active labor market policies," Labour Economics, Elsevier, vol. 49(C), pages 42-54.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Alessio Brown & Johannes Koettl, 2015. "Active labor market programs - employment gain or fiscal drain?," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 4(1), pages 1-36, December.
    2. van der Klaauw, Bas, 2014. "From micro data to causality: Forty years of empirical labor economics," Labour Economics, Elsevier, vol. 30(C), pages 88-97.
    3. Schmidl, Ricarda, 2015. "The Effectiveness of Early Vacancy Information in the Presence of Monitoring and ALMP," IZA Discussion Papers 9575, Institute of Labor Economics (IZA).
    4. Fervers, Lukas & Brändle, Tobias & Webel, Carina, 2014. "Decomposing a Matching Estimation - Correlated Unobserved non-random Selection, Substitution, and Causal Effects in a Large Scale ALMP Program in Germany," VfS Annual Conference 2014 (Hamburg): Evidence-based Economic Policy 100500, Verein für Socialpolitik / German Economic Association.
    5. Koning, Pierre, 2013. "Making Work Pay for the Indebted: The Effect of Debt Services on the Exit Rates of Unemployed Individuals," IZA Discussion Papers 7873, Institute of Labor Economics (IZA).
    6. Boockmann Bernhard & Brändle Tobias, 2019. "Coaching, Counseling, Case-Working: Do They Help the Older Unemployed Out of Benefit Receipt and Back Into the Labor Market?," German Economic Review, De Gruyter, vol. 20(4), pages 436-468, December.
    7. Bernhard Boockmann & Christopher Osiander & Michael Stops, 2014. "Vermittlerstrategien und Arbeitsmarkterfolg – Evidenz aus kombinierten Prozess- und Befragungsdaten [Caseworkers’ strategies and clients’ labor market outcomes]," Journal for Labour Market Research, Springer;Institute for Employment Research/ Institut für Arbeitsmarkt- und Berufsforschung (IAB), vol. 47(4), pages 341-360, December.
    8. Muller, Paul & van der Klaauw, Bas & Heyma, Arjan, 2017. "Comparing Econometric Methods to Empirically Evaluate Job-Search Assistance," IZA Discussion Papers 10531, Institute of Labor Economics (IZA).
    9. Vikman, Johan, 2014. "IPW estimation and related estimators for evaluation of active labor market policies in a dynamic setting," Working Paper Series, Center for Labor Studies 2014:8, Uppsala University, Department of Economics.
    10. Boockmann, Bernhard & Osiander, Christopher & Stops, Michael & Verbeek, Hans, 2013. "Effekte von Vermittlerhandeln und Vermittlerstrategien im SGB II und SGB III (Pilotstudie) : Abschlussbericht an das IAB durch das Institut für Angewandte Wirtschaftsforschung e. V. (IAW), Tübingen," IAB-Forschungsbericht 201307, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    11. Paul Muller & Bas van der Klaauw & Arjan Heyma, 2020. "Comparing econometric methods to empirically evaluate activation programs for job seekers," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 526-547, August.
    12. Rainer Eppel & Helmut Mahringer & Andrea Weber, 2014. "Job Search Behaviour and Job Search Success of the Unemployed," WIFO Working Papers 471, WIFO.
    13. Stephen Kastoryano & Bas van der Klaauw, 2022. "Dynamic evaluation of job search assistance," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 227-241, March.
    14. Gautier, Pieter A. & van der Klaauw, Bas, 2009. "Institutions and labor market outcomes in the Netherlands," Working Paper Series 2009:28, IFAU - Institute for Evaluation of Labour Market and Education Policy.
    15. Rainer Eppel & Helmut Mahringer, 2019. "Getting a lot out of a little bit of work? The effects of marginal employment during unemployment," Empirica, Springer;Austrian Institute for Economic Research;Austrian Economic Association, vol. 46(2), pages 381-408, May.
    16. Koning, Pierre, 2015. "Making work pay for the indebted? Assessing the effects of debt services on welfare recipients," Labour Economics, Elsevier, vol. 34(C), pages 152-161.
    17. Isabelle Benoteau, 2015. "Quels effets du recrutement en contrat aidé sur la trajectoire professionnelle ? Une évaluation à partir du Panel 2008," Économie et Statistique, Programme National Persée, vol. 477(1), pages 85-129.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paul Muller & Bas van der Klaauw & Arjan Heyma, 2020. "Comparing econometric methods to empirically evaluate activation programs for job seekers," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(5), pages 526-547, August.
    2. Muller, Paul & van der Klaauw, Bas & Heyma, Arjan, 2017. "Comparing Econometric Methods to Empirically Evaluate Job-Search Assistance," IZA Discussion Papers 10531, Institute of Labor Economics (IZA).
    3. Michael C. Knaus & Michael Lechner & Anthony Strittmatter, 2022. "Heterogeneous Employment Effects of Job Search Programs: A Machine Learning Approach," Journal of Human Resources, University of Wisconsin Press, vol. 57(2), pages 597-636.
    4. Jaap Abbring & James Heckman, 2008. "Dynamic policy analysis," CeMMAP working papers CWP05/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    5. Bruno Crépon & Muriel Dejemeppe & Marc Gurgand, 2005. "Counseling the unemployed: does it lower unemployment duration and recurrence?," Working Papers halshs-00590769, HAL.
    6. McGuinness, Seamus & O'Connell, Philip J. & Kelly, Elish & Walsh, John R., 2011. "Activation in Ireland: An Evaluation of the National Employment Action Plan," Research Series, Economic and Social Research Institute (ESRI), number RS20, June.
    7. van der Klaauw, Bas, 2014. "From micro data to causality: Forty years of empirical labor economics," Labour Economics, Elsevier, vol. 30(C), pages 88-97.
    8. Seamus McGuinness & Philip J. O’Connell & Elish Kelly, 2019. "Carrots, No Stick, No Driver: The Employment Impact of Job Search Assistance in a Regime with Minimal Monitoring and Sanctions," Journal of Labor Research, Springer, vol. 40(2), pages 151-180, June.
    9. Fitzenberger, Bernd & Osikominu, Aderonke & Paul, Marie, 2023. "The effects of training incidence and planned training duration on labor market transitions," Journal of Econometrics, Elsevier, vol. 235(1), pages 256-279.
    10. Aderonke Osikominu, 2013. "Quick Job Entry or Long-Term Human Capital Development? The Dynamic Effects of Alternative Training Schemes," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(1), pages 313-342.
    11. Jorge Rodríguez & Fernando Saltiel & Sergio Urzúa, 2022. "Dynamic treatment effects of job training," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(2), pages 242-269, March.
    12. Gerard J. van den Berg & Petyo Bonev & Enno Mammen, 2020. "Nonparametric Instrumental Variable Methods for Dynamic Treatment Evaluation," The Review of Economics and Statistics, MIT Press, vol. 102(2), pages 355-367, May.
    13. Jaap Abbring & Gerard Van Den Berg, 2005. "Social experiments and instrumental variables with duration outcomes," IFS Working Papers W05/19, Institute for Fiscal Studies.
    14. Kazuaki Okamura & Nizamul Islam, 2021. "Effects of the timing of childbirth on female labor supply: an analysis using the sequential matching approach," Applied Economics, Taylor & Francis Journals, vol. 53(28), pages 3253-3266, June.
    15. Schmidpeter, Bernhard & Winter-Ebmer, Rudolf, 2021. "Automation, unemployment, and the role of labor market training," European Economic Review, Elsevier, vol. 137(C).
    16. Conny Wunsch, 2013. "Optimal Use of Labor Market Policies: The Role of Job Search Assistance," The Review of Economics and Statistics, MIT Press, vol. 95(3), pages 1030-1045, July.
    17. Pedro H. C. Sant'Anna, 2016. "Program Evaluation with Right-Censored Data," Papers 1604.02642, arXiv.org.
    18. McVicar, Duncan, 2008. "Job search monitoring intensity, unemployment exit and job entry: Quasi-experimental evidence from the UK," Labour Economics, Elsevier, vol. 15(6), pages 1451-1468, December.
    19. Lalive, Rafael & Cottier, Lionel & Flueckiger, Yves & Kempeneers, Pierre, 2018. "Does Job Search Assistance Really Raise Employment?," CEPR Discussion Papers 13133, C.E.P.R. Discussion Papers.
    20. Dalla-Zuanna, Antonio & Liu, Kai, 2019. "Understanding Program Complementarities: Estimating the Dynamic Effects of a Training Program with Multiple Alternatives," IZA Discussion Papers 12839, Institute of Labor Economics (IZA).

    More about this item

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search
    • J68 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Public Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:japmet:v:37:y:2022:i:2:p:227-241. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.