IDEAS home Printed from https://ideas.repec.org/p/crs/wpaper/2023-09.html
   My bibliography  Save this paper

Predicting Re-Employment: Machine Learning Versus Assessments by Unemployed Workers and by Their Caseworkers

Author

Listed:
  • Gerard J. van den Berg

    (University of Groningen, University Medical Center Groningen, IFAU Uppsala, ZEW, IZA, CEPR)

  • Max Kunaschk

    (IAB Nuremberg)

  • Julia Lang

    (IAB Nuremberg)

  • Gesine Stephan

    (IAB Nuremberg, Friedrich-Alexander-Universität Erlangen-Nürnberg)

  • Arne Uhlendorf

    (CNRS and CREST, IAB Nuremberg, DIW, IZA)

Abstract

Predictions of whether newly unemployed individuals will become long-term unemployed are important for the planning and policy mix of unemployment insurance agencies. We analyze unique data on three sources of information on the probability of re-employment within 6 months (RE6), for the same individuals sampled from the inflow into unemployment. First, they were asked for their perceived probability of RE6. Second, their caseworkers revealed whether they expected RE6. Third, random-forest machine learning methods are trained on administrative data on the full inflow, to predict individual RE6. We compare the predictive performance of these measures and consider whether combinations improve this performance. We show that self-reported and caseworker assessments sometimes contain information not captured by the machine learning algorithm.

Suggested Citation

  • Gerard J. van den Berg & Max Kunaschk & Julia Lang & Gesine Stephan & Arne Uhlendorf, 2023. "Predicting Re-Employment: Machine Learning Versus Assessments by Unemployed Workers and by Their Caseworkers," Working Papers 2023-09, Center for Research in Economics and Statistics.
  • Handle: RePEc:crs:wpaper:2023-09
    as

    Download full text from publisher

    File URL: http://crest.science/RePEc/wpstorage/2023-09.pdf
    File Function: CREST working paper version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Lechner, Michael & Wunsch, Conny, 2013. "Sensitivity of matching-based program evaluations to the availability of control variables," Labour Economics, Elsevier, vol. 21(C), pages 111-121.
    2. Jeff Dominitz, 1998. "Earnings Expectations, Revisions, And Realizations," The Review of Economics and Statistics, MIT Press, vol. 80(3), pages 374-388, August.
    3. Andreas I. Mueller & Johannes Spinnewijn & Giorgio Topa, 2021. "Job Seekers' Perceptions and Employment Prospects: Heterogeneity, Duration Dependence, and Bias," American Economic Review, American Economic Association, vol. 111(1), pages 324-363, January.
    4. Charles F. Manski, 2018. "Survey Measurement of Probabilistic Macroeconomic Expectations: Progress and Promise," NBER Macroeconomics Annual, University of Chicago Press, vol. 32(1), pages 411-471.
    5. V. Kerry Smith & Donald H. Taylor & Frank A. Sloan, 2001. "Longevity Expectations and Death: Can People Predict Their Own Demise?," American Economic Review, American Economic Association, vol. 91(4), pages 1126-1134, September.
    6. Christian Stoltenberg & Arne Uhlendorf, 2022. "Consumption Choices and Earnings Expectations: Empirical Evidence and Structural Estimation," Working Papers 2022-15, Center for Research in Economics and Statistics.
    7. Xavier D'Haultfoeuille & Christophe Gaillac & Arnaud Maurel, 2021. "Rationalizing rational expectations: Characterizations and tests," Quantitative Economics, Econometric Society, vol. 12(3), pages 817-842, July.
    8. Kunaschk, Max & Lang, Julia, 2022. "Can Algorithms Reliably Predict Long-Term Unemployment in Times of Crisis? – Evidence from the COVID-19 Pandemic," IAB-Discussion Paper 202208, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    9. David Campbell & Alan Carruth & Andrew Dickerson & Francis Green, 2007. "Job insecurity and wages," Economic Journal, Royal Economic Society, vol. 117(518), pages 544-566, March.
    10. Carl Magnus Bjuggren & Niklas Elert, 2019. "Gender differences in optimism," Applied Economics, Taylor & Francis Journals, vol. 51(47), pages 5160-5173, October.
    11. Berg, Gerard J. van den & Hofmann, Barbara & Stephan, Gesine & Uhlendorff, Arne, 2014. "Was Vermittlungsfachkräfte von Eingliederungsvereinbarungen halten: Befragungsergebnisse aus einem Modellprojekt," IAB-Forschungsbericht 201411, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    12. Melvin Stephens, 2004. "Job Loss Expectations, Realizations, and Household Consumption Behavior," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 253-269, February.
    13. Bert van Landeghem & Sam Desiere & Ludo Struyven, 2021. "Statistical profiling of unemployed jobseekers," IZA World of Labor, Institute of Labor Economics (IZA), pages 483-483, February.
    14. Nathaniel Hendren, 2017. "Knowledge of Future Job Loss and Implications for Unemployment Insurance," American Economic Review, American Economic Association, vol. 107(7), pages 1778-1823, July.
    15. Mühlbauer, Sabrina & Weber, Enzo, 2022. "Machine Learning for Labour Market Matching," IAB-Discussion Paper 202203, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany].
    16. James J. Heckman & Jeffrey A. Smith, 1999. "The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies," NBER Working Papers 6983, National Bureau of Economic Research, Inc.
    17. Heckman, James J & Smith, Jeffrey A, 1999. "The Pre-programme Earnings Dip and the Determinants of Participation in a Social Programme. Implications for Simple Programme Evaluation Strategies," Economic Journal, Royal Economic Society, vol. 109(457), pages 313-348, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Altmann, Steffen & Mahlstedt, Robert & Rattenborg, Malte Jacob & Sebald, Alexander, 2023. "Which Occupations Do Unemployed Workers Target? Insights from Online Job Search Profiles," IZA Discussion Papers 16696, Institute of Labor Economics (IZA).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Christian Stoltenberg & Arne Uhlendorf, 2022. "Consumption Choices and Earnings Expectations: Empirical Evidence and Structural Estimation," Working Papers 2022-15, Center for Research in Economics and Statistics.
    2. Koşar, Gizem & van der Klaauw, Wilbert, 2023. "Workers' Perceptions of Earnings Growth and Employment Risk," IZA Discussion Papers 16013, Institute of Labor Economics (IZA).
    3. Denderski, Piotr & Stoltenberg, Christian A., 2020. "Risk sharing with private and public information," Journal of Economic Theory, Elsevier, vol. 186(C).
    4. Christian A. Stoltenberg & Swapnil Singh, 2020. "Consumption insurance with advance information," Quantitative Economics, Econometric Society, vol. 11(2), pages 671-711, May.
    5. Dickerson, Andy & Green, Francis, 2012. "Fears and realisations of employment insecurity," Labour Economics, Elsevier, vol. 19(2), pages 198-210.
    6. Marcelo Pedroni & Swapnil Singh & Christian Stoltenberg, 2022. "Advance Information and Consumption Insurance: Evidence from Panel Data," Tinbergen Institute Discussion Papers 22-032/VI, Tinbergen Institute.
    7. Swapnil Singh & Christian A. Stoltenbergz, 2018. "How Much Do Households Really Know About Their Future Income?," Bank of Lithuania Working Paper Series 55, Bank of Lithuania.
    8. Gabrielle Penrose & Gianni La Cava, 2021. "Job Loss, Subjective Expectations and Household Spending," RBA Research Discussion Papers rdp2021-08, Reserve Bank of Australia.
    9. Caliendo, Marco & Mahlstedt, Robert & Mitnik, Oscar A., 2017. "Unobservable, but unimportant? The relevance of usually unobserved variables for the evaluation of labor market policies," Labour Economics, Elsevier, vol. 46(C), pages 14-25.
    10. Da Silva, António Dias & Rusinova, Desislava & Weißler, Marco, 2023. "Consumption effects of job loss expectations: new evidence for the euro area," Working Paper Series 2817, European Central Bank.
    11. Hagen, Tobias, 2016. "Econometric evaluation of a placement coaching program for recipients of disability insurance benefits in Switzerland," Working Paper Series 10, Frankfurt University of Applied Sciences, Faculty of Business and Law.
    12. Andersson, Fredrik W. & Holzer, Harry J. & Lane, Julia & Rosenblum, David & Smith, Jeffrey A., 2013. "Does Federally-Funded Job Training Work? Nonexperimental Estimates of WIA Training Impacts Using Longitudinal Data on Workers and Firms," IZA Discussion Papers 7621, Institute of Labor Economics (IZA).
    13. Michael Dietrich, 2010. "Efficiency and profitability: a panel data analysis of UK manufacturing firms, 1993-2007," Working Papers 2010003, The University of Sheffield, Department of Economics, revised Jan 2010.
    14. Almut Balleer & Georg Duernecker & Susanne Forstner & Johannes Goensch, 2023. "Biased Expectations and Labor Market Outcomes: Evidence from German Survey Data and Implications for the East-West Wage Gap," CESifo Working Paper Series 10336, CESifo.
    15. Lombardi, Stefano & van den Berg, Gerard J. & Vikström, Johan, 2020. "Empirical Monte Carlo evidence on estimation of Timing-of-Events models," Working Paper Series 2020:26, IFAU - Institute for Evaluation of Labour Market and Education Policy, revised 05 Jan 2021.
    16. Kassenboehmer, Sonja C. & Schatz, Sonja G., 2017. "Re-employment expectations and realisations: Prediction errors and behavioural responses," Labour Economics, Elsevier, vol. 44(C), pages 161-176.
    17. Barbara Sianesi, 2013. "Dealing with randomisation bias in a social experiment exploiting the randomisation itself: the case of ERA," IFS Working Papers W13/15, Institute for Fiscal Studies.
    18. Cerqua, Augusto & Urwin, Peter & Thomson, Dave & Bibby, David, 2020. "Evaluation of education and training impacts for the unemployed: Challenges of new data," Labour Economics, Elsevier, vol. 67(C).
    19. Pamela Giustinelli, 2022. "Expectations in Education: Framework, Elicitation, and Evidence," Working Papers 2022-026, Human Capital and Economic Opportunity Working Group.
    20. Fezzi, Carlo & Menapace, Luisa & Raffaelli, Roberta, 2021. "Estimating risk preferences integrating insurance choices with subjective beliefs," European Economic Review, Elsevier, vol. 135(C).

    More about this item

    Keywords

    unemployment; expectations; prediction; random forest; unemployment insurance; information;
    All these keywords.

    JEL classification:

    • J64 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment: Models, Duration, Incidence, and Job Search
    • J65 - Labor and Demographic Economics - - Mobility, Unemployment, Vacancies, and Immigrant Workers - - - Unemployment Insurance; Severance Pay; Plant Closings
    • C55 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Large Data Sets: Modeling and Analysis
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C41 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Duration Analysis; Optimal Timing Strategies
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:crs:wpaper:2023-09. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Secretariat General (email available below). General contact details of provider: https://edirc.repec.org/data/crestfr.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.