IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2505.01933.html
   My bibliography  Save this paper

Unemployment Dynamics Forecasting with Machine Learning Regression Models

Author

Listed:
  • Kyungsu Kim

Abstract

In this paper, I explored how a range of regression and machine learning techniques can be applied to monthly U.S. unemployment data to produce timely forecasts. I compared seven models: Linear Regression, SGDRegressor, Random Forest, XGBoost, CatBoost, Support Vector Regression, and an LSTM network, training each on a historical span of data and then evaluating on a later hold-out period. Input features include macro indicators (GDP growth, CPI), labor market measures (job openings, initial claims), financial variables (interest rates, equity indices), and consumer sentiment. I tuned model hyperparameters via cross-validation and assessed performance with standard error metrics and the ability to predict the correct unemployment direction. Across the board, tree-based ensembles (and CatBoost in particular) deliver noticeably better forecasts than simple linear approaches, while the LSTM captures underlying temporal patterns more effectively than other nonlinear methods. SVR and SGDRegressor yield modest gains over standard regression but don't match the consistency of the ensemble and deep-learning models. Interpretability tools ,feature importance rankings and SHAP values, point to job openings and consumer sentiment as the most influential predictors across all methods. By directly comparing linear, ensemble, and deep-learning approaches on the same dataset, our study shows how modern machine-learning techniques can enhance real-time unemployment forecasting, offering economists and policymakers richer insights into labor market trends. In the comparative evaluation of the models, I employed a dataset comprising thirty distinct features over the period from January 2020 through December 2024.

Suggested Citation

  • Kyungsu Kim, 2025. "Unemployment Dynamics Forecasting with Machine Learning Regression Models," Papers 2505.01933, arXiv.org.
  • Handle: RePEc:arx:papers:2505.01933
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2505.01933
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kitov, Ivan & Kitov, Oleg & Dolinskaya, Svetlana, 2007. "Relationship between inflation, unemployment and labor force change rate in France: cointegration test," MPRA Paper 2736, University Library of Munich, Germany.
    2. Sydney C. Ludvigson, 2004. "Consumer Confidence and Consumer Spending," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 29-50, Spring.
    3. Laurence Ball & Sandeep Mazumder, 2019. "A Phillips Curve with Anchored Expectations and Short‐Term Unemployment," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 51(1), pages 111-137, February.
    4. Carmen M. Reinhart & Kenneth S. Rogoff, 2010. "Growth in a Time of Debt," American Economic Review, American Economic Association, vol. 100(2), pages 573-578, May.
    5. Kyungsu Kim, 2025. "Forecasting Labor Demand: Predicting JOLT Job Openings using Deep Learning Model," Papers 2503.19048, arXiv.org.
    6. Marcus Dillender & Andrew I. Friedson & Cong T. Gian & Kosali I. Simon, 2021. "Is Healthcare Employment Resilient and “Recession Proof”?," NBER Working Papers 29287, National Bureau of Economic Research, Inc.
    7. Hyeri Choi & Ioana Marinescu, 2024. "The Labor Demand Side of Involuntary Part-Time Employment," Research in Labor Economics, in: Big Data Applications in Labor Economics, Part A, volume 52, pages 35-70, Emerald Group Publishing Limited.
    8. Daniel Aaronson & Daniel G. Sullivan, 2000. "Unemployment and wage growth: recent cross-state evidence," Economic Perspectives, Federal Reserve Bank of Chicago, vol. 25(Q II), pages 41-54.
    9. Aruoba, S. BoraÄŸan & Diebold, Francis X. & Scotti, Chiara, 2009. "Real-Time Measurement of Business Conditions," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 417-427.
    10. Evan F. Koenig, 2002. "Using the Purchasing Managers' Index to assess the economy's strength and the likely direction of monetary policy," Economic and Financial Policy Review, Federal Reserve Bank of Dallas, vol. 1(6).
    11. David N. F. Bell & David G. Blanchflower, 2011. "Young people and the Great Recession," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 27(2), pages 241-267.
    12. Ivan Kitov, 2021. "The link between unemployment and real economic growth in developed countries," Papers 2104.04595, arXiv.org.
    13. Z. Koohi Lai & A. Namaki & A. Hosseiny & G. R. Jafari & M. Ausloos, 2020. "Coupled criticality analysis of inflation and unemployment," Papers 2003.12655, arXiv.org.
    14. Haydory Akbar Ahmed & Tareque Nasser, 2023. "Long-run relationship between the unemployment rate and the current account balance in the United States: An empirical analysis," Portuguese Economic Journal, Springer;Instituto Superior de Economia e Gestao, vol. 22(3), pages 397-416, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Delis, Manthos D. & Kouretas, Georgios P. & Tsoumas, Chris, 2014. "Anxious periods and bank lending," Journal of Banking & Finance, Elsevier, vol. 38(C), pages 1-13.
    2. Harendra Behera & Garima Wahi & Muneesh Kapur, 2017. "Phillips Curve Relationship in India: Evidence from State-Level Analysis," Working Papers id:11973, eSocialSciences.
    3. Christiansen, Charlotte & Eriksen, Jonas Nygaard & Møller, Stig Vinther, 2014. "Forecasting US recessions: The role of sentiment," Journal of Banking & Finance, Elsevier, vol. 49(C), pages 459-468.
    4. Daniel Aaronson & Scott A. Brave & Michael Fogarty & Ezra Karger & Spencer D. Krane, 2021. "Tracking U.S. Consumers in Real Time with a New Weekly Index of Retail Trade," Working Paper Series WP-2021-05, Federal Reserve Bank of Chicago, revised 18 Jun 2021.
    5. Andres Algaba & Samuel Borms & Kris Boudt & Brecht Verbeken, 2021. "Daily news sentiment and monthly surveys: A mixed–frequency dynamic factor model for nowcasting consumer confidence," Working Paper Research 396, National Bank of Belgium.
    6. Algaba, Andres & Borms, Samuel & Boudt, Kris & Verbeken, Brecht, 2023. "Daily news sentiment and monthly surveys: A mixed-frequency dynamic factor model for nowcasting consumer confidence," International Journal of Forecasting, Elsevier, vol. 39(1), pages 266-278.
    7. Nicholas Taylor, 2014. "Economic forecast quality: information timeliness and data vintage effects," Empirical Economics, Springer, vol. 46(1), pages 145-174, February.
    8. Schnatz, Bernd & D'Agostino, Antonello, 2012. "Survey-based nowcasting of US growth: a real-time forecast comparison over more than 40 years," Working Paper Series 1455, European Central Bank.
    9. Behera, Harendra & Wahi, Garima & Kapur, Muneesh, 2018. "Phillips curve relationship in an emerging economy: Evidence from India," Economic Analysis and Policy, Elsevier, vol. 59(C), pages 116-126.
    10. Steininger, Lea & Hesse, Casimir, 2024. "Buying into new ideas: The ECB’s evolving justification of unlimited liquidity," Department of Economics Working Paper Series 357, WU Vienna University of Economics and Business.
    11. Sebnem Kalemli-Ozcan & Herman Kamil & Carolina Villegas-Sanchez, 2016. "What Hinders Investment in the Aftermath of Financial Crises: Insolvent Firms or Illiquid Banks?," The Review of Economics and Statistics, MIT Press, vol. 98(4), pages 756-769, October.
    12. Balima, Hippolyte Weneyam, 2020. "Coups d’état and the cost of debt," Journal of Comparative Economics, Elsevier, vol. 48(3), pages 509-528.
    13. Michael A. Clemens, 2017. "The Meaning Of Failed Replications: A Review And Proposal," Journal of Economic Surveys, Wiley Blackwell, vol. 31(1), pages 326-342, February.
    14. Slimani, Slah & Bakari, Sayef & Othmani, Abdelhafidh, 2015. "Croissance et Soutenabilité de la Dette Extérieure Tunisienne pour la Période 1970-2012 : Une Analyse Dynamique [Growth and Sustainability of Tunisian External Debt for the Period 1970-2012: A Dyna," MPRA Paper 80954, University Library of Munich, Germany.
    15. Peppel-Srebrny, Jemima, 2021. "Not all government budget deficits are created equal: Evidence from advanced economies' sovereign bond markets," Journal of International Money and Finance, Elsevier, vol. 118(C).
    16. Cozzi, Marco, 2023. "Public debt and welfare in a quantitative Schumpeterian growth model with incomplete markets," Journal of Macroeconomics, Elsevier, vol. 77(C).
    17. Faria, Gonçalo & Verona, Fabio, 2023. "Forecast combination in the frequency domain," Bank of Finland Research Discussion Papers 1/2023, Bank of Finland.
    18. António Afonso & Yasfir Ibraimo, 2020. "The macroeconomic effects of public debt: an empirical analysis of Mozambique," Applied Economics, Taylor & Francis Journals, vol. 52(2), pages 212-226, January.
    19. Ibrahim Ari & Muammer Koc, 2018. "Sustainable Financing for Sustainable Development: Understanding the Interrelations between Public Investment and Sovereign Debt," Sustainability, MDPI, vol. 10(11), pages 1-25, October.
    20. Séverine MENGUY, 2019. "Does public indebtedness constrain or can it favor economic growth? A simple analytical modeling," Bulletin of Applied Economics, Risk Market Journals, vol. 6(2), pages 1-29.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2505.01933. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.