IDEAS home Printed from https://ideas.repec.org/a/kap/compec/v66y2025i1d10.1007_s10614-024-10675-5.html
   My bibliography  Save this article

Machine Learning Methods and Time Series: A Through Forecasting Study via Simulation and USA Inflation Analysis

Author

Listed:
  • Klaus Boesch

    (Sul-rio-grandense Federal Institute)

  • Flavio A. Ziegelmann

    (Federal University of Rio Grande do Sul)

Abstract

Modern problems in Economics have tremendously benefited from the ever increasing amount of available information. Hence, most of the recent econometric approaches have focused on how to model and estimate relationships between covariates and dependent variables under this high-dimensional scenario. Particularly in the time series context, one usually aims to produce valuable forecasts of the dependent variables. In this paper our main goal is two-folded: i) employ several modern computationally highly intensive Machine Learning (ML) methods for achieving time series forecasting accuracy under a high-dimensional covariates setting; ii) propose a novel variation of the Elastic Net (ENet), the Weighted Lag Adaptive ENet (WLadaENet), which combines the popular Ridge Regression with a regularization method tailored for time series, the WLAdaLASSO (Konzen and Ziegelmann in J Forecast 35:592–612, 2016). To achieve our goal, we carry out Monte Carlo simulation studies as well as a real data analysis of USA inflation with a forecast range from January 2013 to December 2023. In our Monte Carlo implementations, the WLadaENet presents a solid performance both in terms of variable selection when the true model is sparse and in terms of forecasting accuracy even when the model is not sparse and nonlinearities are included. Our approach also performs reasonably well to forecast the USA inflation for different horizons ahead. Since the chosen period includes the Covid-19 crisis, a sub-period analysis is carried out, not leading to a uniformly best forecaster.

Suggested Citation

  • Klaus Boesch & Flavio A. Ziegelmann, 2025. "Machine Learning Methods and Time Series: A Through Forecasting Study via Simulation and USA Inflation Analysis," Computational Economics, Springer;Society for Computational Economics, vol. 66(1), pages 1-34, July.
  • Handle: RePEc:kap:compec:v:66:y:2025:i:1:d:10.1007_s10614-024-10675-5
    DOI: 10.1007/s10614-024-10675-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10614-024-10675-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10614-024-10675-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    3. Medeiros, Marcelo C. & Vasconcelos, Gabriel F.R., 2016. "Forecasting macroeconomic variables in data-rich environments," Economics Letters, Elsevier, vol. 138(C), pages 50-52.
    4. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    5. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    6. Sendhil Mullainathan & Jann Spiess, 2017. "Machine Learning: An Applied Econometric Approach," Journal of Economic Perspectives, American Economic Association, vol. 31(2), pages 87-106, Spring.
    7. Evandro Konzen & Flavio A. Ziegelmann, 2016. "LASSO‐Type Penalties for Covariate Selection and Forecasting in Time Series," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(7), pages 592-612, November.
    8. Marcelo C. Medeiros & Gabriel F. R. Vasconcelos & Álvaro Veiga & Eduardo Zilberman, 2021. "Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 98-119, January.
    9. Friedman, Jerome H., 2002. "Stochastic gradient boosting," Computational Statistics & Data Analysis, Elsevier, vol. 38(4), pages 367-378, February.
    10. Elliott, Graham & Gargano, Antonio & Timmermann, Allan, 2015. "Complete subset regressions with large-dimensional sets of predictors," Journal of Economic Dynamics and Control, Elsevier, vol. 54(C), pages 86-110.
    11. Peter R. Hansen & Asger Lunde & James M. Nason, 2011. "The Model Confidence Set," Econometrica, Econometric Society, vol. 79(2), pages 453-497, March.
    12. Medeiros, Marcelo C & Vasconcelos, Gabriel & Freitas, Eduardo, 2016. "Forecasting Brazilian Inflation with High-Dimensional Models," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 36(2), November.
    13. repec:cdl:ucsdec:qt1st3n7z7 is not listed on IDEAS
    14. Garcia, Márcio G.P. & Medeiros, Marcelo C. & Vasconcelos, Gabriel F.R., 2017. "Real-time inflation forecasting with high-dimensional models: The case of Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 679-693.
    15. Jushan Bai & Serena Ng, 2009. "Boosting diffusion indices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 607-629.
    16. Elliott, Graham & Gargano, Antonio & Timmermann, Allan, 2013. "Complete subset regressions," Journal of Econometrics, Elsevier, vol. 177(2), pages 357-373.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    2. Araujo, Gustavo Silva & Gaglianone, Wagner Piazza, 2023. "Machine learning methods for inflation forecasting in Brazil: New contenders versus classical models," Latin American Journal of Central Banking (previously Monetaria), Elsevier, vol. 4(2).
    3. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    4. Felipe Leal & Carlos Molina & Eduardo Zilberman, 2020. "Proyección de la Inflación en Chile con Métodos de Machine Learning," Working Papers Central Bank of Chile 860, Central Bank of Chile.
    5. Byron Botha & Rulof Burger & Kevin Kotzé & Neil Rankin & Daan Steenkamp, 2023. "Big data forecasting of South African inflation," Empirical Economics, Springer, vol. 65(1), pages 149-188, July.
    6. Borup, Daniel & Christensen, Bent Jesper & Mühlbach, Nicolaj Søndergaard & Nielsen, Mikkel Slot, 2023. "Targeting predictors in random forest regression," International Journal of Forecasting, Elsevier, vol. 39(2), pages 841-868.
    7. Costa, Alexandre Bonnet R. & Ferreira, Pedro Cavalcanti G. & Gaglianone, Wagner P. & Guillén, Osmani Teixeira C. & Issler, João Victor & Lin, Yihao, 2021. "Machine learning and oil price point and density forecasting," Energy Economics, Elsevier, vol. 102(C).
    8. Garcia, Márcio G.P. & Medeiros, Marcelo C. & Vasconcelos, Gabriel F.R., 2017. "Real-time inflation forecasting with high-dimensional models: The case of Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 679-693.
    9. Philippe Goulet Coulombe, 2020. "To Bag is to Prune," Papers 2008.07063, arXiv.org, revised Sep 2024.
      • Philippe Goulet Coulombe, 2021. "To Bag is to Prune," Working Papers 21-03, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management, revised Jun 2021.
    10. Risse, Marian, 2019. "Combining wavelet decomposition with machine learning to forecast gold returns," International Journal of Forecasting, Elsevier, vol. 35(2), pages 601-615.
    11. Goulet Coulombe, Philippe & Leroux, Maxime & Stevanovic, Dalibor & Surprenant, Stéphane, 2021. "Macroeconomic data transformations matter," International Journal of Forecasting, Elsevier, vol. 37(4), pages 1338-1354.
    12. DeMiguel, Victor & Gil-Bazo, Javier & Nogales, Francisco J. & Santos, André A.P., 2023. "Machine learning and fund characteristics help to select mutual funds with positive alpha," Journal of Financial Economics, Elsevier, vol. 150(3).
    13. Chen, Bin & Maung, Kenwin, 2023. "Time-varying forecast combination for high-dimensional data," Journal of Econometrics, Elsevier, vol. 237(2).
    14. Mei, Ziwei & Shi, Zhentao, 2024. "On LASSO for high dimensional predictive regression," Journal of Econometrics, Elsevier, vol. 242(2).
    15. Victor DeMiguel & Javier Gil-Bazo & Francisco J. Nogales & André A. P. Santos, 2021. "Can machine learning help to select portfolios of mutual funds?," Economics Working Papers 1772, Department of Economics and Business, Universitat Pompeu Fabra.
    16. Victor DeMiguel & Javier Gil-Bazo & Francisco J. Nogales & André A. P. Santos, 2021. "Can Machine Learning Help to Select Portfolios of Mutual Funds?," Working Papers 1245, Barcelona School of Economics.
    17. Robert-Paul Berben & Rajni Rasiawan & Jasper de Winter, 2025. "Forecasting Dutch inflation using machine learning methods," Working Papers 828, DNB.
    18. Mekelburg, Erik & Strauss, Jack, 2024. "Pooling and winsorizing machine learning forecasts to predict stock returns with high-dimensional data," Journal of Empirical Finance, Elsevier, vol. 79(C).
    19. Zhu, Haibin & Bai, Lu & He, Lidan & Liu, Zhi, 2023. "Forecasting realized volatility with machine learning: Panel data perspective," Journal of Empirical Finance, Elsevier, vol. 73(C), pages 251-271.
    20. Rad, Hossein & Low, Rand Kwong Yew & Miffre, Joëlle & Faff, Robert, 2023. "The commodity risk premium and neural networks," Journal of Empirical Finance, Elsevier, vol. 74(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:compec:v:66:y:2025:i:1:d:10.1007_s10614-024-10675-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.