IDEAS home Printed from https://ideas.repec.org/p/tky/fseres/2020cf1146.html

Macroeconomic Forecasting Using Factor Models and Machine Learning: An Application to Japan

Author

Listed:
  • Kohei Maehashi

    (School of Engineering, The University of Tokyo)

  • Mototsugu Shintani

    (Faculty of Economics, The University of Tokyo)

Abstract

We perform a thorough comparative analysis of factor models and machine learning to forecast Japanese macroeconomic time series. Our main results can be summarized as follows. First, factor models and machine learning perform better than the con-ventional AR model in many cases. Second, predictions made by machine learning methods perform particularly well for medium to long forecast horizons. Third, the success of machine learning mainly comes from the nonlinearity and interaction ofvariables, suggesting the importance of nonlinear structure in predicting the Japanese macroeconomic series. Fourth, while neural networks are helpful in forecasting, simply adding many hidden layers does not necessarily enhance its forecast accuracy. Fifth, the composite forecast of factor models and machine learning performs better than factor models or machine learning alone, and machine learning methods applied to principal components are found to be useful in the composite forecast.

Suggested Citation

  • Kohei Maehashi & Mototsugu Shintani, 2020. "Macroeconomic Forecasting Using Factor Models and Machine Learning: An Application to Japan," CIRJE F-Series CIRJE-F-1146, CIRJE, Faculty of Economics, University of Tokyo.
  • Handle: RePEc:tky:fseres:2020cf1146
    as

    Download full text from publisher

    File URL: http://www.cirje.e.u-tokyo.ac.jp/research/dp/2020/2020cf1146.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    2. Blix, Mårten, 1999. "Forecasting Swedish Inflation With a Markov Switching VAR," Working Paper Series 76, Sveriges Riksbank (Central Bank of Sweden).
    3. Shintani, Mototsugu, 2005. "Nonlinear Forecasting Analysis Using Diffusion Indexes: An Application to Japan," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 517-538, June.
    4. Inoue, Atsushi & Kilian, Lutz, 2008. "How Useful Is Bagging in Forecasting Economic Time Series? A Case Study of U.S. Consumer Price Inflation," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 511-522, June.
    5. Nakamura, Emi, 2005. "Inflation forecasting using a neural network," Economics Letters, Elsevier, vol. 86(3), pages 373-378, March.
    6. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    7. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    8. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    9. Michael Artis & Anindya Banerjee & Massimiliano Marcellino, "undated". "Factor forecasts for the UK," Working Papers 203, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    10. Thomas R. Cook & Aaron Smalter Hall, 2017. "Macroeconomic Indicator Forecasting with Deep Neural Networks," Research Working Paper RWP 17-11, Federal Reserve Bank of Kansas City.
    11. Arthur F. Burns & Wesley C. Mitchell, 1946. "Measuring Business Cycles," NBER Books, National Bureau of Economic Research, Inc, number burn46-1.
    12. Clark, Todd E. & McCracken, Michael W., 2009. "Tests of Equal Predictive Ability With Real-Time Data," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 441-454.
    13. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    14. Pesaran, M. Hashem & Pick, Andreas & Timmermann, Allan, 2011. "Variable selection, estimation and inference for multi-period forecasting problems," Journal of Econometrics, Elsevier, vol. 164(1), pages 173-187, September.
    15. Gary Koop & Simon Potter, 2004. "Forecasting in dynamic factor models using Bayesian model averaging," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 550-565, December.
    16. James H. Stock & Mark W. Watson, 2012. "Generalized Shrinkage Methods for Forecasting Using Many Predictors," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(4), pages 481-493, June.
    17. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    18. Jeffrey C. Chen & Abe Dunn & Kyle Hood & Alexander Driessen & Andrea Batch, 2019. "Off to the Races: A Comparison of Machine Learning and Alternative Data for Predicting Economic Indicators," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 373-402, National Bureau of Economic Research, Inc.
    19. Kitamura, Tomiyuki & Koike, Ryoji, 2003. "The Effectiveness of Forecasting Methods Using Multiple Information Variables," Monetary and Economic Studies, Institute for Monetary and Economic Studies, Bank of Japan, vol. 21(1), pages 105-143, February.
    20. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    21. Marcelo C. Medeiros & Gabriel F. R. Vasconcelos & Álvaro Veiga & Eduardo Zilberman, 2021. "Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 98-119, January.
    22. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    23. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    24. Yoshiki Nakajima & Naoya Sueishi, 2022. "Forecasting the Japanese macroeconomy using high-dimensional data," The Japanese Economic Review, Springer, vol. 73(2), pages 299-324, April.
    25. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    26. Jushan Bai & Serena Ng, 2009. "Boosting diffusion indices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 607-629.
    27. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    28. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    29. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    30. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Danilo Leiva-León & Rodrigo Sekkel & Luis Uzeda, 2026. "Do Monetary Policy Shocks Affect the Neutral Rate of Interest?," Staff Working Papers 26-6, Bank of Canada.
    2. komaki, Yasuyuki, 2023. "Why is the forecast error of quarterly GDP in Japan so large? – From an international comparison of quarterly GDP forecast situation," Japan and the World Economy, Elsevier, vol. 66(C).
    3. Tingguo Zheng & Xinyue Fan & Wei Jin & Kuangnan Fang, 2024. "Forecasting CPI with multisource data: The value of media and internet information," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(3), pages 702-753, April.
    4. Адилханова Зарина // Adilkhanova Zarina & Ержан Ислам // Yerzhan Islam, 2024. "Система селективно - комбинированного прогноза инфляции (SSCIF)// Selective-Combined Inflation Forecasting System," Working Papers #2024-13, National Bank of Kazakhstan.
    5. Jesús Alejandro Navarro Acosta & Valeria Soto Mendoza & Laura Policardo & Edgar Javier Sánchez Carrera, 2025. "Modeling economic growth in pandemic times with machine learning regression algorithms," Remef - Revista Mexicana de Economía y Finanzas Nueva Época REMEF (The Mexican Journal of Economics and Finance), Instituto Mexicano de Ejecutivos de Finanzas, IMEF, vol. 20(1), pages 1-33, Enero - M.
    6. Anubhab Pattanayak & Madhumitha Srinivasan & K. S. Kavi Kumar, 2023. "Crop Diversity and Resilience to Droughts: Evidence from Indian Agriculture," Review of Development and Change, , vol. 28(2), pages 166-188, December.
    7. Ádám Csápai, 0000. "Macroeconomic Forecasting Using Machine Learning: A Case of Slovakia," Proceedings of Economics and Finance Conferences 14115967, International Institute of Social and Economic Sciences.
    8. Dennis Kant & Andreas Pick & Jasper de Winter, 2025. "Nowcasting GDP using machine learning methods," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 109(1), pages 1-24, March.
    9. Ilkin Huseynov & Nazrin Ramazanova & Hikmat Valirzayev, 2022. "Using National Payment System Data to Nowcast Economic Activity in Azerbaijan," Working Papers 2201, Central Bank of Azerbaijan Republic.
    10. Gupta, Somya & Ghardallou, Wafa & Pandey, Dharen Kumar & Sahu, Ganesh P., 2022. "Artificial intelligence adoption in the insurance industry: Evidence using the technology–organization–environment framework," Research in International Business and Finance, Elsevier, vol. 63(C).
    11. James T. E. Chapman & Ajit Desai, 2023. "Macroeconomic Predictions Using Payments Data and Machine Learning," Forecasting, MDPI, vol. 5(4), pages 1-32, November.
    12. Kakuho Furukawa & Ryohei Hisano, 2022. "A Nowcasting Model of Exports Using Maritime Big Data," Bank of Japan Working Paper Series 22-E-19, Bank of Japan.
    13. Hasnain Iftikhar & Faridoon Khan & Paulo Canas Rodrigues & Abdulmajeed Atiah Alharbi & Jeza Allohibi, 2025. "Forecasting of Inflation Based on Univariate and Multivariate Time Series Models: An Empirical Application," Mathematics, MDPI, vol. 13(7), pages 1-18, March.
    14. Sun, Weixin & Wang, Yong & Zhang, Li & Chen, Xihui Haviour & Hoang, Yen Hai, 2025. "Enhancing economic cycle forecasting based on interpretable machine learning and news narrative sentiment," Technological Forecasting and Social Change, Elsevier, vol. 215(C).
    15. Juan Jos√© Rinc√≥n Brice√±o, 2025. "Colombian economic activity nowcasting: addressing nonlinearities and high dimensionality through machine-learning," Documentos CEDE 21388, Universidad de los Andes, Facultad de Economía, CEDE.
    16. Abdukakhkhor Abdurakhmonov, 2026. "Macroeconomic Forecasting Using Machine Learning Methods: An Application to Uzbekistan," IHEID Working Papers 19-2026, Economics Section, The Graduate Institute of International Studies.
    17. Angelica Ghiselli, 2026. "The Impact of Uncertainty on Forecasting the US Economy," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 45(6), pages 2703-2734, September.
    18. Khan, Faridoon & Muhammadullah, Sara & Sharif, Arshian & Lee, Chien-Chiang, 2024. "The role of green energy stock market in forecasting China's crude oil market: An application of IIS approach and sparse regression models," Energy Economics, Elsevier, vol. 130(C).
    19. Robert-Paul Berben & Rajni Rasiawan & Jasper de Winter, 2025. "Forecasting Dutch inflation using machine learning methods," Working Papers 828, DNB.
    20. Junko Koeda & Bin Wei, 2025. "Forward Guidance and Its Effectiveness: A Macro-Finance Shadow-Rate Framework," Working Papers 2423, Waseda University, Faculty of Political Science and Economics.
    21. Muhammad Anees Khan & Kumail Abbas & Mazliham Mohd Su’ud & Anas A. Salameh & Muhammad Mansoor Alam & Nida Aman & Mehreen Mehreen & Amin Jan & Nik Alif Amri Bin Nik Hashim & Roslizawati Che Aziz, 2022. "Application of Machine Learning Algorithms for Sustainable Business Management Based on Macro-Economic Data: Supervised Learning Techniques Approach," Sustainability, MDPI, vol. 14(16), pages 1-14, August.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    2. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    3. Tan, Xueping & Sirichand, Kavita & Vivian, Andrew & Wang, Xinyu, 2022. "Forecasting European carbon returns using dimension reduction techniques: Commodity versus financial fundamentals," International Journal of Forecasting, Elsevier, vol. 38(3), pages 944-969.
    4. Bae, Juhee, 2024. "Factor-augmented forecasting in big data," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1660-1688.
    5. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    6. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    7. Hasnain Iftikhar & Faridoon Khan & Paulo Canas Rodrigues & Abdulmajeed Atiah Alharbi & Jeza Allohibi, 2025. "Forecasting of Inflation Based on Univariate and Multivariate Time Series Models: An Empirical Application," Mathematics, MDPI, vol. 13(7), pages 1-18, March.
    8. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    9. Cepni, Oguzhan & Güney, I. Ethem & Swanson, Norman R., 2019. "Nowcasting and forecasting GDP in emerging markets using global financial and macroeconomic diffusion indexes," International Journal of Forecasting, Elsevier, vol. 35(2), pages 555-572.
    10. Hyun Hak Kim & Norman Swanson, 2013. "Mining Big Data Using Parsimonious Factor and Shrinkage Methods," Departmental Working Papers 201316, Rutgers University, Department of Economics.
    11. Joseph, Andreas & Potjagailo, Galina & Chakraborty, Chiranjit & Kapetanios, George, 2024. "Forecasting UK inflation bottom up," International Journal of Forecasting, Elsevier, vol. 40(4), pages 1521-1538.
    12. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers halshs-02262202, HAL.
    13. Kihwan Kim & Hyun Hak Kim & Norman R. Swanson, 2023. "Mixing mixed frequency and diffusion indices in good times and in bad: an assessment based on historical data around the great recession of 2008," Empirical Economics, Springer, vol. 64(3), pages 1421-1469, March.
    14. Pijush Kanti Das & Prabir Kumar Das, 2024. "Forecasting and Analyzing Predictors of Inflation Rate: Using Machine Learning Approach," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 22(2), pages 493-517, June.
    15. Kutateladze, Varlam, 2022. "The kernel trick for nonlinear factor modeling," International Journal of Forecasting, Elsevier, vol. 38(1), pages 165-177.
    16. Smeekes, Stephan & Wijler, Etienne, 2018. "Macroeconomic forecasting using penalized regression methods," International Journal of Forecasting, Elsevier, vol. 34(3), pages 408-430.
    17. Cheng, Xu & Hansen, Bruce E., 2015. "Forecasting with factor-augmented regression: A frequentist model averaging approach," Journal of Econometrics, Elsevier, vol. 186(2), pages 280-293.
    18. T. Ando & R. S. Tsay, 2009. "‘Model selection for generalized linear models with factor‐augmented predictors’," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 25(3), pages 243-246, May.
    19. Oguzhan Cepni & I. Ethem Guney & Norman R. Swanson, 2020. "Forecasting and nowcasting emerging market GDP growth rates: The role of latent global economic policy uncertainty and macroeconomic data surprise factors," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(1), pages 18-36, January.
    20. Jonas Krampe & Luca Margaritella, 2021. "Factor Models with Sparse VAR Idiosyncratic Components," Papers 2112.07149, arXiv.org, revised May 2022.

    More about this item

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tky:fseres:2020cf1146. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CIRJE administrative office (email available below). General contact details of provider: https://edirc.repec.org/data/ritokjp.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.