IDEAS home Printed from https://ideas.repec.org/a/eee/jjieco/v58y2020ics0889158320300411.html
   My bibliography  Save this article

Macroeconomic forecasting using factor models and machine learning: an application to Japan

Author

Listed:
  • Maehashi, Kohei
  • Shintani, Mototsugu

Abstract

We perform a thorough comparative analysis of factor models and machine learning to forecast Japanese macroeconomic time series. Our main results can be summarized as follows. First, in many instances, factor models and machine learning perform better than the conventional AR model. Second, predictions made by machine learning methods perform particularly well for medium to long forecast horizons. Third, the success of machine learning mainly comes from the nonlinearity and interaction of variables, which suggests the importance of nonlinear structure in predicting the Japanese macroeconomic series. Fourth, the composite forecast of factor models and machine learning performs better than factor models or machine learning alone; and machine learning methods applied to common factors are found to be useful in the composite forecast.

Suggested Citation

  • Maehashi, Kohei & Shintani, Mototsugu, 2020. "Macroeconomic forecasting using factor models and machine learning: an application to Japan," Journal of the Japanese and International Economies, Elsevier, vol. 58(C).
  • Handle: RePEc:eee:jjieco:v:58:y:2020:i:c:s0889158320300411
    DOI: 10.1016/j.jjie.2020.101104
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0889158320300411
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jjie.2020.101104?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    2. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    3. Stock, James H. & Watson, Mark W., 1999. "Forecasting inflation," Journal of Monetary Economics, Elsevier, vol. 44(2), pages 293-335, October.
    4. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    5. Seung C. Ahn & Alex R. Horenstein, 2013. "Eigenvalue Ratio Test for the Number of Factors," Econometrica, Econometric Society, vol. 81(3), pages 1203-1227, May.
    6. Thomas R. Cook & Aaron Smalter Hall, 2017. "Macroeconomic Indicator Forecasting with Deep Neural Networks," Research Working Paper RWP 17-11, Federal Reserve Bank of Kansas City.
    7. James H. Stock & Mark W. Watson, 2012. "Generalized Shrinkage Methods for Forecasting Using Many Predictors," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 30(4), pages 481-493, June.
    8. Jushan Bai & Serena Ng, 2009. "Boosting diffusion indices," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 607-629.
    9. Shintani, Mototsugu, 2005. "Nonlinear Forecasting Analysis Using Diffusion Indexes: An Application to Japan," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 37(3), pages 517-538, June.
    10. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    11. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    12. Blix, Mårten, 1999. "Forecasting Swedish Inflation With a Markov Switching VAR," Working Paper Series 76, Sveriges Riksbank (Central Bank of Sweden).
    13. Nakamura, Emi, 2005. "Inflation forecasting using a neural network," Economics Letters, Elsevier, vol. 86(3), pages 373-378, March.
    14. Boivin, Jean & Ng, Serena, 2006. "Are more data always better for factor analysis?," Journal of Econometrics, Elsevier, vol. 132(1), pages 169-194, May.
    15. Michael Artis & Anindya Banerjee & Massimiliano Marcellino, "undated". "Factor forecasts for the UK," Working Papers 203, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    16. Arthur F. Burns & Wesley C. Mitchell, 1946. "Measuring Business Cycles," NBER Books, National Bureau of Economic Research, Inc, number burn46-1, March.
    17. Diebold, Francis X. & Shin, Minchul, 2019. "Machine learning for regularized survey forecast combination: Partially-egalitarian LASSO and its derivatives," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1679-1691.
    18. Gary Koop & Simon Potter, 2004. "Forecasting in dynamic factor models using Bayesian model averaging," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 550-565, December.
    19. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    20. Jeffrey C. Chen & Abe Dunn & Kyle Hood & Alexander Driessen & Andrea Batch, 2019. "Off to the Races: A Comparison of Machine Learning and Alternative Data for Predicting Economic Indicators," NBER Chapters, in: Big Data for Twenty-First-Century Economic Statistics, pages 373-402, National Bureau of Economic Research, Inc.
    21. Kitamura, Tomiyuki & Koike, Ryoji, 2003. "The Effectiveness of Forecasting Methods Using Multiple Information Variables," Monetary and Economic Studies, Institute for Monetary and Economic Studies, Bank of Japan, vol. 21(1), pages 105-143, February.
    22. Marcelo C. Medeiros & Gabriel F. R. Vasconcelos & Álvaro Veiga & Eduardo Zilberman, 2021. "Forecasting Inflation in a Data-Rich Environment: The Benefits of Machine Learning Methods," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(1), pages 98-119, January.
    23. Thomas J. Sargent & Christopher A. Sims, 1977. "Business cycle modeling without pretending to have too much a priori economic theory," Working Papers 55, Federal Reserve Bank of Minneapolis.
    24. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    25. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    26. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. James T. E. Chapman & Ajit Desai, 2023. "Macroeconomic Predictions Using Payments Data and Machine Learning," Forecasting, MDPI, vol. 5(4), pages 1-32, November.
    2. S. Madhumitha & Anubhab Pattanayak & K.S. Kavi Kumar, 2021. "Crop Diversity and Resilience to Droughts: Evidence from Indian Agriculture," Working Papers 2021-206, Madras School of Economics,Chennai,India.
    3. Dennis Kant & Andreas Pick & Jasper de Winter, 2022. "Nowcasting GDP using machine learning methods," Working Papers 754, DNB.
    4. Ilkin Huseynov & Nazrin Ramazanova & Hikmat Valirzayev, 2022. "Using National Payment System Data to Nowcast Economic Activity in Azerbaijan," IHEID Working Papers 23-2022, Economics Section, The Graduate Institute of International Studies.
    5. James T. E. Chapman & Ajit Desai, 2023. "Macroeconomic Predictions Using Payments Data and Machine Learning," Forecasting, MDPI, vol. 5(4), pages 1-32, November.
    6. Gupta, Somya & Ghardallou, Wafa & Pandey, Dharen Kumar & Sahu, Ganesh P., 2022. "Artificial intelligence adoption in the insurance industry: Evidence using the technology–organization–environment framework," Research in International Business and Finance, Elsevier, vol. 63(C).
    7. Muhammad Anees Khan & Kumail Abbas & Mazliham Mohd Su’ud & Anas A. Salameh & Muhammad Mansoor Alam & Nida Aman & Mehreen Mehreen & Amin Jan & Nik Alif Amri Bin Nik Hashim & Roslizawati Che Aziz, 2022. "Application of Machine Learning Algorithms for Sustainable Business Management Based on Macro-Economic Data: Supervised Learning Techniques Approach," Sustainability, MDPI, vol. 14(16), pages 1-14, August.
    8. Kakuho Furukawa & Ryohei Hisano, 2022. "A Nowcasting Model of Exports Using Maritime Big Data," Bank of Japan Working Paper Series 22-E-19, Bank of Japan.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kohei Maehashi & Mototsugu Shintani, 2020. "Macroeconomic Forecasting Using Factor Models and Machine Learning: An Application to Japan," CIRJE F-Series CIRJE-F-1146, CIRJE, Faculty of Economics, University of Tokyo.
    2. Kim, Hyun Hak & Swanson, Norman R., 2018. "Mining big data using parsimonious factor, machine learning, variable selection and shrinkage methods," International Journal of Forecasting, Elsevier, vol. 34(2), pages 339-354.
    3. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    4. Kim, Hyun Hak & Swanson, Norman R., 2014. "Forecasting financial and macroeconomic variables using data reduction methods: New empirical evidence," Journal of Econometrics, Elsevier, vol. 178(P2), pages 352-367.
    5. Tan, Xueping & Sirichand, Kavita & Vivian, Andrew & Wang, Xinyu, 2022. "Forecasting European carbon returns using dimension reduction techniques: Commodity versus financial fundamentals," International Journal of Forecasting, Elsevier, vol. 38(3), pages 944-969.
    6. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    7. Cepni, Oguzhan & Güney, I. Ethem & Swanson, Norman R., 2019. "Nowcasting and forecasting GDP in emerging markets using global financial and macroeconomic diffusion indexes," International Journal of Forecasting, Elsevier, vol. 35(2), pages 555-572.
    8. Smeekes, Stephan & Wijler, Etienne, 2018. "Macroeconomic forecasting using penalized regression methods," International Journal of Forecasting, Elsevier, vol. 34(3), pages 408-430.
    9. Kihwan Kim & Hyun Hak Kim & Norman R. Swanson, 2023. "Mixing mixed frequency and diffusion indices in good times and in bad: an assessment based on historical data around the great recession of 2008," Empirical Economics, Springer, vol. 64(3), pages 1421-1469, March.
    10. Kutateladze, Varlam, 2022. "The kernel trick for nonlinear factor modeling," International Journal of Forecasting, Elsevier, vol. 38(1), pages 165-177.
    11. Tomohiro Ando & Ruey S. Tsay, 2009. "Model selection for generalized linear models with factor‐augmented predictors," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 25(3), pages 207-235, May.
    12. Norman R. Swanson & Weiqi Xiong, 2018. "Big data analytics in economics: What have we learned so far, and where should we go from here?," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 51(3), pages 695-746, August.
    13. Oguzhan Cepni & I. Ethem Guney & Norman R. Swanson, 2020. "Forecasting and nowcasting emerging market GDP growth rates: The role of latent global economic policy uncertainty and macroeconomic data surprise factors," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 39(1), pages 18-36, January.
    14. Jonas Krampe & Luca Margaritella, 2021. "Factor Models with Sparse VAR Idiosyncratic Components," Papers 2112.07149, arXiv.org, revised May 2022.
    15. Sandra Eickmeier & Christina Ziegler, 2008. "How successful are dynamic factor models at forecasting output and inflation? A meta-analytic approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(3), pages 237-265.
    16. Yoshiki Nakajima & Naoya Sueishi, 2022. "Forecasting the Japanese macroeconomy using high-dimensional data," The Japanese Economic Review, Springer, vol. 73(2), pages 299-324, April.
    17. Hyun Hak Kim, 2013. "Forecasting Macroeconomic Variables Using Data Dimension Reduction Methods: The Case of Korea," Working Papers 2013-26, Economic Research Institute, Bank of Korea.
    18. Olivier Fortin‐Gagnon & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "A large Canadian database for macroeconomic analysis," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 55(4), pages 1799-1833, November.
    19. Anesti, Nikoleta & Kalamara, Eleni & Kapetanios, George, 2021. "Forecasting UK GDP growth with large survey panels," Bank of England working papers 923, Bank of England.
    20. Catherine Doz & Peter Fuleky, 2019. "Dynamic Factor Models," Working Papers 2019-4, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.

    More about this item

    Keywords

    Lasso; Bagging; Random forests; Boosting; Neural network; Composite forecast;
    All these keywords.

    JEL classification:

    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis
    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jjieco:v:58:y:2020:i:c:s0889158320300411. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/622903 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.