IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2312.05593.html
   My bibliography  Save this paper

Economic Forecasts Using Many Noises

Author

Listed:
  • Yuan Liao
  • Xinjie Ma
  • Andreas Neuhierl
  • Zhentao Shi

Abstract

This paper addresses a key question in economic forecasting: does pure noise truly lack predictive power? Economists typically conduct variable selection to eliminate noises from predictors. Yet, we prove a compelling result that in most economic forecasts, the inclusion of noises in predictions yields greater benefits than its exclusion. Furthermore, if the total number of predictors is not sufficiently large, intentionally adding more noises yields superior forecast performance, outperforming benchmark predictors relying on dimension reduction. The intuition lies in economic predictive signals being densely distributed among regression coefficients, maintaining modest forecast bias while diversifying away overall variance, even when a significant proportion of predictors constitute pure noises. One of our empirical demonstrations shows that intentionally adding 300~6,000 pure noises to the Welch and Goyal (2008) dataset achieves a noteworthy 10% out-of-sample R square accuracy in forecasting the annual U.S. equity premium. The performance surpasses the majority of sophisticated machine learning models.

Suggested Citation

  • Yuan Liao & Xinjie Ma & Andreas Neuhierl & Zhentao Shi, 2023. "Economic Forecasts Using Many Noises," Papers 2312.05593, arXiv.org, revised Dec 2023.
  • Handle: RePEc:arx:papers:2312.05593
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2312.05593
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Bryan T. Kelly & Semyon Malamud & Kangying Zhou, 2022. "The Virtue of Complexity in Return Prediction," NBER Working Papers 30217, National Bureau of Economic Research, Inc.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    4. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    5. Ian W. R. Martin & Christian Wagner, 2019. "What Is the Expected Return on a Stock?," Journal of Finance, American Finance Association, vol. 74(4), pages 1887-1929, August.
    6. Jushan Bai & Serena Ng, 2002. "Determining the Number of Factors in Approximate Factor Models," Econometrica, Econometric Society, vol. 70(1), pages 191-221, January.
    7. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    8. Jondeau, Eric & Zhang, Qunzi & Zhu, Xiaoneng, 2019. "Average skewness matters," Journal of Financial Economics, Elsevier, vol. 134(1), pages 29-47.
    9. So, Eric C., 2013. "A new approach to predicting analyst forecast errors: Do investors overweight analyst forecasts?," Journal of Financial Economics, Elsevier, vol. 108(3), pages 615-640.
    10. Riccardo Colacito & Eric Ghysels & Jinghan Meng & Wasin Siwasarit, 2016. "Skewness in Expected Macro Fundamentals and the Predictability of Equity Returns: Evidence and Theory," The Review of Financial Studies, Society for Financial Studies, vol. 29(8), pages 2069-2109.
    11. Fan, Jianqing & Ke, Yuan & Wang, Kaizheng, 2020. "Factor-adjusted regularized model selection," Journal of Econometrics, Elsevier, vol. 216(1), pages 71-85.
    12. Chen, Yong & Eaton, Gregory W. & Paye, Bradley S., 2018. "Micro(structure) before macro? The predictive power of aggregate illiquidity for stock returns and economic activity," Journal of Financial Economics, Elsevier, vol. 130(1), pages 48-73.
    13. Bekaert, Geert & Hoerova, Marie, 2014. "The VIX, the variance premium and stock market volatility," Journal of Econometrics, Elsevier, vol. 183(2), pages 181-192.
    14. Bryan Kelly & Seth Pruitt, 2013. "Market Expectations in the Cross-Section of Present Values," Journal of Finance, American Finance Association, vol. 68(5), pages 1721-1756, October.
    15. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    16. Ian Martin, 2017. "What is the Expected Return on the Market?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 132(1), pages 367-433.
    17. Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
    18. Connor, Gregory & Korajczyk, Robert A., 1988. "Risk and return in an equilibrium APT : Application of a new test methodology," Journal of Financial Economics, Elsevier, vol. 21(2), pages 255-289, September.
    19. Møller, Stig V. & Rangvid, Jesper, 2015. "End-of-the-year economic growth and time-varying expected returns," Journal of Financial Economics, Elsevier, vol. 115(1), pages 136-154.
    20. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    21. Christopher S. Jones & Selale Tuzel, 2013. "New Orders and Asset Prices," The Review of Financial Studies, Society for Financial Studies, vol. 26(1), pages 115-157.
    22. Antoine Didisheim & Shikun (Barry) Ke & Bryan T. Kelly & Semyon Malamud, 2023. "Complexity in Factor Pricing Models," NBER Working Papers 31689, National Bureau of Economic Research, Inc.
    23. Jann Spiess & Guido Imbens & Amar Venugopal, 2023. "Double and Single Descent in Causal Inference with an Application to High-Dimensional Synthetic Control," Papers 2305.00700, arXiv.org, revised Oct 2023.
    24. Dashan Huang & Fuwei Jiang & Jun Tu & Guofu Zhou, 2015. "Investor Sentiment Aligned: A Powerful Predictor of Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 791-837.
    25. Xi Chen & Yang Ha (Tony) Cho & Yiwei Dou & Baruch Lev, 2022. "Predicting Future Earnings Changes Using Machine Learning and Detailed Financial Data," Journal of Accounting Research, Wiley Blackwell, vol. 60(2), pages 467-515, May.
    26. Ng, Serena, 2013. "Variable Selection in Predictive Regressions," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 752-789, Elsevier.
    27. Hirshleifer, David & Hou, Kewei & Teoh, Siew Hong, 2009. "Accruals, cash flows, and aggregate stock returns," Journal of Financial Economics, Elsevier, vol. 91(3), pages 389-406, March.
    28. Victoria Atanasov & Stig V. Møller & Richard Priestley, 2020. "Consumption Fluctuations and Expected Returns," Journal of Finance, American Finance Association, vol. 75(3), pages 1677-1713, June.
    29. Antoine Didisheim & Shikun Ke & Bryan T. Kelly & Semyon Malamud, 2023. "Complexity in Factor Pricing Models," Swiss Finance Institute Research Paper Series 23-19, Swiss Finance Institute.
    30. Chava, Sudheer & Gallmeyer, Michael & Park, Heungju, 2015. "Credit conditions and stock return predictability," Journal of Monetary Economics, Elsevier, vol. 74(C), pages 117-132.
    31. Jushan Bai, 2003. "Inferential Theory for Factor Models of Large Dimensions," Econometrica, Econometric Society, vol. 71(1), pages 135-171, January.
    32. Jushan Bai & Serena Ng, 2006. "Confidence Intervals for Diffusion Index Forecasts and Inference for Factor-Augmented Regressions," Econometrica, Econometric Society, vol. 74(4), pages 1133-1150, July.
    33. Rapach, David E. & Ringgenberg, Matthew C. & Zhou, Guofu, 2016. "Short interest and aggregate stock returns," Journal of Financial Economics, Elsevier, vol. 121(1), pages 46-65.
    34. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhaoxing Gao & Ruey S. Tsay, 2023. "Supervised Dynamic PCA: Linear Dynamic Forecasting with Many Predictors," Papers 2307.07689, arXiv.org.
    2. Huang, Dashan & Li, Jiangyuan & Wang, Liyao, 2021. "Are disagreements agreeable? Evidence from information aggregation," Journal of Financial Economics, Elsevier, vol. 141(1), pages 83-101.
    3. Jianqing Fan & Ricardo Masini & Marcelo C. Medeiros, 2021. "Bridging factor and sparse models," Papers 2102.11341, arXiv.org, revised Sep 2022.
    4. Dashan Huang & Fuwei Jiang & Kunpeng Li & Guoshi Tong & Guofu Zhou, 2022. "Scaled PCA: A New Approach to Dimension Reduction," Management Science, INFORMS, vol. 68(3), pages 1678-1695, March.
    5. Jianqing Fan & Kunpeng Li & Yuan Liao, 2020. "Recent Developments on Factor Models and its Applications in Econometric Learning," Papers 2009.10103, arXiv.org.
    6. Borup, Daniel & Christensen, Bent Jesper & Mühlbach, Nicolaj Søndergaard & Nielsen, Mikkel Slot, 2023. "Targeting predictors in random forest regression," International Journal of Forecasting, Elsevier, vol. 39(2), pages 841-868.
    7. Ziwei Mei & Zhentao Shi, 2022. "On LASSO for High Dimensional Predictive Regression," Papers 2212.07052, arXiv.org, revised Jan 2024.
    8. Kelly, Bryan & Pruitt, Seth, 2015. "The three-pass regression filter: A new approach to forecasting using many predictors," Journal of Econometrics, Elsevier, vol. 186(2), pages 294-316.
    9. Buncic, Daniel & Tischhauser, Martin, 2017. "Macroeconomic factors and equity premium predictability," International Review of Economics & Finance, Elsevier, vol. 51(C), pages 621-644.
    10. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    11. Wang, Yunqi & Zhou, Ti, 2023. "Out-of-sample equity premium prediction: The role of option-implied constraints," Journal of Empirical Finance, Elsevier, vol. 70(C), pages 199-226.
    12. Giovannelli, Alessandro & Massacci, Daniele & Soccorsi, Stefano, 2021. "Forecasting stock returns with large dimensional factor models," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 252-269.
    13. Li, Jun & Wang, Huijun & Yu, Jianfeng, 2018. "Aggregate Expected Investment Growth and Stock Market Returns," ADBI Working Papers 808, Asian Development Bank Institute.
    14. Fan, Jianqing & Jiang, Bai & Sun, Qiang, 2022. "Bayesian factor-adjusted sparse regression," Journal of Econometrics, Elsevier, vol. 230(1), pages 3-19.
    15. Philippe Goulet Coulombe & Maxime Leroux & Dalibor Stevanovic & Stéphane Surprenant, 2022. "How is machine learning useful for macroeconomic forecasting?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 920-964, August.
    16. Tae-Hwy Lee & Ekaterina Seregina, 2020. "Optimal Portfolio Using Factor Graphical Lasso," Working Papers 202025, University of California at Riverside, Department of Economics.
    17. Nii Ayi Armah & Norman Swanson, 2010. "Seeing Inside the Black Box: Using Diffusion Index Methodology to Construct Factor Proxies in Large Scale Macroeconomic Time Series Environments," Econometric Reviews, Taylor & Francis Journals, vol. 29(5-6), pages 476-510.
    18. Back, Kerry & Crotty, Kevin & Kazempour, Seyed Mohammad, 2022. "Validity, tightness, and forecasting power of risk premium bounds," Journal of Financial Economics, Elsevier, vol. 144(3), pages 732-760.
    19. repec:zbw:bofrdp:2018_007 is not listed on IDEAS
    20. Stock, J.H. & Watson, M.W., 2016. "Dynamic Factor Models, Factor-Augmented Vector Autoregressions, and Structural Vector Autoregressions in Macroeconomics," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 415-525, Elsevier.
    21. Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019. "Predictive regressions under asymmetric loss: Factor augmentation and model selection," International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2312.05593. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.