IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2009.03394.html
   My bibliography  Save this paper

Deep Learning, Predictability, and Optimal Portfolio Returns

Author

Listed:
  • Mykola Babiak
  • Jozef Barunik

Abstract

We study dynamic portfolio choice of a long-horizon investor who uses deep learning methods to predict equity returns when forming optimal portfolios. Our results show statistically and economically significant benefits from using deep learning to form optimal portfolios through certainty equivalent returns and Sharpe ratios. We demonstrate that a long-short-term-memory recurrent neural network, which excels in learning complex time-series dependencies, generates a superior performance among a variety of networks considered. Return predictability via deep learning generates substantially improved portfolio performance across different subsamples, particularly during recessionary periods. These gains are robust to including transaction costs, short-selling and borrowing constraints.

Suggested Citation

  • Mykola Babiak & Jozef Barunik, 2020. "Deep Learning, Predictability, and Optimal Portfolio Returns," Papers 2009.03394, arXiv.org, revised Jul 2021.
  • Handle: RePEc:arx:papers:2009.03394
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2009.03394
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Zihao Zhang & Stefan Zohren & Stephen Roberts, 2020. "Deep Learning for Portfolio Optimization," Papers 2005.13665, arXiv.org, revised Jan 2021.
    2. Martin Lettau & Stijn Van Nieuwerburgh, 2008. "Reconciling the Return Predictability Evidence," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1607-1652, July.
    3. Kelly, Bryan T. & Pruitt, Seth & Su, Yinan, 2019. "Characteristics are covariances: A unified model of risk and return," Journal of Financial Economics, Elsevier, vol. 134(3), pages 501-524.
    4. Racine, Jeffrey, 2001. "On the Nonlinear Predictability of Stock Returns Using Financial and Economic Variables," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(3), pages 380-382, July.
    5. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    6. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2021. "Economic Predictions With Big Data: The Illusion of Sparsity," Econometrica, Econometric Society, vol. 89(5), pages 2409-2437, September.
    7. Stefano Giglio & Dacheng Xiu, 2017. "Inference on Risk Premia in the Presence of Omitted Factors," NBER Working Papers 23527, National Bureau of Economic Research, Inc.
    8. Paye, Bradley S. & Timmermann, Allan, 2006. "Instability of return prediction models," Journal of Empirical Finance, Elsevier, vol. 13(3), pages 274-315, June.
    9. Bryan Kelly & Seth Pruitt, 2013. "Market Expectations in the Cross-Section of Present Values," Journal of Finance, American Finance Association, vol. 68(5), pages 1721-1756, October.
    10. Hodrick, Robert J, 1992. "Dividend Yields and Expected Stock Returns: Alternative Procedures for Inference and Measurement," The Review of Financial Studies, Society for Financial Studies, vol. 5(3), pages 357-386.
    11. Luyang Chen & Markus Pelger & Jason Zhu, 2019. "Deep Learning in Asset Pricing," Papers 1904.00745, arXiv.org, revised Aug 2021.
    12. John Y. Campbell & Samuel B. Thompson, 2008. "Predicting Excess Stock Returns Out of Sample: Can Anything Beat the Historical Average?," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1509-1531, July.
    13. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    14. Baillie, Richard T. & Kapetanios, George, 2007. "Testing for Neglected Nonlinearity in Long-Memory Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 447-461, October.
    15. Kozak, Serhiy & Nagel, Stefan & Santosh, Shrihari, 2020. "Shrinking the cross-section," Journal of Financial Economics, Elsevier, vol. 135(2), pages 271-292.
    16. Martin Lettau & Sydney Ludvigson, 2001. "Consumption, Aggregate Wealth, and Expected Stock Returns," Journal of Finance, American Finance Association, vol. 56(3), pages 815-849, June.
    17. Lior Menzly & Tano Santos & Pietro Veronesi, 2004. "Understanding Predictability," Journal of Political Economy, University of Chicago Press, vol. 112(1), pages 1-47, February.
    18. Hutchinson, James M & Lo, Andrew W & Poggio, Tomaso, 1994. "A Nonparametric Approach to Pricing and Hedging Derivative Securities via Learning Networks," Journal of Finance, American Finance Association, vol. 49(3), pages 851-889, July.
    19. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    20. Michael W. McCracken & Serena Ng, 2016. "FRED-MD: A Monthly Database for Macroeconomic Research," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(4), pages 574-589, October.
    21. Wachter, Jessica A., 2006. "A consumption-based model of the term structure of interest rates," Journal of Financial Economics, Elsevier, vol. 79(2), pages 365-399, February.
    22. Andrew Ang & Geert Bekaert, 2007. "Stock Return Predictability: Is it There?," The Review of Financial Studies, Society for Financial Studies, vol. 20(3), pages 651-707.
    23. Antonio Gargano & Davide Pettenuzzo & Allan Timmermann, 2019. "Bond Return Predictability: Economic Value and Links to the Macroeconomy," Management Science, INFORMS, vol. 65(2), pages 508-540, February.
    24. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    25. Dangl, Thomas & Weissensteiner, Alex, 2020. "Optimal Portfolios under Time-Varying Investment Opportunities, Parameter Uncertainty, and Ambiguity Aversion," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 55(4), pages 1163-1198, June.
    26. Joachim Freyberger & Andreas Neuhierl & Michael Weber, 2020. "Dissecting Characteristics Nonparametrically," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2326-2377.
    27. Pesaran, M Hashem & Timmermann, Allan, 1995. "Predictability of Stock Returns: Robustness and Economic Significance," Journal of Finance, American Finance Association, vol. 50(4), pages 1201-1228, September.
    28. Walter Torous & Rossen Valkanov & Shu Yan, 2004. "On Predicting Stock Returns with Nearly Integrated Explanatory Variables," The Journal of Business, University of Chicago Press, vol. 77(4), pages 937-966, October.
    29. Geert Bekaert & Eric C. Engstrom & Nancy R. Xu, 2022. "The Time Variation in Risk Appetite and Uncertainty," Management Science, INFORMS, vol. 68(6), pages 3975-4004, June.
    30. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    31. Wayne E. Ferson & Sergei Sarkissian & Timothy T. Simin, 2003. "Spurious Regressions in Financial Economics?," Journal of Finance, American Finance Association, vol. 58(4), pages 1393-1413, August.
    32. Andrea Buraschi & Alexei Jiltsov, 2007. "Habit Formation and Macroeconomic Models of the Term Structure of Interest Rates," Journal of Finance, American Finance Association, vol. 62(6), pages 3009-3063, December.
    33. John Y. Campbell, Robert J. Shiller, 1988. "The Dividend-Price Ratio and Expectations of Future Dividends and Discount Factors," Review of Financial Studies, Society for Financial Studies, vol. 1(3), pages 195-228.
    34. Ferson, Wayne E & Harvey, Campbell R, 1991. "The Variation of Economic Risk Premiums," Journal of Political Economy, University of Chicago Press, vol. 99(2), pages 385-415, April.
    35. Michael Johannes & Arthur Korteweg & Nicholas Polson, 2014. "Sequential Learning, Predictability, and Optimal Portfolio Returns," Journal of Finance, American Finance Association, vol. 69(2), pages 611-644, April.
    36. Bernard Dumas & Alexander Kurshev & Raman Uppal, 2009. "Equilibrium Portfolio Strategies in the Presence of Sentiment Risk and Excess Volatility," Journal of Finance, American Finance Association, vol. 64(2), pages 579-629, April.
    37. Joachim Freyberger & Andreas Neuhierl & Michael Weber & Andrew KarolyiEditor, 2020. "Dissecting Characteristics Nonparametrically," Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2326-2377.
    38. Jeff Fleming & Chris Kirby & Barbara Ostdiek, 2001. "The Economic Value of Volatility Timing," Journal of Finance, American Finance Association, vol. 56(1), pages 329-352, February.
    39. Campbell, John Y. & Yogo, Motohiro, 2006. "Efficient tests of stock return predictability," Journal of Financial Economics, Elsevier, vol. 81(1), pages 27-60, July.
    40. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    41. Daniele Bianchi & Matthias Büchner & Andrea Tamoni, 2021. "Bond Risk Premiums with Machine Learning [Quadratic term structure models: Theory and evidence]," The Review of Financial Studies, Society for Financial Studies, vol. 34(2), pages 1046-1089.
    42. Guanhao Feng & Jingyu He & Nicholas G. Polson, 2018. "Deep Learning for Predicting Asset Returns," Papers 1804.09314, arXiv.org, revised Apr 2018.
    43. Dangl, Thomas & Halling, Michael, 2012. "Predictive regressions with time-varying coefficients," Journal of Financial Economics, Elsevier, vol. 106(1), pages 157-181.
    44. Clark, Todd E. & West, Kenneth D., 2007. "Approximately normal tests for equal predictive accuracy in nested models," Journal of Econometrics, Elsevier, vol. 138(1), pages 291-311, May.
    45. JULES H. Van BINSBERGEN & RALPH S. J. KOIJEN, 2010. "Predictive Regressions: A Present‐Value Approach," Journal of Finance, American Finance Association, vol. 65(4), pages 1439-1471, August.
    46. Henkel, Sam James & Martin, J. Spencer & Nardari, Federico, 2011. "Time-varying short-horizon predictability," Journal of Financial Economics, Elsevier, vol. 99(3), pages 560-580, March.
    47. Lewellen, Jonathan, 2004. "Predicting returns with financial ratios," Journal of Financial Economics, Elsevier, vol. 74(2), pages 209-235, November.
    48. Ľuboš Pástor & Robert F. Stambaugh, 2009. "Predictive Systems: Living with Imperfect Predictors," Journal of Finance, American Finance Association, vol. 64(4), pages 1583-1628, August.
    49. David E. Rapach & Jack K. Strauss & Guofu Zhou, 2010. "Out-of-Sample Equity Premium Prediction: Combination Forecasts and Links to the Real Economy," The Review of Financial Studies, Society for Financial Studies, vol. 23(2), pages 821-862, February.
    50. K. J. Martijn Cremers, 2002. "Stock Return Predictability: A Bayesian Model Selection Perspective," The Review of Financial Studies, Society for Financial Studies, vol. 15(4), pages 1223-1249.
    51. Shiller, Robert J, 1981. "Do Stock Prices Move Too Much to be Justified by Subsequent Changes in Dividends?," American Economic Review, American Economic Association, vol. 71(3), pages 421-436, June.
    52. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    53. Wayne E. Ferson & Sergei Sarkissian & Timothy T. Simin, 2003. "Spurious Regressions in Financial Economics?," Journal of Finance, American Finance Association, vol. 58(4), pages 1393-1414, August.
    54. Nicholas Barberis, 2000. "Investing for the Long Run when Returns Are Predictable," Journal of Finance, American Finance Association, vol. 55(1), pages 225-264, February.
    55. John H. Cochrane, 2008. "The Dog That Did Not Bark: A Defense of Return Predictability," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1533-1575, July.
    56. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    57. Stambaugh, Robert F., 1999. "Predictive regressions," Journal of Financial Economics, Elsevier, vol. 54(3), pages 375-421, December.
    58. J. B. Heaton & N. G. Polson & J. H. Witte, 2017. "Deep learning for finance: deep portfolios," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 33(1), pages 3-12, January.
    59. Tano Santos & Pietro Veronesi, 2006. "Labor Income and Predictable Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 19(1), pages 1-44.
    60. Kelly, Bryan & Pruitt, Seth, 2015. "The three-pass regression filter: A new approach to forecasting using many predictors," Journal of Econometrics, Elsevier, vol. 186(2), pages 294-316.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Philippe Goulet Coulombe & Maximilian Goebel, 2023. "Maximally Machine-Learnable Portfolios," Papers 2306.05568, arXiv.org, revised Apr 2024.
    2. Weidong Lin & Abderrahim Taamouti, 2023. "Portfolio Selection Under Non-Gaussianity And Systemic Risk: A Machine Learning Based Forecasting Approach," Working Papers 202310, University of Liverpool, Department of Economics.
    3. Jozef Barunik & Lubos Hanus, 2022. "Learning Probability Distributions in Macroeconomics and Finance," Papers 2204.06848, arXiv.org.
    4. Philippe Goulet Coulombe & Maximilian Gobel, 2023. "Maximally Machine-Learnable Portfolios," Working Papers 23-01, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management, revised Apr 2023.
    5. Zhenning Hong & Ruyan Tian & Qing Yang & Weiliang Yao & Tingting Ye & Liangliang Zhang, 2021. "Asset Allocation via Machine Learning," Accounting and Finance Research, Sciedu Press, vol. 10(4), pages 1-34, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rapach, David & Zhou, Guofu, 2013. "Forecasting Stock Returns," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 328-383, Elsevier.
    2. Michael Johannes & Arthur Korteweg & Nicholas Polson, 2014. "Sequential Learning, Predictability, and Optimal Portfolio Returns," Journal of Finance, American Finance Association, vol. 69(2), pages 611-644, April.
    3. Leland E. Farmer & Lawrence Schmidt & Allan Timmermann, 2023. "Pockets of Predictability," Journal of Finance, American Finance Association, vol. 78(3), pages 1279-1341, June.
    4. Ľuboš Pástor & Robert F. Stambaugh, 2009. "Predictive Systems: Living with Imperfect Predictors," Journal of Finance, American Finance Association, vol. 64(4), pages 1583-1628, August.
    5. Nonejad, Nima, 2021. "Predicting equity premium using dynamic model averaging. Does the state–space representation matter?," The North American Journal of Economics and Finance, Elsevier, vol. 57(C).
    6. Schrimpf, Andreas, 2010. "International stock return predictability under model uncertainty," Journal of International Money and Finance, Elsevier, vol. 29(7), pages 1256-1282, November.
    7. Smith, Simon C., 2021. "International stock return predictability," International Review of Financial Analysis, Elsevier, vol. 78(C).
    8. Daniel Mantilla-García & Vijay Vaidyanathan, 2017. "Predicting stock returns in the presence of uncertain structural changes and sample noise," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 31(3), pages 357-391, August.
    9. Wachter, Jessica A. & Warusawitharana, Missaka, 2009. "Predictable returns and asset allocation: Should a skeptical investor time the market?," Journal of Econometrics, Elsevier, vol. 148(2), pages 162-178, February.
    10. Pettenuzzo, Davide & Timmermann, Allan & Valkanov, Rossen, 2014. "Forecasting stock returns under economic constraints," Journal of Financial Economics, Elsevier, vol. 114(3), pages 517-553.
    11. Chen, Long, 2009. "On the reversal of return and dividend growth predictability: A tale of two periods," Journal of Financial Economics, Elsevier, vol. 92(1), pages 128-151, April.
    12. Bakshi, Gurdip & Panayotov, George & Skoulakis, Georgios, 2011. "Improving the predictability of real economic activity and asset returns with forward variances inferred from option portfolios," Journal of Financial Economics, Elsevier, vol. 100(3), pages 475-495, June.
    13. Yufeng Han, 2010. "On the Economic Value of Return Predictability," Annals of Economics and Finance, Society for AEF, vol. 11(1), pages 1-33, May.
    14. Lawrenz, Jochen & Zorn, Josef, 2017. "Predicting international stock returns with conditional price-to-fundamental ratios," Journal of Empirical Finance, Elsevier, vol. 43(C), pages 159-184.
    15. Ferreira, Miguel A. & Santa-Clara, Pedro, 2011. "Forecasting stock market returns: The sum of the parts is more than the whole," Journal of Financial Economics, Elsevier, vol. 100(3), pages 514-537, June.
    16. Pyun, Sungjune, 2019. "Variance risk in aggregate stock returns and time-varying return predictability," Journal of Financial Economics, Elsevier, vol. 132(1), pages 150-174.
    17. Christopher J. Neely & David E. Rapach & Jun Tu & Guofu Zhou, 2014. "Forecasting the Equity Risk Premium: The Role of Technical Indicators," Management Science, INFORMS, vol. 60(7), pages 1772-1791, July.
    18. Victoria Atanasov & Stig V. Møller & Richard Priestley, 2020. "Consumption Fluctuations and Expected Returns," Journal of Finance, American Finance Association, vol. 75(3), pages 1677-1713, June.
    19. Jiang, Fuwei & Lee, Joshua & Martin, Xiumin & Zhou, Guofu, 2019. "Manager sentiment and stock returns," Journal of Financial Economics, Elsevier, vol. 132(1), pages 126-149.
    20. Wang, Yudong & Pan, Zhiyuan & Liu, Li & Wu, Chongfeng, 2019. "Oil price increases and the predictability of equity premium," Journal of Banking & Finance, Elsevier, vol. 102(C), pages 43-58.

    More about this item

    JEL classification:

    • C45 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Neural Networks and Related Topics
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions
    • G17 - Financial Economics - - General Financial Markets - - - Financial Forecasting and Simulation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2009.03394. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.