IDEAS home Printed from https://ideas.repec.org/a/spr/orspec/v45y2023i1d10.1007_s00291-022-00693-w.html
   My bibliography  Save this article

Machine learning techniques for cross-sectional equity returns’ prediction

Author

Listed:
  • Christian Fieberg

    (University of Bremen
    University of Luxembourg
    Concordia University)

  • Daniel Metko

    (University of Bremen
    Concordia University)

  • Thorsten Poddig

    (University of Bremen)

  • Thomas Loy

    (University of Bremen)

Abstract

We compare the performance of the linear regression model, which is the current standard in science and practice for cross-sectional stock return forecasting, with that of machine learning methods, i.e., penalized linear models, support vector regression, random forests, gradient boosted trees and neural networks. Our analysis is based on monthly data on nearly 12,000 individual stocks from 16 European economies over almost 30 years from 1990 to 2019. We find that the prediction of stock returns can be decisively improved through machine learning methods. The outperformance of individual (combined) machine learning models over the benchmark model is approximately 0.6% (0.7%) per month for the full cross-section of stocks. Furthermore, we find no model breakdowns, which suggests that investors do not incur additional risk from using machine learning methods compared to the traditional benchmark approach. Additionally, the superior performance of machine learning models is not due to substantially higher portfolio turnover. Further analyses suggest that machine learning models generate their added value particularly in bear markets when the average investor tends to lose money. Our results indicate that future research and practice should make more intensive use of machine learning techniques with respect to stock return prediction.

Suggested Citation

  • Christian Fieberg & Daniel Metko & Thorsten Poddig & Thomas Loy, 2023. "Machine learning techniques for cross-sectional equity returns’ prediction," OR Spectrum: Quantitative Approaches in Management, Springer;Gesellschaft für Operations Research e.V., vol. 45(1), pages 289-323, March.
  • Handle: RePEc:spr:orspec:v:45:y:2023:i:1:d:10.1007_s00291-022-00693-w
    DOI: 10.1007/s00291-022-00693-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00291-022-00693-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00291-022-00693-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kelly, Bryan T. & Pruitt, Seth & Su, Yinan, 2019. "Characteristics are covariances: A unified model of risk and return," Journal of Financial Economics, Elsevier, vol. 134(3), pages 501-524.
    2. Ivo Welch & Amit Goyal, 2008. "A Comprehensive Look at The Empirical Performance of Equity Premium Prediction," The Review of Financial Studies, Society for Financial Studies, vol. 21(4), pages 1455-1508, July.
    3. Ralph S.J. Koijen & Stijn Van Nieuwerburgh, 2011. "Predictability of Returns and Cash Flows," Annual Review of Financial Economics, Annual Reviews, vol. 3(1), pages 467-491, December.
    4. Nelson, Charles R, 1976. "Inflation and Rates of Return on Common Stocks," Journal of Finance, American Finance Association, vol. 31(2), pages 471-483, May.
    5. Wang, Kevin Q. & Xu, Jianguo, 2015. "Market volatility and momentum," Journal of Empirical Finance, Elsevier, vol. 30(C), pages 79-91.
    6. Lewellen, Jonathan, 2015. "The Cross-section of Expected Stock Returns," Critical Finance Review, now publishers, vol. 4(1), pages 1-44, June.
    7. Enno Mammen & Jens Perch Nielsen & Michael Scholz & Stefan Sperlich, 2019. "Conditional Variance Forecasts for Long-Term Stock Returns," Risks, MDPI, vol. 7(4), pages 1-22, November.
    8. John M. Griffin & Nicholas H. Hirschey & Patrick J. Kelly, 2011. "How Important Is the Financial Media in Global Markets?," The Review of Financial Studies, Society for Financial Studies, vol. 24(12), pages 3941-3992.
    9. Liu, Qingfu & Tao, Zhenyi & Tse, Yiuman & Wang, Chuanjie, 2022. "Stock market prediction with deep learning: The case of China," Finance Research Letters, Elsevier, vol. 46(PA).
    10. Novy-Marx, Robert, 2013. "The other side of value: The gross profitability premium," Journal of Financial Economics, Elsevier, vol. 108(1), pages 1-28.
    11. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    12. R. David Mclean & Jeffrey Pontiff, 2016. "Does Academic Research Destroy Stock Return Predictability?," Journal of Finance, American Finance Association, vol. 71(1), pages 5-32, February.
    13. Leippold, Markus & Wang, Qian & Zhou, Wenyu, 2022. "Machine learning in the Chinese stock market," Journal of Financial Economics, Elsevier, vol. 145(2), pages 64-82.
    14. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    15. Jishnu Das & Quy-Toan Do, 2020. "US and them - The geography of academic research," Vox eBook Chapters, in: Sebastian Galliani & Ugo Panizza (ed.), Publishing and Measuring Success in Economics, edition 1, volume 1, chapter 1, pages 111-114, Centre for Economic Policy Research.
    16. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    17. Xi Dong & Yan Li & David E. Rapach & Guofu Zhou, 2022. "Anomalies and the Expected Market Return," Journal of Finance, American Finance Association, vol. 77(1), pages 639-681, February.
    18. Kingsley Y. L. Fong & Craig W. Holden & Charles A. Trzcinka, 2017. "What Are the Best Liquidity Proxies for Global Research?," Review of Finance, European Finance Association, vol. 21(4), pages 1355-1401.
    19. Cahan, Ercument & Bai, Jushan & Ng, Serena, 2023. "Factor-based imputation of missing values and covariances in panel data of large dimensions," Journal of Econometrics, Elsevier, vol. 233(1), pages 113-131.
    20. Fama, Eugene F. & French, Kenneth R., 1989. "Business conditions and expected returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 25(1), pages 23-49, November.
    21. Karolyi, G. Andrew & Lee, Kuan-Hui & van Dijk, Mathijs A., 2012. "Understanding commonality in liquidity around the world," Journal of Financial Economics, Elsevier, vol. 105(1), pages 82-112.
    22. Tobek, Ondrej & Hronec, Martin, 2021. "Does it pay to follow anomalies research? Machine learning approach with international evidence," Journal of Financial Markets, Elsevier, vol. 56(C).
    23. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    24. Zaremba, Adam & Umutlu, Mehmet & Maydybura, Alina, 2020. "Where have the profits gone? Market efficiency and the disappearing equity anomalies in country and industry returns," Journal of Banking & Finance, Elsevier, vol. 121(C).
    25. Rubesam, Alexandre, 2022. "Machine learning portfolios with equal risk contributions: Evidence from the Brazilian market," Emerging Markets Review, Elsevier, vol. 51(PB).
    26. Frazzini, Andrea & Pedersen, Lasse Heje, 2014. "Betting against beta," Journal of Financial Economics, Elsevier, vol. 111(1), pages 1-25.
    27. van Dijk, Mathijs A., 2011. "Is size dead? A review of the size effect in equity returns," Journal of Banking & Finance, Elsevier, vol. 35(12), pages 3263-3274.
    28. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    29. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    30. Ioannis Kyriakou & Parastoo Mousavi & Jens Perch Nielsen & Michael Scholz, 2021. "Forecasting benchmarks of long-term stock returns via machine learning," Annals of Operations Research, Springer, vol. 297(1), pages 221-240, February.
    31. Titman, Sheridan & Wei, K. C. John & Xie, Feixue, 2004. "Capital Investments and Stock Returns," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 39(4), pages 677-700, December.
    32. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    33. Eugene F. Fama & Kenneth R. French, 2008. "Dissecting Anomalies," Journal of Finance, American Finance Association, vol. 63(4), pages 1653-1678, August.
    34. John M. Griffin & Patrick J. Kelly & Federico Nardari, 2010. "Do Market Efficiency Measures Yield Correct Inferences? A Comparison of Developed and Emerging Markets," The Review of Financial Studies, Society for Financial Studies, vol. 23(8), pages 3225-3277, August.
    35. Jacobs, Heiko & Müller, Sebastian, 2020. "Anomalies across the globe: Once public, no longer existent?," Journal of Financial Economics, Elsevier, vol. 135(1), pages 213-230.
    36. Carhart, Mark M, 1997. "On Persistence in Mutual Fund Performance," Journal of Finance, American Finance Association, vol. 52(1), pages 57-82, March.
    37. Campbell, John Y., 1987. "Stock returns and the term structure," Journal of Financial Economics, Elsevier, vol. 18(2), pages 373-399, June.
    38. Ozgur S. Ince & R. Burt Porter, 2006. "Individual Equity Return Data From Thomson Datastream: Handle With Care!," Journal of Financial Research, Southern Finance Association;Southwestern Finance Association, vol. 29(4), pages 463-479, December.
    39. Israel, Ronen & Moskowitz, Tobias J., 2013. "The role of shorting, firm size, and time on market anomalies," Journal of Financial Economics, Elsevier, vol. 108(2), pages 275-301.
    40. Vaibhav Lalwani & Vedprakash Vasantrao Meshram, 2022. "The cross-section of Indian stock returns: evidence using machine learning," Applied Economics, Taylor & Francis Journals, vol. 54(16), pages 1814-1828, April.
    41. Ľuboš Pástor & Robert F. Stambaugh, 2009. "Predictive Systems: Living with Imperfect Predictors," Journal of Finance, American Finance Association, vol. 64(4), pages 1583-1628, August.
    42. Annaert, Jan & De Ceuster, Marc & Verstegen, Kurt, 2013. "Are extreme returns priced in the stock market? European evidence," Journal of Banking & Finance, Elsevier, vol. 37(9), pages 3401-3411.
    43. Enno Mammen & Jens Perch Nielsen & Michael Scholz & Stefan Sperlich, 2019. "Conditional variance forecasts for long-term stock returns," Graz Economics Papers 2019-08, University of Graz, Department of Economics.
    44. Campbell R. Harvey, 2017. "Presidential Address: The Scientific Outlook in Financial Economics," Journal of Finance, American Finance Association, vol. 72(4), pages 1399-1440, August.
    45. Beckmeyer, Heiner & Wiedemann, Timo, 2022. "Recovering Missing Firm Characteristics with Attention-Based Machine Learning," VfS Annual Conference 2022 (Basel): Big Data in Economics 264135, Verein für Socialpolitik / German Economic Association.
    46. Michael J. Cooper & Roberto C. Gutierrez & Allaudeen Hameed, 2004. "Market States and Momentum," Journal of Finance, American Finance Association, vol. 59(3), pages 1345-1365, June.
    47. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    48. Kerrie Woodhouse & Paul Mather & Dinithi Ranasinghe & Tom Smith, 2017. "Externally reported performance measures and benchmarks in Australia," Accounting and Finance, Accounting and Finance Association of Australia and New Zealand, vol. 57(3), pages 879-905, September.
    49. repec:oup:rfinst:v:21:y:2017:i:4:p:1355-1401. is not listed on IDEAS
    50. Leitch, Gordon & Tanner, J Ernest, 1991. "Economic Forecast Evaluation: Profits versus the Conventional Error Measures," American Economic Review, American Economic Association, vol. 81(3), pages 580-590, June.
    51. Jeremiah Green & John R. M. Hand & X. Frank Zhang, 2017. "The Characteristics that Provide Independent Information about Average U.S. Monthly Stock Returns," The Review of Financial Studies, Society for Financial Studies, vol. 30(12), pages 4389-4436.
    52. Fama, Eugene F. & French, Kenneth R., 1988. "Dividend yields and expected stock returns," Journal of Financial Economics, Elsevier, vol. 22(1), pages 3-25, October.
    53. Lesmond, David A & Ogden, Joseph P & Trzcinka, Charles A, 1999. "A New Estimate of Transaction Costs," The Review of Financial Studies, Society for Financial Studies, vol. 12(5), pages 1113-1141.
    54. Banz, Rolf W., 1981. "The relationship between return and market value of common stocks," Journal of Financial Economics, Elsevier, vol. 9(1), pages 3-18, March.
    55. Wolfgang Drobetz & Tizian Otto, 2021. "Empirical asset pricing via machine learning: evidence from the European stock market," Journal of Asset Management, Palgrave Macmillan, vol. 22(7), pages 507-538, December.
    56. G. Andrew Karolyi, 2016. "Home Bias, an Academic Puzzle," Review of Finance, European Finance Association, vol. 20(6), pages 2049-2078.
    57. Jegadeesh, Narasimhan & Titman, Sheridan, 1993. "Returns to Buying Winners and Selling Losers: Implications for Stock Market Efficiency," Journal of Finance, American Finance Association, vol. 48(1), pages 65-91, March.
    58. Goyal, Amit & Wahal, Sunil, 2015. "Is Momentum an Echo?," Journal of Financial and Quantitative Analysis, Cambridge University Press, vol. 50(6), pages 1237-1267, December.
    59. Campbell, Cynthia J. & Cowan, Arnold R. & Salotti, Valentina, 2010. "Multi-country event-study methods," Journal of Banking & Finance, Elsevier, vol. 34(12), pages 3078-3090, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hanauer, Matthias X. & Kalsbach, Tobias, 2023. "Machine learning and the cross-section of emerging market stock returns," Emerging Markets Review, Elsevier, vol. 55(C).
    2. Cakici, Nusret & Zaremba, Adam, 2023. "Recency bias and the cross-section of international stock returns," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 84(C).
    3. Cakici, Nusret & Fieberg, Christian & Metko, Daniel & Zaremba, Adam, 2023. "Machine learning goes global: Cross-sectional return predictability in international stock markets," Journal of Economic Dynamics and Control, Elsevier, vol. 155(C).
    4. Cakici, Nusret & Zaremba, Adam, 2022. "Salience theory and the cross-section of stock returns: International and further evidence," Journal of Financial Economics, Elsevier, vol. 146(2), pages 689-725.
    5. Adam Zaremba & Jacob Koby Shemer, 2018. "Price-Based Investment Strategies," Springer Books, Springer, number 978-3-319-91530-2, September.
    6. Cakici, Nusret & Zaremba, Adam & Bianchi, Robert J. & Pham, Nga, 2021. "False discoveries in the anomaly research: New insights from the Stock Exchange of Melbourne (1927–1987)," Pacific-Basin Finance Journal, Elsevier, vol. 70(C).
    7. Vitor Azevedo & Georg Sebastian Kaiser & Sebastian Mueller, 2023. "Stock market anomalies and machine learning across the globe," Journal of Asset Management, Palgrave Macmillan, vol. 24(5), pages 419-441, September.
    8. Tobek, Ondrej & Hronec, Martin, 2021. "Does it pay to follow anomalies research? Machine learning approach with international evidence," Journal of Financial Markets, Elsevier, vol. 56(C).
    9. Clarke, Charles, 2022. "The level, slope, and curve factor model for stocks," Journal of Financial Economics, Elsevier, vol. 143(1), pages 159-187.
    10. Cakici, Nusret & Zaremba, Adam, 2021. "Liquidity and the cross-section of international stock returns," Journal of Banking & Finance, Elsevier, vol. 127(C).
    11. Söhnke M. Bartram & Harald Lohre & Peter F. Pope & Ananthalakshmi Ranganathan, 2021. "Navigating the factor zoo around the world: an institutional investor perspective," Journal of Business Economics, Springer, vol. 91(5), pages 655-703, July.
    12. Hanauer, Matthias X. & Lauterbach, Jochim G., 2019. "The cross-section of emerging market stock returns," Emerging Markets Review, Elsevier, vol. 38(C), pages 265-286.
    13. Hanauer, Matthias X. & Windmüller, Steffen, 2023. "Enhanced momentum strategies," Journal of Banking & Finance, Elsevier, vol. 148(C).
    14. Huber, Daniel & Jacobs, Heiko & Müller, Sebastian & Preissler, Fabian, 2023. "International factor models," Journal of Banking & Finance, Elsevier, vol. 150(C).
    15. Wolfgang Drobetz & Tizian Otto, 2021. "Empirical asset pricing via machine learning: evidence from the European stock market," Journal of Asset Management, Palgrave Macmillan, vol. 22(7), pages 507-538, December.
    16. Stephen A. Gorman & Frank J. Fabozzi, 2021. "The ABC’s of the alternative risk premium: academic roots," Journal of Asset Management, Palgrave Macmillan, vol. 22(6), pages 405-436, October.
    17. Xi Dong & Yan Li & David E. Rapach & Guofu Zhou, 2022. "Anomalies and the Expected Market Return," Journal of Finance, American Finance Association, vol. 77(1), pages 639-681, February.
    18. Cederburg, Scott & O’Doherty, Michael S. & Wang, Feifei & Yan, Xuemin (Sterling), 2020. "On the performance of volatility-managed portfolios," Journal of Financial Economics, Elsevier, vol. 138(1), pages 95-117.
    19. Doron Avramov & Si Cheng & Lior Metzker, 2023. "Machine Learning vs. Economic Restrictions: Evidence from Stock Return Predictability," Management Science, INFORMS, vol. 69(5), pages 2587-2619, May.
    20. Tran, Vu Le, 2023. "Sentiment and covariance characteristics," International Review of Financial Analysis, Elsevier, vol. 86(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:orspec:v:45:y:2023:i:1:d:10.1007_s00291-022-00693-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.