IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v346y2025i1d10.1007_s10479-024-06257-1.html
   My bibliography  Save this article

Enhancing Markowitz's portfolio selection paradigm with machine learning

Author

Listed:
  • Marcos López de Prado

    (Abu Dhabi Investment Authority (ADIA)
    Cornell University)

  • Joseph Simonian

    (Autonomous Investment Technologies
    FDP Institute)

  • Francesco A. Fabozzi

    (Yale’s International Center for Finance)

  • Frank J. Fabozzi

    (Johns Hopkins University)

Abstract

In this paper we describe the integration of machine learning (ML) techniques into the framework of Markowitz's portfolio selection and show how they can help advance the robust mathematical strategies necessary for modern financial markets. By combining traditional econometrics with cutting-edge ML methodologies, we show how to enhance portfolio management processes including alpha generation, risk management, and optimization of risk metrics like conditional value at risk. ML's capacity to handle vast and complex datasets allows for more dynamic and informed decision-making in portfolio construction. Moreover, we discuss the practical applications of these techniques in real-world portfolio management, highlighting both the potential enhancements and the challenges faced by portfolio managers in implementing ML strategies.

Suggested Citation

  • Marcos López de Prado & Joseph Simonian & Francesco A. Fabozzi & Frank J. Fabozzi, 2025. "Enhancing Markowitz's portfolio selection paradigm with machine learning," Annals of Operations Research, Springer, vol. 346(1), pages 319-340, March.
    • Handle: RePEc:spr:annopr:v:346:y:2025:i:1:d:10.1007_s10479-024-06257-1
    DOI: 10.1007/s10479-024-06257-1
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-024-06257-1
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-024-06257-1?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    2. Guanhao Feng & Stefano Giglio & Dacheng Xiu, 2020. "Taming the Factor Zoo: A Test of New Factors," Journal of Finance, American Finance Association, vol. 75(3), pages 1327-1370, June.
    3. Joachim Freyberger & Andreas Neuhierl & Michael Weber & Andrew KarolyiEditor, 2020. "Dissecting Characteristics Nonparametrically," Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2326-2377.
    4. Guidolin, Massimo & Timmermann, Allan, 2007. "Asset allocation under multivariate regime switching," Journal of Economic Dynamics and Control, Elsevier, vol. 31(11), pages 3503-3544, November.
    5. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    6. Filardo, Andrew J, 1994. "Business-Cycle Phases and Their Transitional Dynamics," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(3), pages 299-308, July.
    7. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    8. Silva, Natan Felipe & de Andrade, Lélis Pedro & da Silva, Washington Santos & de Melo, Maísa Kely & Tonelli, Adriano Olímpio, 2024. "Portfolio optimization based on the pre-selection of stocks by the Support Vector Machine model," Finance Research Letters, Elsevier, vol. 61(C).
    9. Marcial Messmer & Francesco Audrino, 2022. "The Lasso and the Factor Zoo-Predicting Expected Returns in the Cross-Section," Forecasting, MDPI, vol. 4(4), pages 1-35, November.
    10. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    11. Kenneth M. Hall, 1970. "An r-Dimensional Quadratic Placement Algorithm," Management Science, INFORMS, vol. 17(3), pages 219-229, November.
    12. Chang-Jin Kim & Charles R. Nelson, 1998. "Business Cycle Turning Points, A New Coincident Index, And Tests Of Duration Dependence Based On A Dynamic Factor Model With Regime Switching," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 188-201, May.
    13. Guidolin, Massimo & Hyde, Stuart & McMillan, David & Ono, Sadayuki, 2009. "Non-linear predictability in stock and bond returns: When and where is it exploitable?," International Journal of Forecasting, Elsevier, vol. 25(2), pages 373-399.
    14. Huanming Zhang & Zhengyong Jiang & Jionglong Su, 2021. "A Deep Deterministic Policy Gradient-based Strategy for Stocks Portfolio Management," Papers 2103.11455, arXiv.org.
    15. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    16. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    17. Gili Rosenberg & Poya Haghnegahdar & Phil Goddard & Peter Carr & Kesheng Wu & Marcos L'opez de Prado, 2015. "Solving the Optimal Trading Trajectory Problem Using a Quantum Annealer," Papers 1508.06182, arXiv.org, revised Aug 2016.
    18. Pankaj Gupta & Mukesh Mehlawat & Garima Mittal, 2012. "Asset portfolio optimization using support vector machines and real-coded genetic algorithm," Journal of Global Optimization, Springer, vol. 53(2), pages 297-315, June.
    19. Massimo Guidolin & Allan Timmermann, 2008. "International asset allocation under regime switching, skew, and kurtosis preferences," The Review of Financial Studies, Society for Financial Studies, vol. 21(2), pages 889-935, April.
    20. Sims, Christopher A, 1972. "Money, Income, and Causality," American Economic Review, American Economic Association, vol. 62(4), pages 540-552, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fabrizio Ghezzi & Anindo Sarkar & Thomas Quistgaard Pedersen & Allan Timmermann, 2025. "Optimal asset allocation and nonlinear return predictability from the dividend-price ratio," Annals of Operations Research, Springer, vol. 346(1), pages 415-445, March.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Balcilar, Mehmet & Hammoudeh, Shawkat & Asaba, Nwin-Anefo Fru, 2015. "A regime-dependent assessment of the information transmission dynamics between oil prices, precious metal prices and exchange rates," International Review of Economics & Finance, Elsevier, vol. 40(C), pages 72-89.
    4. Andrew Ang & Allan Timmermann, 2012. "Regime Changes and Financial Markets," Annual Review of Financial Economics, Annual Reviews, vol. 4(1), pages 313-337, October.
    5. Bakalli, Gaetan & Guerrier, Stéphane & Scaillet, Olivier, 2023. "A penalized two-pass regression to predict stock returns with time-varying risk premia," Journal of Econometrics, Elsevier, vol. 237(2).
    6. Aloui, Chaker & Hammoudeh, Shawkat & Hamida, Hela Ben, 2015. "Price discovery and regime shift behavior in the relationship between sharia stocks and sukuk: A two-state Markov switching analysis," Pacific-Basin Finance Journal, Elsevier, vol. 34(C), pages 121-135.
    7. Bernardi, Mauro & Catania, Leopoldo, 2018. "Portfolio optimisation under flexible dynamic dependence modelling," Journal of Empirical Finance, Elsevier, vol. 48(C), pages 1-18.
    8. Hematizadeh, Roksana & Tajaddini, Reza, 2024. "A state-dependent international CAPM for partially integrated markets: Using local and US risk factors," Global Finance Journal, Elsevier, vol. 62(C).
    9. Esfandiar Maasoumi & Jianqiu Wang & Zhuo Wang & Ke Wu, 2024. "Identifying factors via automatic debiased machine learning," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(3), pages 438-461, April.
    10. Balcilar, Mehmet & Gupta, Rangan & Miller, Stephen M., 2015. "Regime switching model of US crude oil and stock market prices: 1859 to 2013," Energy Economics, Elsevier, vol. 49(C), pages 317-327.
    11. Sun, Chuanping, 2024. "Factor correlation and the cross section of asset returns: A correlation-robust machine learning approach," Journal of Empirical Finance, Elsevier, vol. 77(C).
    12. Ma, Tian & Leong, Wen Jun & Jiang, Fuwei, 2023. "A latent factor model for the Chinese stock market," International Review of Financial Analysis, Elsevier, vol. 87(C).
    13. Feng, Guanhao & He, Jingyu, 2022. "Factor investing: A Bayesian hierarchical approach," Journal of Econometrics, Elsevier, vol. 230(1), pages 183-200.
    14. Yoontae Hwang & Yaxuan Kong & Stefan Zohren & Yongjae Lee, 2025. "Decision-informed Neural Networks with Large Language Model Integration for Portfolio Optimization," Papers 2502.00828, arXiv.org.
    15. De Nard, Gianluca & Zhao, Zhao, 2023. "Using, taming or avoiding the factor zoo? A double-shrinkage estimator for covariance matrices," Journal of Empirical Finance, Elsevier, vol. 72(C), pages 23-35.
    16. Maheu, John M. & McCurdy, Thomas H., 2000. "Volatility dynamics under duration-dependent mixing," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 345-372, November.
    17. Donatien Hainaut & Franck Moraux, 2019. "A switching self-exciting jump diffusion process for stock prices," Annals of Finance, Springer, vol. 15(2), pages 267-306, June.
    18. Söhnke M. Bartram & Harald Lohre & Peter F. Pope & Ananthalakshmi Ranganathan, 2021. "Navigating the factor zoo around the world: an institutional investor perspective," Journal of Business Economics, Springer, vol. 91(5), pages 655-703, July.
    19. Chung-Ming Kuan, 2013. "Markov switching model (in Russian)," Quantile, Quantile, issue 11, pages 13-40, December.
    20. Kaniel, Ron & Lin, Zihan & Pelger, Markus & Van Nieuwerburgh, Stijn, 2023. "Machine-learning the skill of mutual fund managers," Journal of Financial Economics, Elsevier, vol. 150(1), pages 94-138.

    More about this item

    Keywords

    Machine learning; Signal generation; Feature selection; Portfolio optimization; Generative Language models; Natural language processing;
    All these keywords.

    JEL classification:

    • C6 - Mathematical and Quantitative Methods - - Mathematical Methods; Programming Models; Mathematical and Simulation Modeling
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:346:y:2025:i:1:d:10.1007_s10479-024-06257-1. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.