IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2510.14986.html

RegimeFolio: A Regime Aware ML System for Sectoral Portfolio Optimization in Dynamic Markets

Author

Listed:
  • Yiyao Zhang
  • Diksha Goel
  • Hussain Ahmad
  • Claudia Szabo

Abstract

Financial markets are inherently non-stationary, with shifting volatility regimes that alter asset co-movements and return distributions. Standard portfolio optimization methods, typically built on stationarity or regime-agnostic assumptions, struggle to adapt to such changes. To address these challenges, we propose RegimeFolio, a novel regime-aware and sector-specialized framework that, unlike existing regime-agnostic models such as DeepVol and DRL optimizers, integrates explicit volatility regime segmentation with sector-specific ensemble forecasting and adaptive mean-variance allocation. This modular architecture ensures forecasts and portfolio decisions remain aligned with current market conditions, enhancing robustness and interpretability in dynamic markets. RegimeFolio combines three components: (i) an interpretable VIX-based classifier for market regime detection; (ii) regime and sector-specific ensemble learners (Random Forest, Gradient Boosting) to capture conditional return structures; and (iii) a dynamic mean-variance optimizer with shrinkage-regularized covariance estimates for regime-aware allocation. We evaluate RegimeFolio on 34 large cap U.S. equities from 2020 to 2024. The framework achieves a cumulative return of 137 percent, a Sharpe ratio of 1.17, a 12 percent lower maximum drawdown, and a 15 to 20 percent improvement in forecast accuracy compared to conventional and advanced machine learning benchmarks. These results show that explicitly modeling volatility regimes in predictive learning and portfolio allocation enhances robustness and leads to more dependable decision-making in real markets.

Suggested Citation

  • Yiyao Zhang & Diksha Goel & Hussain Ahmad & Claudia Szabo, 2025. "RegimeFolio: A Regime Aware ML System for Sectoral Portfolio Optimization in Dynamic Markets," Papers 2510.14986, arXiv.org.
  • Handle: RePEc:arx:papers:2510.14986
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2510.14986
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Victor DeMiguel & Lorenzo Garlappi & Raman Uppal, 2009. "Optimal Versus Naive Diversification: How Inefficient is the 1-N Portfolio Strategy?," The Review of Financial Studies, Society for Financial Studies, vol. 22(5), pages 1915-1953, May.
    2. William F. Sharpe, 1964. "Capital Asset Prices: A Theory Of Market Equilibrium Under Conditions Of Risk," Journal of Finance, American Finance Association, vol. 19(3), pages 425-442, September.
    3. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    4. Ledoit, Olivier & Wolf, Michael, 2004. "A well-conditioned estimator for large-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 88(2), pages 365-411, February.
    5. Guidolin, Massimo & Timmermann, Allan, 2007. "Asset allocation under multivariate regime switching," Journal of Economic Dynamics and Control, Elsevier, vol. 31(11), pages 3503-3544, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kefan Chen & Hussain Ahmad & Diksha Goel & Claudia Szabo, 2025. "3S-Trader: A Multi-LLM Framework for Adaptive Stock Scoring, Strategy, and Selection in Portfolio Optimization," Papers 2510.17393, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yoontae Hwang & Yaxuan Kong & Stefan Zohren & Yongjae Lee, 2025. "Decision-informed Neural Networks with Large Language Model Integration for Portfolio Optimization," Papers 2502.00828, arXiv.org.
    2. Yi Huang & Wei Zhu & Duan Li & Shushang Zhu & Shikun Wang, 2023. "Integrating Different Informations for Portfolio Selection," Papers 2305.17881, arXiv.org.
    3. Guillaume Coqueret, 2016. "Empirical properties of a heterogeneous agent model in large dimensions," Post-Print hal-02088097, HAL.
    4. Jieting Chen & Yuichiro Kawaguchi, 2018. "Multi-Factor Asset-Pricing Models under Markov Regime Switches: Evidence from the Chinese Stock Market," IJFS, MDPI, vol. 6(2), pages 1-19, May.
    5. Yan, Cheng & Zhang, Huazhu, 2017. "Mean-variance versus naïve diversification: The role of mispricing," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 48(C), pages 61-81.
    6. Guillaume Coqueret, 2017. "Empirical properties of a heterogeneous agent model in large dimensions," Post-Print hal-02000726, HAL.
    7. Samuel Tabot Enow, 2025. "The intertemporal relationship between downside risks and expected stock returns: Evidence from time-varying transition probability models," International Journal of Business Ecosystem & Strategy (2687-2293), Bussecon International Academy, vol. 7(2), pages 319-323, April.
    8. Coqueret, Guillaume, 2017. "Empirical properties of a heterogeneous agent model in large dimensions," Journal of Economic Dynamics and Control, Elsevier, vol. 77(C), pages 180-201.
    9. Yizhan Shu & Chenyu Yu & John M. Mulvey, 2025. "Dynamic asset allocation with asset-specific regime forecasts," Annals of Operations Research, Springer, vol. 346(1), pages 285-318, March.
    10. Giovanni Bonaccolto & Sandra Paterlini, 2020. "Developing new portfolio strategies by aggregation," Annals of Operations Research, Springer, vol. 292(2), pages 933-971, September.
    11. Massimo Guidolin & Federica Ria, 2011. "Regime shifts in mean-variance efficient frontiers: Some international evidence," Journal of Asset Management, Palgrave Macmillan, vol. 12(5), pages 322-349, November.
    12. Yuki Shigeta, 2016. "Optimality of Naive Investment Strategies in Dynamic MeanVariance Optimization Problems with Multiple Priors," Discussion papers e-16-004, Graduate School of Economics , Kyoto University.
    13. Marcelo Lewin & Carlos Heitor Campani, 2023. "Constrained portfolio strategies in a regime-switching economy," Financial Markets and Portfolio Management, Springer;Swiss Society for Financial Market Research, vol. 37(1), pages 27-59, March.
    14. Amine Boukardagha, 2026. "Explainable Regime Aware Investing," Papers 2603.04441, arXiv.org.
    15. Bushra Mohd. Zaki & Nik Rozila Nik Mohd Masdek & Muhammad Abd Hadi Abd Rahman & Nordianah Jusoh @ Hussain & Adi Hakim Talib & Nurul Ainun Ahmad Atory, 2025. "Risk–Return Efficiency in Emerging Dual Financial Markets: A Comparative Study of Markowitz Mean–Variance and Sharpe Single-Index Portfolio Models in Malaysia," International Journal of Research and Innovation in Social Science, International Journal of Research and Innovation in Social Science (IJRISS), vol. 9(9), pages 2934-2948, September.
    16. Fays, Boris & Papageorgiou, Nicolas & Lambert, Marie, 2021. "Risk optimizations on basis portfolios: The role of sorting," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 136-163.
    17. Heonbae Jeon & Soonbong Lee & Hongseon Kim & Seung Bum Soh & Seongmoon Kim, 2023. "Portfolio Evaluation with the Vector Distance Based on Portfolio Composition," Mathematics, MDPI, vol. 11(1), pages 1-19, January.
    18. Yizhan Shu & Chenyu Yu & John M. Mulvey, 2024. "Dynamic Asset Allocation with Asset-Specific Regime Forecasts," Papers 2406.09578, arXiv.org, revised Aug 2024.
    19. Ayadi, Mohamed A. & Lazrak, Skander & Liao, Yusui & Welch, Robert, 2018. "Performance of fixed-income mutual funds with regime-switching models," The Quarterly Review of Economics and Finance, Elsevier, vol. 69(C), pages 217-231.
    20. Marcos López de Prado & Joseph Simonian & Francesco A. Fabozzi & Frank J. Fabozzi, 2025. "Enhancing Markowitz's portfolio selection paradigm with machine learning," Annals of Operations Research, Springer, vol. 346(1), pages 319-340, March.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2510.14986. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.