IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2601.07792.html

Non-Convex Portfolio Optimization via Energy-Based Models: A Comparative Analysis Using the Thermodynamic HypergRaphical Model Library (THRML) for Index Tracking

Author

Listed:
  • Javier Mancilla
  • Theodoros D. Bouloumis
  • Frederic Goguikian

Abstract

Portfolio optimization under cardinality constraints transforms the classical Markowitz mean-variance problem from a convex quadratic problem into an NP-hard combinatorial optimization problem. This paper introduces a novel approach using THRML (Thermodynamic HypergRaphical Model Library), a JAX-based library for building and sampling probabilistic graphical models that reformulates index tracking as probabilistic inference on an Ising Hamiltonian. Unlike traditional methods that seek a single optimal solution, THRML samples from the Boltzmann distribution of high-quality portfolios using GPU-accelerated block Gibbs sampling, providing natural regularization against overfitting. We implement three key innovations: (1) dynamic coupling strength that scales inversely with market volatility (VIX), adapting diversification pressure to market regimes; (2) rebalanced bias weights prioritizing tracking quality over momentum for index replication; and (3) sector-aware post-processing ensuring institutional-grade diversification. Backtesting on a 100-stock S and P 500 universe from 2023 to 2025 demonstrates that THRML achieves 4.31 percent annualized tracking error versus 5.66 to 6.30 percent for baselines, while simultaneously generating 128.63 percent total return against the index total return of 79.61 percent. The Diebold-Mariano test confirms statistical significance with p less than 0.0001 across all comparisons. These results position energy-based models as a promising paradigm for portfolio construction, bridging statistical mechanics and quantitative finance.

Suggested Citation

  • Javier Mancilla & Theodoros D. Bouloumis & Frederic Goguikian, 2026. "Non-Convex Portfolio Optimization via Energy-Based Models: A Comparative Analysis Using the Thermodynamic HypergRaphical Model Library (THRML) for Index Tracking," Papers 2601.07792, arXiv.org.
  • Handle: RePEc:arx:papers:2601.07792
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2601.07792
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fred Glover & Gary Kochenberger & Yu Du, 2019. "Quantum Bridge Analytics I: a tutorial on formulating and using QUBO models," 4OR, Springer, vol. 17(4), pages 335-371, December.
    2. Michaud, Richard O. & Michaud, Robert O., 2008. "Efficient Asset Management: A Practical Guide to Stock Portfolio Optimization and Asset Allocation," OUP Catalogue, Oxford University Press, edition 2, number 9780195331912.
    3. Dimitris Bertsimas & Christopher Darnell & Robert Soucy, 1999. "Portfolio Construction Through Mixed-Integer Programming at Grantham, Mayo, Van Otterloo and Company," Interfaces, INFORMS, vol. 29(1), pages 49-66, February.
    4. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    5. Dimitris Bertsimas & Romy Shioda, 2009. "Algorithm for cardinality-constrained quadratic optimization," Computational Optimization and Applications, Springer, vol. 43(1), pages 1-22, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Javier Mancilla & Theodoros D. Bouloumis & Frederic Goguikian, 2026. "Constrained Portfolio Optimization via Quantum Approximate Optimization Algorithm (QAOA) with XY-Mixers and Trotterized Initialization: A Hybrid Approach for Direct Indexing," Papers 2602.14827, arXiv.org.
    2. Francesco Cesarone & Andrea Scozzari & Fabio Tardella, 2015. "Linear vs. quadratic portfolio selection models with hard real-world constraints," Computational Management Science, Springer, vol. 12(3), pages 345-370, July.
    3. Ceren Tuncer Şakar & Murat Köksalan, 2013. "A stochastic programming approach to multicriteria portfolio optimization," Journal of Global Optimization, Springer, vol. 57(2), pages 299-314, October.
    4. Dimitris Bertsimas & Ryan Cory-Wright, 2022. "A Scalable Algorithm for Sparse Portfolio Selection," INFORMS Journal on Computing, INFORMS, vol. 34(3), pages 1489-1511, May.
    5. N. Krejić & E. H. M. Krulikovski & M. Raydan, 2023. "A Low-Cost Alternating Projection Approach for a Continuous Formulation of Convex and Cardinality Constrained Optimization," SN Operations Research Forum, Springer, vol. 4(4), pages 1-24, December.
    6. Michael Curran & Patrick O'Sullivan & Ryan Zalla, 2020. "Can Volatility Solve the Naive Portfolio Puzzle?," Papers 2005.03204, arXiv.org, revised Feb 2022.
    7. Carina Moreira Costa & Dennis Kreber & Martin Schmidt, 2022. "An Alternating Method for Cardinality-Constrained Optimization: A Computational Study for the Best Subset Selection and Sparse Portfolio Problems," INFORMS Journal on Computing, INFORMS, vol. 34(6), pages 2968-2988, November.
    8. Wu, Dexiang & Kwon, Roy H. & Costa, Giorgio, 2017. "A constrained cluster-based approach for tracking the S&P 500 index," International Journal of Production Economics, Elsevier, vol. 193(C), pages 222-243.
    9. Mansini, Renata & Ogryczak, Wlodzimierz & Speranza, M. Grazia, 2014. "Twenty years of linear programming based portfolio optimization," European Journal of Operational Research, Elsevier, vol. 234(2), pages 518-535.
    10. Hauzenberger, Niko & Huber, Florian & Klieber, Karin & Marcellino, Massimiliano, 2025. "Bayesian neural networks for macroeconomic analysis," Journal of Econometrics, Elsevier, vol. 249(PC).
    11. Anatoly A. Peresetsky & Ruslan I. Yakubov, 2017. "Autocorrelation in an unobservable global trend: does it help to forecast market returns?," International Journal of Computational Economics and Econometrics, Inderscience Enterprises Ltd, vol. 7(1/2), pages 152-169.
    12. Kelly Burns & Imad Moosa, 2017. "Demystifying the Meese–Rogoff puzzle: structural breaks or measures of forecasting accuracy?," Applied Economics, Taylor & Francis Journals, vol. 49(48), pages 4897-4910, October.
    13. Hao Chen & Qiulan Wan & Yurong Wang, 2014. "Refined Diebold-Mariano Test Methods for the Evaluation of Wind Power Forecasting Models," Energies, MDPI, vol. 7(7), pages 1-14, July.
    14. Antonello D’Agostino & Kieran Mcquinn & Karl Whelan, 2012. "Are Some Forecasters Really Better Than Others?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(4), pages 715-732, June.
    15. Christophe Chorro & Florian Ielpo & Benoît Sévi, 2017. "The contribution of jumps to forecasting the density of returns," Post-Print halshs-01442618, HAL.
    16. Carlo Altavilla & Paul De Grauwe, 2010. "Forecasting and combining competing models of exchange rate determination," Applied Economics, Taylor & Francis Journals, vol. 42(27), pages 3455-3480.
    17. Matsumura, Marco & Moreira, Ajax & Vicente, José, 2011. "Forecasting the yield curve with linear factor models," International Review of Financial Analysis, Elsevier, vol. 20(5), pages 237-243.
    18. Castro, Luciano de & Galvao, Antonio F. & Kim, Jeong Yeol & Montes-Rojas, Gabriel & Olmo, Jose, 2022. "Experiments on portfolio selection: A comparison between quantile preferences and expected utility decision models," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 97(C).
    19. Tom Boot & Bart Keijsers, 2025. "Diffusion index forecasts under weaker loadings: PCA, ridge regression, and random projections," Papers 2506.09575, arXiv.org.
    20. Vitek, Francis, 2006. "Measuring the Stance of Monetary Policy in a Small Open Economy: A Dynamic Stochastic General Equilibrium Approach," MPRA Paper 802, University Library of Munich, Germany.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2601.07792. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.