IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2603.10202.html

Hybrid Hidden Markov Model for Modeling Equity Excess Growth Rate Dynamics: A Discrete-State Approach with Jump-Diffusion

Author

Listed:
  • Abdulrahman Alswaidan
  • Jeffrey D. Varner

Abstract

Generating synthetic financial time series that preserve the statistical properties of real market data is essential for stress testing, risk model validation, and scenario design. Existing approaches struggle to simultaneously reproduce heavy-tailed distributions, negligible linear autocorrelation, and persistent volatility clustering. We developed a hybrid hidden Markov framework that discretized excess growth rates into Laplace quantile-defined states and augmented regime switching with a Poisson jump-duration mechanism to enforce realistic tail-state dwell times. Parameters were estimated by direct transition counting, bypassing the Baum-Welch EM algorithm and scaling to a 424-asset pipeline. Applied to ten years of daily equity data, the framework achieved high distributional pass rates both in-sample and out-of-sample while partially reproducing the volatility clustering that standard regime-switching models miss. No single model was best at everything: GARCH(1,1) better reproduced volatility clustering but failed distributional tests, while the standard HMM without jumps passed more distributional tests but could not generate volatility clustering. The proposed framework delivered the most balanced performance overall. For multi-asset generation, copula-based dependence models that preserved each asset's marginal HMM distribution substantially outperformed a Single-Index Model factor baseline on both per-asset distributional accuracy and correlation reproduction.

Suggested Citation

  • Abdulrahman Alswaidan & Jeffrey D. Varner, 2026. "Hybrid Hidden Markov Model for Modeling Equity Excess Growth Rate Dynamics: A Discrete-State Approach with Jump-Diffusion," Papers 2603.10202, arXiv.org, revised Apr 2026.
  • Handle: RePEc:arx:papers:2603.10202
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2603.10202
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Diebold, Francis X. & Inoue, Atsushi, 2001. "Long memory and regime switching," Journal of Econometrics, Elsevier, vol. 105(1), pages 131-159, November.
    2. Tobias Rydén & Timo Teräsvirta & Stefan Åsbrink, 1998. "Stylized facts of daily return series and the hidden Markov model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 13(3), pages 217-244.
    3. Fama, Eugene F, 1970. "Efficient Capital Markets: A Review of Theory and Empirical Work," Journal of Finance, American Finance Association, vol. 25(2), pages 383-417, May.
    4. S. G. Kou, 2002. "A Jump-Diffusion Model for Option Pricing," Management Science, INFORMS, vol. 48(8), pages 1086-1101, August.
    5. Jun-Jie Chen & Lei Tan & Bo Zheng, 2015. "Agent-based model with multi-level herding for complex financial systems," Papers 1504.01811, arXiv.org.
    6. William F. Sharpe, 1963. "A Simplified Model for Portfolio Analysis," Management Science, INFORMS, vol. 9(2), pages 277-293, January.
    7. Takahashi, Shuntaro & Chen, Yu & Tanaka-Ishii, Kumiko, 2019. "Modeling financial time-series with generative adversarial networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 527(C).
    8. Thomas Lux & Michele Marchesi, 1999. "Scaling and criticality in a stochastic multi-agent model of a financial market," Nature, Nature, vol. 397(6719), pages 498-500, February.
    9. Bulla, Jan & Bulla, Ingo, 2006. "Stylized facts of financial time series and hidden semi-Markov models," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2192-2209, December.
    10. Stein, Elias M & Stein, Jeremy C, 1991. "Stock Price Distributions with Stochastic Volatility: An Analytic Approach," The Review of Financial Studies, Society for Financial Studies, vol. 4(4), pages 727-752.
    11. Fama, Eugene F. & French, Kenneth R., 1993. "Common risk factors in the returns on stocks and bonds," Journal of Financial Economics, Elsevier, vol. 33(1), pages 3-56, February.
    12. Sohyeon Kwon & Yongjae Lee, 2024. "Can GANs Learn the Stylized Facts of Financial Time Series?," Papers 2410.09850, arXiv.org.
    13. repec:bla:jfinan:v:44:y:1989:i:5:p:1115-53 is not listed on IDEAS
    14. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    15. Benoit Mandelbrot, 2015. "The Variation of Certain Speculative Prices," World Scientific Book Chapters, in: Anastasios G Malliaris & William T Ziemba (ed.), THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 3, pages 39-78, World Scientific Publishing Co. Pte. Ltd..
    16. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    17. Challet, D. & Zhang, Y.-C., 1997. "Emergence of cooperation and organization in an evolutionary game," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 246(3), pages 407-418.
    18. Merton, Robert C., 1976. "Option pricing when underlying stock returns are discontinuous," Journal of Financial Economics, Elsevier, vol. 3(1-2), pages 125-144.
    19. Black, Fischer & Scholes, Myron S, 1973. "The Pricing of Options and Corporate Liabilities," Journal of Political Economy, University of Chicago Press, vol. 81(3), pages 637-654, May-June.
    20. J Doyne Farmer, 2025. "Quantitative agent-based models: a promising alternative for macroeconomics," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 41(2), pages 571-590.
    21. David Toth & Bruce Jones, 2019. "Against the Norm: Modeling Daily Stock Returns with the Laplace Distribution," Papers 1906.10325, arXiv.org.
    22. Cont, Rama & Bouchaud, Jean-Philipe, 2000. "Herd Behavior And Aggregate Fluctuations In Financial Markets," Macroeconomic Dynamics, Cambridge University Press, vol. 4(2), pages 170-196, June.
    23. Heston, Steven L, 1993. "A Closed-Form Solution for Options with Stochastic Volatility with Applications to Bond and Currency Options," The Review of Financial Studies, Society for Financial Studies, vol. 6(2), pages 327-343.
    24. Farmer, J. Doyne & Joshi, Shareen, 2002. "The price dynamics of common trading strategies," Journal of Economic Behavior & Organization, Elsevier, vol. 49(2), pages 149-171, October.
    25. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Detlef Seese & Christof Weinhardt & Frank Schlottmann (ed.), 2008. "Handbook on Information Technology in Finance," International Handbooks on Information Systems, Springer, number 978-3-540-49487-4, December.
    2. Jovanovic, Franck & Schinckus, Christophe, 2017. "Econophysics and Financial Economics: An Emerging Dialogue," OUP Catalogue, Oxford University Press, number 9780190205034.
    3. Alexandre Subbotin, 2009. "Volatility Models: from Conditional Heteroscedasticity to Cascades at Multiple Horizons," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 15(3), pages 94-138.
    4. Giulia Di Nunno & Kk{e}stutis Kubilius & Yuliya Mishura & Anton Yurchenko-Tytarenko, 2023. "From constant to rough: A survey of continuous volatility modeling," Papers 2309.01033, arXiv.org, revised Aug 2025.
    5. Didier SORNETTE, 2014. "Physics and Financial Economics (1776-2014): Puzzles, Ising and Agent-Based Models," Swiss Finance Institute Research Paper Series 14-25, Swiss Finance Institute.
    6. Ghysels, E. & Harvey, A. & Renault, E., 1995. "Stochastic Volatility," Papers 95.400, Toulouse - GREMAQ.
    7. Pierdzioch, Christian, 2000. "Noise Traders? Trigger Rates, FX Options, and Smiles," Kiel Working Papers 970, Kiel Institute for the World Economy.
    8. D. Sornette, 2014. "Physics and Financial Economics (1776-2014): Puzzles, Ising and Agent-Based models," Papers 1404.0243, arXiv.org.
    9. Alexander Subbotin & Thierry Chauveau & Kateryna Shapovalova, 2009. "Volatility Models: from GARCH to Multi-Horizon Cascades," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-00390636, HAL.
    10. D. Delpini & G. Bormetti, 2015. "Stochastic volatility with heterogeneous time scales," Quantitative Finance, Taylor & Francis Journals, vol. 15(10), pages 1597-1608, October.
    11. Anatoliy Swishchuk, 2013. "Modeling and Pricing of Swaps for Financial and Energy Markets with Stochastic Volatilities," World Scientific Books, World Scientific Publishing Co. Pte. Ltd., number 8660.
    12. Kei Nakagawa & Masanori Hirano & Kentaro Minami & Takanobu Mizuta, 2024. "A Multi-agent Market Model Can Explain the Impact of AI Traders in Financial Markets -- A New Microfoundations of GARCH model," Papers 2409.12516, arXiv.org.
    13. Kozarski, R., 2013. "Pricing and hedging in the VIX derivative market," Other publications TiSEM 221fefe0-241e-4914-b6bd-c, Tilburg University, School of Economics and Management.
    14. Zhu, Ke & Ling, Shiqing, 2015. "Model-based pricing for financial derivatives," Journal of Econometrics, Elsevier, vol. 187(2), pages 447-457.
    15. Hommes, Cars H., 2006. "Heterogeneous Agent Models in Economics and Finance," Handbook of Computational Economics, in: Leigh Tesfatsion & Kenneth L. Judd (ed.), Handbook of Computational Economics, edition 1, volume 2, chapter 23, pages 1109-1186, Elsevier.
    16. Johann Lussange & Ivan Lazarevich & Sacha Bourgeois-Gironde & Stefano Palminteri & Boris Gutkin, 2021. "Modelling Stock Markets by Multi-agent Reinforcement Learning," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 113-147, January.
    17. Maung, Kenwin & Swanson, Norman R., 2025. "A survey of models and methods used for forecasting when investing in financial markets," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1355-1382.
    18. Liu, Chang & Chang, Chuo, 2021. "Combination of transition probability distribution and stable Lorentz distribution in stock markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 565(C).
    19. Giulia Di Nunno & Kęstutis Kubilius & Yuliya Mishura & Anton Yurchenko-Tytarenko, 2023. "From Constant to Rough: A Survey of Continuous Volatility Modeling," Mathematics, MDPI, vol. 11(19), pages 1-35, October.
    20. David Edelman & Thomas Gillespie, 2000. "The Stochastically Subordinated Poisson Normal Process for Modelling Financial Assets," Annals of Operations Research, Springer, vol. 100(1), pages 133-164, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2603.10202. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.