IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.23492.html

Continuous Hidden Markov Models for Equity Returns: Heavy-Tail Emission Families and Regime-Conditional Value-at-Risk

Author

Listed:
  • Abdulrahman Alswaidan
  • Cade Jin
  • Jeffrey D. Varner

Abstract

Synthetic generators of daily equity returns let practitioners stress test, backtest, and design scenarios that a single realized market history cannot supply, but only if the generator reproduces the stylized facts of real returns: heavy tails, negligible linear autocorrelation, and slow decay of the absolute-return autocorrelation. Hidden Markov models with few Gaussian states were long thought unable to reproduce that slow decay, and the standard fix was to abandon them for more complex hidden semi-Markov models. We revisit this issue with a continuous hidden Markov model whose regime chain governs the autocorrelation while per-regime densities govern the marginal, separating the temporal and distributional sides of the original failure. A unified expectation-maximization framework fits Gaussian, Student-t, Laplace, and generalized-error emissions under shared forward-backward recursions and quantile-based initialization, and a spectral identity bounds the number of decay modes by the rank of the centred transition matrix. Across SPY walk-forward folds, a sector-balanced 30-ticker panel, a CRSP cross-decade transfer, and a six-asset basket, that bound was not binding once a few states were used: heavy-tailed marginals, not additional decay modes, closed most of the fit gap, recovering volatility clustering above the i.i.d. baseline and narrowing the kurtosis gap without a tuning hyperparameter. The original failure is therefore distributional, not temporal. On daily US equities, a simple, interpretable Markov model suffices, and unlike a bootstrap or semi-Markov fit that wins only on a single-window fit, the fitted model also yields a regime-conditional Value-at-Risk that passes a joint conditional-coverage test and a copula that reproduces cross-asset correlations: one interpretable generator serving both path simulation and downstream risk and portfolio tasks.

Suggested Citation

  • Abdulrahman Alswaidan & Cade Jin & Jeffrey D. Varner, 2026. "Continuous Hidden Markov Models for Equity Returns: Heavy-Tail Emission Families and Regime-Conditional Value-at-Risk," Papers 2606.23492, arXiv.org.
  • Handle: RePEc:arx:papers:2606.23492
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.23492
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Tobias Rydén & Timo Teräsvirta & Stefan Åsbrink, 1998. "Stylized facts of daily return series and the hidden Markov model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 13(3), pages 217-244.
    2. Rossi, Alessandro & Gallo, Giampiero M., 2006. "Volatility estimation via hidden Markov models," Journal of Empirical Finance, Elsevier, vol. 13(2), pages 203-230, March.
    3. Laurent E. Calvet, 2004. "How to Forecast Long-Run Volatility: Regime Switching and the Estimation of Multifractal Processes," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 49-83.
    4. Andrew Harvey & Esther Ruiz & Neil Shephard, 1994. "Multivariate Stochastic Variance Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(2), pages 247-264.
    5. William F. Sharpe, 1963. "A Simplified Model for Portfolio Analysis," Management Science, INFORMS, vol. 9(2), pages 277-293, January.
    6. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    7. Magnus Wiese & Robert Knobloch & Ralf Korn & Peter Kretschmer, 2020. "Quant GANs: deep generation of financial time series," Quantitative Finance, Taylor & Francis Journals, vol. 20(9), pages 1419-1440, September.
    8. Fulvio Corsi, 2009. "A Simple Approximate Long-Memory Model of Realized Volatility," Journal of Financial Econometrics, Oxford University Press, vol. 7(2), pages 174-196, Spring.
    9. Bollerslev, Tim, 1987. "A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return," The Review of Economics and Statistics, MIT Press, vol. 69(3), pages 542-547, August.
    10. Peter Nystrup & Henrik Madsen & Erik Lindström, 2017. "Long Memory of Financial Time Series and Hidden Markov Models with Time‐Varying Parameters," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(8), pages 989-1002, December.
    11. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    12. Pesaran, M. Hashem & Timmermann, Allan, 2007. "Selection of estimation window in the presence of breaks," Journal of Econometrics, Elsevier, vol. 137(1), pages 134-161, March.
    13. Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 1994. "Bayesian Analysis of Stochastic Volatility Models: Comments: Reply," Journal of Business & Economic Statistics, American Statistical Association, vol. 12(4), pages 413-417, October.
    14. Alexander J. McNeil & Rüdiger Frey & Paul Embrechts, 2015. "Quantitative Risk Management: Concepts, Techniques and Tools Revised edition," Economics Books, Princeton University Press, edition 2, number 10496, December.
    15. Markus Haas, 2004. "A New Approach to Markov-Switching GARCH Models," Journal of Financial Econometrics, Oxford University Press, vol. 2(4), pages 493-530.
    16. Sangjoon Kim & Neil Shephard & Siddhartha Chib, 1998. "Stochastic Volatility: Likelihood Inference and Comparison with ARCH Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(3), pages 361-393.
    17. Takahashi, Shuntaro & Chen, Yu & Tanaka-Ishii, Kumiko, 2019. "Modeling financial time-series with generative adversarial networks," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 527(C).
    18. Paul Fearnhead & Zhen Liu, 2007. "On‐line inference for multiple changepoint problems," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(4), pages 589-605, September.
    19. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    20. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    21. Bulla, Jan & Bulla, Ingo, 2006. "Stylized facts of financial time series and hidden semi-Markov models," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2192-2209, December.
    22. Giovanni Barone‐Adesi & Kostas Giannopoulos & Les Vosper, 1999. "VaR without correlations for portfolios of derivative securities," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 19(5), pages 583-602, August.
    23. Sohyeon Kwon & Yongjae Lee, 2024. "Can GANs Learn the Stylized Facts of Financial Time Series?," Papers 2410.09850, arXiv.org.
    24. Andersen, Torben G & Bollerslev, Tim, 1997. "Heterogeneous Information Arrivals and Return Volatility Dynamics: Uncovering the Long-Run in High Frequency Returns," Journal of Finance, American Finance Association, vol. 52(3), pages 975-1005, July.
    25. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    26. Carlos A. Abanto‐Valle & Roland Langrock & Ming‐Hui Chen & Michel V. Cardoso, 2017. "Maximum likelihood estimation for stochastic volatility in mean models with heavy‐tailed distributions," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 33(4), pages 394-408, August.
    27. Benoit Mandelbrot, 2015. "The Variation of Certain Speculative Prices," World Scientific Book Chapters, in: Anastasios G Malliaris & William T Ziemba (ed.), THE WORLD SCIENTIFIC HANDBOOK OF FUTURES MARKETS, chapter 3, pages 39-78, World Scientific Publishing Co. Pte. Ltd..
    28. Hamilton, James D, 1989. "A New Approach to the Economic Analysis of Nonstationary Time Series and the Business Cycle," Econometrica, Econometric Society, vol. 57(2), pages 357-384, March.
    29. Ľluboš Pástor & Robert F. Stambaugh, 2001. "The Equity Premium and Structural Breaks," Journal of Finance, American Finance Association, vol. 56(4), pages 1207-1239, August.
    30. So, Mike K P & Lam, K & Li, W K, 1998. "A Stochastic Volatility Model with Markov Switching," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(2), pages 244-253, April.
    31. Elena Andreou & Eric Ghysels, 2002. "Detecting multiple breaks in financial market volatility dynamics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 17(5), pages 579-600.
    32. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    33. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    34. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    35. Cavit Pakel & Neil Shephard & Kevin Sheppard & Robert F. Engle, 2021. "Fitting Vast Dimensional Time-Varying Covariance Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(3), pages 652-668, July.
    36. Huntley Schaller & Simon Van Norden, 1997. "Regime switching in stock market returns," Applied Financial Economics, Taylor & Francis Journals, vol. 7(2), pages 177-191.
    37. Merton, Robert C., 1976. "Option pricing when underlying stock returns are discontinuous," Journal of Financial Economics, Elsevier, vol. 3(1-2), pages 125-144.
    38. Engle, Robert, 2002. "Dynamic Conditional Correlation: A Simple Class of Multivariate Generalized Autoregressive Conditional Heteroskedasticity Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 339-350, July.
    39. Abdulrahman Alswaidan & Jeffrey D. Varner, 2026. "Hybrid Hidden Markov Model for Modeling Equity Excess Growth Rate Dynamics: A Discrete-State Approach with Jump-Diffusion," Papers 2603.10202, arXiv.org, revised Apr 2026.
    40. Timmermann, Allan, 2000. "Moments of Markov switching models," Journal of Econometrics, Elsevier, vol. 96(1), pages 75-111, May.
    41. Jacquier, Eric & Polson, Nicholas G & Rossi, Peter E, 2002. "Bayesian Analysis of Stochastic Volatility Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 69-87, January.
    42. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Bauwens, L. & Hafner C. & Laurent, S., 2011. "Volatility Models," LIDAM Discussion Papers ISBA 2011044, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
      • BAUWENS, Luc & HAFNER, Christian & LAURENT, Sébastien, 2011. "Volatility models," LIDAM Discussion Papers CORE 2011058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
      • Bauwens, L. & Hafner, C. & Laurent, S., 2012. "Volatility Models," LIDAM Reprints ISBA 2012028, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    4. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2005. "Volatility forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies (CFS).
    5. Ardia, David & Bluteau, Keven & Boudt, Kris & Catania, Leopoldo, 2018. "Forecasting risk with Markov-switching GARCH models:A large-scale performance study," International Journal of Forecasting, Elsevier, vol. 34(4), pages 733-747.
    6. Leopoldo Catania & Nima Nonejad, 2016. "Density Forecasts and the Leverage Effect: Some Evidence from Observation and Parameter-Driven Volatility Models," Papers 1605.00230, arXiv.org, revised Nov 2016.
    7. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521770415.
    8. Abdulrahman Alswaidan & Jeffrey D. Varner, 2026. "Hybrid Hidden Markov Model for Modeling Equity Excess Growth Rate Dynamics: A Discrete-State Approach with Jump-Diffusion," Papers 2603.10202, arXiv.org, revised Apr 2026.
    9. Giovanni Bonaccolto & Massimiliano Caporin, 2016. "The Determinants of Equity Risk and Their Forecasting Implications: A Quantile Regression Perspective," JRFM, MDPI, vol. 9(3), pages 1-25, July.
    10. Timmermann, Allan, 2018. "Forecasting Methods in Finance," CEPR Discussion Papers 12692, Centre for Economic Policy Research.
    11. Bekaert, Geert & Engstrom, Eric & Ermolov, Andrey, 2015. "Bad environments, good environments: A non-Gaussian asymmetric volatility model," Journal of Econometrics, Elsevier, vol. 186(1), pages 258-275.
    12. Allan Timmermann, 2018. "Forecasting Methods in Finance," Annual Review of Financial Economics, Annual Reviews, vol. 10(1), pages 449-479, November.
    13. Richard D. F. Harris & Murat Mazibas, 2022. "A component Markov regime‐switching autoregressive conditional range model," Bulletin of Economic Research, Wiley Blackwell, vol. 74(2), pages 650-683, April.
    14. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2013. "Financial Risk Measurement for Financial Risk Management," Handbook of the Economics of Finance, in: G.M. Constantinides & M. Harris & R. M. Stulz (ed.), Handbook of the Economics of Finance, volume 2, chapter 0, pages 1127-1220, Elsevier.
    15. Maung, Kenwin & Swanson, Norman R., 2025. "A survey of models and methods used for forecasting when investing in financial markets," International Journal of Forecasting, Elsevier, vol. 41(4), pages 1355-1382.
    16. Eduardo Ramos-P'erez & Pablo J. Alonso-Gonz'alez & Jos'e Javier N'u~nez-Vel'azquez, 2021. "Multi-Transformer: A New Neural Network-Based Architecture for Forecasting S&P Volatility," Papers 2109.12621, arXiv.org.
    17. Eduardo Ramos-Pérez & Pablo J. Alonso-González & José Javier Núñez-Velázquez, 2021. "Multi-Transformer: A New Neural Network-Based Architecture for Forecasting S&P Volatility," Mathematics, MDPI, vol. 9(15), pages 1-18, July.
    18. LeBaron, Blake, 2003. "Non-Linear Time Series Models in Empirical Finance,: Philip Hans Franses and Dick van Dijk, Cambridge University Press, Cambridge, 2000, 296 pp., Paperback, ISBN 0-521-77965-0, $33, [UK pound]22.95, [euro;]36.18, Hardback, ISBN 0-521-770416-0, $90, [," International Journal of Forecasting, Elsevier, vol. 19(4), pages 751-752.
    19. AUGUSTYNIAK, Maciej & BAUWENS, Luc & DUFAYS, Arnaud, 2016. "A New Approach to Volatility Modeling : The High-Dimensional Markov Model," LIDAM Discussion Papers CORE 2016042, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    20. Degiannakis, Stavros & Xekalaki, Evdokia, 2004. "Autoregressive Conditional Heteroskedasticity (ARCH) Models: A Review," MPRA Paper 80487, University Library of Munich, Germany.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.23492. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.