IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0314444.html
   My bibliography  Save this article

The influence of observation sequence features on the performance of the Bayesian hidden Markov model: A Monte Carlo simulation study

Author

Listed:
  • Jan-Willem Simons
  • Bart-Jan Boverhof
  • Emmeke Aarts

Abstract

The hidden Markov model is a popular modeling strategy for describing and explaining latent process dynamics. There is a lack of information on the estimation performance of the Bayesian hidden Markov model when applied to categorical, one-level data. We conducted a simulation study to assess the effect of the 1) number of observations (250—8.000), 2) number of levels in the categorical outcome variable (3—7), and 3) state distinctiveness and state separation in the emission distribution (low, medium, high) on the performance of the Bayesian hidden Markov model. Performance is quantified in terms of convergence, accuracy, precision, and coverage. Convergence is generally achieved throughout. Accuracy, precision, and coverage increase with a higher number of observations and an increased level of state distinctiveness, and to a lesser extent with an increased level of state separation. The number of categorical levels only marginally influences performance. A minimum of 1.000 observations is recommended to ensure adequate model performance.

Suggested Citation

  • Jan-Willem Simons & Bart-Jan Boverhof & Emmeke Aarts, 2024. "The influence of observation sequence features on the performance of the Bayesian hidden Markov model: A Monte Carlo simulation study," PLOS ONE, Public Library of Science, vol. 19(12), pages 1-17, December.
    • Handle: RePEc:plo:pone00:0314444
    DOI: 10.1371/journal.pone.0314444
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0314444
    Download Restriction: no
    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0314444&type=printable
    Download Restriction: no
    File URL: https://libkey.io/10.1371/journal.pone.0314444?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Altman, Rachel MacKay, 2007. "Mixed Hidden Markov Models: An Extension of the Hidden Markov Model to the Longitudinal Data Setting," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 201-210, March.
    2. Israr Ullah & Rashid Ahmad & DoHyeun Kim, 2018. "A Prediction Mechanism of Energy Consumption in Residential Buildings Using Hidden Markov Model," Energies, MDPI, vol. 11(2), pages 1-20, February.
    3. Stoner, Oliver & Economou, Theo, 2020. "An advanced hidden Markov model for hourly rainfall time series," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benny Ren & Ian Barnett, 2023. "Combining mixed effects hidden Markov models with latent alternating recurrent event processes to model diurnal active–rest cycles," Biometrics, The International Biometric Society, vol. 79(4), pages 3402-3417, December.
    2. Spezia, L. & Cooksley, S.L. & Brewer, M.J. & Donnelly, D. & Tree, A., 2014. "Modelling species abundance in a river by Negative Binomial hidden Markov models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 599-614.
    3. Marino, Maria Francesca & Alfó, Marco, 2016. "Gaussian quadrature approximations in mixed hidden Markov models for longitudinal data: A simulation study," Computational Statistics & Data Analysis, Elsevier, vol. 94(C), pages 193-209.
    4. F. Bartolucci & A. Farcomeni & F. Pennoni, 2014. "Rejoinder on: Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 484-486, September.
    5. Anh Tuan Phan & Thi Tuyet Hong Vu & Dinh Quang Nguyen & Eleonora Riva Sanseverino & Hang Thi-Thuy Le & Van Cong Bui, 2022. "Data Compensation with Gaussian Processes Regression: Application in Smart Building’s Sensor Network," Energies, MDPI, vol. 15(23), pages 1-16, December.
    6. Arpad Gellert & Stefan-Alexandru Precup & Alexandru Matei & Bogdan-Constantin Pirvu & Constantin-Bala Zamfirescu, 2022. "Real-Time Assembly Support System with Hidden Markov Model and Hybrid Extensions," Mathematics, MDPI, vol. 10(15), pages 1-21, August.
    7. Eric Lucas dos Santos Cabral & Mario Orestes Aguirre Gonzalez & Priscila da Cunha Jacome Vidal & Joao Florencio da Costa Junior & Rafael Monteiro de Vasconcelos & David Cassimiro de Melo & Ruan Lucas , 2024. "Optimization Models for Operations and Maintenance of Offshore Wind Turbines Based on Artificial Intelligence and Operations Research: A Systematic Literature Review," International Journal of Business and Management, Canadian Center of Science and Education, vol. 19(3), pages 1-1, June.
    8. Bartolucci, Francesco & Pandolfi, Silvia & Pennoni, Fulvia, 2025. "On a class of finite mixture models that includes hidden Markov models," Journal of Multivariate Analysis, Elsevier, vol. 208(C).
    9. Victor Medina-Olivares & Raffaella Calabrese, 2023. "Detecting Consumers' Financial Vulnerability using Open Banking Data: Evidence from UK Payday Loans," Papers 2306.01749, arXiv.org.
    10. Gordon Anderson & Alessio Farcomeni & Maria Grazia Pittau & Roberto Zelli, 2019. "Rectangular latent Markov models for time‐specific clustering, with an analysis of the wellbeing of nations," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 68(3), pages 603-621, April.
    11. Furio Urso & Antonino Abbruzzo & Marcello Chiodi & Maria Francesca Cracolici, 2024. "Model selection for mixture hidden Markov models: an application to clickstream data," Statistical Papers, Springer, vol. 65(9), pages 5797-5834, December.
    12. Michael W. Hopwood & Lekha Patel & Thushara Gunda, 2022. "Classification of Photovoltaic Failures with Hidden Markov Modeling, an Unsupervised Statistical Approach," Energies, MDPI, vol. 15(14), pages 1-12, July.
    13. Ruijin Lu & Tonja R. Nansel & Zhen Chen, 2023. "A Perception-Augmented Hidden Markov Model for Parent–Child Relations in Families of Youth with Type 1 Diabetes," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(1), pages 288-308, April.
    14. Langrock, R. & Zucchini, W., 2011. "Hidden Markov models with arbitrary state dwell-time distributions," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 715-724, January.
    15. Xie, Minghua & Yi, Xiangyu & Liu, Kui & Sun, Chuanwang & Kong, Qingbao, 2023. "How much natural gas does China need: An empirical study from the perspective of energy transition," Energy, Elsevier, vol. 266(C).
    16. Roberto Colombi & Sabrina Giordano, 2025. "Markov switching stereotype logit models for longitudinal ordinal data affected by unobserved heterogeneity in responding behavior," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 109(1), pages 117-147, March.
    17. Anam-Nawaz Khan & Naeem Iqbal & Atif Rizwan & Rashid Ahmad & Do-Hyeun Kim, 2021. "An Ensemble Energy Consumption Forecasting Model Based on Spatial-Temporal Clustering Analysis in Residential Buildings," Energies, MDPI, vol. 14(11), pages 1-25, May.
    18. Luca Merlo & Lea Petrella & Nikos Tzavidis, 2022. "Quantile mixed hidden Markov models for multivariate longitudinal data: An application to children's Strengths and Difficulties Questionnaire scores," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(2), pages 417-448, March.
    19. Roland Langrock & Timo Adam & Vianey Leos‐Barajas & Sina Mews & David L. Miller & Yannis P. Papastamatiou, 2018. "Spline‐based nonparametric inference in general state‐switching models," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(3), pages 179-200, August.
    20. Francesco Lagona & Antonello Maruotti & Fabio Padovano, 2015. "Multilevel multivariate modelling of legislative count data, with a hidden Markov chain," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 178(3), pages 705-723, June.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0314444. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.