IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v132y2019icp190-211.html
   My bibliography  Save this article

Bayesian analysis for mixture of latent variable hidden Markov models with multivariate longitudinal data

Author

Listed:
  • Xia, Ye-Mao
  • Tang, Nian-Sheng

Abstract

Latent variable hidden Markov models (LVHMMs) are important statistical methods in exploring the possible heterogeneity of data and explaining the pattern of subjects moving from one group to another over time. Classic subject- and/or time-homogeneous assumptions on transition matrices in transition model as well as the emission distribution in the observed process may be inappropriate to interpret heterogeneity at the subject level. For this end, a general extension of LVHMM is proposed to address the heterogeneity of multivariate longitudinal data both at the subject level and the occasion level. The main modeling strategy is that the observed time sequences are first grouped into different clusters, and then within each cluster the observed sequences are formulated via latent variable hidden Markov model. The local heterogeneity at the occasion level is characterized by the distribution related to the latent states, while the global heterogeneity at the subject level is identified with the finite mixture model. Compared to the existing methods, an appeal underlying the proposal is its capacity of accommodating non-homogeneous patterns of state sequences and emission distributions across the subjects simultaneously. As a result, the proposal provides a comprehensive framework for exploring various kinds of relevance among the multivariate longitudinal data. Within the Bayesian paradigm, Markov Chains Monte Carlo (MCMC) method is used to implement posterior analysis. Gibbs sampler is used to draw observations from the related full conditionals and posterior inferences are carried out based on these simulated observations. Empirical results including simulation studies and a real example are used to illustrate the proposed methodology.

Suggested Citation

  • Xia, Ye-Mao & Tang, Nian-Sheng, 2019. "Bayesian analysis for mixture of latent variable hidden Markov models with multivariate longitudinal data," Computational Statistics & Data Analysis, Elsevier, vol. 132(C), pages 190-211.
    • Handle: RePEc:eee:csdana:v:132:y:2019:i:c:p:190-211
    DOI: 10.1016/j.csda.2018.08.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947318301877
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2018.08.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Leroux, Brian G., 1992. "Maximum-likelihood estimation for hidden Markov models," Stochastic Processes and their Applications, Elsevier, vol. 40(1), pages 127-143, February.
    2. Sik-Yum Lee & Ye-Mao Xia, 2006. "Maximum Likelihood Methods in Treating Outliers and Symmetrically Heavy-Tailed Distributions for Nonlinear Structural Equation Models with Missing Data," Psychometrika, Springer;The Psychometric Society, vol. 71(3), pages 565-585, September.
    3. Sik-Yum Lee, 2006. "Bayesian Analysis of Nonlinear Structural Equation Models with Nonignorable Missing Data," Psychometrika, Springer;The Psychometric Society, vol. 71(3), pages 541-564, September.
    4. Scott, Steven L. & James, Gareth M. & Sugar, Catherine A., 2005. "Hidden Markov Models for Longitudinal Comparisons," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 359-369, June.
    5. Conor Dolan & Han Maas, 1998. "Fitting multivariage normal finite mixtures subject to structural equation modeling," Psychometrika, Springer;The Psychometric Society, vol. 63(3), pages 227-253, September.
    6. Xinyuan Song & Yemao Xia & Hongtu Zhu, 2017. "Hidden Markov latent variable models with multivariate longitudinal data," Biometrics, The International Biometric Society, vol. 73(1), pages 313-323, March.
    7. Nicholas G. Polson & James G. Scott & Jesse Windle, 2013. "Bayesian Inference for Logistic Models Using Pólya--Gamma Latent Variables," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(504), pages 1339-1349, December.
    8. Francesco Bartolucci & Monia Lupparelli, 2016. "Pairwise Likelihood Inference for Nested Hidden Markov Chain Models for Multilevel Longitudinal Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 216-228, March.
    9. Yiu-Fai Yung, 1997. "Finite mixtures in confirmatory factor-analysis models," Psychometrika, Springer;The Psychometric Society, vol. 62(3), pages 297-330, September.
    10. Altman, Rachel MacKay, 2007. "Mixed Hidden Markov Models: An Extension of the Hidden Markov Model to the Longitudinal Data Setting," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 201-210, March.
    11. C. Yau & O. Papaspiliopoulos & G. O. Roberts & C. Holmes, 2011. "Bayesian non‐parametric hidden Markov models with applications in genomics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 73(1), pages 37-57, January.
    12. Lawrence Hubert & Phipps Arabie, 1985. "Comparing partitions," Journal of Classification, Springer;The Classification Society, vol. 2(1), pages 193-218, December.
    13. Hong-Tu Zhu & Sik-Yum Lee, 2001. "A Bayesian analysis of finite mixtures in the LISREL model," Psychometrika, Springer;The Psychometric Society, vol. 66(1), pages 133-152, March.
    14. Chib, Siddhartha, 1996. "Calculating posterior distributions and modal estimates in Markov mixture models," Journal of Econometrics, Elsevier, vol. 75(1), pages 79-97, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Qi Zhang & Yihui Zhang & Yemao Xia, 2024. "Bayesian Feature Extraction for Two-Part Latent Variable Model with Polytomous Manifestations," Mathematics, MDPI, vol. 12(5), pages 1-23, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cai, Jing-Heng & Song, Xin-Yuan & Lam, Kwok-Hap & Ip, Edward Hak-Sing, 2011. "A mixture of generalized latent variable models for mixed mode and heterogeneous data," Computational Statistics & Data Analysis, Elsevier, vol. 55(11), pages 2889-2907, November.
    2. Zhou, Jie & Song, Xinyuan & Sun, Liuquan, 2020. "Continuous time hidden Markov model for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 179(C).
    3. Xinyuan Song & Yemao Xia & Hongtu Zhu, 2017. "Hidden Markov latent variable models with multivariate longitudinal data," Biometrics, The International Biometric Society, vol. 73(1), pages 313-323, March.
    4. F. Bartolucci & A. Farcomeni & F. Pennoni, 2014. "Latent Markov models: a review of a general framework for the analysis of longitudinal data with covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(3), pages 433-465, September.
    5. Ruijin Lu & Tonja R. Nansel & Zhen Chen, 2023. "A Perception-Augmented Hidden Markov Model for Parent–Child Relations in Families of Youth with Type 1 Diabetes," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(1), pages 288-308, April.
    6. Mingan Yang & David Dunson, 2010. "Bayesian Semiparametric Structural Equation Models with Latent Variables," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 675-693, December.
    7. Song, Xin-Yuan & Chen, Fei & Lu, Zhao-Hua, 2013. "A Bayesian semiparametric dynamic two-level structural equation model for analyzing non-normal longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 121(C), pages 87-108.
    8. Chaofeng Yuan & Wensheng Zhu & Xuming He & Jianhua Guo, 2019. "A mixture factor model with applications to microarray data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(1), pages 60-76, March.
    9. Lin, Yiqi & Song, Xinyuan, 2022. "Order selection for regression-based hidden Markov model," Journal of Multivariate Analysis, Elsevier, vol. 192(C).
    10. Xiong, Yingge & Tobias, Justin L. & Mannering, Fred L., 2014. "The analysis of vehicle crash injury-severity data: A Markov switching approach with road-segment heterogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 67(C), pages 109-128.
    11. Giorgio Eduardo Montanari & Marco Doretti & Maria Francesca Marino, 2022. "Model-based two-way clustering of second-level units in ordinal multilevel latent Markov models," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(2), pages 457-485, June.
    12. Montanari, Giorgio E. & Doretti, Marco & Bartolucci, Francesco, 2017. "A multilevel latent Markov model for the evaluation of nursing homes' performance," MPRA Paper 80691, University Library of Munich, Germany.
    13. Jesse D. Raffa & Joel A. Dubin, 2015. "Multivariate longitudinal data analysis with mixed effects hidden Markov models," Biometrics, The International Biometric Society, vol. 71(3), pages 821-831, September.
    14. Qi Zhang & Yihui Zhang & Yemao Xia, 2024. "Bayesian Feature Extraction for Two-Part Latent Variable Model with Polytomous Manifestations," Mathematics, MDPI, vol. 12(5), pages 1-23, March.
    15. Francq, C. & Zakoian, J. -M., 2001. "Stationarity of multivariate Markov-switching ARMA models," Journal of Econometrics, Elsevier, vol. 102(2), pages 339-364, June.
    16. Liu, Hefei & Song, Xinyuan & Zhang, Baoxue, 2022. "Varying-coefficient hidden Markov models with zero-effect regions," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
    17. Sylvia Frühwirth-Schnatter & Gertraud Malsiner-Walli, 2019. "From here to infinity: sparse finite versus Dirichlet process mixtures in model-based clustering," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(1), pages 33-64, March.
    18. Sy-Miin Chow & Guangjian Zhang, 2013. "Nonlinear Regime-Switching State-Space (RSSS) Models," Psychometrika, Springer;The Psychometric Society, vol. 78(4), pages 740-768, October.
    19. James Y. Dai & Peter B. Gilbert & Benoît R. Mâsse, 2012. "Partially Hidden Markov Model for Time-Varying Principal Stratification in HIV Prevention Trials," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 52-65, March.
    20. Ando, Tomohiro, 2009. "Bayesian factor analysis with fat-tailed factors and its exact marginal likelihood," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1717-1726, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:132:y:2019:i:c:p:190-211. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.