IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v173y2022ics0167947322000627.html
   My bibliography  Save this article

Varying-coefficient hidden Markov models with zero-effect regions

Author

Listed:
  • Liu, Hefei
  • Song, Xinyuan
  • Zhang, Baoxue

Abstract

In psychological, social, behavioral, and medical studies, hidden Markov models (HMMs) have been extensively applied to the simultaneous modeling of longitudinal observations and the underlying dynamic transition process. However, the existing HMMs mainly focus on constant-coefficient HMMs. This study considers a varying-coefficient HMM, which enables simultaneous investigation of the dynamic covariate effects and between-state transitions. Moreover, a soft-thresholding operator is introduced to detect zero-effect regions of the coefficient functions. A full Bayesian approach with a hybird Markov chain Monte Carlo algorithm that combines B-spline approximation and penalization technique is developed for statistical inference. The empirical performance of the propose method is evaluated through simulation studies. An application to a study on the Alzheimer's Disease Neuroimaging Initiative dataset is presented.

Suggested Citation

  • Liu, Hefei & Song, Xinyuan & Zhang, Baoxue, 2022. "Varying-coefficient hidden Markov models with zero-effect regions," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
    • Handle: RePEc:eee:csdana:v:173:y:2022:i:c:s0167947322000627
    DOI: 10.1016/j.csda.2022.107482
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947322000627
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2022.107482?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Scott, Steven L. & James, Gareth M. & Sugar, Catherine A., 2005. "Hidden Markov Models for Longitudinal Comparisons," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 359-369, June.
    2. David B. Dunson & Patricia Chulada & Samuel J. Arbes Jr, 2003. "Bayesian Modeling of Time-Varying and Waning Exposure Effects," Biometrics, The International Biometric Society, vol. 59(1), pages 83-91, March.
    3. Xinyuan Song & Yemao Xia & Hongtu Zhu, 2017. "Hidden Markov latent variable models with multivariate longitudinal data," Biometrics, The International Biometric Society, vol. 73(1), pages 313-323, March.
    4. R. L. Eubank & Chunfeng Huang & Y. Muñoz Maldonado & Naisyin Wang & Suojin Wang & R. J. Buchanan, 2004. "Smoothing spline estimation in varying‐coefficient models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 653-667, August.
    5. Bartolucci, Francesco & Farcomeni, Alessio, 2009. "A Multivariate Extension of the Dynamic Logit Model for Longitudinal Data Based on a Latent Markov Heterogeneity Structure," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 816-831.
    6. Park, Trevor & Casella, George, 2008. "The Bayesian Lasso," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 681-686, June.
    7. Xiangnan Feng & Tengfei Li & Xinyuan Song & Hongtu Zhu, 2020. "Bayesian Scalar on Image Regression With Nonignorable Nonresponse," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(532), pages 1574-1597, December.
    8. Shujie Ma & Peter X.-K. Song, 2015. "Varying Index Coefficient Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 341-356, March.
    9. Chiang C-T. & Rice J. A & Wu C. O, 2001. "Smoothing Spline Estimation for Varying Coefficient Models With Repeatedly Measured Dependent Variables," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 605-619, June.
    10. C. P. Robert & T. Rydén & D. M. Titterington, 2000. "Bayesian inference in hidden Markov models through the reversible jump Markov chain Monte Carlo method," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(1), pages 57-75.
    11. Ye, Mao & Lu, Zhao-Hua & Li, Yimei & Song, Xinyuan, 2019. "Finite mixture of varying coefficient model: Estimation and component selection," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 452-474.
    12. Zhang, Wenyang & Lee, Sik-Yum & Song, Xinyuan, 2002. "Local Polynomial Fitting in Semivarying Coefficient Model," Journal of Multivariate Analysis, Elsevier, vol. 82(1), pages 166-188, July.
    13. Jian Kang & Brian J Reich & Ana-Maria Staicu, 2018. "Scalar-on-image regression via the soft-thresholded Gaussian process," Biometrika, Biometrika Trust, vol. 105(1), pages 165-184.
    14. Edward Ip & Qiang Zhang & Jack Rejeski & Tammy Harris & Stephen Kritchevsky, 2013. "Partially Ordered Mixed Hidden Markov Model for the Disablement Process of Older Adults," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(502), pages 370-384, June.
    15. Jianhua Z. Huang, 2002. "Varying-coefficient models and basis function approximations for the analysis of repeated measurements," Biometrika, Biometrika Trust, vol. 89(1), pages 111-128, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ye, Mao & Lu, Zhao-Hua & Li, Yimei & Song, Xinyuan, 2019. "Finite mixture of varying coefficient model: Estimation and component selection," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 452-474.
    2. Tang Qingguo & Cheng Longsheng, 2008. "M-estimation and B-spline approximation for varying coefficient models with longitudinal data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 20(7), pages 611-625.
    3. Zhou, Jie & Song, Xinyuan & Sun, Liuquan, 2020. "Continuous time hidden Markov model for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 179(C).
    4. Jun Jin & Tiefeng Ma & Jiajia Dai, 2021. "New efficient spline estimation for varying-coefficient models with two-step knot number selection," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(5), pages 693-712, July.
    5. Xinyuan Song & Yemao Xia & Hongtu Zhu, 2017. "Hidden Markov latent variable models with multivariate longitudinal data," Biometrics, The International Biometric Society, vol. 73(1), pages 313-323, March.
    6. Rahul Ghosal & Arnab Maity & Timothy Clark & Stefano B. Longo, 2020. "Variable selection in functional linear concurrent regression," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 69(3), pages 565-587, June.
    7. Zhaoping Hong & Yuao Hu & Heng Lian, 2013. "Variable selection for high-dimensional varying coefficient partially linear models via nonconcave penalty," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 76(7), pages 887-908, October.
    8. Linjun Tang & Zhangong Zhou, 2015. "Weighted local linear CQR for varying-coefficient models with missing covariates," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 583-604, September.
    9. Liu, Hefei & Song, Xinyuan, 2021. "Bayesian analysis of hidden Markov structural equation models with an unknown number of hidden states," Econometrics and Statistics, Elsevier, vol. 18(C), pages 29-43.
    10. Kim, Young-Ju, 2013. "A partial spline approach for semiparametric estimation of varying-coefficient partially linear models," Computational Statistics & Data Analysis, Elsevier, vol. 62(C), pages 181-187.
    11. Lian, Heng, 2015. "Quantile regression for dynamic partially linear varying coefficient time series models," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 49-66.
    12. Chen, Yixin & Wang, Qin & Yao, Weixin, 2015. "Adaptive estimation for varying coefficient models," Journal of Multivariate Analysis, Elsevier, vol. 137(C), pages 17-31.
    13. Wang, Qihua & Zhang, Riquan, 2009. "Statistical estimation in varying coefficient models with surrogate data and validation sampling," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2389-2405, November.
    14. Olga Klopp & Marianna Pensky, 2013. "Sparse High-dimensional Varying Coefficient Model : Non-asymptotic Minimax Study," Working Papers 2013-30, Center for Research in Economics and Statistics.
    15. Lin, Yiqi & Song, Xinyuan, 2022. "Order selection for regression-based hidden Markov model," Journal of Multivariate Analysis, Elsevier, vol. 192(C).
    16. Qiu, Jia & Li, Degao & You, Jinhong, 2015. "SCAD-penalized regression for varying-coefficient models with autoregressive errors," Journal of Multivariate Analysis, Elsevier, vol. 137(C), pages 100-118.
    17. Senturk, Damla & Nguyen, Danh V., 2006. "Estimation in covariate-adjusted regression," Computational Statistics & Data Analysis, Elsevier, vol. 50(11), pages 3294-3310, July.
    18. Wang-Li Xu & Li-Xing Zhu, 2008. "Goodness-of-fit testing for varying-coefficient models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 68(2), pages 129-146, September.
    19. Yiqiang Lu & Riquan Zhang, 2009. "Smoothing spline estimation of generalised varying-coefficient mixed model," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(7), pages 815-825.
    20. Chin-Tsang Chiang, 2005. "Comparisons between simultaneous and componentwise splines for varying coefficient models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 57(4), pages 637-653, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:173:y:2022:i:c:s0167947322000627. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.