IDEAS home Printed from https://ideas.repec.org/a/spr/testjl/v28y2019i2d10.1007_s11749-018-0580-8.html
   My bibliography  Save this article

Modelling covariance matrices by the trigonometric separation strategy with application to hidden Markov models

Author

Listed:
  • Luigi Spezia

    (Biomathematics & Statistics Scotland)

Abstract

Bayesian inference on the covariance matrix is usually performed after placing an inverse-Wishart or a multivariate Jeffreys as a prior density, but both of them, for different reasons, present some drawbacks. As an alternative, the covariance matrix can be modelled by separating out the standard deviations and the correlations. This separation strategy takes advantage of the fact that usually it is more straightforward and flexible to set priors on the standard deviations and the correlations rather than on the covariance matrix. On the other hand, the priors must preserve the positive definiteness of the correlation matrix. This can be obtained by considering the Cholesky decomposition of the correlation matrix, whose entries are reparameterized using trigonometric functions. The efficiency of the trigonometric separation strategy (TSS) is shown through an application to hidden Markov models (HMMs), with conditional distributions multivariate normal. In the case of an unknown number of hidden states, estimation is conducted using a reversible jump Markov chain Monte Carlo algorithm based on the split-and-combine and birth-and-death moves whose design is straightforward because of the use of the TSS. Finally, an example in remote sensing is described, where a HMM containing the TSS is used for the segmentation of a multi-colour satellite image.

Suggested Citation

  • Luigi Spezia, 2019. "Modelling covariance matrices by the trigonometric separation strategy with application to hidden Markov models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 28(2), pages 399-422, June.
  • Handle: RePEc:spr:testjl:v:28:y:2019:i:2:d:10.1007_s11749-018-0580-8
    DOI: 10.1007/s11749-018-0580-8
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11749-018-0580-8
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11749-018-0580-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Scott, Steven L. & James, Gareth M. & Sugar, Catherine A., 2005. "Hidden Markov Models for Longitudinal Comparisons," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 359-369, June.
    2. Luigi Spezia, 2010. "Bayesian analysis of multivariate Gaussian hidden Markov models with an unknown number of regimes," Journal of Time Series Analysis, Wiley Blackwell, vol. 31(1), pages 1-11, January.
    3. John W. Seaman & John W. Seaman & James D. Stamey, 2012. "Hidden Dangers of Specifying Noninformative Priors," The American Statistician, Taylor & Francis Journals, vol. 66(2), pages 77-84, May.
    4. Smith M. & Kohn R., 2002. "Parsimonious Covariance Matrix Estimation for Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1141-1153, December.
    5. Olivier Cappé & Christian P. Robert & Tobias Rydén, 2003. "Reversible jump, birth‐and‐death and more general continuous time Markov chain Monte Carlo samplers," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(3), pages 679-700, August.
    6. Sylvia. Richardson & Peter J. Green, 1997. "On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion)," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 59(4), pages 731-792.
    7. John C. Liechty, 2004. "Bayesian correlation estimation," Biometrika, Biometrika Trust, vol. 91(1), pages 1-14, March.
    8. Michael J. Daniels, 2002. "Bayesian analysis of covariance matrices and dynamic models for longitudinal data," Biometrika, Biometrika Trust, vol. 89(3), pages 553-566, August.
    9. repec:dau:papers:123456789/6040 is not listed on IDEAS
    10. Peter D. Hoff, 2009. "A hierarchical eigenmodel for pooled covariance estimation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(5), pages 971-992, November.
    11. J. Møller & A. N. Pettitt & R. Reeves & K. K. Berthelsen, 2006. "An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants," Biometrika, Biometrika Trust, vol. 93(2), pages 451-458, June.
    12. Daniels, M.J. & Pourahmadi, M., 2009. "Modeling covariance matrices via partial autocorrelations," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2352-2363, November.
    13. Green P.J. & Richardson S., 2002. "Hidden Markov Models and Disease Mapping," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1055-1070, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Y. & Daniels, M.J., 2013. "Bayesian modeling of the dependence in longitudinal data via partial autocorrelations and marginal variances," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 130-140.
    2. Carter, Christopher K. & Wong, Frederick & Kohn, Robert, 2011. "Constructing priors based on model size for nondecomposable Gaussian graphical models: A simulation based approach," Journal of Multivariate Analysis, Elsevier, vol. 102(5), pages 871-883, May.
    3. Bo Cai & David B. Dunson, 2006. "Bayesian Covariance Selection in Generalized Linear Mixed Models," Biometrics, The International Biometric Society, vol. 62(2), pages 446-457, June.
    4. Wang, Hao, 2010. "Sparse seemingly unrelated regression modelling: Applications in finance and econometrics," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2866-2877, November.
    5. Athanasios C. Micheas & Jiaxun Chen, 2018. "sppmix: Poisson point process modeling using normal mixture models," Computational Statistics, Springer, vol. 33(4), pages 1767-1798, December.
    6. Spezia, Luigi, 2020. "Bayesian variable selection in non-homogeneous hidden Markov models through an evolutionary Monte Carlo method," Computational Statistics & Data Analysis, Elsevier, vol. 143(C).
    7. Peter J. Danaher & Michael S. Smith, 2011. "Rejoinder--Estimation Issues for Copulas Applied to Marketing Data," Marketing Science, INFORMS, vol. 30(1), pages 25-28, 01-02.
    8. Gautam Sabnis & Debdeep Pati & Anirban Bhattacharya, 2019. "Compressed Covariance Estimation with Automated Dimension Learning," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 81(2), pages 466-481, December.
    9. Paolo Giordani & Xiuyan Mun & Robert Kohn, 2012. "Efficient Estimation of Covariance Matrices using Posterior Mode Multiple Shrinkage," Journal of Financial Econometrics, Oxford University Press, vol. 11(1), pages 154-192, December.
    10. Huber, Florian & Zörner, Thomas O., 2019. "Threshold cointegration in international exchange rates:A Bayesian approach," International Journal of Forecasting, Elsevier, vol. 35(2), pages 458-473.
    11. Smith, Michael Stanley, 2015. "Copula modelling of dependence in multivariate time series," International Journal of Forecasting, Elsevier, vol. 31(3), pages 815-833.
    12. Liu, Hefei & Song, Xinyuan, 2021. "Bayesian analysis of hidden Markov structural equation models with an unknown number of hidden states," Econometrics and Statistics, Elsevier, vol. 18(C), pages 29-43.
    13. Michael S. Smith & Shaun P. Vahey, 2016. "Asymmetric Forecast Densities for U.S. Macroeconomic Variables from a Gaussian Copula Model of Cross-Sectional and Serial Dependence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 416-434, July.
    14. Webb, Emily L. & Forster, Jonathan J., 2008. "Bayesian model determination for multivariate ordinal and binary data," Computational Statistics & Data Analysis, Elsevier, vol. 52(5), pages 2632-2649, January.
    15. Komárek, Arnost, 2009. "A new R package for Bayesian estimation of multivariate normal mixtures allowing for selection of the number of components and interval-censored data," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 3932-3947, October.
    16. Athanasios Christou Micheas, 2014. "Hierarchical Bayesian modeling of marked non-homogeneous Poisson processes with finite mixtures and inclusion of covariate information," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(12), pages 2596-2615, December.
    17. Wanchuang Zhu & Yanan Fan, 2023. "A synthetic likelihood approach for intractable markov random fields," Computational Statistics, Springer, vol. 38(2), pages 749-777, June.
    18. Helen Armstrong & Christopher K. Carter & Kevin K. F. Wong & Robert Kohn, 2007. "Bayesian Covariance Matrix Estimation using a Mixture of Decomposable Graphical Models," Discussion Papers 2007-13, School of Economics, The University of New South Wales.
    19. Daniels, M.J. & Pourahmadi, M., 2009. "Modeling covariance matrices via partial autocorrelations," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2352-2363, November.
    20. Lee, Keunbaik & Baek, Changryong & Daniels, Michael J., 2017. "ARMA Cholesky factor models for the covariance matrix of linear models," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 267-280.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:testjl:v:28:y:2019:i:2:d:10.1007_s11749-018-0580-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.