IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v191y2022ics0047259x2200046x.html
   My bibliography  Save this article

Robust estimation in multivariate heteroscedastic regression models with autoregressive covariance structures using EM algorithm

Author

Listed:
  • Guney, Yesim
  • Arslan, Olcay
  • Yavuz, Fulya Gokalp

Abstract

In the analysis of repeated or clustered measurements, it is crucial to determine the dynamics that affect the mean, variance, and correlations of the data, which will be possible using appropriate models. One of these models is the joint mean–covariance model, which is a multivariate heteroscedastic regression model with autoregressive covariance structures. In these models, parameter estimation is usually carried on under normality assumption, but the resulting estimators will be very sensitive to the outliers or non-normality of data. In this study, we propose a robust alternative method and an EM algorithm for estimating the parameters of joint mean–covariance models. Robustification is achieved using a multivariate heavy-tailed distribution with the same number of parameters as the multivariate normal distribution. To simplify the estimation procedure, a modified Cholesky decomposition is adopted to factorize the dependence structure in terms of unconstrained autoregressive and scale innovation parameters. Also, the technique for the prediction of future responses is given. An intensive simulation study and a real data example are provided to demonstrate the performance of the proposed method.

Suggested Citation

  • Guney, Yesim & Arslan, Olcay & Yavuz, Fulya Gokalp, 2022. "Robust estimation in multivariate heteroscedastic regression models with autoregressive covariance structures using EM algorithm," Journal of Multivariate Analysis, Elsevier, vol. 191(C).
    • Handle: RePEc:eee:jmvana:v:191:y:2022:i:c:s0047259x2200046x
    DOI: 10.1016/j.jmva.2022.105026
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X2200046X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2022.105026?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lv, Jing & Yang, Hu & Guo, Chaohui, 2015. "An efficient and robust variable selection method for longitudinal generalized linear models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 74-88.
    2. Rossi, E. & Spazzini, F., 2010. "Model and distribution uncertainty in multivariate GARCH estimation: A Monte Carlo analysis," Computational Statistics & Data Analysis, Elsevier, vol. 54(11), pages 2786-2800, November.
    3. Thanakorn Nitithumbundit & Jennifer S. K. Chan, 2020. "ECM Algorithm for Auto-Regressive Multivariate Skewed Variance Gamma Model with Unbounded Density," Methodology and Computing in Applied Probability, Springer, vol. 22(3), pages 1169-1191, September.
    4. Weiping Zhang & Chenlei Leng & Cheng Yong Tang, 2015. "A joint modelling approach for longitudinal studies," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(1), pages 219-238, January.
    5. Lindsey, J.K. & Lindsey, P.J., 2006. "Multivariate distributions with correlation matrices for nonlinear repeated measurements," Computational Statistics & Data Analysis, Elsevier, vol. 50(3), pages 720-732, February.
    6. You-Gan Wang, 2003. "Working correlation structure misspecification, estimation and covariate design: Implications for generalised estimating equations performance," Biometrika, Biometrika Trust, vol. 90(1), pages 29-41, March.
    7. Christophe Croux & Irène Gijbels & Ilaria Prosdocimi, 2012. "Robust Estimation of Mean and Dispersion Functions in Extended Generalized Additive Models," Biometrics, The International Biometric Society, vol. 68(1), pages 31-44, March.
    8. Guoyou Qin & Zhongyi Zhu, 2015. "Robust estimation of mean and covariance for longitudinal data with dropouts," Journal of Applied Statistics, Taylor & Francis Journals, vol. 42(6), pages 1240-1254, June.
    9. Jianxin Pan, 2003. "On modelling mean-covariance structures in longitudinal studies," Biometrika, Biometrika Trust, vol. 90(1), pages 239-244, March.
    10. Anderson, Dale N., 1992. "A multivariate Linnik distribution," Statistics & Probability Letters, Elsevier, vol. 14(4), pages 333-336, July.
    11. Mohsen Pourahmadi, 2007. "Cholesky Decompositions and Estimation of A Covariance Matrix: Orthogonality of Variance--Correlation Parameters," Biometrika, Biometrika Trust, vol. 94(4), pages 1006-1013.
    12. Jianhua Z. Huang & Naiping Liu & Mohsen Pourahmadi & Linxu Liu, 2006. "Covariance matrix selection and estimation via penalised normal likelihood," Biometrika, Biometrika Trust, vol. 93(1), pages 85-98, March.
    13. Xu, Lin & Xiang, Sijia & Yao, Weixin, 2019. "Robust maximum Lq-likelihood estimation of joint mean–covariance models for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 397-411.
    14. Olcay Arslan, 2010. "An alternative multivariate skew Laplace distribution: properties and estimation," Statistical Papers, Springer, vol. 51(4), pages 865-887, December.
    15. Hürlimann, Werner, 2013. "A moment method for the multivariate asymmetric Laplace distribution," Statistics & Probability Letters, Elsevier, vol. 83(4), pages 1247-1253.
    16. Fulya Gokalp Yavuz & Olcay Arslan, 2018. "Linear mixed model with Laplace distribution (LLMM)," Statistical Papers, Springer, vol. 59(1), pages 271-289, March.
    17. Huajun Ye & Jianxin Pan, 2006. "Modelling of covariance structures in generalised estimating equations for longitudinal data," Biometrika, Biometrika Trust, vol. 93(4), pages 927-941, December.
    18. Daniels, M.J. & Pourahmadi, M., 2009. "Modeling covariance matrices via partial autocorrelations," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2352-2363, November.
    19. Xueqin Wang & Yunlu Jiang & Mian Huang & Heping Zhang, 2013. "Robust Variable Selection With Exponential Squared Loss," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(502), pages 632-643, June.
    20. Weiping Zhang & Chenlei Leng, 2012. "A moving average Cholesky factor model in covariance modelling for longitudinal data," Biometrika, Biometrika Trust, vol. 99(1), pages 141-150.
    21. Tomasz J. Kozubowski & Krzysztof Podgórski, 2000. "A Multivariate and Asymmetric Generalization of Laplace Distribution," Computational Statistics, Springer, vol. 15(4), pages 531-540, December.
    22. Fan, Yali & Qin, Guoyou & Zhu, Zhongyi, 2012. "Variable selection in robust regression models for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 156-167.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lee, Keunbaik & Baek, Changryong & Daniels, Michael J., 2017. "ARMA Cholesky factor models for the covariance matrix of linear models," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 267-280.
    2. Luo, Renwen & Pan, Jianxin, 2022. "Conditional generalized estimating equations of mean-variance-correlation for clustered data," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    3. Lu, Fei & Xue, Liugen & Cai, Xiong, 2020. "GEE analysis in joint mean-covariance model for longitudinal data," Statistics & Probability Letters, Elsevier, vol. 160(C).
    4. Feng, Sanying & Lian, Heng & Xue, Liugen, 2016. "A new nested Cholesky decomposition and estimation for the covariance matrix of bivariate longitudinal data," Computational Statistics & Data Analysis, Elsevier, vol. 102(C), pages 98-109.
    5. Yixin Chen & Weixin Yao, 2017. "Unified Inference for Sparse and Dense Longitudinal Data in Time-varying Coefficient Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(1), pages 268-284, March.
    6. Liya Fu & Zhuoran Yang & Fengjing Cai & You-Gan Wang, 2021. "Efficient and doubly-robust methods for variable selection and parameter estimation in longitudinal data analysis," Computational Statistics, Springer, vol. 36(2), pages 781-804, June.
    7. Xu, Lin & Xiang, Sijia & Yao, Weixin, 2019. "Robust maximum Lq-likelihood estimation of joint mean–covariance models for longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 397-411.
    8. Xueying Zheng & Wing Fung & Zhongyi Zhu, 2013. "Robust estimation in joint mean–covariance regression model for longitudinal data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(4), pages 617-638, August.
    9. Lam, Clifford, 2020. "High-dimensional covariance matrix estimation," LSE Research Online Documents on Economics 101667, London School of Economics and Political Science, LSE Library.
    10. Yu, Jing & Nummi, Tapio & Pan, Jianxin, 2022. "Mixture regression for longitudinal data based on joint mean–covariance model," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    11. Ziqi Chen & Man†Lai Tang & Wei Gao, 2018. "A profile likelihood approach for longitudinal data analysis," Biometrics, The International Biometric Society, vol. 74(1), pages 220-228, March.
    12. Kangning Wang & Lu Lin, 2019. "Robust and efficient estimator for simultaneous model structure identification and variable selection in generalized partial linear varying coefficient models with longitudinal data," Statistical Papers, Springer, vol. 60(5), pages 1649-1676, October.
    13. Shi, Jianhong & Bai, Xiuqin & Song, Weixing, 2022. "Tweedie-type formulae for a multivariate Laplace distribution," Statistics & Probability Letters, Elsevier, vol. 183(C).
    14. Weiping Zhang & Feiyue Xie & Jiaxin Tan, 2020. "A robust joint modeling approach for longitudinal data with informative dropouts," Computational Statistics, Springer, vol. 35(4), pages 1759-1783, December.
    15. Zhang, Qiang & Ip, Edward H. & Pan, Junhao & Plemmons, Robert, 2017. "Individual-specific, sparse inverse covariance estimation in generalized estimating equations," Statistics & Probability Letters, Elsevier, vol. 122(C), pages 96-103.
    16. Jing Lv & Chaohui Guo, 2017. "Efficient parameter estimation via modified Cholesky decomposition for quantile regression with longitudinal data," Computational Statistics, Springer, vol. 32(3), pages 947-975, September.
    17. Dengke Xu & Zhongzhan Zhang & Liucang Wu, 2014. "Bayesian analysis of joint mean and covariance models for longitudinal data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 41(11), pages 2504-2514, November.
    18. Jing Lv & Chaohui Guo, 2019. "Quantile estimations via modified Cholesky decomposition for longitudinal single-index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(5), pages 1163-1199, October.
    19. Rabe Anasu & Shangodoyin D. K. & Thaga K., 2019. "Linear Cholesky Decomposition Of Covariance Matrices In Mixed Models With Correlated Random Effects," Statistics in Transition New Series, Polish Statistical Association, vol. 20(4), pages 59-70, December.
    20. Peng, Cheng & Yang, Yihe & Zhou, Jie & Pan, Jianxin, 2022. "Latent Gaussian copula models for longitudinal binary data," Journal of Multivariate Analysis, Elsevier, vol. 189(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:191:y:2022:i:c:s0047259x2200046x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.