IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v176y2020ics0047259x19300077.html
   My bibliography  Save this article

M-estimation with incomplete and dependent multivariate data

Author

Listed:
  • Frahm, Gabriel
  • Nordhausen, Klaus
  • Oja, Hannu

Abstract

We extend the theory of M-estimation to incomplete and dependent multivariate data. ML-estimation can still be considered a special case of M-estimation in this context. We notice that the unobserved data must be missing completely at random but not only missing at random, which is a typical assumption of ML-estimation, to guarantee the consistency of an M-estimator. Further, we show that the weight functions for scatter must satisfy a critical scaling condition, which is implicitly fulfilled both by the Gaussian and by Tyler’s weight function. We generalize this principal result by introducing the class of power weight functions, which contains the two aforementioned weight functions as limiting cases. A simulation study confirms our theoretical findings. If the data are heavy tailed or contaminated, the M-estimators turn out to be favorable compared to the ML-estimators that are based on the normal-distribution assumption.

Suggested Citation

  • Frahm, Gabriel & Nordhausen, Klaus & Oja, Hannu, 2020. "M-estimation with incomplete and dependent multivariate data," Journal of Multivariate Analysis, Elsevier, vol. 176(C).
    • Handle: RePEc:eee:jmvana:v:176:y:2020:i:c:s0047259x19300077
    DOI: 10.1016/j.jmva.2019.104569
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X19300077
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2019.104569?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jane‐Ling Wang, 1999. "Asymptotic Properties of M‐estimators Based on Estimating Equations and Censored Data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 26(2), pages 297-318, June.
    2. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    3. Thomas P. Hettmansperger, 2002. "A practical affine equivariant multivariate median," Biometrika, Biometrika Trust, vol. 89(4), pages 851-860, December.
    4. Mike Danilov & Víctor J. Yohai & Ruben H. Zamar, 2012. "Robust Estimation of Multivariate Location and Scatter in the Presence of Missing Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 1178-1186, September.
    5. Hansen, Bruce E, 1992. "Consistent Covariance Matrix Estimation for Dependent Heterogeneous Processes," Econometrica, Econometric Society, vol. 60(4), pages 967-972, July.
    6. Frahm, Gabriel & Jaekel, Uwe, 2010. "A generalization of Tyler's M-estimators to the case of incomplete data," Computational Statistics & Data Analysis, Elsevier, vol. 54(2), pages 374-393, February.
    7. Mortaza Jamshidian & Siavash Jalal, 2010. "Tests of Homoscedasticity, Normality, and Missing Completely at Random for Incomplete Multivariate Data," Psychometrika, Springer;The Psychometric Society, vol. 75(4), pages 649-674, December.
    8. Frahm, Gabriel & Glombek, Konstantin, 2012. "Semicircle law of Tyler’s M-estimator for scatter," Statistics & Probability Letters, Elsevier, vol. 82(5), pages 959-964.
    9. Jamshidian, Mortaza & Jalal, Siavash & Jansen, Camden, 2014. "MissMech: An R Package for Testing Homoscedasticity, Multivariate Normality, and Missing Completely at Random (MCAR)," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 56(i06).
    10. Dümbgen, Lutz & Nordhausen, Klaus & Schuhmacher, Heike, 2016. "New algorithms for M-estimation of multivariate scatter and location," Journal of Multivariate Analysis, Elsevier, vol. 144(C), pages 200-217.
    11. Hron, K. & Templ, M. & Filzmoser, P., 2010. "Imputation of missing values for compositional data using classical and robust methods," Computational Statistics & Data Analysis, Elsevier, vol. 54(12), pages 3095-3107, December.
    12. Anton Flossmann, 2010. "Accounting for missing data in M-estimation: a general matching approach," Empirical Economics, Springer, vol. 38(1), pages 85-117, February.
    13. Frahm, Gabriel, 2009. "Asymptotic distributions of robust shape matrices and scales," Journal of Multivariate Analysis, Elsevier, vol. 100(7), pages 1329-1337, August.
    14. Roderick J. A. Little, 1988. "Robust Estimation of the Mean and Covariance Matrix from Data with Missing Values," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 37(1), pages 23-38, March.
    15. Wooldridge, Jeffrey M., 2007. "Inverse probability weighted estimation for general missing data problems," Journal of Econometrics, Elsevier, vol. 141(2), pages 1281-1301, December.
    16. Paindaveine, Davy, 2008. "A canonical definition of shape," Statistics & Probability Letters, Elsevier, vol. 78(14), pages 2240-2247, October.
    17. Cambanis, Stamatis & Huang, Steel & Simons, Gordon, 1981. "On the theory of elliptically contoured distributions," Journal of Multivariate Analysis, Elsevier, vol. 11(3), pages 368-385, September.
    18. Peisong Han, 2014. "Multiply Robust Estimation in Regression Analysis With Missing Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1159-1173, September.
    19. Templ, Matthias & Kowarik, Alexander & Filzmoser, Peter, 2011. "Iterative stepwise regression imputation using standard and robust methods," Computational Statistics & Data Analysis, Elsevier, vol. 55(10), pages 2793-2806, October.
    20. Peisong Han, 2016. "Combining Inverse Probability Weighting and Multiple Imputation to Improve Robustness of Estimation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 43(1), pages 246-260, March.
    21. Serneels, Sven & Verdonck, Tim, 2008. "Principal component analysis for data containing outliers and missing elements," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1712-1727, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Frahm, Gabriel & Jaekel, Uwe, 2010. "A generalization of Tyler's M-estimators to the case of incomplete data," Computational Statistics & Data Analysis, Elsevier, vol. 54(2), pages 374-393, February.
    2. Nikola Štefelová & Andreas Alfons & Javier Palarea-Albaladejo & Peter Filzmoser & Karel Hron, 2021. "Robust regression with compositional covariates including cellwise outliers," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(4), pages 869-909, December.
    3. Paindaveine, Davy & Van Bever, Germain, 2014. "Inference on the shape of elliptical distributions based on the MCD," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 125-144.
    4. Frahm, Gabriel, 2009. "Asymptotic distributions of robust shape matrices and scales," Journal of Multivariate Analysis, Elsevier, vol. 100(7), pages 1329-1337, August.
    5. Davy Paindaveine & Germain Van Bever, 2013. "Inference on the Shape of Elliptical Distribution Based on the MCD," Working Papers ECARES ECARES 2013-27, ULB -- Universite Libre de Bruxelles.
    6. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    7. Chassan, Malika & Concordet, Didier, 2023. "How to test the missing data mechanism in a hidden Markov model," Computational Statistics & Data Analysis, Elsevier, vol. 182(C).
    8. Xiaogang Duan & Guosheng Yin, 2017. "Ensemble Approaches to Estimating the Population Mean with Missing Response," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 44(4), pages 899-917, December.
    9. Prokhorov, Artem & Schmidt, Peter, 2009. "GMM redundancy results for general missing data problems," Journal of Econometrics, Elsevier, vol. 151(1), pages 47-55, July.
    10. Jean-Marie Dufour & Alain Trognon & Purevdorj Tuvaandorj, 2017. "Invariant tests based on M -estimators, estimating functions, and the generalized method of moments," Econometric Reviews, Taylor & Francis Journals, vol. 36(1-3), pages 182-204, March.
    11. Hirukawa, Masayuki, 2023. "Robust Covariance Matrix Estimation in Time Series: A Review," Econometrics and Statistics, Elsevier, vol. 27(C), pages 36-61.
    12. Lewbel, Arthur & Choi, Jin Young & Zhou, Zhuzhu, 2023. "Over-identified Doubly Robust identification and estimation," Journal of Econometrics, Elsevier, vol. 235(1), pages 25-42.
    13. Ke-Hai Yuan & Mortaza Jamshidian & Yutaka Kano, 2018. "Missing Data Mechanisms and Homogeneity of Means and Variances–Covariances," Psychometrika, Springer;The Psychometric Society, vol. 83(2), pages 425-442, June.
    14. Dominique Guegan & Bertrand K. Hassani, 2019. "Risk Measurement," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-02119256, HAL.
    15. Davy Paindaveine & Germain Van Bever, 2017. "Halfspace Depths for Scatter, Concentration and Shape Matrices," Working Papers ECARES ECARES 2017-19, ULB -- Universite Libre de Bruxelles.
    16. C. Croux & C. Dehon & A. Yadine, 2010. "The k-step spatial sign covariance matrix," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 4(2), pages 137-150, September.
    17. Zhuoer Sun & Suojin Wang, 2019. "Semiparametric estimation in regression with missing covariates using single-index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(5), pages 1201-1232, October.
    18. Li, Jia & Liao, Zhipeng, 2020. "Uniform nonparametric inference for time series," Journal of Econometrics, Elsevier, vol. 219(1), pages 38-51.
    19. Chen, Xiaohong & Liao, Zhipeng, 2015. "Sieve semiparametric two-step GMM under weak dependence," Journal of Econometrics, Elsevier, vol. 189(1), pages 163-186.
    20. Hall, Alastair R. & Inoue, Atsushi, 2003. "The large sample behaviour of the generalized method of moments estimator in misspecified models," Journal of Econometrics, Elsevier, vol. 114(2), pages 361-394, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:176:y:2020:i:c:s0047259x19300077. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.