IDEAS home Printed from https://ideas.repec.org/a/spr/stmapp/v26y2017i4d10.1007_s10260-017-0388-9.html
   My bibliography  Save this article

Robust skew-t factor analysis models for handling missing data

Author

Listed:
  • Wan-Lun Wang

    (Feng Chia University)

  • Min Liu

    (University of Hawaii at Mānoa)

  • Tsung-I Lin

    (National Chung Hsing University
    China Medical University)

Abstract

This paper presents a novel framework for maximum likelihood (ML) estimation in skew-t factor analysis (STFA) models in the presence of missing values or nonresponses. As a robust extension of the ordinary factor analysis model, the STFA model assumes a restricted version of the multivariate skew-t distribution for the latent factors and the unobservable errors to accommodate non-normal features such as asymmetry and heavy tails or outliers. An EM-type algorithm is developed to carry out ML estimation and imputation of missing values under a missing at random mechanism. The practical utility of the proposed methodology is illustrated through real and synthetic data examples.

Suggested Citation

  • Wan-Lun Wang & Min Liu & Tsung-I Lin, 2017. "Robust skew-t factor analysis models for handling missing data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 26(4), pages 649-672, November.
    • Handle: RePEc:spr:stmapp:v:26:y:2017:i:4:d:10.1007_s10260-017-0388-9
    DOI: 10.1007/s10260-017-0388-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10260-017-0388-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10260-017-0388-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Geert Molenberghs & Caroline Beunckens & Cristina Sotto & Michael G. Kenward, 2008. "Every missingness not at random model has a missingness at random counterpart with equal fit," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(2), pages 371-388, April.
    2. ., 1999. "The assessment of capital adequacy," Chapters, in: Handbook of Banking Regulation and Supervision in the United Kingdom, chapter 17, Edward Elgar Publishing.
    3. Kim, Hyoung-Moon & Maadooliat, Mehdi & Arellano-Valle, Reinaldo B. & Genton, Marc G., 2016. "Skewed factor models using selection mechanisms," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 162-177.
    4. Liu, Chuanhai, 1999. "Efficient ML Estimation of the Multivariate Normal Distribution from Incomplete Data," Journal of Multivariate Analysis, Elsevier, vol. 69(2), pages 206-217, May.
    5. M. J. R. Healy, 1968. "Multivariate Normal Plotting," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 17(2), pages 157-161, June.
    6. -, 2003. "Capital flows to Latin America: first quarter 2003," Oficina de la CEPAL en Washington (Estudios e Investigaciones) 28822, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    7. A. Azzalini & A. Capitanio, 1999. "Statistical applications of the multivariate skew normal distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(3), pages 579-602.
    8. M. Liu & T.I. Lin, 2015. "Skew-normal factor analysis models with incomplete data," Journal of Applied Statistics, Taylor & Francis Journals, vol. 42(4), pages 789-805, April.
    9. -, 2003. "Capital flows to Latin America: second quarter 2002," Oficina de la CEPAL en Washington (Estudios e Investigaciones) 28812, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    10. Lounasheimo, Antton, 1999. "The Impact of Human Capital on Economic Growth," Discussion Papers 673, The Research Institute of the Finnish Economy.
    11. Álvarez Alvarado, Marcos Tulio, 2003. "¿Existe una alternativa al capitalismo?," Observatorio de la Economía Latinoamericana, Servicios Académicos Intercontinentales SL. Hasta 31/12/2022, issue 16, November.
    12. Angela Montanari & Cinzia Viroli, 2010. "A skew-normal factor model for the analysis of student satisfaction towards university courses," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(3), pages 473-487.
    13. Donald Rubin & Dorothy Thayer, 1982. "EM algorithms for ML factor analysis," Psychometrika, Springer;The Psychometric Society, vol. 47(1), pages 69-76, March.
    14. Tsung-I Lin & Pal Wu & Geoffrey McLachlan & Sharon Lee, 2015. "A robust factor analysis model using the restricted skew- $$t$$ t distribution," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 510-531, September.
    15. -, 2003. "Capital flows to Latin America: second quarter 2003," Oficina de la CEPAL en Washington (Estudios e Investigaciones) 28823, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    16. -, 2003. "Capital flows to Latin America: first quarter 2002," Oficina de la CEPAL en Washington (Estudios e Investigaciones) 28811, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    17. -, 2003. "Capital flows to Latin America: fourth quarter 2002," Oficina de la CEPAL en Washington (Estudios e Investigaciones) 28814, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    18. Ab Mooijaart, 1985. "Factor analysis for non-normal variables," Psychometrika, Springer;The Psychometric Society, vol. 50(3), pages 323-342, September.
    19. Ole E. Barndorff‐Nielsen & Neil Shephard, 2001. "Non‐Gaussian Ornstein–Uhlenbeck‐based models and some of their uses in financial economics," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 167-241.
    20. -, 2003. "Capital flows to Latin America: third quarter 2003," Oficina de la CEPAL en Washington (Estudios e Investigaciones) 28824, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    21. -, 2003. "Capital flows to Latin America: third quarter 2002," Oficina de la CEPAL en Washington (Estudios e Investigaciones) 28813, Naciones Unidas Comisión Económica para América Latina y el Caribe (CEPAL).
    22. McNicholas, P.D. & Murphy, T.B. & McDaid, A.F. & Frost, D., 2010. "Serial and parallel implementations of model-based clustering via parsimonious Gaussian mixture models," Computational Statistics & Data Analysis, Elsevier, vol. 54(3), pages 711-723, March.
    23. Jae-On Kim & James Curry, 1977. "The Treatment of Missing Data in Multivariate Analysis," Sociological Methods & Research, , vol. 6(2), pages 215-240, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wang, Wan-Lun & Castro, Luis M. & Lin, Tsung-I, 2017. "Automated learning of t factor analysis models with complete and incomplete data," Journal of Multivariate Analysis, Elsevier, vol. 161(C), pages 157-171.
    2. Tsung-I Lin & I-An Chen & Wan-Lun Wang, 2023. "A robust factor analysis model based on the canonical fundamental skew-t distribution," Statistical Papers, Springer, vol. 64(2), pages 367-393, April.
    3. Cornelis J. Potgieter, 2020. "Density deconvolution for generalized skew-symmetric distributions," Journal of Statistical Distributions and Applications, Springer, vol. 7(1), pages 1-20, December.
    4. Morris, Katherine & Punzo, Antonio & McNicholas, Paul D. & Browne, Ryan P., 2019. "Asymmetric clusters and outliers: Mixtures of multivariate contaminated shifted asymmetric Laplace distributions," Computational Statistics & Data Analysis, Elsevier, vol. 132(C), pages 145-166.
    5. Francisco H. C. Alencar & Christian E. Galarza & Larissa A. Matos & Victor H. Lachos, 2022. "Finite mixture modeling of censored and missing data using the multivariate skew-normal distribution," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 16(3), pages 521-557, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mehdi Amiri & Ahad Jamalizadeh & Mina Towhidi, 2015. "Inference and further probabilistic properties of the $$ SUN_{n,2}$$ S U N n , 2 -distribution," Statistical Papers, Springer, vol. 56(4), pages 1071-1098, November.
    2. Wan-Lun Wang & Tsung-I Lin, 2015. "Robust model-based clustering via mixtures of skew-t distributions with missing information," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 9(4), pages 423-445, December.
    3. McLachlan, Geoff & Lee, Sharon X, 2013. "EMMIXuskew: An R Package for Fitting Mixtures of Multivariate Skew t Distributions via the EM Algorithm," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 55(i12).
    4. Ahad Jamalizadeh & Tsung-I Lin, 2017. "A general class of scale-shape mixtures of skew-normal distributions: properties and estimation," Computational Statistics, Springer, vol. 32(2), pages 451-474, June.
    5. Tao Lu, 2017. "Bayesian inference on longitudinal-survival data with multiple features," Computational Statistics, Springer, vol. 32(3), pages 845-866, September.
    6. Komárek, Arnošt & Komárková, Lenka, 2014. "Capabilities of R Package mixAK for Clustering Based on Multivariate Continuous and Discrete Longitudinal Data," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 59(i12).
    7. John Marangos & Charles J. Whalen, 2011. "Evolution without fundamental change: the Washington Consensus on economic development," Chapters, in: Charles J. Whalen (ed.), Financial Instability and Economic Security after the Great Recession, chapter 8, pages 153-178, Edward Elgar Publishing.
    8. Tsung-I Lin & Pal Wu & Geoffrey McLachlan & Sharon Lee, 2015. "A robust factor analysis model using the restricted skew- $$t$$ t distribution," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 510-531, September.
    9. Alvaro Cuervo-Cazurra & Luis Alfonso Dau, 2009. "Structural Reform and Firm Exports," Management International Review, Springer, vol. 49(4), pages 479-507, September.
    10. Yangxin Huang & Tao Lu, 2017. "Bayesian inference on partially linear mixed-effects joint models for longitudinal data with multiple features," Computational Statistics, Springer, vol. 32(1), pages 179-196, March.
    11. Olcay Arslan, 2015. "Variance-mean mixture of the multivariate skew normal distribution," Statistical Papers, Springer, vol. 56(2), pages 353-378, May.
    12. Tsung-I Lin & I-An Chen & Wan-Lun Wang, 2023. "A robust factor analysis model based on the canonical fundamental skew-t distribution," Statistical Papers, Springer, vol. 64(2), pages 367-393, April.
    13. Catarina Figueira & David Parker, 2011. "Infrastructure Liberalization: Challenges to the New Economic Paradigm in the Context of Developing Countries," Chapters, in: Matthias Finger & Rolf W. Künneke (ed.), International Handbook of Network Industries, chapter 27, Edward Elgar Publishing.
    14. Hashemi, Farzane & Naderi, Mehrdad & Jamalizadeh, Ahad & Bekker, Andriette, 2021. "A flexible factor analysis based on the class of mean-mixture of normal distributions," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    15. Matthias Finger & Rolf W. Künneke (ed.), 2011. "International Handbook of Network Industries," Books, Edward Elgar Publishing, number 12961.
    16. Anna Gottard & Simona Pacillo, 2007. "On the impact of contaminations in graphical Gaussian models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 15(3), pages 343-354, February.
    17. David Mayston, 2015. "Analysing the effectiveness of public service producers with endogenous resourcing," Journal of Productivity Analysis, Springer, vol. 44(1), pages 115-126, August.
    18. Maria Carolina Basso, 2016. "A Economia Brasileira Sob Restrição Do Balanço De Pagamentos: Uma Análise Empírica Da Lei De Thirlwall No Boom Das Commodities," Anais do XLII Encontro Nacional de Economia [Proceedings of the 42nd Brazilian Economics Meeting] 089, ANPEC - Associação Nacional dos Centros de Pós-Graduação em Economia [Brazilian Association of Graduate Programs in Economics].
    19. Murray, Paula M. & Browne, Ryan P. & McNicholas, Paul D., 2017. "A mixture of SDB skew-t factor analyzers," Econometrics and Statistics, Elsevier, vol. 3(C), pages 160-168.
    20. Sharon X. Lee & Tsung-I Lin & Geoffrey J. McLachlan, 2021. "Mixtures of factor analyzers with scale mixtures of fundamental skew normal distributions," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 15(2), pages 481-512, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stmapp:v:26:y:2017:i:4:d:10.1007_s10260-017-0388-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.