IDEAS home Printed from https://ideas.repec.org/a/spr/stmapp/v30y2021i2d10.1007_s10260-020-00530-w.html
   My bibliography  Save this article

Semiparametric model for regression analysis with nonmonotone missing data

Author

Listed:
  • Yang Zhao

    (University of Regina)

Abstract

Semiparametric likelihoods for regression models with missing at random data (Chen in J Am Stat Assoc 99:1176–1189, 2004, Zhang and Rockette in J Stat Comput Simul 77(2):163–173, 2007, Zhao et al. in Biom J 51: 123–136, 2009, Zhao in Commun Stat Theory Methods 38:3736–3744, 2009) are robust as they use nonparametric models for covariate distributions and do not require modeling the missing data probabilities. Furthermore, the EM algorithms based on the semiparametric likelihoods have closed form expressions for both E-step and M-step. As far as we know the semiparametric likelihoods can only deal with the simple monotone missing data pattern. In this research we extend the semiparemetric likelihood approach to deal with regression models with arbitrary nonmonotone missing at random data. We propose a pseudo-likelihood model, which uses an empirical distribution to model the conditional distribution of missing covariates given observed covariates for each missing data pattern separately. We show that an EM algorithm with closed form updating formulas can be used for computing maximum pseudo-likelihood estimates for regression models with nonmonotone missing data. We then propose estimating the asymptotic variance of the maximum pseudo-likelihood estimator through a profile log likelihood and the EM algorithm. We examine the finite sample performance of the new methods in simulation studies and further illustrate the methods in a real data example investigating high risk gambling behavior and the associated factors.

Suggested Citation

  • Yang Zhao, 2021. "Semiparametric model for regression analysis with nonmonotone missing data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(2), pages 461-475, June.
  • Handle: RePEc:spr:stmapp:v:30:y:2021:i:2:d:10.1007_s10260-020-00530-w
    DOI: 10.1007/s10260-020-00530-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10260-020-00530-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10260-020-00530-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Joseph G. Ibrahim & Ming-Hui Chen & Stuart R. Lipsitz & Amy H. Herring, 2005. "Missing-Data Methods for Generalized Linear Models: A Comparative Review," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 332-346, March.
    2. Hua Yun Chen & Hui Xie & Yi Qian, 2011. "Multiple Imputation for Missing Values through Conditional Semiparametric Odds Ratio Models," Biometrics, The International Biometric Society, vol. 67(3), pages 799-809, September.
    3. Chatterjee N. & Chen Y-H. & Breslow N.E., 2003. "A Pseudoscore Estimator for Regression Problems With Two-Phase Sampling," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 158-168, January.
    4. Joseph G. Ibrahim & Ming-Hui Chen & Stuart R. Lipsitz, 1999. "Monte Carlo EM for Missing Covariates in Parametric Regression Models," Biometrics, The International Biometric Society, vol. 55(2), pages 591-596, June.
    5. Hua Yun Chen, 2004. "Nonparametric and Semiparametric Models for Missing Covariates in Parametric Regression," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 1176-1189, December.
    6. Samiran Sinha & Krishna K. Saha & Suojin Wang, 2014. "Semiparametric approach for non-monotone missing covariates in a parametric regression model," Biometrics, The International Biometric Society, vol. 70(2), pages 299-311, June.
    7. J. F. Lawless & J. D. Kalbfleisch & C. J. Wild, 1999. "Semiparametric methods for response‐selective and missing data problems in regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 61(2), pages 413-438, April.
    8. BaoLuo Sun & Eric J. Tchetgen Tchetgen, 2018. "On Inverse Probability Weighting for Nonmonotone Missing at Random Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 369-379, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang Zhao, 2023. "Maximum likelihood estimation of missing data probability for nonmonotone missing at random data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(1), pages 197-209, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang Zhao & Meng Liu, 2021. "Unified approach for regression models with nonmonotone missing at random data," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 105(1), pages 87-101, March.
    2. Zhiwei Zhang & Howard Rockette, 2006. "Semiparametric Maximum Likelihood for Missing Covariates in Parametric Regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 58(4), pages 687-706, December.
    3. J. F. Lawless, 2018. "Two-phase outcome-dependent studies for failure times and testing for effects of expensive covariates," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 24(1), pages 28-44, January.
    4. Zhuoer Sun & Suojin Wang, 2019. "Semiparametric estimation in regression with missing covariates using single-index models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(5), pages 1201-1232, October.
    5. Samiran Sinha & Krishna K. Saha & Suojin Wang, 2014. "Semiparametric approach for non-monotone missing covariates in a parametric regression model," Biometrics, The International Biometric Society, vol. 70(2), pages 299-311, June.
    6. Liang, Hua, 2008. "Generalized partially linear models with missing covariates," Journal of Multivariate Analysis, Elsevier, vol. 99(5), pages 880-895, May.
    7. James Y. Dai & Michael LeBlanc & Charles Kooperberg, 2009. "Semiparametric Estimation Exploiting Covariate Independence in Two-Phase Randomized Trials," Biometrics, The International Biometric Society, vol. 65(1), pages 178-187, March.
    8. Yang Zhao, 2023. "Maximum likelihood estimation of missing data probability for nonmonotone missing at random data," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 32(1), pages 197-209, March.
    9. Ryo Kato & Takahiro Hoshino, 2020. "Semiparametric Bayesian multiple imputation for regression models with missing mixed continuous–discrete covariates," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(3), pages 803-825, June.
    10. Lei Jin & Suojin Wang, 2010. "A Model Validation Procedure when Covariate Data are Missing at Random," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 37(3), pages 403-421, September.
    11. Jonathan S. Schildcrout & Shawn P. Garbett & Patrick J. Heagerty, 2013. "Outcome Vector Dependent Sampling with Longitudinal Continuous Response Data: Stratified Sampling Based on Summary Statistics," Biometrics, The International Biometric Society, vol. 69(2), pages 405-416, June.
    12. Yi Qian & Hui Xie, 2011. "No Customer Left Behind: A Distribution-Free Bayesian Approach to Accounting for Missing Xs in Marketing Models," Marketing Science, INFORMS, vol. 30(4), pages 717-736, July.
    13. Jiang, Wei & Josse, Julie & Lavielle, Marc, 2020. "Logistic regression with missing covariates—Parameter estimation, model selection and prediction within a joint-modeling framework," Computational Statistics & Data Analysis, Elsevier, vol. 145(C).
    14. Brady Ryan & Ananthika Nirmalkanna & Candemir Cigsar & Yildiz E. Yilmaz, 2023. "Evaluation of Designs and Estimation Methods Under Response-Dependent Two-Phase Sampling for Genetic Association Studies," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 15(2), pages 510-539, July.
    15. Haibo Zhou & Rui Song & Yuanshan Wu & Jing Qin, 2011. "Statistical Inference for a Two-Stage Outcome-Dependent Sampling Design with a Continuous Outcome," Biometrics, The International Biometric Society, vol. 67(1), pages 194-202, March.
    16. Chen, Xue-Dong & Fu, Ying-Zi, 2011. "Model selection for zero-inflated regression with missing covariates," Computational Statistics & Data Analysis, Elsevier, vol. 55(1), pages 765-773, January.
    17. Hongtu Zhu & Joseph G. Ibrahim & Xiaoyan Shi, 2009. "Diagnostic Measures for Generalized Linear Models with Missing Covariates," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 36(4), pages 686-712, December.
    18. Fatema Shafie Khorassani & Jeremy M. G. Taylor & Niko Kaciroti & Michael R. Elliott, 2023. "Incorporating Covariates into Measures of Surrogate Paradox Risk," Stats, MDPI, vol. 6(1), pages 1-23, February.
    19. Chen, Qingxia & Ibrahim, Joseph G. & Chen, Ming-Hui & Senchaudhuri, Pralay, 2008. "Theory and inference for regression models with missing responses and covariates," Journal of Multivariate Analysis, Elsevier, vol. 99(6), pages 1302-1331, July.
    20. Jieli Ding & Tsui-Shan Lu & Jianwen Cai & Haibo Zhou, 2017. "Recent progresses in outcome-dependent sampling with failure time data," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 23(1), pages 57-82, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stmapp:v:30:y:2021:i:2:d:10.1007_s10260-020-00530-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.