IDEAS home Printed from https://ideas.repec.org/a/bla/stanee/v78y2024i2p374-396.html
   My bibliography  Save this article

Semiparametric recovery of central dimension reduction space with nonignorable nonresponse

Author

Listed:
  • Siming Zheng
  • Alan T. K. Wan
  • Yong Zhou

Abstract

Sufficient dimension reduction (SDR) methods are effective tools for handling high dimensional data. Classical SDR methods are developed under the assumption that the data are completely observed. When the data are incomplete due to missing values, SDR has only been considered when the data are randomly missing, but not when they are nonignorably missing, which is arguably more difficult to handle due to the missing values' dependence on the reasons they are missing. The purpose of this paper is to fill this void. We propose an intuitive, easy‐to‐implement SDR estimator based on a semiparametric propensity score function for response data with non‐ignorable missing values. We refer to it as the dimension reduction‐based imputed estimator. We establish the theoretical properties of this estimator and examine its empirical performance via an extensive numerical study on real and simulated data. As well, we compare the performance of our proposed dimension reduction‐based imputed estimator with two competing estimators, including the fusion refined estimator and cumulative slicing estimator. A distinguishing feature of our method is that it requires no validation sample. The SDR theory developed in this paper is a non‐trivial extension of the existing literature, due to the technical challenges posed by nonignorable missingness. All the technical proofs of the theorems are given in the Appendix S1.

Suggested Citation

  • Siming Zheng & Alan T. K. Wan & Yong Zhou, 2024. "Semiparametric recovery of central dimension reduction space with nonignorable nonresponse," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 78(2), pages 374-396, May.
    • Handle: RePEc:bla:stanee:v:78:y:2024:i:2:p:374-396
    DOI: 10.1111/stan.12321
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/stan.12321
    Download Restriction: no
    File URL: https://libkey.io/10.1111/stan.12321?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Guo, Xu & Wang, Tao & Xu, Wangli & Zhu, Lixing, 2014. "Dimension reduction with missing response at random," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 228-242.
    3. Xuerong Chen & Alan T. K. Wan & Yong Zhou, 2015. "Efficient Quantile Regression Analysis With Missing Observations," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 723-741, June.
    4. Puying Zhao & Lei Wang & Jun Shao, 2019. "Empirical likelihood and Wilks phenomenon for data with nonignorable missing values," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 46(4), pages 1003-1024, December.
    5. Jun Shao & Lei Wang, 2016. "Semiparametric inverse propensity weighting for nonignorable missing data," Biometrika, Biometrika Trust, vol. 103(1), pages 175-187.
    6. Kim, Jae Kwang & Yu, Cindy Long, 2011. "A Semiparametric Estimation of Mean Functionals With Nonignorable Missing Data," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 157-165.
    7. Zhou, Yong & Wan, Alan T. K & Wang, Xiaojing, 2008. "Estimating Equations Inference With Missing Data," Journal of the American Statistical Association, American Statistical Association, vol. 103(483), pages 1187-1199.
    8. Yanyuan Ma & Liping Zhu, 2013. "A Review on Dimension Reduction," International Statistical Review, International Statistical Institute, vol. 81(1), pages 134-150, April.
    9. Lei Wang, 2019. "Dimension reduction for kernel-assisted M-estimators with missing response at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(4), pages 889-910, August.
    10. repec:mpr:mprres:8160 is not listed on IDEAS
    11. Li, Lexin & Lu, Wenbin, 2008. "Sufficient Dimension Reduction With Missing Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 822-831, June.
    12. Ding, Xiaobo & Wang, Qihua, 2011. "Fusion-Refinement Procedure for Dimension Reduction With Missing Response at Random," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1193-1207.
    13. Zhu, Li-Ping & Zhu, Li-Xing & Feng, Zheng-Hui, 2010. "Dimension Reduction in Regressions Through Cumulative Slicing Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1455-1466.
    14. Yanyuan Ma & Liping Zhu, 2012. "A Semiparametric Approach to Dimension Reduction," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 168-179, March.
    15. Dong, Yuexiao & Xia, Qi & Tang, Cheng Yong & Li, Zeda, 2018. "On sufficient dimension reduction with missing responses through estimating equations," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 67-77.
    16. Deng, Jianqiu & Yang, Xiaojie & Wang, Qihua, 2022. "Surrogate space based dimension reduction for nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    17. Wang, Lei & Zhao, Puying & Shao, Jun, 2021. "Dimension-reduced semiparametric estimation of distribution functions and quantiles with nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    18. Liping Zhu & Tao Wang & Lixing Zhu & Louis Ferré, 2010. "Sufficient dimension reduction through discretization-expectation estimation," Biometrika, Biometrika Trust, vol. 97(2), pages 295-304.
    19. Ying Yuan & Guosheng Yin, 2010. "Bayesian Quantile Regression for Longitudinal Studies with Nonignorable Missing Data," Biometrics, The International Biometric Society, vol. 66(1), pages 105-114, March.
    20. Li, Bing & Wang, Shaoli, 2007. "On Directional Regression for Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 997-1008, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Lei & Zhao, Puying & Shao, Jun, 2021. "Dimension-reduced semiparametric estimation of distribution functions and quantiles with nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    2. Deng, Jianqiu & Yang, Xiaojie & Wang, Qihua, 2022. "Surrogate space based dimension reduction for nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    3. Lei Wang, 2019. "Dimension reduction for kernel-assisted M-estimators with missing response at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(4), pages 889-910, August.
    4. Dong, Yuexiao & Xia, Qi & Tang, Cheng Yong & Li, Zeda, 2018. "On sufficient dimension reduction with missing responses through estimating equations," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 67-77.
    5. Tang, Cheng Yong, 2024. "A model specification test for semiparametric nonignorable missing data modeling," Econometrics and Statistics, Elsevier, vol. 30(C), pages 124-132.
    6. Zhang, Ting & Wang, Lei, 2020. "Smoothed empirical likelihood inference and variable selection for quantile regression with nonignorable missing response," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    7. Aiai Yu & Yujie Zhong & Xingdong Feng & Ying Wei, 2023. "Quantile regression for nonignorable missing data with its application of analyzing electronic medical records," Biometrics, The International Biometric Society, vol. 79(3), pages 2036-2049, September.
    8. Majid Mojirsheibani, 2024. "Strong optimality of kernel functional regression in $$L^p$$ L p norms with partial response variables and applications," Statistical Papers, Springer, vol. 65(9), pages 5615-5648, December.
    9. Tai, Lingnan & Tao, Li & Pan, Jianxin & Tang, Man-lai & Yu, Keming & Härdle, Wolfgang Karl & Tian, Maozai, 2025. "Fully nonparametric inverse probability weighting estimation with nonignorable missing data and its extension to missing quantile regression," Computational Statistics & Data Analysis, Elsevier, vol. 206(C).
    10. Guo, Xu & Wang, Tao & Xu, Wangli & Zhu, Lixing, 2014. "Dimension reduction with missing response at random," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 228-242.
    11. Wei Luo, 2022. "On efficient dimension reduction with respect to the interaction between two response variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 269-294, April.
    12. Hung Hung & Su‐Yun Huang, 2019. "Sufficient dimension reduction via random‐partitions for the large‐p‐small‐n problem," Biometrics, The International Biometric Society, vol. 75(1), pages 245-255, March.
    13. Wang, Qin & Xue, Yuan, 2021. "An ensemble of inverse moment estimators for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    14. Yujing Shao & Lei Wang, 2022. "Generalized partial linear models with nonignorable dropouts," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 85(2), pages 223-252, February.
    15. Lian, Heng & Li, Gaorong, 2014. "Series expansion for functional sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 124(C), pages 150-165.
    16. Dong, Yuexiao & Yu, Zhou & Zhu, Liping, 2015. "Robust inverse regression for dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 134(C), pages 71-81.
    17. Liu, Jianxuan, 2025. "Sufficient Dimension Reduction for Poisson Regression," Econometrics and Statistics, Elsevier, vol. 34(C), pages 109-119.
    18. Zhou, Jingke & Xu, Wangli & Zhu, Lixing, 2015. "Robust estimating equation-based sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 134(C), pages 99-118.
    19. Lyu Ni & Jun Shao, 2023. "Estimation with multivariate outcomes having nonignorable item nonresponse," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(1), pages 1-15, February.
    20. Majid Mojirsheibani, 2022. "On the maximal deviation of kernel regression estimators with NMAR response variables," Statistical Papers, Springer, vol. 63(5), pages 1677-1705, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:stanee:v:78:y:2024:i:2:p:374-396. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0039-0402 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.