IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v115y2017icp67-78.html
   My bibliography  Save this article

Sufficient dimension reduction using Hilbert–Schmidt independence criterion

Author

Listed:
  • Xue, Yuan
  • Zhang, Nan
  • Yin, Xiangrong
  • Zheng, Haitao

Abstract

By using Hilbert–Schmidt Independence Criterion, a sufficient dimension reduction method is proposed to estimate the directions in multiple-index models. A projection pursuit type of sufficient searching algorithm is introduced to reduce the computational complexity, as the original problem involves non-linear optimization over multidimensional Grassmann-manifold. A bootstrap procedure with additional jump point detection algorithm is used for determining the dimensionality. The proposed method demonstrates competitive performance compared with some well-known dimension reduction methods via simulation studies and an application to a real data.

Suggested Citation

  • Xue, Yuan & Zhang, Nan & Yin, Xiangrong & Zheng, Haitao, 2017. "Sufficient dimension reduction using Hilbert–Schmidt independence criterion," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 67-78.
  • Handle: RePEc:eee:csdana:v:115:y:2017:i:c:p:67-78
    DOI: 10.1016/j.csda.2017.05.002
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947317300968
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2017.05.002?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yingcun Xia & Howell Tong & W. K. Li & Li‐Xing Zhu, 2002. "An adaptive estimation of dimension reduction space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 363-410, August.
    2. Hinkley, D. V., 1997. "Discussion of paper by H. Li & G.S. Maddala," Journal of Econometrics, Elsevier, vol. 80(2), pages 319-323, October.
    3. Yin, Xiangrong & Li, Bing & Cook, R. Dennis, 2008. "Successive direction extraction for estimating the central subspace in a multiple-index regression," Journal of Multivariate Analysis, Elsevier, vol. 99(8), pages 1733-1757, September.
    4. Wang, Hansheng & Xia, Yingcun, 2008. "Sliced Regression for Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 811-821, June.
    5. Zhu, Yu & Zeng, Peng, 2006. "Fourier Methods for Estimating the Central Subspace and the Central Mean Subspace in Regression," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1638-1651, December.
    6. Ye Z. & Weiss R.E., 2003. "Using the Bootstrap to Select One of a New Class of Dimension Reduction Methods," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 968-979, January.
    7. Sheng, Wenhui & Yin, Xiangrong, 2013. "Direction estimation in single-index models via distance covariance," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 148-161.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Pei & Yin, Xiangrong & Yuan, Qingcong & Kryscio, Richard, 2021. "Feature filter for estimating central mean subspace and its sparse solution," Computational Statistics & Data Analysis, Elsevier, vol. 163(C).
    2. Wu, Runxiong & Chen, Xin, 2021. "MM algorithms for distance covariance based sufficient dimension reduction and sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    3. Wang, Qin & Yin, Xiangrong, 2011. "Estimation of inverse mean: An orthogonal series approach," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1656-1664, April.
    4. Weng, Jiaying, 2022. "Fourier transform sparse inverse regression estimators for sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    5. Sheng, Wenhui & Yin, Xiangrong, 2013. "Direction estimation in single-index models via distance covariance," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 148-161.
    6. Wang, Qin & Xue, Yuan, 2021. "An ensemble of inverse moment estimators for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    7. Tao, Chenyang & Feng, Jianfeng, 2017. "Canonical kernel dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 107(C), pages 131-148.
    8. Rekabdarkolaee, Hossein Moradi & Boone, Edward & Wang, Qin, 2017. "Robust estimation and variable selection in sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 108(C), pages 146-157.
    9. Zhang, Jing & Wang, Qin & Mays, D'Arcy, 2021. "Robust MAVE through nonconvex penalized regression," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    10. Eliana Christou, 2020. "Robust dimension reduction using sliced inverse median regression," Statistical Papers, Springer, vol. 61(5), pages 1799-1818, October.
    11. Iaci, Ross & Yin, Xiangrong & Zhu, Lixing, 2016. "The Dual Central Subspaces in dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 178-189.
    12. Zeng, Bilin & Yu, Zhou & Wen, Xuerong Meggie, 2015. "A note on cumulative mean estimation," Statistics & Probability Letters, Elsevier, vol. 96(C), pages 322-327.
    13. Yin, Xiangrong & Li, Bing & Cook, R. Dennis, 2008. "Successive direction extraction for estimating the central subspace in a multiple-index regression," Journal of Multivariate Analysis, Elsevier, vol. 99(8), pages 1733-1757, September.
    14. Xue, Yuan & Yin, Xiangrong & Jiang, Xiaolin, 2016. "Ensemble sufficient dimension folding methods for analyzing matrix-valued data," Computational Statistics & Data Analysis, Elsevier, vol. 103(C), pages 193-205.
    15. Kim, Kyongwon, 2022. "On principal graphical models with application to gene network," Computational Statistics & Data Analysis, Elsevier, vol. 166(C).
    16. Ming-Yueh Huang & Chin-Tsang Chiang, 2017. "An Effective Semiparametric Estimation Approach for the Sufficient Dimension Reduction Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1296-1310, July.
    17. Wang, Qin & Yao, Weixin, 2012. "An adaptive estimation of MAVE," Journal of Multivariate Analysis, Elsevier, vol. 104(1), pages 88-100, February.
    18. S. Yaser Samadi & Tharindu P. De Alwis, 2023. "Fourier Methods for Sufficient Dimension Reduction in Time Series," Papers 2312.02110, arXiv.org.
    19. Park, Jin-Hong & Bandyopadhyay, Dipankar & Letourneau, Elizabeth, 2014. "Examining deterrence of adult sex crimes: A semi-parametric intervention time-series approach," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 198-207.
    20. Luo, Wei & Cai, Xizhen, 2016. "A new estimator for efficient dimension reduction in regression," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 236-249.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:115:y:2017:i:c:p:67-78. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.