IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v61y2020i5d10.1007_s00362-018-1007-z.html
   My bibliography  Save this article

Robust dimension reduction using sliced inverse median regression

Author

Listed:
  • Eliana Christou

    (University of North Carolina at Charlotte)

Abstract

Dimension reduction is a useful technique when working with high-dimensional predictors, as meaningful data visualizations and graphical analyses using fewer predictors can be achieved. We propose a new non-iterative and robust against extreme values estimation of the effective dimension reduction (e.d.r) subspace, which is based on the estimation of the conditional median function of the predictors given the response. The existing literature on robust estimation of the e.d.r subspace relies on iterative algorithms, such as the composite quantile minimum average variance estimation and the sliced regression. Compared with these existing robust dimension reduction methods, the new method avoids iterations by directly estimating the e.d.r subspace and has better finite sample performance. It is shown that the inverse Tukey and Oja median regression curve falls into the e.d.r subspace, and that its directions can be estimated $$\sqrt{n}$$ n -consistently.

Suggested Citation

  • Eliana Christou, 2020. "Robust dimension reduction using sliced inverse median regression," Statistical Papers, Springer, vol. 61(5), pages 1799-1818, October.
  • Handle: RePEc:spr:stpapr:v:61:y:2020:i:5:d:10.1007_s00362-018-1007-z
    DOI: 10.1007/s00362-018-1007-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-018-1007-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00362-018-1007-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yingcun Xia & Howell Tong & W. K. Li & Li‐Xing Zhu, 2002. "An adaptive estimation of dimension reduction space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 363-410, August.
    2. Xiangrong Yin & R. Dennis Cook, 2002. "Dimension reduction for the conditional kth moment in regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(2), pages 159-175, May.
    3. Yin, Xiangrong & Li, Bing & Cook, R. Dennis, 2008. "Successive direction extraction for estimating the central subspace in a multiple-index regression," Journal of Multivariate Analysis, Elsevier, vol. 99(8), pages 1733-1757, September.
    4. Wang, Hansheng & Xia, Yingcun, 2008. "Sliced Regression for Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 811-821, June.
    5. Shen, Gang, 2008. "Asymptotics of Oja Median Estimate," Statistics & Probability Letters, Elsevier, vol. 78(14), pages 2137-2141, October.
    6. Kong, Efang & Xia, Yingcun, 2012. "A Single-Index Quantile Regression Model And Its Estimation," Econometric Theory, Cambridge University Press, vol. 28(4), pages 730-768, August.
    7. Zhu, Li-Ping & Zhu, Li-Xing & Feng, Zheng-Hui, 2010. "Dimension Reduction in Regressions Through Cumulative Slicing Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1455-1466.
    8. Christou, Eliana & Akritas, Michael G., 2016. "Single index quantile regression for heteroscedastic data," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 169-182.
    9. Guochang Wang & Jianjun Zhou & Wuqing Wu & Min Chen, 2017. "Robust functional sliced inverse regression," Statistical Papers, Springer, vol. 58(1), pages 227-245, March.
    10. Yanyuan Ma & Liping Zhu, 2012. "A Semiparametric Approach to Dimension Reduction," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 168-179, March.
    11. Zhu, Yu & Zeng, Peng, 2006. "Fourier Methods for Estimating the Central Subspace and the Central Mean Subspace in Regression," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1638-1651, December.
    12. Nolan, D., 1999. "On min-max majority and deepest points," Statistics & Probability Letters, Elsevier, vol. 43(4), pages 325-333, July.
    13. Oja, Hannu, 1983. "Descriptive statistics for multivariate distributions," Statistics & Probability Letters, Elsevier, vol. 1(6), pages 327-332, October.
    14. Eaton, M. L. & Tyler, D., 1994. "The Asymptotic Distribution of Singular-Values with Applications to Canonical Correlations and Correspondence Analysis," Journal of Multivariate Analysis, Elsevier, vol. 50(2), pages 238-264, August.
    15. Li, Bing & Wang, Shaoli, 2007. "On Directional Regression for Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 997-1008, September.
    16. Yuexiao Dong & Bing Li, 2010. "Dimension reduction for non-elliptically distributed predictors: second-order methods," Biometrika, Biometrika Trust, vol. 97(2), pages 279-294.
    17. Heng-Hui Lue, 2004. "Principal Hessian Directions for regression with measurement error," Biometrika, Biometrika Trust, vol. 91(2), pages 409-423, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ming-Yueh Huang & Chin-Tsang Chiang, 2017. "An Effective Semiparametric Estimation Approach for the Sufficient Dimension Reduction Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1296-1310, July.
    2. Wang, Qin & Xue, Yuan, 2021. "An ensemble of inverse moment estimators for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    3. Zeng, Bilin & Yu, Zhou & Wen, Xuerong Meggie, 2015. "A note on cumulative mean estimation," Statistics & Probability Letters, Elsevier, vol. 96(C), pages 322-327.
    4. Wang, Pei & Yin, Xiangrong & Yuan, Qingcong & Kryscio, Richard, 2021. "Feature filter for estimating central mean subspace and its sparse solution," Computational Statistics & Data Analysis, Elsevier, vol. 163(C).
    5. Sheng, Wenhui & Yin, Xiangrong, 2013. "Direction estimation in single-index models via distance covariance," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 148-161.
    6. Lu Li & Kai Tan & Xuerong Meggie Wen & Zhou Yu, 2023. "Variable-dependent partial dimension reduction," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(2), pages 521-541, June.
    7. Wenjuan Li & Wenying Wang & Jingsi Chen & Weidong Rao, 2023. "Aggregate Kernel Inverse Regression Estimation," Mathematics, MDPI, vol. 11(12), pages 1-10, June.
    8. Deng, Jianqiu & Yang, Xiaojie & Wang, Qihua, 2022. "Surrogate space based dimension reduction for nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    9. Wu, Runxiong & Chen, Xin, 2021. "MM algorithms for distance covariance based sufficient dimension reduction and sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    10. Qin Wang & Yuan Xue, 2023. "A structured covariance ensemble for sufficient dimension reduction," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(3), pages 777-800, September.
    11. Weng, Jiaying, 2022. "Fourier transform sparse inverse regression estimators for sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    12. Luo, Wei & Cai, Xizhen, 2016. "A new estimator for efficient dimension reduction in regression," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 236-249.
    13. Zifang Guo & Lexin Li & Wenbin Lu & Bing Li, 2015. "Groupwise Dimension Reduction via Envelope Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1515-1527, December.
    14. Iaci, Ross & Yin, Xiangrong & Zhu, Lixing, 2016. "The Dual Central Subspaces in dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 178-189.
    15. Ming-Yueh Huang & Kwun Chuen Gary Chan, 2017. "Joint sufficient dimension reduction and estimation of conditional and average treatment effects," Biometrika, Biometrika Trust, vol. 104(3), pages 583-596.
    16. Xie, Chuanlong & Zhu, Lixing, 2020. "Generalized kernel-based inverse regression methods for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 150(C).
    17. Chen, Canyi & Xu, Wangli & Zhu, Liping, 2022. "Distributed estimation in heterogeneous reduced rank regression: With application to order determination in sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    18. Stephen Babos & Andreas Artemiou, 2021. "Cumulative Median Estimation for Sufficient Dimension Reduction," Stats, MDPI, vol. 4(1), pages 1-8, February.
    19. S. Yaser Samadi & Tharindu P. De Alwis, 2023. "Fourier Methods for Sufficient Dimension Reduction in Time Series," Papers 2312.02110, arXiv.org.
    20. Lian, Heng & Li, Gaorong, 2014. "Series expansion for functional sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 124(C), pages 150-165.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:61:y:2020:i:5:d:10.1007_s00362-018-1007-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.