IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v102y2011i3p550-562.html
   My bibliography  Save this article

A link-free method for testing the significance of predictors

Author

Listed:
  • Zeng, Peng

Abstract

One important step in regression analysis is to identify significant predictors from a pool of candidates so that a parsimonious model can be obtained using these significant predictors only. However, most of the existing methods assume linear relationships between response and predictors, which may be inappropriate in some applications. In this article, we discuss a link-free method that avoids specifying how the response depends on the predictors. Therefore, this method has no problem of model misspecification, and it is suitable for selecting significant predictors at the preliminary stage of data analysis. A test statistic is suggested and its asymptotic distribution is derived. Examples are used to demonstrate the proposed method.

Suggested Citation

  • Zeng, Peng, 2011. "A link-free method for testing the significance of predictors," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 550-562, March.
    • Handle: RePEc:eee:jmvana:v:102:y:2011:i:3:p:550-562
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(10)00219-8
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hao Helen Zhang & Grace Wahba & Yi Lin & Meta Voelker & Michael Ferris & Ronald Klein & Barbara Klein, 2004. "Variable Selection and Model Building via Likelihood Basis Pursuit," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 659-672, January.
    2. Franklin Satterthwaite, 1941. "Synthesis of variance," Psychometrika, Springer;The Psychometric Society, vol. 6(5), pages 309-316, October.
    3. Lexin Li, 2007. "Sparse sufficient dimension reduction," Biometrika, Biometrika Trust, vol. 94(3), pages 603-613.
    4. Zhu, Yu & Zeng, Peng, 2006. "Fourier Methods for Estimating the Central Subspace and the Central Mean Subspace in Regression," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1638-1651, December.
    5. Casella, George & Moreno, Elias, 2006. "Objective Bayesian Variable Selection," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 157-167, March.
    6. Zeng, Peng & Zhu, Yu, 2010. "An integral transform method for estimating the central mean and central subspaces," Journal of Multivariate Analysis, Elsevier, vol. 101(1), pages 271-290, January.
    7. Lexin Li & R. Dennis Cook & Christopher J. Nachtsheim, 2005. "Model‐free variable selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 285-299, April.
    8. Csörgo, Sándor, 1985. "Testing for independence by the empirical characteristic function," Journal of Multivariate Analysis, Elsevier, vol. 16(3), pages 290-299, June.
    9. Efang Kong & Yingcun Xia, 2007. "Variable selection for the single‐index model," Biometrika, Biometrika Trust, vol. 94(1), pages 217-229.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yao, Weixin & Wang, Qin, 2013. "Robust variable selection through MAVE," Computational Statistics & Data Analysis, Elsevier, vol. 63(C), pages 42-49.
    2. Heng-Hui Lue & Bing-Ran You, 2013. "High-dimensional regression analysis with treatment comparisons," Computational Statistics, Springer, vol. 28(3), pages 1299-1317, June.
    3. Howard D. Bondell & Lexin Li, 2009. "Shrinkage inverse regression estimation for model‐free variable selection," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(1), pages 287-299, January.
    4. Heng-Hui Lue, 2015. "An Inverse-regression Method of Dependent Variable Transformation for Dimension Reduction with Non-linear Confounding," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(3), pages 760-774, September.
    5. Bilin Zeng & Xuerong Meggie Wen & Lixing Zhu, 2017. "A link-free sparse group variable selection method for single-index model," Journal of Applied Statistics, Taylor & Francis Journals, vol. 44(13), pages 2388-2400, October.
    6. Weng, Jiaying, 2022. "Fourier transform sparse inverse regression estimators for sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    7. Wang, Pei & Yin, Xiangrong & Yuan, Qingcong & Kryscio, Richard, 2021. "Feature filter for estimating central mean subspace and its sparse solution," Computational Statistics & Data Analysis, Elsevier, vol. 163(C).
    8. Sheng, Wenhui & Yin, Xiangrong, 2013. "Direction estimation in single-index models via distance covariance," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 148-161.
    9. Ming-Yueh Huang & Chin-Tsang Chiang, 2017. "An Effective Semiparametric Estimation Approach for the Sufficient Dimension Reduction Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1296-1310, July.
    10. S. Yaser Samadi & Tharindu P. De Alwis, 2023. "Fourier Methods for Sufficient Dimension Reduction in Time Series," Papers 2312.02110, arXiv.org.
    11. Wang, Qin & Xue, Yuan, 2021. "An ensemble of inverse moment estimators for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    12. Wang, Qin & Yin, Xiangrong, 2008. "A nonlinear multi-dimensional variable selection method for high dimensional data: Sparse MAVE," Computational Statistics & Data Analysis, Elsevier, vol. 52(9), pages 4512-4520, May.
    13. Tao, Chenyang & Feng, Jianfeng, 2017. "Canonical kernel dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 107(C), pages 131-148.
    14. Moradi Rekabdarkolaee, Hossein & Wang, Qin, 2017. "Variable selection through adaptive MAVE," Statistics & Probability Letters, Elsevier, vol. 128(C), pages 44-51.
    15. Alothman, Ahmad & Dong, Yuexiao & Artemiou, Andreas, 2018. "On dual model-free variable selection with two groups of variables," Journal of Multivariate Analysis, Elsevier, vol. 167(C), pages 366-377.
    16. Wang, Tao & Zhu, Lixing, 2013. "Sparse sufficient dimension reduction using optimal scoring," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 223-232.
    17. Zhou Yu & Yuexiao Dong & Li-Xing Zhu, 2016. "Trace Pursuit: A General Framework for Model-Free Variable Selection," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 813-821, April.
    18. Yu, Zhou & Zhu, Lixing & Wen, Xuerong Meggie, 2012. "On model-free conditional coordinate tests for regressions," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 61-72.
    19. Wu, Runxiong & Chen, Xin, 2021. "MM algorithms for distance covariance based sufficient dimension reduction and sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    20. Lada, Emily K. & Wilson, James R., 2006. "A wavelet-based spectral procedure for steady-state simulation analysis," European Journal of Operational Research, Elsevier, vol. 174(3), pages 1769-1801, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:102:y:2011:i:3:p:550-562. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.