IDEAS home Printed from https://ideas.repec.org/a/oup/biomet/v104y2017i3p743-749..html
   My bibliography  Save this article

Weighted envelope estimation to handle variability in model selection

Author

Listed:
  • D. J. Eck
  • R. D. Cook

Abstract

SummaryEnvelope methodology can provide substantial efficiency gains in multivariate statistical problems, but in some applications the estimation of the envelope dimension can induce selection volatility that may mitigate those gains. Current envelope methodology does not account for the added variance that can result from this selection. In this article, we circumvent dimension selection volatility through the development of a weighted envelope estimator. Theoretical justification is given for our estimator, and the validity of the residual bootstrap for estimating its asymptotic variance is established. A simulation study and real-data analysis illustrate the utility of our weighted envelope estimator.

Suggested Citation

  • D. J. Eck & R. D. Cook, 2017. "Weighted envelope estimation to handle variability in model selection," Biometrika, Biometrika Trust, vol. 104(3), pages 743-749.
    • Handle: RePEc:oup:biomet:v:104:y:2017:i:3:p:743-749.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/biomet/asx035
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bradley Efron, 2014. "Estimation and Accuracy After Model Selection," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 991-1007, September.
    2. Z. Su & G. Zhu & X. Chen & Y. Yang, 2016. "Sparse envelope model: efficient estimation and response variable selection in multivariate linear regression," Biometrika, Biometrika Trust, vol. 103(3), pages 579-593.
    3. Donald W. K. Andrews, 2002. "Higher-Order Improvements of a Computationally Attractive "k"-Step Bootstrap for Extremum Estimators," Econometrica, Econometric Society, vol. 70(1), pages 119-162, January.
    4. Hjort N.L. & Claeskens G., 2003. "Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 879-899, January.
    5. Zhihua Su & R. Dennis Cook, 2011. "Partial envelopes for efficient estimation in multivariate linear regression," Biometrika, Biometrika Trust, vol. 98(1), pages 133-146.
    6. R. Dennis Cook & Xin Zhang, 2015. "Foundations for Envelope Models and Methods," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 599-611, June.
    7. Kenneth P. Burnham & David R. Anderson, 2004. "Multimodel Inference," Sociological Methods & Research, , vol. 33(2), pages 261-304, November.
    8. Liang, Hua & Zou, Guohua & Wan, Alan T. K. & Zhang, Xinyu, 2011. "Optimal Weight Choice for Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1053-1066.
    9. R. D. Cook & I. S. Helland & Z. Su, 2013. "Envelopes and partial least squares regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(5), pages 851-877, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Minji Lee & Zhihua Su, 2020. "A Review of Envelope Models," International Statistical Review, International Statistical Institute, vol. 88(3), pages 658-676, December.
    2. Lan Liu & Wei Li & Zhihua Su & Dennis Cook & Luca Vizioli & Essa Yacoub, 2022. "Efficient estimation via envelope chain in magnetic resonance imaging‐based studies," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(2), pages 481-501, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Minji Lee & Zhihua Su, 2020. "A Review of Envelope Models," International Statistical Review, International Statistical Institute, vol. 88(3), pages 658-676, December.
    2. Yue Zhao & Ingrid Van Keilegom & Shanshan Ding, 2022. "Envelopes for censored quantile regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(4), pages 1562-1585, December.
    3. Jain Yashita & Ding Shanshan & Qiu Jing, 2019. "Sliced inverse regression for integrative multi-omics data analysis," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 18(1), pages 1-13, February.
    4. Zhang, Xin & Wang, Chong & Wu, Yichao, 2018. "Functional envelope for model-free sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 163(C), pages 37-50.
    5. Cook, R. Dennis & Forzani, Liliana & Su, Zhihua, 2016. "A note on fast envelope estimation," Journal of Multivariate Analysis, Elsevier, vol. 150(C), pages 42-54.
    6. Yeonhee Park & Zhihua Su & Hongtu Zhu, 2017. "Groupwise envelope models for imaging genetic analysis," Biometrics, The International Biometric Society, vol. 73(4), pages 1243-1253, December.
    7. Dennis Cook, R. & Forzani, Liliana, 2023. "On the role of partial least squares in path analysis for the social sciences," Journal of Business Research, Elsevier, vol. 167(C).
    8. Haili Zhang & Guohua Zou, 2020. "Cross-Validation Model Averaging for Generalized Functional Linear Model," Econometrics, MDPI, vol. 8(1), pages 1-35, February.
    9. Lan Liu & Wei Li & Zhihua Su & Dennis Cook & Luca Vizioli & Essa Yacoub, 2022. "Efficient estimation via envelope chain in magnetic resonance imaging‐based studies," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 49(2), pages 481-501, June.
    10. Phillip Heiler & Jana Mareckova, 2019. "Shrinkage for Categorical Regressors," Papers 1901.01898, arXiv.org.
    11. John Copas & Shinto Eguchi, 2020. "Strong model dependence in statistical analysis: goodness of fit is not enough for model choice," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(2), pages 329-352, April.
    12. Shangwei Zhao & Aman Ullah & Xinyu Zhang, 2018. "A Class of Model Averaging Estimators," Working Paper series 18-11, Rimini Centre for Economic Analysis.
    13. Yan Gao & Xinyu Zhang & Shouyang Wang & Terence Tai-leung Chong & Guohua Zou, 2019. "Frequentist model averaging for threshold models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 275-306, April.
    14. Chu-An Liu & Biing-Shen Kuo & Wen-Jen Tsay, 2017. "Autoregressive Spectral Averaging Estimator," IEAS Working Paper : academic research 17-A013, Institute of Economics, Academia Sinica, Taipei, Taiwan.
    15. Kira Alhorn & Holger Dette & Kirsten Schorning, 2021. "Optimal Designs for Model Averaging in non-nested Models," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 83(2), pages 745-778, August.
    16. Hu, Jianhua & Liu, Xiaoqian & Liu, Xu & Xia, Ningning, 2022. "Some aspects of response variable selection and estimation in multivariate linear regression," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    17. Aman Ullah & Xinyu Zhang, 2015. "Grouped Model Averaging for Finite Sample Size," Working Papers 201501, University of California at Riverside, Department of Economics.
    18. Lenard Lieb & Stephan Smeekes, 2017. "Inference for Impulse Responses under Model Uncertainty," Papers 1709.09583, arXiv.org, revised Oct 2019.
    19. Martins, Luis F. & Gabriel, Vasco J., 2014. "Linear instrumental variables model averaging estimation," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 709-724.
    20. Wan, Alan T.K. & Zhang, Xinyu & Wang, Shouyang, 2014. "Frequentist model averaging for multinomial and ordered logit models," International Journal of Forecasting, Elsevier, vol. 30(1), pages 118-128.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:biomet:v:104:y:2017:i:3:p:743-749.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/biomet .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.