IDEAS home Printed from https://ideas.repec.org/p/kud/kuiedp/2104.html

Analytic and Bootstrap-after-Cross-Validation Methods for Selecting Penalty Parameters of High-Dimensional M-Estimators

Author

Listed:
  • Denis Chetverikov

    (Department of Economics, UCLA)

  • Jesper R.-V. Sørensen

    (Department of Economics, University of Copenhagen)

Abstract

We develop two new methods for selecting the penalty parameter for the L1-penalized high-dimensional M-estimator, which we refer to as the analytic and bootstrap-after-cross-validation methods. For both methods, we derive nonasymptotic error bounds for the corresponding L1-penalized M-estimator and show that the bounds converge to zero under mild conditions, thus providing a theoretical justification for these methods. We demonstrate via simulations that the finite-sample performance of our methods is much better than that of previously available and theoretically justified methods.

Suggested Citation

  • Denis Chetverikov & Jesper R.-V. Sørensen, 2021. "Analytic and Bootstrap-after-Cross-Validation Methods for Selecting Penalty Parameters of High-Dimensional M-Estimators," Discussion Papers 21-04, University of Copenhagen. Department of Economics.
    • Handle: RePEc:kud:kuiedp:2104
    as

    Download full text from publisher

    File URL: https://www.economics.ku.dk/research/publications/wp/dp-2021/2104.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Friedman, Jerome H. & Hastie, Trevor & Tibshirani, Rob, 2010. "Regularization Paths for Generalized Linear Models via Coordinate Descent," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 33(i01).
    2. Lancaster,Tony, 1992. "The Econometric Analysis of Transition Data," Cambridge Books, Cambridge University Press, number 9780521437899, January.
    3. Moshe Buchinsky & Jinyong Hahn, 1998. "An Alternative Estimator for the Censored Quantile Regression Model," Econometrica, Econometric Society, vol. 66(3), pages 653-672, May.
    4. Kosuke Imai & Marc Ratkovic, 2014. "Covariate balancing propensity score," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(1), pages 243-263, January.
    5. Aigner, D J & Amemiya, Takeshi & Poirier, Dale J, 1976. "On the Estimation of Production Frontiers: Maximum Likelihood Estimation of the Parameters of a Discontinuous Density Function," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 17(2), pages 377-396, June.
    6. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors," Papers 1212.6906, arXiv.org, revised Jan 2018.
    7. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    8. Denis Chetverikov & . ., 2016. "On cross-validated Lasso," CeMMAP working papers CWP47/16, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Richard H. Spady & Sami Stouli, 2025. "Gaussian Transforms Modeling and the Estimation of Distributional Regression Functions," Econometrica, Econometric Society, vol. 93(5), pages 1885-1913, September.
    2. Adam Baybutt, 2024. "Dynamic Latent-Factor Model with High-Dimensional Asset Characteristics," Papers 2405.15721, arXiv.org.
    3. Adam Baybutt & Manu Navjeevan, 2023. "Doubly-Robust Inference for Conditional Average Treatment Effects with High-Dimensional Controls," Papers 2301.06283, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Denis Chetverikov & Jesper Riis-Vestergaard S{o}rensen, 2021. "Selecting Penalty Parameters of High-Dimensional M-Estimators using Bootstrapping after Cross-Validation," Papers 2104.04716, arXiv.org, revised Nov 2024.
    2. Baron, Opher & Callen, Jeffrey L. & Segal, Dan, 2023. "Does the bullwhip matter economically? A cross-sectional firm-level analysis," International Journal of Production Economics, Elsevier, vol. 259(C).
    3. Jun Li & Serguei Netessine & Sergei Koulayev, 2018. "Price to Compete … with Many: How to Identify Price Competition in High-Dimensional Space," Management Science, INFORMS, vol. 64(9), pages 4118-4136, September.
    4. Litimein, Ouahiba & Laksaci, Ali & Mechab, Boubaker & Bouzebda, Salim, 2023. "Local linear estimate of the functional expectile regression," Statistics & Probability Letters, Elsevier, vol. 192(C).
    5. Min Ren & Shengli Zhao & Mingqiu Wang & Xinbei Zhu, 2024. "Robust optimal subsampling based on weighted asymmetric least squares," Statistical Papers, Springer, vol. 65(4), pages 2221-2251, June.
    6. Wang, Yihe & Zhao, Sihai Dave, 2021. "A nonparametric empirical Bayes approach to large-scale multivariate regression," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    7. Philipp Bach & Victor Chernozhukov & Malte S. Kurz & Martin Spindler & Sven Klaassen, 2021. "DoubleML -- An Object-Oriented Implementation of Double Machine Learning in R," Papers 2103.09603, arXiv.org, revised Jun 2024.
    8. Sokbae Lee & Ryo Okui & Yoon†Jae Whang, 2017. "Doubly robust uniform confidence band for the conditional average treatment effect function," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(7), pages 1207-1225, November.
    9. Richard Gerlach & Declan Walpole & Chao Wang, 2017. "Semi-parametric Bayesian tail risk forecasting incorporating realized measures of volatility," Quantitative Finance, Taylor & Francis Journals, vol. 17(2), pages 199-215, February.
    10. Giuseppe Storti & Chao Wang, 2023. "Modeling uncertainty in financial tail risk: A forecast combination and weighted quantile approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1648-1663, November.
    11. Wang, Bingling & Li, Yingxing & Härdle, Wolfgang Karl, 2022. "K-expectiles clustering," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    12. Bonaccolto, Giovanni & Caporin, Massimiliano & Maillet, Bertrand B., 2022. "Dynamic large financial networks via conditional expected shortfalls," European Journal of Operational Research, Elsevier, vol. 298(1), pages 322-336.
    13. Zhao, Jun & Chen, Yingyu & Zhang, Yi, 2018. "Expectile regression for analyzing heteroscedasticity in high dimension," Statistics & Probability Letters, Elsevier, vol. 137(C), pages 304-311.
    14. Wolfgang Karl Härdle & Brenda López Cabrera & Awdesch Melzer, 2021. "Pricing wind power futures," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 70(4), pages 1083-1102, August.
    15. Lina Liao & Cheolwoo Park & Hosik Choi, 2019. "Penalized expectile regression: an alternative to penalized quantile regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(2), pages 409-438, April.
    16. Luke Connelly & Gianluca Fiorentini & Marica Iommi, 2022. "Supply-side solutions targeting demand-side characteristics: causal effects of a chronic disease management program on adherence and health outcomes," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(7), pages 1203-1220, September.
    17. Knippenberg, Erwin & Jensen, Nathaniel & Constas, Mark, 2019. "Quantifying household resilience with high frequency data: Temporal dynamics and methodological options," World Development, Elsevier, vol. 121(C), pages 1-15.
    18. Böckerman, Petri & Bryson, Alex & Ilmakunnas, Ilari & Ilmakunnas, Pekka, 2025. "Does high involvement management make you work longer? Insights from linked survey and register data," The Journal of the Economics of Ageing, Elsevier, vol. 30(C).
    19. Zhang, Feipeng & Li, Qunhua, 2017. "A continuous threshold expectile model," Computational Statistics & Data Analysis, Elsevier, vol. 116(C), pages 49-66.
    20. Alexandre SAUQUET, 2011. "Exploring the Nature of Strategic Interactions in the Ratification Process of the Kyoto Protocol," Working Papers 201119, CERDI.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kud:kuiedp:2104. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thomas Hoffmann (email available below). General contact details of provider: https://edirc.repec.org/data/okokudk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.