IDEAS home Printed from https://ideas.repec.org/p/azt/cemmap/76-13.html
   My bibliography  Save this paper

Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors

Author

Listed:
  • Victor Chernozhukov
  • Denis Chetverikov
  • Kengo Kato

Abstract

We derive a Gaussian approximation result for the maximum of a sum of high dimensional random vectors. Specifically, we establish conditions under which the distribution of the maximum is approximated by that of the maximum of a sum of the Gaussian random vectors with the same covariance matrices as the original vectors. This result applies when the dimension of random vectors (p) is large compared to the sample size (n); in fact, p can be much larger than n, without restricting correlations of the coordinates of these vectors. We also show that the distribution of the maximum of a sum of the random vectors with unknown covariance matrices can be consistently estimated by the distribution of the maximum of a sum of the conditional Gaussian random vectors obtained by multiplying the original vectors with i.i.d. Gaussian multipliers. This is the Gaussian multiplier (or wild) bootstrap procedure. Here too, p can be large or even much larger than n. These distributional approximations, either Gaussian or conditional Gaussian, yield a high-quality approximation to the distribution of the original maximum, often with approximation error decreasing polynomially in the sample size, and hence are of interest in many applications. We demonstrate how our Gaussian approximations and the multiplier bootstrap can be used for modern high dimensional estimation, multiple hypothesis testing, and adaptive specification testing. All these results contain non-asymptotic bounds on approximation errors.

Suggested Citation

  • Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2013. "Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors," CeMMAP working papers 76/13, Institute for Fiscal Studies.
  • Handle: RePEc:azt:cemmap:76/13
    DOI: 10.1920/wp.cem.2013.7613
    as

    Download full text from publisher

    File URL: https://www.cemmap.ac.uk/wp-content/uploads/2020/08/CWP7613.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.1920/wp.cem.2013.7613?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Gaussian approximation of suprema of empirical processes," CeMMAP working papers CWP44/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    2. Horowitz, Joel L & Spokoiny, Vladimir G, 2001. "An Adaptive, Rate-Optimal Test of a Parametric Mean-Regression Model against a Nonparametric Alternative," Econometrica, Econometric Society, vol. 69(3), pages 599-631, May.
    3. Emmanuel Guerre & Pascal Lavergne, 2004. "Data-Driven Rate-Optimal Specification Testing In Regression Models," Econometrics 0411008, University Library of Munich, Germany.
    4. Yosef Rinott & Vladimir Rotar, 2000. "Normal approximations by Stein's method," Decisions in Economics and Finance, Springer;Associazione per la Matematica, vol. 23(1), pages 15-29.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2012. "Central limit theorems and multiplier bootstrap when p is much larger than n," CeMMAP working papers 45/12, Institute for Fiscal Studies.
    2. Long Feng & Changliang Zou & Zhaojun Wang & Lixing Zhu, 2015. "Robust comparison of regression curves," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(1), pages 185-204, March.
    3. Lopez, O. & Patilea, V., 2009. "Nonparametric lack-of-fit tests for parametric mean-regression models with censored data," Journal of Multivariate Analysis, Elsevier, vol. 100(1), pages 210-230, January.
    4. Andrea Vaona, 2008. "The sensitivity of nonparametric misspecification tests to disturbance autocorrelation," Quaderni della facoltà di Scienze economiche dell'Università di Lugano 0803, USI Università della Svizzera italiana.
    5. Masamune Iwasawa, 2015. "A Joint Specification Test for Response Probabilities in Unordered Multinomial Choice Models," Econometrics, MDPI, vol. 3(3), pages 1-31, September.
    6. Stefan Sperlich, 2014. "On the choice of regularization parameters in specification testing: a critical discussion," Empirical Economics, Springer, vol. 47(2), pages 427-450, September.
    7. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 361-411, September.
    8. Stefan Sperlich, 2013. "Comments on: An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 419-427, September.
    9. Mora, Juan & Moro-Egido, Ana I., 2008. "On specification testing of ordered discrete choice models," Journal of Econometrics, Elsevier, vol. 143(1), pages 191-205, March.
    10. Richard K. Crump & V. Joseph Hotz & Guido W. Imbens & Oscar A. Mitnik, 2008. "Nonparametric Tests for Treatment Effect Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 389-405, August.
    11. Alexandre Belloni & Victor Chernozhukov & Kengo Kato, 2019. "Valid Post-Selection Inference in High-Dimensional Approximately Sparse Quantile Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 749-758, April.
    12. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2014. "Central limit theorems and bootstrap in high dimensions," CeMMAP working papers CWP49/14, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2013. "Anti-concentration and honest, adaptive confidence bands," CeMMAP working papers CWP69/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    14. Peter Hall & Joel L. Horowitz, 2013. "A simple bootstrap method for constructing nonparametric confidence bands for functions," CeMMAP working papers CWP29/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    15. Christoph Breunig, 2019. "Goodness-of-Fit Tests based on Series Estimators in Nonparametric Instrumental Regression," Papers 1909.10133, arXiv.org.
    16. Patrick Saart & Jiti Gao & Nam Hyun Kim, 2014. "Semiparametric methods in nonlinear time series analysis: a selective review," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(1), pages 141-169, March.
    17. Olivier Collier & Arnak S, Dalalyan, 2013. "Curve registration by Nonparametric goodness-of-fit Testing," Working Papers 2013-33, Center for Research in Economics and Statistics.
    18. Emmanuel Guerre & Pascal Lavergne, 2001. "Rate-optimal data-driven specification testing in regression models," Econometrics 0107001, University Library of Munich, Germany.
    19. Escanciano, Juan Carlos & Jacho-Chávez, David T. & Lewbel, Arthur, 2014. "Uniform convergence of weighted sums of non and semiparametric residuals for estimation and testing," Journal of Econometrics, Elsevier, vol. 178(P3), pages 426-443.
    20. Pipat Wongsaart & Jiti Gao, 2011. "Nonparametric Kernel Testing in Semiparametric Autoregressive Conditional Duration Model," Monash Econometrics and Business Statistics Working Papers 18/11, Monash University, Department of Econometrics and Business Statistics.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:azt:cemmap:76/13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dermot Watson (email available below). General contact details of provider: https://edirc.repec.org/data/ifsssuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.