Gaussian approximation of suprema of empirical processes
We develop a new direct approach to approximating suprema of general empirical processes by a sequence of suprema of Gaussian processes, without taking the route of approximating whole empirical processes in the supremum norm. We prove an abstract approximation theorem that is applicable to a wide variety of problems, primarily in statistics. In particular, the bound in the main approximation theorem is non-asymptotic and the theorem does not require uniform boundedness of the class of functions. The proof of the approximation theorem builds on a new coupling inequality for maxima of sums of random vectors, the proof of which depends on an effective use of Stein’s method for normal approximation, and some new empirical process techniques. We study applications of this approximation theorem to local empirical processes and series estimation in nonparametric regression where the classes of functions change with the sample size and are not Donsker-type. Importantly, our new technique is able to prove the Gaussian approximation for the supremum type statistics under weak regularity conditions, especially concerning the bandwidth and the number of series functions, in those examples.
|Date of creation:||30 Dec 2013|
|Date of revision:|
|Contact details of provider:|| Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE|
Phone: (+44) 020 7291 4800
Fax: (+44) 020 7323 4780
Web page: http://cemmap.ifs.org.uk
More information through EDIRC
|Order Information:|| Postal: The Institute for Fiscal Studies 7 Ridgmount Street LONDON WC1E 7AE|
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
- Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
- Victor Chernozhukov & Sokbae Lee & Adam Rosen, 2011.
"Intersection bounds: estimation and inference,"
CeMMAP working papers
CWP34/11, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Victor Chernozhukov & Sokbae Lee & Adam Rosen, 2009. "Intersection Bounds: estimation and inference," CeMMAP working papers CWP19/09, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Victor Chernozhukov & Sokbae Lee & Adam Rosen, 2012. "Intersection bounds: estimation and inference," CeMMAP working papers CWP33/12, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Huang, Jianhua Z., 2003. "Asymptotics for polynomial spline regression under weak conditions," Statistics & Probability Letters, Elsevier, vol. 65(3), pages 207-216, November.
- He, Xuming & Shao, Qi-Man, 2000. "On Parameters of Increasing Dimensions," Journal of Multivariate Analysis, Elsevier, vol. 73(1), pages 120-135, April.
- Konakov, V. D. & Piterbarg, V. I., 1984. "On the convergence rate of maximal deviation distribution for kernel regression estimates," Journal of Multivariate Analysis, Elsevier, vol. 15(3), pages 279-294, December.
- Alexandre Belloni & Victor Chernozhukov & Ivan Fernandez-Val, 2011. "Conditional quantile processes based on series or many regressors," CeMMAP working papers CWP19/11, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:75/13. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Emma Hyman)
If references are entirely missing, you can add them using this form.