IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/1923.html
   My bibliography  Save this paper

Optimal Uniform Convergence Rates for Sieve Nonparametric Instrumental Variables Regression

Author

Listed:

Abstract

We study the problem of nonparametric regression when the regressor is endogenous, which is an important nonparametric instrumental variables (NPIV) regression in econometrics and a difficult ill-posed inverse problem with unknown operator in statistics. We first establish a general upper bound on the sup-norm (uniform) convergence rate of a sieve estimator, allowing for endogenous regressors and weakly dependent data. This result leads to the optimal sup-norm convergence rates for spline and wavelet least squares regression estimators under weakly dependent data and heavy-tailed error terms. This upper bound also yields the sup-norm convergence rates for sieve NPIV estimators under i.i.d. data: the rates coincide with the known optimal L^2-norm rates for severely ill-posed problems, and are power of log(n) slower than the optimal L^2-norm rates for mildly ill-posed problems. We then establish the minimax risk lower bound in sup-norm loss, which coincides with our upper bounds on sup-norm rates for the spline and wavelet sieve NPIV estimators. This sup-norm rate optimality provides another justification for the wide application of sieve NPIV estimators. Useful results on weakly-dependent random matrices are also provided.

Suggested Citation

  • Xiaohong Chen & Timothy Christensen, 2013. "Optimal Uniform Convergence Rates for Sieve Nonparametric Instrumental Variables Regression," Cowles Foundation Discussion Papers 1923, Cowles Foundation for Research in Economics, Yale University.
  • Handle: RePEc:cwl:cwldpp:1923
    as

    Download full text from publisher

    File URL: https://cowles.yale.edu/sites/default/files/files/pub/d19/d1923.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Bruce E., 2008. "Uniform Convergence Rates For Kernel Estimation With Dependent Data," Econometric Theory, Cambridge University Press, vol. 24(3), pages 726-748, June.
    2. Chen, Xiaohong & Pouzo, Demian, 2009. "Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals," Journal of Econometrics, Elsevier, vol. 152(1), pages 46-60, September.
    3. Chen, Xiaohong & Reiss, Markus, 2011. "On Rate Optimality For Ill-Posed Inverse Problems In Econometrics," Econometric Theory, Cambridge University Press, vol. 27(3), pages 497-521, June.
    4. Florens, Jean-Pierre & Simoni, Anna, 2012. "Nonparametric estimation of an instrumental regression: A quasi-Bayesian approach based on regularized posterior," Journal of Econometrics, Elsevier, vol. 170(2), pages 458-475.
    5. Xiaohong Chen & Sydney C. Ludvigson, 2009. "Land of addicts? an empirical investigation of habit-based asset pricing models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(7), pages 1057-1093.
    6. Cohen, Albert & Hoffmann, Marc & Reiß, Markus, 2002. "Adaptive wavelet Galerkin methods for linear inverse problems," SFB 373 Discussion Papers 2002,50, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    7. D’Haultfoeuille, Xavier, 2011. "On The Completeness Condition In Nonparametric Instrumental Problems," Econometric Theory, Cambridge University Press, vol. 27(3), pages 460-471, June.
    8. repec:cep:stiecm:/2013/570 is not listed on IDEAS
    9. Gagliardini, Patrick & Scaillet, Olivier, 2012. "Tikhonov regularization for nonparametric instrumental variable estimators," Journal of Econometrics, Elsevier, vol. 167(1), pages 61-75.
    10. Jungyoon Lee & Peter M Robinson, 2013. "Series Estimation under Cross-sectional Dependence," STICERD - Econometrics Paper Series 570, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    11. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818728, October.
    12. S. Darolles & Y. Fan & J. P. Florens & E. Renault, 2011. "Nonparametric Instrumental Regression," Econometrica, Econometric Society, vol. 79(5), pages 1541-1565, September.
    13. Cattaneo, Matias D. & Farrell, Max H., 2013. "Optimal convergence rates, Bahadur representation, and asymptotic normality of partitioning estimators," Journal of Econometrics, Elsevier, vol. 174(2), pages 127-143.
    14. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524131, October.
    15. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818735, October.
    16. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524124, October.
    17. de Jong, Robert M., 2002. "A note on "Convergence rates and asymptotic normality for series estimators": uniform convergence rates," Journal of Econometrics, Elsevier, vol. 111(1), pages 1-9, November.
    18. Lee, Jungyoon & Robinson, Peter M., 2013. "Series estimation under cross-sectional dependence," LSE Research Online Documents on Economics 58188, London School of Economics and Political Science, LSE Library.
    19. Whitney K. Newey & James L. Powell, 2003. "Instrumental Variable Estimation of Nonparametric Models," Econometrica, Econometric Society, vol. 71(5), pages 1565-1578, September.
    20. Chunrong Ai & Xiaohong Chen, 2003. "Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions," Econometrica, Econometric Society, vol. 71(6), pages 1795-1843, November.
    21. Song, Kyungchul, 2008. "Uniform Convergence Of Series Estimators Over Function Spaces," Econometric Theory, Cambridge University Press, vol. 24(6), pages 1463-1499, December.
    22. Elias Masry, 1996. "Multivariate Local Polynomial Regression For Time Series:Uniform Strong Consistency And Rates," Journal of Time Series Analysis, Wiley Blackwell, vol. 17(6), pages 571-599, November.
    23. Liao, Yuan & Jiang, Wenxin, 2011. "Posterior consistency of nonparametric conditional moment restricted models," MPRA Paper 38700, University Library of Munich, Germany.
    24. Newey, Whitney K., 1997. "Convergence rates and asymptotic normality for series estimators," Journal of Econometrics, Elsevier, vol. 79(1), pages 147-168, July.
    25. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521818742, October.
    26. Joel L. Horowitz, 2011. "Applied Nonparametric Instrumental Variables Estimation," Econometrica, Econometric Society, vol. 79(2), pages 347-394, March.
    27. Dewatripont,Mathias & Hansen,Lars Peter & Turnovsky,Stephen J. (ed.), 2003. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521524117, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Denis Chetverikov & Daniel Wilhelm, 2017. "Nonparametric instrumental variable estimation under monotonicity," CeMMAP working papers 14/17, Institute for Fiscal Studies.
    2. Alexandre Belloni & Victor Chernozhukov & Denis Chetverikov & Kengo Kato, 2013. "On the asymptotic theory for least squares series: pointwise and uniform results," CeMMAP working papers CWP73/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    3. Belloni, Alexandre & Chernozhukov, Victor & Chetverikov, Denis & Kato, Kengo, 2015. "Some new asymptotic theory for least squares series: Pointwise and uniform results," Journal of Econometrics, Elsevier, vol. 186(2), pages 345-366.
    4. Xiaohong Chen & Demian Pouzo, 2015. "Sieve Wald and QLR Inferences on Semi/Nonparametric Conditional Moment Models," Econometrica, Econometric Society, vol. 83(3), pages 1013-1079, May.
    5. Liu, Chu-An & Tao, Jing, 2016. "Model selection and model averaging in nonparametric instrumental variables models," MPRA Paper 69492, University Library of Munich, Germany.
    6. Xiaohong Chen & Demian Pouzo, 2014. "Sieve Wald and QLR Inferences on Semi/nonparametric Conditional Moment Models," CeMMAP working papers 38/14, Institute for Fiscal Studies.
    7. Victor Chernozhukov & Whitney K. Newey & Andres Santos, 2023. "Constrained Conditional Moment Restriction Models," Econometrica, Econometric Society, vol. 91(2), pages 709-736, March.
    8. Xiaohong Chen & Timothy M. Christensen, 2015. "Optimal sup-norm rates, adaptivity and inference in nonparametric instrumental variables estimation," CeMMAP working papers 32/15, Institute for Fiscal Studies.
    9. Denis Chetverikov & Daniel Wilhelm, 2016. "Nonparametric instrumental variable estimation under monotonicity," CeMMAP working papers 48/16, Institute for Fiscal Studies.
    10. Chen, Xiaohong & Christensen, Timothy M., 2015. "Optimal uniform convergence rates and asymptotic normality for series estimators under weak dependence and weak conditions," Journal of Econometrics, Elsevier, vol. 188(2), pages 447-465.
    11. Denis Chetverikov & Daniel Wilhelm, 2017. "Nonparametric Instrumental Variable Estimation Under Monotonicity," Econometrica, Econometric Society, vol. 85, pages 1303-1320, July.
    12. Denis Chetverikov & Daniel Wilhelm, 2015. "Nonparametric instrumental variable estimation under monotonicity," CeMMAP working papers 39/15, Institute for Fiscal Studies.
    13. Xiaohong Chen & Timothy M. Christensen, 2014. "Optimal uniform convergence rates and asymptotic normality for series estimators under weak dependence and weak conditions," CeMMAP working papers 46/14, Institute for Fiscal Studies.
    14. Xiaohong Chen & Timothy Christensen, 2013. "Optimal Sup-norm Rates, Adaptivity and Inference in Nonparametric Instrumental Variables Estimation," Cowles Foundation Discussion Papers 1923R, Cowles Foundation for Research in Economics, Yale University, revised Apr 2015.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liao, Yuan & Jiang, Wenxin, 2011. "Posterior consistency of nonparametric conditional moment restricted models," MPRA Paper 38700, University Library of Munich, Germany.
    2. Xiaohong Chen & Timothy M. Christensen, 2013. "Optimal uniform convergence rates for sieve nonparametric instrumental variables regression," CeMMAP working papers 56/13, Institute for Fiscal Studies.
    3. Florens, Jean-Pierre & Simoni, Anna, 2016. "Regularizing Priors For Linear Inverse Problems," Econometric Theory, Cambridge University Press, vol. 32(1), pages 71-121, February.
    4. Breunig, Christoph, 2015. "Goodness-of-fit tests based on series estimators in nonparametric instrumental regression," Journal of Econometrics, Elsevier, vol. 184(2), pages 328-346.
    5. Gagliardini, Patrick & Scaillet, Olivier, 2012. "Tikhonov regularization for nonparametric instrumental variable estimators," Journal of Econometrics, Elsevier, vol. 167(1), pages 61-75.
    6. Florens, Jean-Pierre & Simoni, Anna, 2012. "Nonparametric estimation of an instrumental regression: A quasi-Bayesian approach based on regularized posterior," Journal of Econometrics, Elsevier, vol. 170(2), pages 458-475.
    7. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    8. Christoph Breunig, 2019. "Goodness-of-Fit Tests based on Series Estimators in Nonparametric Instrumental Regression," Papers 1909.10133, arXiv.org.
    9. Frédérique Fève & Jean-Pierre Florens, 2010. "The practice of non-parametric estimation by solving inverse problems: the example of transformation models," Econometrics Journal, Royal Economic Society, vol. 13(3), pages 1-27, October.
    10. Xiaohong Chen & Demian Pouzo, 2015. "Sieve Wald and QLR Inferences on Semi/Nonparametric Conditional Moment Models," Econometrica, Econometric Society, vol. 83(3), pages 1013-1079, May.
    11. Jean‐Pierre Florens & Jan Johannes & Sébastien Van Bellegem, 2012. "Instrumental regression in partially linear models," Econometrics Journal, Royal Economic Society, vol. 15(2), pages 304-324, June.
    12. Xiaohong Chen & Demian Pouzo, 2012. "Estimation of Nonparametric Conditional Moment Models With Possibly Nonsmooth Generalized Residuals," Econometrica, Econometric Society, vol. 80(1), pages 277-321, January.
    13. Xiaohong Chen & Timothy M. Christensen, 2015. "Optimal sup-norm rates, adaptivity and inference in nonparametric instrumental variables estimation," CeMMAP working papers 32/15, Institute for Fiscal Studies.
    14. Xiaohong Chen & Timothy Christensen, 2013. "Optimal Sup-norm Rates, Adaptivity and Inference in Nonparametric Instrumental Variables Estimation," Cowles Foundation Discussion Papers 1923R, Cowles Foundation for Research in Economics, Yale University, revised Apr 2015.
    15. Dunker, Fabian & Florens, Jean-Pierre & Hohage, Thorsten & Johannes, Jan & Mammen, Enno, 2014. "Iterative estimation of solutions to noisy nonlinear operator equations in nonparametric instrumental regression," Journal of Econometrics, Elsevier, vol. 178(P3), pages 444-455.
    16. Chen, Xiaohong & Christensen, Timothy M., 2015. "Optimal uniform convergence rates and asymptotic normality for series estimators under weak dependence and weak conditions," Journal of Econometrics, Elsevier, vol. 188(2), pages 447-465.
    17. Matzkin, Rosa L., 2016. "On independence conditions in nonseparable models: Observable and unobservable instruments," Journal of Econometrics, Elsevier, vol. 191(2), pages 302-311.
    18. Severini, Thomas A. & Tripathi, Gautam, 2006. "Some Identification Issues In Nonparametric Linear Models With Endogenous Regressors," Econometric Theory, Cambridge University Press, vol. 22(2), pages 258-278, April.
    19. Richard Blundell & Xiaohong Chen & Dennis Kristensen, 2003. "Nonparametric IV estimation of shape-invariant Engel curves," CeMMAP working papers CWP15/03, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    20. Chen, Xiaohong & Reiss, Markus, 2011. "On Rate Optimality For Ill-Posed Inverse Problems In Econometrics," Econometric Theory, Cambridge University Press, vol. 27(3), pages 497-521, June.

    More about this item

    Keywords

    Nonparametric instrumental variables; Statistical ill-posed inverse problems; Optimal uniform convergence rates; Weak dependence; Random matrices; Splines; Wavelets;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:1923. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.