IDEAS home Printed from https://ideas.repec.org/p/ifs/cemmap/30-13.html
   My bibliography  Save this paper

Adaptive nonparametric instrumental variables estimation: empirical choice of the regularization parameter

Author

Listed:
  • Joel L. Horowitz

    (Institute for Fiscal Studies and Northwestern University)

Abstract

In nonparametric instrumental variables estimation, the mapping that identifies the function of interest, g say, is discontinuous and must be regularised (that is, modified) to make consistent estimation possible. The amount of modification is controlled by a regularisation parameter. The optimal value of this parameter depends on unknown population characteristics and cannot be calculated in applications. Theoretically justified methods for choosing the regularisation parameter empirically in applications are not yet available. This paper presents such a method for use in series estimation, where the regularisation parameter is the number of terms in a series approximation to g. The method does not required knowledge of the smoothness of g or of other unknown functions. It adapts to their unknown smoothness. The estimator of g based on the empirically selected regularisation parameter converges in probability at a rate that is at least as fast as the asymptotically optimal rate multiplied by (logn)1/2, where n is the sample size. The asymptotic integrated mean-square error (AIMSE) of the estimator is within a specified factor of the optimal AIMSE.

Suggested Citation

  • Joel L. Horowitz, 2013. "Adaptive nonparametric instrumental variables estimation: empirical choice of the regularization parameter," CeMMAP working papers CWP30/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    • Handle: RePEc:ifs:cemmap:30/13
    as

    Download full text from publisher

    File URL: http://www.cemmap.ac.uk/wps/cwp301313.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chen, Xiaohong & Reiss, Markus, 2011. "On Rate Optimality For Ill-Posed Inverse Problems In Econometrics," Econometric Theory, Cambridge University Press, vol. 27(3), pages 497-521, June.
    2. Florens, Jean-Pierre & Simoni, Anna, 2012. "Nonparametric estimation of an instrumental regression: A quasi-Bayesian approach based on regularized posterior," Journal of Econometrics, Elsevier, vol. 170(2), pages 458-475.
    3. Johannes, Jan & Schwarz, Maik, 2010. "Adaptive nonparametric instrumental regression by model selection," LIDAM Discussion Papers ISBA 2010026, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    4. S. Darolles & Y. Fan & J. P. Florens & E. Renault, 2011. "Nonparametric Instrumental Regression," Econometrica, Econometric Society, vol. 79(5), pages 1541-1565, September.
    5. Horowitz, Joel L. & Lee, Sokbae, 2012. "Uniform confidence bands for functions estimated nonparametrically with instrumental variables," Journal of Econometrics, Elsevier, vol. 168(2), pages 175-188.
    6. Joel L. Horowitz, 2007. "Asymptotic Normality Of A Nonparametric Instrumental Variables Estimator," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 48(4), pages 1329-1349, November.
    7. Richard Blundell & Joel L. Horowitz, 2007. "A Non-Parametric Test of Exogeneity," Review of Economic Studies, Oxford University Press, vol. 74(4), pages 1035-1058.
    8. Xiaohong Chen & Demian Pouzo, 2008. "Estimation of nonparametric conditional moment models with possibly nonsmooth moments," CeMMAP working papers CWP12/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    9. Chen, Xiaohong & Pouzo, Demian, 2009. "Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals," Journal of Econometrics, Elsevier, vol. 152(1), pages 46-60, September.
    10. Carrasco, Marine & Florens, Jean-Pierre & Renault, Eric, 2007. "Linear Inverse Problems in Structural Econometrics Estimation Based on Spectral Decomposition and Regularization," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 77, Elsevier.
    11. Chunrong Ai & Xiaohong Chen, 2003. "Efficient Estimation of Models with Conditional Moment Restrictions Containing Unknown Functions," Econometrica, Econometric Society, vol. 71(6), pages 1795-1843, November.
    12. Whitney K. Newey & James L. Powell & Francis Vella, 1999. "Nonparametric Estimation of Triangular Simultaneous Equations Models," Econometrica, Econometric Society, vol. 67(3), pages 565-604, May.
    13. Joel L. Horowitz & Sokbae Lee, 2007. "Nonparametric Instrumental Variables Estimation of a Quantile Regression Model," Econometrica, Econometric Society, vol. 75(4), pages 1191-1208, July.
    14. Patrick Gagliardini & Olivier Scaillet, 2012. "Nonparametric Instrumental Variable Estimation of Structural Quantile Effects," Econometrica, Econometric Society, vol. 80(4), pages 1533-1562, July.
    15. Blundell, Richard & Pashardes, Panos & Weber, Guglielmo, 1993. "What Do We Learn About Consumer Demand Patterns from Micro Data?," American Economic Review, American Economic Association, vol. 83(3), pages 570-597, June.
    16. Horowitz, Joel L., 2012. "Specification testing in nonparametric instrumental variable estimation," Journal of Econometrics, Elsevier, vol. 167(2), pages 383-396.
    17. Whitney K. Newey & James L. Powell, 2003. "Instrumental Variable Estimation of Nonparametric Models," Econometrica, Econometric Society, vol. 71(5), pages 1565-1578, September.
    18. Chernozhukov, Victor & Imbens, Guido W. & Newey, Whitney K., 2007. "Instrumental variable estimation of nonseparable models," Journal of Econometrics, Elsevier, vol. 139(1), pages 4-14, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Florens, Jean-Pierre & Simoni, Anna, 2016. "Regularizing Priors For Linear Inverse Problems," Econometric Theory, Cambridge University Press, vol. 32(1), pages 71-121, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Joel L. Horowitz, 2013. "Adaptive nonparametric instrumental variables estimation: empirical choice of the regularization parameter," CeMMAP working papers 30/13, Institute for Fiscal Studies.
    2. Horowitz, Joel L., 2014. "Adaptive nonparametric instrumental variables estimation: Empirical choice of the regularization parameter," Journal of Econometrics, Elsevier, vol. 180(2), pages 158-173.
    3. Xiaohong Chen & Demian Pouzo, 2015. "Sieve Wald and QLR Inferences on Semi/Nonparametric Conditional Moment Models," Econometrica, Econometric Society, vol. 83(3), pages 1013-1079, May.
    4. Liao, Yuan & Jiang, Wenxin, 2011. "Posterior consistency of nonparametric conditional moment restricted models," MPRA Paper 38700, University Library of Munich, Germany.
    5. Xiaohong Chen & Demian Pouzo, 2012. "Estimation of Nonparametric Conditional Moment Models With Possibly Nonsmooth Generalized Residuals," Econometrica, Econometric Society, vol. 80(1), pages 277-321, January.
    6. Xiaohong Chen & Victor Chernozhukov & Sokbae Lee & Whitney K. Newey, 2014. "Local Identification of Nonparametric and Semiparametric Models," Econometrica, Econometric Society, vol. 82(2), pages 785-809, March.
    7. Xiaohong Chen & Demian Pouzo, 2014. "Sieve Wald and QLR Inferences on Semi/nonparametric Conditional Moment Models," CeMMAP working papers 38/14, Institute for Fiscal Studies.
    8. Frédérique Fève & Jean-Pierre Florens, 2010. "The practice of non-parametric estimation by solving inverse problems: the example of transformation models," Econometrics Journal, Royal Economic Society, vol. 13(3), pages 1-27, October.
    9. Chen, Xiaohong & Pouzo, Demian & Powell, James L., 2019. "Penalized sieve GEL for weighted average derivatives of nonparametric quantile IV regressions," Journal of Econometrics, Elsevier, vol. 213(1), pages 30-53.
    10. Xiaohong Chen & Demian Pouzo, 2008. "Estimation of nonparametric conditional moment models with possibly nonsmooth moments," CeMMAP working papers CWP12/08, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    11. Joel L. Horowitz, 2013. "Ill-posed inverse problems in economics," CeMMAP working papers 37/13, Institute for Fiscal Studies.
    12. Asin, Nicolas & Johannes, Jan, 2016. "Adaptive non-parametric instrumental regression in the presence of dependence," LIDAM Discussion Papers ISBA 2016015, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    13. Joel L. Horowitz, 2013. "Ill-posed inverse problems in economics," CeMMAP working papers CWP37/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    14. Gagliardini, Patrick & Scaillet, Olivier, 2012. "Tikhonov regularization for nonparametric instrumental variable estimators," Journal of Econometrics, Elsevier, vol. 167(1), pages 61-75.
    15. Xiaohong Chen & Demian Pouzo, 2013. "Sieve Quasi Likelihood Ratio Inference on Semi/nonparametric Conditional Moment Models," Cowles Foundation Discussion Papers 1897, Cowles Foundation for Research in Economics, Yale University.
    16. Chen, Xiaohong & Pouzo, Demian, 2009. "Efficient estimation of semiparametric conditional moment models with possibly nonsmooth residuals," Journal of Econometrics, Elsevier, vol. 152(1), pages 46-60, September.
    17. Xiaohong Chen & Timothy M. Christensen, 2015. "Optimal sup-norm rates, adaptivity and inference in nonparametric instrumental variables estimation," CeMMAP working papers 32/15, Institute for Fiscal Studies.
    18. Xiaohong Chen & Timothy Christensen, 2013. "Optimal Sup-norm Rates, Adaptivity and Inference in Nonparametric Instrumental Variables Estimation," Cowles Foundation Discussion Papers 1923R, Cowles Foundation for Research in Economics, Yale University, revised Apr 2015.
    19. Ai, Chunrong & Chen, Xiaohong, 2012. "The semiparametric efficiency bound for models of sequential moment restrictions containing unknown functions," Journal of Econometrics, Elsevier, vol. 170(2), pages 442-457.
    20. Horowitz, Joel L. & Lee, Sokbae, 2009. "Testing a parametric quantile-regression model with an endogenous explanatory variable against a nonparametric alternative," Journal of Econometrics, Elsevier, vol. 152(2), pages 141-152, October.

    More about this item

    Keywords

    ill-posed inverse problem. regularisatoin; sieve estimation; series estimation; nonparametric estimation;
    All these keywords.

    JEL classification:

    • C13 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Estimation: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ifs:cemmap:30/13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Emma Hyman (email available below). General contact details of provider: https://edirc.repec.org/data/cmifsuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.