IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2205.10772.html
   My bibliography  Save this paper

Fast Instrument Learning with Faster Rates

Author

Listed:
  • Ziyu Wang
  • Yuhao Zhou
  • Jun Zhu

Abstract

We investigate nonlinear instrumental variable (IV) regression given high-dimensional instruments. We propose a simple algorithm which combines kernelized IV methods and an arbitrary, adaptive regression algorithm, accessed as a black box. Our algorithm enjoys faster-rate convergence and adapts to the dimensionality of informative latent features, while avoiding an expensive minimax optimization procedure, which has been necessary to establish similar guarantees. It further brings the benefit of flexible machine learning models to quasi-Bayesian uncertainty quantification, likelihood-based model selection, and model averaging. Simulation studies demonstrate the competitive performance of our method.

Suggested Citation

  • Ziyu Wang & Yuhao Zhou & Jun Zhu, 2022. "Fast Instrument Learning with Faster Rates," Papers 2205.10772, arXiv.org, revised Oct 2022.
  • Handle: RePEc:arx:papers:2205.10772
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2205.10772
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Chen, Xiaohong & Reiss, Markus, 2011. "On Rate Optimality For Ill-Posed Inverse Problems In Econometrics," Econometric Theory, Cambridge University Press, vol. 27(3), pages 497-521, June.
    2. Xiaohong Chen & Demian Pouzo, 2012. "Estimation of Nonparametric Conditional Moment Models With Possibly Nonsmooth Generalized Residuals," Econometrica, Econometric Society, vol. 80(1), pages 277-321, January.
    3. Joel L. Horowitz, 2014. "Ill-Posed Inverse Problems in Economics," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 21-51, August.
    4. Florens, Jean-Pierre & Simoni, Anna, 2012. "Nonparametric estimation of an instrumental regression: A quasi-Bayesian approach based on regularized posterior," Journal of Econometrics, Elsevier, vol. 170(2), pages 458-475.
    5. Jiafeng Chen & Daniel L. Chen & Greg Lewis, 2020. "Mostly Harmless Machine Learning: Learning Optimal Instruments in Linear IV Models," Papers 2011.06158, arXiv.org, revised Jun 2021.
    6. Carrasco, Marine, 2012. "A regularization approach to the many instruments problem," Journal of Econometrics, Elsevier, vol. 170(2), pages 383-398.
    7. Chamberlain, Gary, 1987. "Asymptotic efficiency in estimation with conditional moment restrictions," Journal of Econometrics, Elsevier, vol. 34(3), pages 305-334, March.
    8. Okui, Ryo, 2011. "Instrumental variable estimation in the presence of many moment conditions," Journal of Econometrics, Elsevier, vol. 165(1), pages 70-86.
    9. Chernozhukov, Victor & Hong, Han, 2003. "An MCMC approach to classical estimation," Journal of Econometrics, Elsevier, vol. 115(2), pages 293-346, August.
    10. Horowitz, Joel L., 2012. "Specification testing in nonparametric instrumental variable estimation," Journal of Econometrics, Elsevier, vol. 167(2), pages 383-396.
    11. Ghosal,Subhashis & van der Vaart,Aad, 2017. "Fundamentals of Nonparametric Bayesian Inference," Cambridge Books, Cambridge University Press, number 9780521878265.
    12. Whitney K. Newey & James L. Powell, 2003. "Instrumental Variable Estimation of Nonparametric Models," Econometrica, Econometric Society, vol. 71(5), pages 1565-1578, September.
    13. Xiaohong Chen & Timothy M. Christensen & Sid Kankanala, 2021. "Adaptive Estimation and Uniform Confidence Bands for Nonparametric IV," Cowles Foundation Discussion Papers 2292, Cowles Foundation for Research in Economics, Yale University.
    14. Wei Lin & Rui Feng & Hongzhe Li, 2015. "Regularization Methods for High-Dimensional Instrumental Variables Regression With an Application to Genetical Genomics," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 270-288, March.
    15. Joel L. Horowitz, 2011. "Applied Nonparametric Instrumental Variables Estimation," Econometrica, Econometric Society, vol. 79(2), pages 347-394, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ziyu Wang & Yucen Luo & Yueru Li & Jun Zhu & Bernhard Scholkopf, 2022. "Spectral Representation Learning for Conditional Moment Models," Papers 2210.16525, arXiv.org, revised Dec 2022.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ziyu Wang & Yucen Luo & Yueru Li & Jun Zhu & Bernhard Scholkopf, 2022. "Spectral Representation Learning for Conditional Moment Models," Papers 2210.16525, arXiv.org, revised Dec 2022.
    2. Xiaohong Chen & Timothy M. Christensen, 2015. "Optimal sup-norm rates, adaptivity and inference in nonparametric instrumental variables estimation," CeMMAP working papers 32/15, Institute for Fiscal Studies.
    3. Xiaohong Chen & Timothy Christensen, 2013. "Optimal Sup-norm Rates, Adaptivity and Inference in Nonparametric Instrumental Variables Estimation," Cowles Foundation Discussion Papers 1923R, Cowles Foundation for Research in Economics, Yale University, revised Apr 2015.
    4. Karun Adusumilli & Taisuke Otsu, 2015. "Nonparametric instrumental regression with errors in variables," STICERD - Econometrics Paper Series /2015/585, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    5. Liao, Yuan & Jiang, Wenxin, 2011. "Posterior consistency of nonparametric conditional moment restricted models," MPRA Paper 38700, University Library of Munich, Germany.
    6. Centorrino, Samuele & Florens, Jean-Pierre, 2021. "Nonparametric Instrumental Variable Estimation of Binary Response Models with Continuous Endogenous Regressors," Econometrics and Statistics, Elsevier, vol. 17(C), pages 35-63.
    7. Horowitz, Joel L., 2014. "Adaptive nonparametric instrumental variables estimation: Empirical choice of the regularization parameter," Journal of Econometrics, Elsevier, vol. 180(2), pages 158-173.
    8. Xiaohong Chen & Timothy M. Christensen, 2013. "Optimal uniform convergence rates for sieve nonparametric instrumental variables regression," CeMMAP working papers 56/13, Institute for Fiscal Studies.
    9. Liu, Chu-An & Tao, Jing, 2016. "Model selection and model averaging in nonparametric instrumental variables models," MPRA Paper 69492, University Library of Munich, Germany.
    10. Xiaohong Chen & Victor Chernozhukov & Sokbae Lee & Whitney K. Newey, 2014. "Local Identification of Nonparametric and Semiparametric Models," Econometrica, Econometric Society, vol. 82(2), pages 785-809, March.
    11. Florens, Jean-Pierre & Simoni, Anna, 2016. "Regularizing Priors For Linear Inverse Problems," Econometric Theory, Cambridge University Press, vol. 32(1), pages 71-121, February.
    12. Xiaohong Chen & Demian Pouzo, 2015. "Sieve Wald and QLR Inferences on Semi/Nonparametric Conditional Moment Models," Econometrica, Econometric Society, vol. 83(3), pages 1013-1079, May.
    13. Samuele CENTORRINO & Jeffrey S. RACINE, 2017. "Semiparametric Varying Coefficient Models with Endogenous Covariates," Annals of Economics and Statistics, GENES, issue 128, pages 261-295.
    14. Joel L. Horowitz, 2013. "Adaptive nonparametric instrumental variables estimation: empirical choice of the regularization parameter," CeMMAP working papers 30/13, Institute for Fiscal Studies.
    15. Joel L. Horowitz, 2013. "Ill-posed inverse problems in economics," CeMMAP working papers 37/13, Institute for Fiscal Studies.
    16. Andrew Bennett & Nathan Kallus & Xiaojie Mao & Whitney Newey & Vasilis Syrgkanis & Masatoshi Uehara, 2023. "Minimax Instrumental Variable Regression and $L_2$ Convergence Guarantees without Identification or Closedness," Papers 2302.05404, arXiv.org.
    17. Breunig, Christoph, 2015. "Goodness-of-fit tests based on series estimators in nonparametric instrumental regression," Journal of Econometrics, Elsevier, vol. 184(2), pages 328-346.
    18. Samuele Centorrino & Jean-Pierre Florens, 2014. "Nonparametric Instrumental Variable Estimation of Binary Response Models," Department of Economics Working Papers 14-07, Stony Brook University, Department of Economics.
    19. Xiaohong Chen & Timothy Christensen, 2013. "Optimal Uniform Convergence Rates for Sieve Nonparametric Instrumental Variables Regression," Cowles Foundation Discussion Papers 1923, Cowles Foundation for Research in Economics, Yale University.
    20. Breunig, Christoph, 2012. "Goodness-of-fit tests based on series estimators in nonparametric instrumental regression," Working Papers 12-13, University of Mannheim, Department of Economics.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2205.10772. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.