IDEAS home Printed from https://ideas.repec.org/p/zbw/vfsc17/168196.html
   My bibliography  Save this paper

On the Use of the Lasso for Instrumental Variables Estimation with Some Invalid Instruments

Author

Listed:
  • Windmeijer, Frank
  • Farbmacher, Helmut
  • Davies, Neil
  • Smith, George Davey

Abstract

We investigate the behaviour of the Lasso for selecting invalid instruments in linear instrumental variables models for estimating causal effects of exposures on outcomes, as proposed recently by Kang, Zhang, Cai and Small (2016, Journal of the American Statistical Association). Invalid instruments are such that they fail the exclusion restriction and enter the model as explanatory variables. We show that for this setup, the Lasso may not select all invalid instruments in large samples if they are relatively strong. Consistent selection also depends on the correlation structure of the instruments. We propose a median estimator that is consistent when less than 50% of the instruments are invalid, but its consistency does not depend on the relative strength of the instruments or their correlation structure. This estimator can therefore be used for adaptive Lasso estimation. The methods are applied to a Mendelian randomisation study to estimate the causal effect of BMI on diastolic blood pressure using data on individuals from the UK Biobank, with 96 single nucleotide polymorphisms as potential instruments for BMI.

Suggested Citation

  • Windmeijer, Frank & Farbmacher, Helmut & Davies, Neil & Smith, George Davey, 2017. "On the Use of the Lasso for Instrumental Variables Estimation with Some Invalid Instruments," VfS Annual Conference 2017 (Vienna): Alternative Structures for Money and Banking 168196, Verein für Socialpolitik / German Economic Association.
  • Handle: RePEc:zbw:vfsc17:168196
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/168196/1/VfS-2017-pid-3107-osp3.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Victor Chernozhukov & Christian Hansen & Martin Spindler, 2015. "Post-Selection and Post-Regularization Inference in Linear Models with Many Controls and Instruments," American Economic Review, American Economic Association, vol. 105(5), pages 486-490, May.
    3. A. Belloni & D. Chen & V. Chernozhukov & C. Hansen, 2012. "Sparse Models and Methods for Optimal Instruments With an Application to Eminent Domain," Econometrica, Econometric Society, vol. 80(6), pages 2369-2429, November.
    4. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    5. Donald W. K. Andrews, 1999. "Consistent Moment Selection Procedures for Generalized Method of Moments Estimation," Econometrica, Econometric Society, vol. 67(3), pages 543-564, May.
    6. von Hinke, Stephanie & Davey Smith, George & Lawlor, Debbie A. & Propper, Carol & Windmeijer, Frank, 2016. "Genetic markers as instrumental variables," Journal of Health Economics, Elsevier, vol. 45(C), pages 131-148.
    7. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    8. Han, Chirok, 2008. "Detecting invalid instruments using L1-GMM," Economics Letters, Elsevier, vol. 101(3), pages 285-287, December.
    9. Hansen, Christian & Hausman, Jerry & Newey, Whitney, 2008. "Estimation With Many Instrumental Variables," Journal of Business & Economic Statistics, American Statistical Association, vol. 26, pages 398-422.
    10. Wei Lin & Rui Feng & Hongzhe Li, 2015. "Regularization Methods for High-Dimensional Instrumental Variables Regression With an Application to Genetical Genomics," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 270-288, March.
    11. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    12. Michal Kolesár & Raj Chetty & John Friedman & Edward Glaeser & Guido W. Imbens, 2015. "Identification and Inference With Many Invalid Instruments," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 474-484, October.
    13. Corbae,Dean & Durlauf,Steven N. & Hansen,Bruce E. (ed.), 2006. "Econometric Theory and Practice," Cambridge Books, Cambridge University Press, number 9780521807234.
    14. Cheng, Xu & Liao, Zhipeng, 2015. "Select the valid and relevant moments: An information-based LASSO for GMM with many moments," Journal of Econometrics, Elsevier, vol. 186(2), pages 443-464.
    15. Bekker, Paul A, 1994. "Alternative Approximations to the Distributions of Instrumental Variable Estimators," Econometrica, Econometric Society, vol. 62(3), pages 657-681, May.
    16. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    17. Imbens, Guido W., 2014. "Instrumental Variables: An Econometrician's Perspective," IZA Discussion Papers 8048, Institute of Labor Economics (IZA).
    18. Paul S. Clarke & Frank Windmeijer, 2012. "Instrumental Variable Estimators for Binary Outcomes," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(500), pages 1638-1652, December.
    19. Joshua D. Angrist & Alan B. Keueger, 1991. "Does Compulsory School Attendance Affect Schooling and Earnings?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 106(4), pages 979-1014.
    20. Hyunseung Kang & Anru Zhang & T. Tony Cai & Dylan S. Small, 2016. "Instrumental Variables Estimation With Some Invalid Instruments and its Application to Mendelian Randomization," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 132-144, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Caner, Mehmet & Fan, Qingliang & Grennes, Thomas, 2021. "Partners in debt: An endogenous non-linear analysis of the effects of public and private debt on growth," International Review of Economics & Finance, Elsevier, vol. 76(C), pages 694-711.
    2. Nicolas Apfel & Helmut Farbmacher & Rebecca Groh & Martin Huber & Henrika Langen, 2022. "Detecting Grouped Local Average Treatment Effects and Selecting True Instruments," Papers 2207.04481, arXiv.org, revised Oct 2023.
    3. Nicolas Apfel, 2019. "Relaxing the Exclusion Restriction in Shift-Share Instrumental Variable Estimation," Papers 1907.00222, arXiv.org, revised Jul 2022.
    4. Martin, Stephen & Claxton, Karl & Lomas, James & Longo, Francesco, 2023. "The impact of different types of NHS expenditure on health: Marginal cost per QALY estimates for England for 2016/17," Health Policy, Elsevier, vol. 132(C).
    5. Jinyuan Chang & Zhentao Shi & Jia Zhang, 2021. "Culling the herd of moments with penalized empirical likelihood," Papers 2108.03382, arXiv.org, revised May 2022.
    6. Qingliang Fan & Yaqian Wu, 2020. "Endogenous Treatment Effect Estimation with some Invalid and Irrelevant Instruments," Papers 2006.14998, arXiv.org.
    7. Frank Windmeijer & Xiaoran Liang & Fernando P. Hartwig & Jack Bowden, 2021. "The confidence interval method for selecting valid instrumental variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(4), pages 752-776, September.
    8. Marcus Munafò & Neil M. Davies & George Davey Smith, 2020. "Can genetics reveal the causes and consequences of educational attainment?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 183(2), pages 681-688, February.
    9. Prosper Dovonon & Firmin Doko Tchatoka & Michael Aguessy, 2019. "Relevant moment selection under mixed identification strength," School of Economics and Public Policy Working Papers 2019-04, University of Adelaide, School of Economics and Public Policy.
    10. Breunig, Christoph & Mammen, Enno & Simoni, Anna, 2020. "Ill-posed estimation in high-dimensional models with instrumental variables," Journal of Econometrics, Elsevier, vol. 219(1), pages 171-200.
    11. Byunghoon Kang, 2018. "Higher Order Approximation of IV Estimators with Invalid Instruments," Working Papers 257105320, Lancaster University Management School, Economics Department.
    12. Huntington-Klein Nick, 2020. "Instruments with Heterogeneous Effects: Bias, Monotonicity, and Localness," Journal of Causal Inference, De Gruyter, vol. 8(1), pages 182-208, January.
    13. Qingliang Fan & Zijian Guo & Ziwei Mei, 2022. "A Heteroskedasticity-Robust Overidentifying Restriction Test with High-Dimensional Covariates," Papers 2205.00171, arXiv.org, revised Mar 2023.
    14. Kumari, Meena & Bao, Yanchun & S. Clarke, Paul & Smart, Melissa, 2018. "A comparison of robust methods for Mendelian randomization using multiple genetic variants," ISER Working Paper Series 2018-08, Institute for Social and Economic Research.
    15. Matthew Harding & Carlos Lamarche & Chris Muris, 2022. "Estimation of a Factor-Augmented Linear Model with Applications Using Student Achievement Data," Papers 2203.03051, arXiv.org.
    16. Nicolas Apfel & Frank Windmeijer, 2022. "The Falsification Adaptive Set in Linear Models with Instrumental Variables that Violate the Exogeneity or Exclusion Restriction," Papers 2212.04814, arXiv.org.
    17. Hyunseung Kang & Youjin Lee & T. Tony Cai & Dylan S. Small, 2022. "Two robust tools for inference about causal effects with invalid instruments," Biometrics, The International Biometric Society, vol. 78(1), pages 24-34, March.
    18. Xiaoran Liang & Eleanor Sanderson & Frank Windmeijer, 2022. "Selecting Valid Instrumental Variables in Linear Models with Multiple Exposure Variables: Adaptive Lasso and the Median-of-Medians Estimator," Papers 2208.05278, arXiv.org.
    19. Kogure, Katsuo & Kubo, Masahiro, 2022. "Cambodian Refugees," Discussion paper series HIAS-E-125, Hitotsubashi Institute for Advanced Study, Hitotsubashi University.
    20. Biewen, Martin & Fitzenberger, Bernd & Seckler, Matthias, 2020. "Counterfactual quantile decompositions with selection correction taking into account Huber/Melly (2015): An application to the German gender wage gap," Labour Economics, Elsevier, vol. 67(C).
    21. Guber, Raphael, 2018. "Instrument Validity Tests with Causal Trees: With an Application to the Same-sex Instrument," MEA discussion paper series 201805, Munich Center for the Economics of Aging (MEA) at the Max Planck Institute for Social Law and Social Policy.
    22. Yiqi Lin & Frank Windmeijer & Xinyuan Song & Qingliang Fan, 2022. "On the instrumental variable estimation with many weak and invalid instruments," Papers 2207.03035, arXiv.org, revised Dec 2023.
    23. Christian M. Dahl & Torben S. D. Johansen & Emil N. S{o}rensen & Christian E. Westermann & Simon F. Wittrock, 2021. "Applications of Machine Learning in Document Digitisation," Papers 2102.03239, arXiv.org.
    24. Christoph F. Kurz & Michael Laxy, 2020. "Application of Mendelian Randomization to Investigate the Association of Body Mass Index with Health Care Costs," Medical Decision Making, , vol. 40(2), pages 156-169, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guo, Zijian & Kang, Hyunseung & Cai, T. Tony & Small, Dylan S., 2018. "Testing endogeneity with high dimensional covariates," Journal of Econometrics, Elsevier, vol. 207(1), pages 175-187.
    2. Frank Windmeijer & Xiaoran Liang & Fernando P. Hartwig & Jack Bowden, 2021. "The confidence interval method for selecting valid instrumental variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(4), pages 752-776, September.
    3. Yiqi Lin & Frank Windmeijer & Xinyuan Song & Qingliang Fan, 2022. "On the instrumental variable estimation with many weak and invalid instruments," Papers 2207.03035, arXiv.org, revised Dec 2023.
    4. Gyuhyeong Goh & Jisang Yu, 2022. "Causal inference with some invalid instrumental variables: A quasi‐Bayesian approach," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1432-1451, December.
    5. Qingliang Fan & Yaqian Wu, 2020. "Endogenous Treatment Effect Estimation with some Invalid and Irrelevant Instruments," Papers 2006.14998, arXiv.org.
    6. Michal Kolesár & Raj Chetty & John Friedman & Edward Glaeser & Guido W. Imbens, 2015. "Identification and Inference With Many Invalid Instruments," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(4), pages 474-484, October.
    7. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    8. Bai Huang & Tae-Hwy Lee & Aman Ullah, 2017. "A combined estimator of regression models with measurement errors," Indian Economic Review, Springer, vol. 52(1), pages 73-91, December.
    9. Sølvsten, Mikkel, 2020. "Robust estimation with many instruments," Journal of Econometrics, Elsevier, vol. 214(2), pages 495-512.
    10. Mardi Dungey & Vitali Alexeev & Jing Tian & Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91, pages 1-24, June.
    11. Alena Skolkova, 2023. "Instrumental Variable Estimation with Many Instruments Using Elastic-Net IV," CERGE-EI Working Papers wp759, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    12. Nicolas Apfel, 2019. "Relaxing the Exclusion Restriction in Shift-Share Instrumental Variable Estimation," Papers 1907.00222, arXiv.org, revised Jul 2022.
    13. Hyunseung Kang & Youjin Lee & T. Tony Cai & Dylan S. Small, 2022. "Two robust tools for inference about causal effects with invalid instruments," Biometrics, The International Biometric Society, vol. 78(1), pages 24-34, March.
    14. Xiaoran Liang & Eleanor Sanderson & Frank Windmeijer, 2022. "Selecting Valid Instrumental Variables in Linear Models with Multiple Exposure Variables: Adaptive Lasso and the Median-of-Medians Estimator," Papers 2208.05278, arXiv.org.
    15. Prosper Dovonon & Firmin Doko Tchatoka & Michael Aguessy, 2019. "Relevant moment selection under mixed identification strength," School of Economics and Public Policy Working Papers 2019-04, University of Adelaide, School of Economics and Public Policy.
    16. Carrasco, Marine & Tchuente, Guy, 2015. "Regularized LIML for many instruments," Journal of Econometrics, Elsevier, vol. 186(2), pages 427-442.
    17. Xu Cheng & Zhipeng Liao, 2012. "Select the Valid and Relevant Moments: A One-Step Procedure for GMM with Many Moments," PIER Working Paper Archive 12-045, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    18. Eric Gautier & Christiern Rose, 2022. "Fast, Robust Inference for Linear Instrumental Variables Models using Self-Normalized Moments," Papers 2211.02249, arXiv.org, revised Nov 2022.
    19. Meijer, Erik & Spierdijk, Laura & Wansbeek, Tom, 2017. "Consistent estimation of linear panel data models with measurement error," Journal of Econometrics, Elsevier, vol. 200(2), pages 169-180.
    20. Murray Michael P., 2017. "Linear Model IV Estimation When Instruments Are Many or Weak," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-22, January.

    More about this item

    Keywords

    causal inference; instrumental variables estimation; invalid instruments; Lasso; Mendelian randomisation;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:vfsc17:168196. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/vfsocea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.